System

Abstract

A system is provided.SOLUTION: An educational platform designed to encourage parents and children to learn together, comprising: tiered authentication and profile creation means; data entry means for receiving and storing questions from users; answer generation means for generating answers to questions using generative artificial intelligence models; presentation means for presenting the generated answers and associated additional content to users; dialogue facilitation means for facilitating dialogue between parents and children; and history storage and feedback means for recording learning history and providing feedback during subsequent learning.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern families, it is becoming increasingly difficult for children and parents to share educational time together. Parents of school-age children, in particular, lack the means to learn together while stimulating their children's curiosity. Adults themselves also seek lifelong learning and look forward to opportunities to grow alongside their children. Against this backdrop, there is a need for efficient and effective ways for parents and children to learn together at home. While existing learning platforms support individualized learning, they lack the mechanisms to promote communication between parents and children and to enable them to learn together. [Means for solving the problem]

[0005] The present invention provides an educational platform for promoting learning between parents and children. The system solves the above-mentioned problems by including the following means.

[0006] The step-by-step authentication and profile creation method allows parents and children to create their own profiles and authenticate each other individually, providing learning content suited to each user.

[0007] The data input means accepts and saves questions that children are interested in. The answer generation means, which uses a generative AI model, generates appropriate answers to the accepted questions and provides them to both parents and children.

[0008] The presentation means presents the generated answers and related additional content to the user in an easy-to-understand manner, allowing parents and children to view them together. The dialogue promotion means presents questions and topics to stimulate dialogue between parents and children, creating an environment for deepening learning.

[0009] History storage and feedback mechanisms record learning history and provide relevant new questions and content for the next learning session, providing an environment where parents and children can continue to grow and learn together.

[0010] "Step-by-step authentication" is the process of verifying a user's identity and granting access to a system through multiple authentication steps.

[0011] The "profile creation means" is a function that allows a user to input his / her own information and create an individual profile.

[0012] "Data input means" is an interface through which a user inputs questions or information into the system and transmits that data to the server.

[0013] A "generative artificial intelligence model" is an artificial intelligence algorithm that generates appropriate answers and content based on input questions and data.

[0014] The "answer generation means" is a process that uses a generative artificial intelligence model to create an answer to a question from a user.

[0015] The "presentation means" is a mechanism for displaying the generated answers and related content to the user so that they can be viewed.

[0016] "Dialogue promotion means" is a function in which the system suggests questions and topics to promote communication between parents and children.

[0017] The "history storage and feedback means" is a function that records the user's learning activities and provides feedback and recommended content that will be useful for the next learning session.

[0018] "Additional content" refers to reference information or learning resources (e.g., video links or experimental methods) that complement the generated answers. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0021] First, the terms used in the following description will be explained.

[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0027] [First embodiment]

[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0040] The present invention is an educational platform that promotes learning between parents and children. This platform provides an environment where parents and children can cooperate to deepen their learning through a series of processes, from user authentication and question reception to AI-based answer generation, answer presentation, promotion of dialogue between parents and children, and the storage and feedback of learning history. Specifically, the following steps and means are used:

[0041] User authentication and profile creation

[0042] 1. Users

[0043] Parents and children enter login information using their respective devices.

[0044] 2. Terminal

[0045] Each device sends login information to the server.

[0046] 3. Server

[0047] The server accesses the database to find a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the device displays a profile creation screen.

[0048] 4. Users

[0049] New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[0050] 5. Terminal

[0051] The entered profile information is sent to the server.

[0052] 6. Server

[0053] The server stores the profile information in a database and sends a message to the terminal indicating that authentication is complete.

[0054] Enter and submit your question

[0055] 1. Users

[0056] A child types a question (e.g., "Why is the sky blue?") into a text box.

[0057] 2. Terminal

[0058] The entered question is sent to the server as text data.

[0059] 3. Server

[0060] The server receives the query and records it in a log.

[0061] AI-powered answer generation

[0062] 1. Server

[0063] The server passes the received question to a generative artificial intelligence model.

[0064] A generative artificial intelligence model analyzes the question and generates an answer in a way that is easy for children to understand.

[0065] 2. Server

[0066] Format the generated answers into a format suitable for parents and children, creating content suitable for both.

[0067] Providing answers and additional content

[0068] 1. Server

[0069] The server sends the generated answer and related additional content (such as video links and experimental methods) to the terminal.

[0070] 2. Terminal

[0071] The device displays the generated answer and also presents additional related content.

[0072] Supporting parent-child dialogue

[0073] 1. Users

[0074] The child reads the answers provided and explains them to the parent.

[0075] Parents listen to their children's explanations and then have a dialogue about further questions and related topics.

[0076] 2. Terminal

[0077] The device suggests questions and topics to encourage dialogue between parents and children.

[0078] Learning history and feedback

[0079] 1. Server

[0080] The server records the learning history of each session and generates a list to recommend new questions and content relevant to the next learning session.

[0081] 2. Terminal

[0082] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[0083] Specific examples

[0084] For example, suppose a child at home types in a question: "Why is the sky blue?" This question is sent to a server via the device and analyzed by a generative AI model. The server generates an answer: "The sky is blue because sunlight hits tiny particles in the atmosphere, scattering the blue light," and displays it on the parent and child's devices. Furthermore, the server provides links to videos about the scattering of light in the atmosphere and simple experiments on light that can be done at home, allowing the parent and child to deepen their dialogue based on these.

[0085] Thus, the present invention is a system that provides an effective means for parents and children to learn and grow together.

[0086] The processing flow will be explained below.

[0087] Step 1:

[0088] Users: Parents and children enter login information using their own devices.

[0089] Step 2:

[0090] Terminal: Each terminal sends login information to the server.

[0091] Step 3:

[0092] Server: The server accesses the database to find a user account that matches the entered information. It generates an authentication token and returns it to the device. If the user is a new user, the device displays a profile creation screen.

[0093] Step 4:

[0094] User: New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[0095] Step 5:

[0096] Terminal: Sends the entered profile information to the server.

[0097] Step 6:

[0098] Server: The server stores the profile information in a database and sends a message to the device that authentication is complete.

[0099] Step 7:

[0100] User: Child types a question (e.g., "Why is the sky blue?") into a text box.

[0101] Step 8:

[0102] Terminal: Sends the entered question to the server as text data.

[0103] Step 9:

[0104] Server: The server receives the query and logs it.

[0105] Step 10:

[0106] Server: The server passes the received question to a generative AI model, which analyzes the question and generates an answer in a format that is easy for children to understand.

[0107] Step 11:

[0108] Server: Formats the generated answers into a format suitable for parents and children, creating content suitable for both.

[0109] Step 12:

[0110] Server: The server sends the generated answers and related additional content (such as video links and experimental methods) to the device.

[0111] Step 13:

[0112] Device: The device displays the generated answer and also suggests additional related content.

[0113] Step 14:

[0114] User: The child reads the presented answer and explains it to the parent. The parent listens to the child's explanation and engages in a dialogue about further questions and related topics.

[0115] Step 15:

[0116] Device: The device suggests questions and topics to encourage dialogue between parent and child.

[0117] Step 16:

[0118] Server: The server records the learning history of each session and generates a list to recommend new questions and content relevant to the next learning session.

[0119] Step 17:

[0120] On the device: The next time the user logs in, the server-provided recommendation list is displayed to the user.

[0121] Example 1

[0122] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0123] Conventional educational platforms lack a comprehensive environment for parent-child learning. In particular, they lack the ability to provide appropriate answers to user questions, foster parent-child dialogue, and utilize long-term learning histories. The present invention aims to address these issues and provide an effective means for parents and children to collaborate and deepen their learning.

[0124] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0125] In this invention, the server includes a user authentication and profile creation means, a data input means for receiving questions from users as text data and sending it to the server, an answer generation means for generating answers to the questions using a generative AI model, a presentation means for presenting the generated answers and related additional content to the user, a dialogue promotion means for suggesting topics to promote dialogue between parents and children, and a history storage and feedback means for recording learning history and suggesting new questions and content related to the next learning session. This enables parents and children to cooperate in deepening their learning and provides an effective learning environment over the long term.

[0126] "User authentication" is the process of identifying users and verifying their authorization to access a system.

[0127] "Profile Creation" is the process of creating a new user account by entering personal information and interests that will be used within the system.

[0128] "Data entry" is the process by which a user enters text data or questions into a system through a terminal.

[0129] A "generative artificial intelligence model" is an AI algorithm used to generate appropriate answers to questions from users.

[0130] "Answer generation" is the process of using a generative artificial intelligence model to generate an answer to an input question.

[0131] "Presentation" is the process of displaying the generated answer and any additional related content to the user.

[0132] "Dialogue facilitation" is the process of suggesting relevant topics and questions to encourage effective dialogue between parents and children.

[0133] "History archiving" is the process of recording each session's learning history in a database.

[0134] "Feedback" is the process of suggesting new questions or content to the user based on their learning history that will be useful for their next study.

[0135] This invention is an educational platform designed to promote learning between parents and children. This platform provides an environment where parents and children can cooperate and deepen their learning through a series of processes, from user authentication and question reception to AI-based answer generation, answer presentation, promotion of dialogue between parents and children, and storage and feedback of learning history. Specific hardware and software used include internet-enabled devices (PCs, tablets, smartphones, etc.) and a server.

[0136] User authentication and profile creation

[0137] 1. User:

[0138] Parents and children enter login information using their respective devices.

[0139] 2. Terminal:

[0140] Each device encrypts the entered login information and sends it to the server.

[0141] 3. Server:

[0142] The server accesses the database to find a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the server sends an instruction to display a profile creation screen on the device.

[0143] 4. User:

[0144] New users enter information such as their name, age, and interests on the profile creation screen.

[0145] 5. Terminal:

[0146] The entered profile information is encrypted and sent to the server.

[0147] 6. Server:

[0148] The server stores the received profile information in a database and returns a message to the terminal indicating that authentication has been completed.

[0149] Enter and submit your question

[0150] 1. User:

[0151] Children type what they want to know into the text box (e.g., "Why is the sky blue?").

[0152] 2. Terminal:

[0153] The entered question is sent to the server as text data.

[0154] 3. Server:

[0155] The query data is received and recorded in a database.

[0156] AI-powered answer generation

[0157] 1. Server:

[0158] The server passes the received question data to a generative artificial intelligence model (e.g., GPT-3 (registered trademark)).

[0159] 2. Server:

[0160] A generative artificial intelligence model analyzes the question and generates an answer in a way that is easy for children to understand.

[0161] 3. Server:

[0162] Format the generated answers in a parent-child friendly format.

[0163] Providing answers and additional content

[0164] 1. Server:

[0165] Send the formatted answers and related additional content (such as video links or experimental methods) to the device.

[0166] 2. Terminal:

[0167] It displays the generated answer and also suggests additional related content.

[0168] Supporting parent-child dialogue

[0169] 1. User:

[0170] The child reads the provided answer and explains it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[0171] 2. Terminal:

[0172] Suggest additional questions or topics to encourage dialogue between parent and child.

[0173] Learning history and feedback

[0174] 1. Server:

[0175] The learning history of each session is recorded in a database.

[0176] 2. Server:

[0177] A list of suggested new questions and content relevant to your next study will be generated and provided to your device the next time you log in.

[0178] Examples and prompts

[0179] As a concrete example, if a child in a household types in the question "Why is the sky blue?", this question is sent to a server via the device. The server passes the question data to a generative AI model (e.g., GPT-3), which analyzes the question and generates the answer "The sky is blue because sunlight collides with small particles in the atmosphere, scattering the blue light." Furthermore, the system provides links to videos about light scattering in the atmosphere and instructions for simple light experiments that can be carried out at home. Parents and children can use this information to deepen their learning.

[0180] Specific prompt examples:

[0181] 1. If a child asks, "Why is the sky blue?"

[0182] Prompt: "Why is the sky blue?"

[0183] 2. If you and your child want to dig deeper into the topic:

[0184] Prompt: "Explain in a way that children can understand how light scatters in the atmosphere."

[0185] This system allows parents and children to learn together, achieving an effective and long-term learning process.

[0186] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0187] User authentication and profile creation

[0188] Step 1:

[0189] Parents and children use their own devices to enter their username and password, which is then encrypted.

[0190] Input: Username, Password

[0191] Output: Encrypted login information

[0192] Step 2:

[0193] The terminal transmits the encrypted login information to the server.

[0194] Input: Encrypted login information

[0195] Output: Send to server

[0196] Step 3:

[0197] The server authenticates the login information it receives by checking it against a database. If it finds a matching account, it generates an authentication token and returns it to the device. If the user is a new user, it sends instructions to display a profile creation screen on the device.

[0198] Input: Encrypted login information

[0199] Output: Authentication token or profile creation instructions

[0200] Step 4:

[0201] New users enter information such as their name, age, and interests on the profile creation screen.

[0202] Input: Profile information (name, age, interests)

[0203] Output: Profile information

[0204] Step 5:

[0205] The terminal encrypts the input profile information and transmits it to the server.

[0206] Input: Profile information

[0207] Output: Encrypted profile information

[0208] Step 6:

[0209] The server stores the received profile information in a database and returns a message to the terminal indicating that authentication has been completed.

[0210] Input: Encrypted profile information

[0211] Output: Authentication complete message

[0212] Enter and submit your question

[0213] Step 1:

[0214] The user types what the child wants to know into a text box (e.g., "Why is the sky blue?").

[0215] Input: Question text

[0216] Output: Question text

[0217] Step 2:

[0218] The terminal transmits the input question to the server as text data.

[0219] Input: Question text

[0220] Output: Send to server

[0221] Step 3:

[0222] The server receives the query data and records it in a database.

[0223] Input: Question text

[0224] Output: Records in the database

[0225] AI-powered answer generation

[0226] Step 1:

[0227] The server passes the received question data to the generative artificial intelligence model.

[0228] Input: Question text

[0229] Output: Input to the AI ​​model

[0230] Step 2:

[0231] The server uses a generative artificial intelligence model to analyze the question and generate an answer in a format that is easy for children to understand.

[0232] Input: Question text

[0233] Output: Answer text

[0234] Step 3:

[0235] The server formats the generated answers in a format suitable for parent and child.

[0236] Input: Answer text

[0237] Output: Formatted answer

[0238] Providing answers and additional content

[0239] Step 1:

[0240] The server sends the formatted answers and related additional content (such as video links and experimental methods) to the device.

[0241] Input: Formatted answers, additional content

[0242] Output: Send to terminal

[0243] Step 2:

[0244] The terminal displays the generated answer and also presents additional related content.

[0245] Input: Formatted answers, additional content

[0246] Output: What is displayed to the user

[0247] Supporting parent-child dialogue

[0248] Step 1:

[0249] The user then has the child read the proposed answer and begin explaining it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[0250] Input: Suggested answer

[0251] Output: Parent-child interaction

[0252] Step 2:

[0253] The device suggests additional questions and topics to encourage dialogue between parent and child.

[0254] Input: Dialogue status

[0255] Output: Additional questions or topics

[0256] Learning history and feedback

[0257] Step 1:

[0258] The server records the learning history of each session in a database.

[0259] Input: Study session data

[0260] Output: Records in the database

[0261] Step 2:

[0262] The server generates a list of suggested new questions and content relevant to the next study session and provides it to the device the next time the user logs in.

[0263] Input: Learning history

[0264] Output: Generate and serve a list of recommendations

[0265] (Application example 1)

[0266] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0267] The modern educational environment does not provide enough opportunities for parents and children to learn together. While there are educational platforms that utilize the internet, there is a lack of learning through actual dialogue and sensory experiences. This results in a gap between theory and practice, making it difficult to maintain deep understanding and interest. Furthermore, there is a lack of systems that promote communication between parents and children while advancing learning.

[0268] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0269] In this invention, the server includes a stepwise authentication and profile creation means, a data input means for receiving and saving questions from users, an answer generation means for generating answers to the questions using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, a virtual experience means for inputting questions while parents and children tour the virtual facility, a dialogue promotion means for promoting dialogue between parents and children, and a history storage and feedback means for recording learning history and providing feedback for the next learning session. This makes it possible to provide an educational environment in which parents and children can learn together and promote deep understanding and dialogue through actual experiences.

[0270] "Multi-step authentication" is a method of verifying a user's identity through multiple steps when accessing a website.

[0271] "Profile creation" is a method of registering a user's personal information, learning history, etc., and creating a user-specific account.

[0272] "Data entry" refers to the act of a user entering questions or information into a system.

[0273] A "generative artificial intelligence model" refers to a system that uses artificial intelligence to generate answers to questions posed by users.

[0274] "Answer generation" is the process of creating appropriate answers to received questions.

[0275] "Presenting" refers to the act of displaying the generated answer and related content to the user.

[0276] "Virtual experience" refers to an experience in which a user engages in activities or sights in a virtual space using virtual reality technology.

[0277] "Promoting dialogue" refers to providing support to stimulate communication between parents and children.

[0278] "History storage" is a means of recording a user's learning history and ensuring that it can be referenced later.

[0279] "Feedback" refers to providing users with evaluations and areas for improvement based on their learning results and history.

[0280] "Virtual facility" refers to a facility for education or tours created using virtual reality technology.

[0281] This invention relates to a virtual science museum guide system that promotes learning between parents and children. This system is realized by combining the following multiple means and processes.

[0282] Overall system configuration

[0283] This system is based on users accessing the virtual reality space via their smartphones or head-mounted displays. The entire system is roughly divided into the server side and the terminal side.

[0284] Hardware and software used

[0285] Server: This system uses a server to store data and run AI models. This server is built on AWS (registered trademark) or Google (registered trademark) Cloud Platform.

[0286] Database: A MySQL® database is used to store user information, questions, answers, and learning history.

[0287] AI model: OpenAI's (registered trademark) GPT series is used to generate answers to user questions.

[0288] Devices: Users can access the virtual reality space using Oculus Quest 2 or iPhone (registered trademark) / ANDROID (registered trademark) smartphones.

[0289] Development environment: The virtual reality space is built using Unity, and communication between the server and client is managed using Node.js.

[0290] User authentication and profile creation

[0291] Users first access the system using a smartphone or VR device and enter their login information. This information is sent to the server, where the user information is verified against a MySQL database. If the user is an existing user, an authentication token is generated and sent back to the device. If the user is a new user, a profile creation screen is displayed, where information such as name, age, and interests is entered and saved in the database.

[0292] Enter data and submit questions

[0293] When parents and children visit an exhibit in the virtual museum and become interested in it, the child can enter a question in the text box, which is sent to the server and recorded as a log.

[0294] AI-powered answer generation

[0295] The server passes the received question to a generative AI model, which analyzes the question and generates an answer in a way that is easy for children to understand. The generated answer is then formatted in a way that is suitable for parents and children.

[0296] Providing answers and additional content

[0297] The generated answers and related additional content (e.g., video links and experimental procedures) are sent from the server to the parent and child's devices, where they are displayed on their smartphones or VR devices.

[0298] Supporting parent-child dialogue

[0299] The AI-generated answers will trigger a dialogue between parent and child, and additional questions and topics will be suggested to further the conversation.

[0300] Learning history and feedback

[0301] The server records the learning history of each session, and the next time the user logs in, the server generates a list of suggested new questions and content for the user to review.

[0302] Specific examples

[0303] For example, if a child types a question in the virtual museum such as "Why is the sky blue?", the question is sent to the server. A generative artificial intelligence model (OpenAI's GPT series) analyzes the question and generates the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light." This answer is displayed on the parent and child's devices, along with a link to a video about the scattering of light in the atmosphere and instructions for a simple light experiment that can be done at home. Parents and children can deepen their conversation based on this information.

[0304] Prompt Sentence Examples

[0305] Generate an answer to the question "Why is the sky blue?". The answer should be understandable to a 10-year-old child, and you should also provide additional relevant content (video links and simple experiments).

[0306] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0307] Step 1:

[0308] User authentication and profile creation

[0309] A user accesses the system from a terminal and enters their login information. This information is sent from the terminal to the server. The server accesses the MySQL database and verifies the user information. If the user is an existing user, an authentication token is generated and sent back to the terminal. If the user is a new user, a profile creation screen is displayed on the terminal, where the user enters information such as their name, age, and interests. This information is sent to the server and stored in the database.

[0310] Enter your login details or new profile details

[0311] Output: Authentication token or profile creation confirmation message

[0312] Step 2:

[0313] Virtual museum tour and question entry

[0314] Parents and children access the virtual museum using devices (smartphones or VR devices) and view the exhibits. Children can enter questions about exhibits that interest them in a text box and send them from their devices to the server. The server then records the received questions as a log.

[0315] Input: Virtual museum visit and question text

[0316] Output: Question data recorded on the server

[0317] Step 3:

[0318] AI-powered answer generation

[0319] The server passes the received question to a generative AI model (OpenAI's GPT series). The AI ​​model analyzes the question and generates an answer in a format that is easy for children to understand. The generated answer is then formatted so that it can be sent to the parent and child's device.

[0320] Input: Logged question

[0321] Output: Formatted answer

[0322] Step 4:

[0323] Providing answers and additional content

[0324] The server sends the generated answers and related additional content (e.g., video links and experimental procedures) to the parent and child's devices, which receive them and display them on their smartphones or VR devices.

[0325] Input: Formatted answers and additional content

[0326] Output: Answers and additional content displayed on the terminal

[0327] Step 5:

[0328] Supporting parent-child dialogue

[0329] The child reads the presented answers and explains them to the parent. The server then suggests additional questions and topics to the device to promote dialogue between the parent and child. The parent and child then advance their dialogue based on the topics suggested by the device.

[0330] Input: Suggested answers and additional content

[0331] Output: Additional questions or topics to further the conversation

[0332] Step 6:

[0333] Learning history and feedback

[0334] The server records the history of the learning session and stores it in a database. The next time the user logs in, the server generates a list of relevant new questions and content suggestions based on the previous learning history and sends it to the user's device.

[0335] Input: Training session data

[0336] Output: A list of suggested new questions or content

[0337] These specific processing steps enable parents and children to learn together through a tour of the virtual museum, promoting dialogue and effectively advancing education.

[0338] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0339] This invention is an educational platform that promotes learning between parents and children. This system provides an environment where parents and children can cooperate and deepen their learning through a series of processes, from user authentication and question reception, to emotion recognition using an emotion engine, answer generation using AI, answer presentation, promotion of dialogue between parents and children, and storage and feedback of learning history. Specifically, the system uses the following steps and means:

[0340] User authentication and profile creation

[0341] 1. Users

[0342] Parents and children enter login information using their respective devices.

[0343] 2. Terminal

[0344] Each device sends login information to the server.

[0345] 3. Server

[0346] The server accesses the database to find a user account that matches the entered information, generates an authentication token and returns it to the device, and if the user is a new user, displays a profile creation screen on the device.

[0347] 4. Users

[0348] New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[0349] 5. Terminal

[0350] The entered profile information is sent to the server.

[0351] 6. Server

[0352] The server stores the profile information in a database and sends a message to the device that authentication is complete.

[0353] Question input and emotion recognition

[0354] 1. Users

[0355] A child types a question (e.g., "Why is the sky blue?") into a text box.

[0356] 2. Terminal

[0357] The entered question is sent to the server as text data.

[0358] At this time, sensors such as a camera and microphone built into the device are used to analyze the child's facial expressions and tone of voice, and the information is sent to the emotion engine.

[0359] 3. Server

[0360] The server receives the question and records it as a log, and the emotion engine analyzes the received emotion data. The analysis results are reflected in the generation of answers.

[0361] AI-powered answer generation

[0362] 1. Server

[0363] The server passes the received question and emotion data to the generative artificial intelligence model.

[0364] A generative artificial intelligence model analyzes questions and emotional data, and generates answers that are easy for children to understand and take into account their emotional state.

[0365] 2. Server

[0366] Format the generated answers into a format suitable for parents and children, creating content suitable for both.

[0367] Providing answers and additional content

[0368] 1. Server

[0369] The server sends the generated answer and related additional content (such as video links and experimental methods) to the device.

[0370] 2. Terminal

[0371] The device displays the generated answer and offers additional related content.

[0372] Emotional Engine Feedback

[0373] 1. Users

[0374] The child reads the answers provided and explains them to the parent.

[0375] Parents listen to their children's explanations and then engage in dialogue about further questions and related topics.

[0376] 2. Terminal

[0377] The device suggests questions and topics to encourage dialogue between parent and child.

[0378] 3. Server

[0379] The emotion engine continuously analyzes the user's emotions during the conversation and provides the results as feedback in real time.

[0380] Learning history and feedback

[0381] 1. Server

[0382] The server records the learning history and emotional data for each session and generates a list of suggested new questions and content relevant to the next learning session.

[0383] 2. Terminal

[0384] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[0385] Specific examples

[0386] For example, suppose a child at home types in a question such as, "Why is the sky blue?" This question is sent to a server via the device, and an emotion engine analyzes the child's facial expressions and tone of voice to recognize a state of "excitement." The server then uses a generative AI model to generate the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light," and provides video links and experiment methods to further pique the child's interest.

[0387] The emotion engine continuously monitors the user's emotions during the interaction and suggests questions and topics to encourage dialogue between parent and child. In this way, feedback and learning content based on emotional state are provided, providing an effective means for parents and children to learn and grow together.

[0388] The processing flow will be explained below.

[0389] Step 1:

[0390] Users: Parents and children enter login information using their own devices.

[0391] Step 2:

[0392] Terminal: Each terminal sends login information to the server.

[0393] Step 3:

[0394] Server: The server accesses the database, searches for a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the profile creation screen is displayed on the device.

[0395] Step 4:

[0396] User: New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[0397] Step 5:

[0398] Terminal: Sends the entered profile information to the server.

[0399] Step 6:

[0400] Server: The server stores the profile information in a database and sends a message to the device that authentication is complete.

[0401] Step 7:

[0402] User: Child types a question (e.g., "Why is the sky blue?") into a text box.

[0403] Step 8:

[0404] Terminal: Sends the entered question to the server as text data.

[0405] In addition, sensors such as a camera and microphone built into the device are used to analyze the child's facial expressions and tone of voice, generating emotional data that is then sent to the server.

[0406] Step 9:

[0407] Server: The server receives the query and logs it.

[0408] The server uses an emotion engine to analyze the received emotion data.

[0409] Step 10:

[0410] Server: The server passes the question and emotion data to the generative AI model.

[0411] A generative artificial intelligence model analyzes the question and emotional data and generates an answer that is appropriate to the question and the child's emotions.

[0412] Step 11:

[0413] Server: Formats the generated answers into a format suitable for parents and children, creating content suitable for both.

[0414] Step 12:

[0415] Server: The server sends the generated answers and related additional content (such as video links and experimental methods) to the device.

[0416] Step 13:

[0417] Device: The device displays the generated answer and also suggests additional related content.

[0418] Step 14:

[0419] User: The child reads the given answer and explains it to the parent.

[0420] Parents listen to their children's explanations and then engage in dialogue about further questions and related topics.

[0421] The device analyzes facial expressions and tone of voice during conversation and generates emotional data.

[0422] Step 15:

[0423] Device: Based on emotional data, suggests questions and topics to promote dialogue between parents and children.

[0424] Step 16:

[0425] Server: The server records the learning history of each session, including emotional data during the conversation, and generates a list of suggested new questions and content for the next learning session.

[0426] Step 17:

[0427] On the device: The next time the user logs in, the server-provided recommendation list is displayed to the user.

[0428] Example 2

[0429] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0430] Conventional educational platforms lack the functionality to promote dialogue between parents and children to effectively deepen learning, or to provide appropriate feedback that takes into account their emotional state. They also lack systems that analyze users' emotional state and adjust learning content accordingly. This makes it difficult to increase motivation to learn and facilitate smooth communication between parents and children.

[0431] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0432] In this invention, the server includes a stepwise authentication and profile creation means, a data input means for receiving and saving questions from a user, an answer generation means for generating answers to the questions using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, an emotion recognition means for analyzing the user's emotional state using an emotion recognition engine, a dialogue promotion means for promoting dialogue between parent and child based on the analysis results, and a history storage and feedback means for recording learning history and emotional data and providing feedback the next time the child studies. As a result, when parents and children study together, appropriate feedback that takes into account the emotional state is provided, improving motivation to learn and enabling smooth communication between parent and child.

[0433] A "stepwise authentication method" is a method for verifying the authenticity of a user by going through multiple authentication steps when the user accesses a system.

[0434] The "profile creation means" is a means for a new user to input necessary information when registering with the system and create an individual profile.

[0435] "Data input means" refers to means for accepting questions and other input data from a user and storing it.

[0436] A "generative artificial intelligence model" is an artificial intelligence model used to generate appropriate answers to questions from users.

[0437] The "answer generation means" is a means for generating an answer to a user's question using a generative artificial intelligence model.

[0438] The "presentation means" is a means for presenting the generated answer and related additional content to the user.

[0439] The "emotion recognition means" is a means for analyzing the user's emotional state, and utilizes an emotion recognition engine.

[0440] "Dialogue promotion means" refers to a means for promoting dialogue between parents and children based on the analysis results.

[0441] The "history storage means" is a means for recording learning history and emotional data.

[0442] "Feedback means" refers to a means for providing appropriate feedback the next time the student studies.

[0443] The present invention is an educational platform designed to promote learning between parents and children. The system comprises a step-by-step authentication and profile creation means, a data input means, an answer generation means using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, an emotion recognition means using an emotion recognition engine, a dialogue promotion means, and a history storage and feedback means.

[0444] Hardware and software used

[0445] 1. Hardware

[0446] Devices: PCs, tablets, smartphones, etc. used by users

[0447] Server: Cloud service or on-premise dedicated server

[0448] Sensors: Built-in camera and microphone (to collect emotional data)

[0449] 2. Software

[0450] Authentication system: A system for multi-factor authentication (e.g., OAuth, SAML)

[0451] Database: A database system (e.g., MySQL, PostgreSQL) for storing user information and learning history.

[0452] Generative AI models: AI models that generate answers to questions (e.g., GPT-3, BERT)

[0453] Emotion recognition engine: A system that analyzes the user's facial expressions and tone of voice (e.g., Azure® Emotion API, Google Cloud Speech-to-Text)

[0454] Web front end: Web technologies (e.g., HTML, CSS, JavaScript) used to provide the user interface

[0455] System operation explanation

[0456] User authentication and profile creation

[0457] Users (parents and children) use their respective devices to enter their username and password on the login screen. The device sends this information to the server, which searches the database for the corresponding user information. If authentication is successful, for new users, a profile creation screen is displayed. The user enters the required information and sends it to the server to create a profile.

[0458] Question input and emotion recognition

[0459] The user (child) enters a question (e.g., "Why is the sky blue?") and the device sends this information to the server. The device also uses the built-in camera and microphone to analyze the child's facial expressions and tone of voice, and sends emotional data to the server. The server receives the question and emotional data, stores it as a log, and passes it to the emotion engine.

[0460] AI-powered answer generation

[0461] The server uses a generative artificial intelligence model to generate appropriate answers based on the received questions and emotion data, and the answers are formatted in a format suitable for parents and children.

[0462] Providing answers and additional content

[0463] The server sends the generated answers and related additional content (such as video links and experimental methods) to the device, which displays them on the screen and supports parents and children in learning together.

[0464] Emotional Engine Feedback

[0465] The user (child) reads the presented answers and explains them to the parent. The emotion engine analyzes the user's emotions during the conversation and provides real-time feedback, further deepening the dialogue between parent and child.

[0466] Learning history and feedback

[0467] The server records the learning history and emotion data for each session and generates a list of suggestions for new questions and content that are relevant to the next learning session. The next time you log in, the server-provided recommendation list will be displayed.

[0468] Specific examples

[0469] For example, if a child types a question like "Why is the sky blue?", the question is sent to the server via the device. The emotion engine analyzes the child's facial expressions and tone of voice and recognizes their "curious" state. The server then uses a generative AI model to generate the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light," and provides video links and experiment methods to further pique the child's interest. In this way, feedback and learning content based on the child's emotional state are provided, creating an effective means for parents and children to learn and grow together.

[0470] Prompt Sentence Examples

[0471] Please explain in detail your approach to using an emotion engine to generate appropriate answers to science questions that interest children and promote dialogue between parents and children.

[0472] This educational platform provides a new environment for parents and children to deepen their learning together, and utilizes emotion recognition and artificial intelligence to support effective learning and communication.

[0473] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0474] Step 1:

[0475] User

[0476] Parents and children enter login information using their respective devices.

[0477] Input: Username, Password

[0478] Action: Enter the required information on the login screen and click the "Login" button.

[0479] Output: Login information is stored on the device.

[0480] Step 2:

[0481] Terminal

[0482] The login information is sent to the server over a secure channel.

[0483] Input: Username, Password

[0484] What it does: Encrypts the login information you enter and sends it to the server.

[0485] Output: Sends encrypted logging information to the server.

[0486] Step 3:

[0487] server

[0488] The received login information is checked against the database and the authentication result is returned.

[0489] Input: Encrypted login information

[0490] What it does: Decrypts the login information, performs a database query to find a matching user account, generates an authentication token and sends it back to the device.

[0491] Output: Authentication result (success or failure), authentication token

[0492] Step 4:

[0493] Servers and Terminals

[0494] For new users, the profile creation screen will be displayed on the device. For existing users, the device will transition to the main screen.

[0495] Input: Authentication result

[0496] Operation: Upon receiving the authentication result, the profile creation screen is displayed for new users, and the main screen is displayed for existing users.

[0497] Output: Profile creation screen or main screen

[0498] Step 5:

[0499] Users (new users only)

[0500] New users enter the required information on the profile creation screen and submit.

[0501] Input: Profile information such as name, age, interests, etc.

[0502] How it works: Enter the required information into the profile creation form and click the "Submit" button.

[0503] Output: Input profile information

[0504] Step 6:

[0505] Device (new users only)

[0506] The entered profile information is sent to the server.

[0507] Input: Profile information

[0508] Action: Sends profile information to the server.

[0509] Output: The profile information is sent to the server.

[0510] Step 7:

[0511] Server (new users only)

[0512] The profile information is stored in a database and an authentication completion message is sent to the terminal.

[0513] Input: Profile information

[0514] Action: Inserts profile information into the database, generates an authentication completion message, and sends it to the terminal.

[0515] Output: Authentication complete message

[0516] Step 8:

[0517] User

[0518] Children type their questions into the text box.

[0519] Input: Question text (e.g., "Why is the sky blue?")

[0520] Action: Enter a question in the text box and click the submit button.

[0521] Output: The question text entered

[0522] Step 9:

[0523] Terminal

[0524] The entered question is sent to the server as text data, and at the same time emotion data is collected using a camera, microphone, etc. and sent to the emotion engine.

[0525] Input: Question text, emotion data

[0526] How it works: Sends question text to the server, collects emotion data and sends it to the emotion engine.

[0527] Output: Question text sent to the server, emotion data sent to the emotion engine

[0528] Step 10:

[0529] server

[0530] It receives question text and emotion data, records them as a log, and generates answers based on the analysis results of the emotion engine.

[0531] Input: Question text, emotion data

[0532] How it works: The question text is logged, the emotion engine generates analysis results, and then passes them to a generative AI model to generate an answer.

[0533] Output: Generated answer text

[0534] Step 11:

[0535] server

[0536] Format the generated answers and convert them into a format suitable for parents and children.

[0537] Input: Generated answer text

[0538] What it does: Formats the answer text into HTML or other display format.

[0539] Output: Formatted answer content

[0540] Step 12:

[0541] Servers and Terminals

[0542] The generated answer and any associated additional content are sent to the terminal, which displays them.

[0543] Input: Formatted answer content, additional content (video links and experiment methods)

[0544] How it works: The server sends content to the device, which then displays it.

[0545] Output: Displayed answer content and additional content

[0546] Step 13:

[0547] User

[0548] The child reads the provided answer and explains it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[0549] Input: Proposed answer content

[0550] Actions: Child reads answer, explains to parent, and engages in dialogue.

[0551] Output: Parent-child interaction

[0552] Step 14:

[0553] Terminal

[0554] Suggest questions and topics to encourage dialogue between parents and children.

[0555] Input: Information during the conversation

[0556] What it does: The dialogue assistant displays suggestions at the appropriate time.

[0557] Output: Suggestions to encourage dialogue

[0558] Step 15:

[0559] server

[0560] The emotion engine analyzes the user's emotions during the conversation and provides the results as feedback in real time.

[0561] Input: Emotion data during conversation

[0562] Operation: Performs real-time sentiment analysis, generates feedback messages, and sends them to the device.

[0563] Output: Real-time feedback message

[0564] Step 16:

[0565] server

[0566] It records learning history and emotional data from each session and generates a list of suggested new questions and content that are relevant for the next learning session.

[0567] Input: learning history, emotion data

[0568] What it does: Saves session data to the database and the recommendation engine generates new suggestions.

[0569] Output: Suggestion list

[0570] Step 17:

[0571] Terminal

[0572] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[0573] Input: Suggestion list

[0574] Behavior: Shows recommended content on the redirected screen.

[0575] Output: Displayed recommendation list

[0576] These steps will enable parents and children to learn together and achieve effective learning and communication using emotion recognition and artificial intelligence.

[0577] (Application example 2)

[0578] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0579] Conventional worker education and training systems using factory robots have issues such as slow response to worker questions and problems and insufficient support to reduce stress and anxiety. In particular, there is a need to improve learning efficiency and reduce psychological burden in the work environment.

[0580] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a step-by-step authentication and profile creation means, a data input means for accepting and saving questions from users, a means for generating answers to questions using a generative artificial intelligence model, a means for presenting the generated answers and related additional content to the user, a dialogue promotion means for encouraging dialogue between parents and children, a history storage and feedback means for recording learning history and providing feedback for the next learning session, an emotion recognition means for analyzing the user's emotional state using an emotion engine and reflecting the results in answer generation, and an answer adjustment means for adjusting the tone of the answer based on the analyzed emotional state. This enables effective education and training of workers in factories and reduces their psychological burden.

[0581] "Step-by-step authentication" is a method for strengthening security by requiring a user to go through multiple authentication steps when logging into a system.

[0582] "Profile creation" is the process by which a new user registers with the system and enters the necessary information to generate an individual user profile.

[0583] "Data entry" is the process by which a user enters questions or information into a system and stores that data.

[0584] A "generative artificial intelligence model" is an AI technology that uses natural language processing to generate answers to input questions or information.

[0585] "Presentation" is the process of displaying generated answers and related content to the user.

[0586] "Dialogue promotion" is a function that the system supports to stimulate dialogue between parents and children or between workers.

[0587] "History storage and feedback" is a system that records learning history and dialogue history and provides feedback for the next learning or dialogue.

[0588] "Emotion recognition" is a technology that analyzes a user's facial expressions and tone of voice to determine their emotional state.

[0589] "Response adjustment" is the process of adjusting the tone and expression of the generated response based on the emotion recognition results, and providing it in a form that is appropriate for the user.

[0590] The present invention is a system for supporting the education and training of workers using factory robots. The system includes functions for step-by-step authentication and profile creation, data input for accepting and saving questions from users, generating answers to questions using a generative artificial intelligence model, presenting the generated answers and related additional content to the user, facilitating dialogue, recording learning history, and providing feedback for the next learning session. It also includes a means for emotion recognition using an emotion engine and adjusting the tone of the response based on the analyzed emotional state.

[0591] Configuration and Operation

[0592] The system consists of the following components:

[0593] 1. Step-by-step authentication and profile creation

[0594] The server performs step-by-step authentication when a user logs in and, for new users, provides a profile creation screen.

[0595] 2. Data Entry

[0596] The device receives questions from users and sends them as text data to the server. It also uses the device's camera and microphone to analyze the user's facial expressions and tone of voice, and sends the data to the emotion engine.

[0597] 3. Answer generation

[0598] The server uses a generative artificial intelligence model (e.g., DistilBERT) to generate answers to received questions.

[0599] 4. Presentation

[0600] The terminal displays the generated answers and associated additional content to the user.

[0601] 5. Promoting dialogue

[0602] The server suggests additional questions and topics to encourage interaction between users.

[0603] 6. History and Feedback

[0604] The server records learning history and emotional data and provides feedback to help with future learning and interaction.

[0605] 7. Emotion recognition and response adjustment

[0606] The emotion engine analyzes the user's facial expressions and tone of voice to determine their emotional state. Based on the analysis results, the server adjusts the tone of the generated response to present it in a manner appropriate for the user.

[0607] Specific examples

[0608] For example, suppose a worker inputs a question about how to operate a new piece of equipment. The question is sent via the device to the server, which then uses a generative AI model to generate an answer. The answer is then displayed on the device, along with relevant reference materials and video links. The emotion engine analyzes the worker's facial expressions and tone of voice, and if the worker is feeling stressed or anxious, the server adjusts the tone of the answer to reduce the worker's psychological burden.

[0609] Example prompts for generative AI models

[0610] "Question: How do I operate this new device?\nContext: Explain it in simple steps, don't stress me out."

[0611] This system enables effective education and training of workers within the factory and reduces the psychological burden on workers.

[0612] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0613] Step 1:

[0614] User Login

[0615] The user enters login information. The device sends this login information to the server. The server references the database to find a user account that matches the entered information, generates an authentication token, and sends it back to the device. If the user is a new user, a profile creation screen is displayed on the device.

[0616] Input: User login information

[0617] Output: Authentication token or profile creation screen

[0618] Step 2:

[0619] Profile Creation

[0620] A new user enters necessary information such as name, age, and interests on the profile creation screen. The device sends this profile information to the server. The server stores the profile information in a database and sends a message to the device confirming authentication.

[0621] Input: Profile information

[0622] Output: Message that profile information has been saved

[0623] Step 3:

[0624] Enter your question

[0625] The user enters a question into the text box. The device sends the entered question as text data to the server. At the same time, the device uses sensors such as a camera and microphone built into the device to analyze the user's facial expressions and tone of voice, and sends this emotional data to the emotion engine.

[0626] Input: Question text, facial expression data, tone of voice

[0627] Output: Send question text, send emotion data

[0628] Step 4:

[0629] Emotion recognition and question saving

[0630] The server logs the received questions in a database. The emotion engine analyzes the emotion data and determines the user's emotional state. The analysis results are fed back to the server and reflected in answer generation.

[0631] Input: Question text, emotion data

[0632] Output: Emotional state determination results, questions saved in a database

[0633] Step 5:

[0634] Generate answers

[0635] The server passes the received question and emotion data to a generative AI model (e.g., DistilBERT), which analyzes this information and generates an answer that is easy for the user to understand and takes into account their emotional state.

[0636] Input: Question text, emotion data

[0637] Output: The generated answer

[0638] Step 6:

[0639] Providing an answer

[0640] The server then formats the generated answers appropriately and sends them to the device along with any additional relevant content (e.g., video links and experimental procedures), which is then displayed to the user.

[0641] Input: Generated answers, related content

[0642] Output: Sending answers and related content to your device

[0643] Step 7:

[0644] Promoting dialogue

[0645] The user reads the presented answers and explains them to their parents or fellow workers, and the device suggests additional questions or topics to encourage dialogue between parents and children or fellow workers.

[0646] Input: Generated answers, related content

[0647] Output: Suggested additional questions or topics

[0648] Step 8:

[0649] Learning history storage and feedback

[0650] The server records the learning history and emotion data for each session and provides them as feedback the next time the user logs in. The device displays the recommendation list provided by the server to the user the next time the user logs in.

[0651] Input: learning history, emotion data

[0652] Output: Provide feedback, display recommendation list

[0653] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0654] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0655] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0656] [Second embodiment]

[0657] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0658] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0659] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0660] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0661] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0662] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0663] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0664] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0665] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0666] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0667] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0668] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0669] The present invention is an educational platform that promotes learning between parents and children. This platform provides an environment where parents and children can cooperate to deepen their learning through a series of processes, from user authentication and question reception to AI-based answer generation, answer presentation, promotion of dialogue between parents and children, and the storage and feedback of learning history. Specifically, the following steps and means are used:

[0670] User authentication and profile creation

[0671] 1. Users

[0672] Parents and children enter login information using their respective devices.

[0673] 2. Terminal

[0674] Each device sends login information to the server.

[0675] 3. Server

[0676] The server accesses the database to find a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the device displays a profile creation screen.

[0677] 4. Users

[0678] New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[0679] 5. Terminal

[0680] The entered profile information is sent to the server.

[0681] 6. Server

[0682] The server stores the profile information in a database and sends a message to the terminal indicating that authentication is complete.

[0683] Enter and submit your question

[0684] 1. Users

[0685] A child types a question (e.g., "Why is the sky blue?") into a text box.

[0686] 2. Terminal

[0687] The entered question is sent to the server as text data.

[0688] 3. Server

[0689] The server receives the query and records it in a log.

[0690] AI-powered answer generation

[0691] 1. Server

[0692] The server passes the received question to a generative artificial intelligence model.

[0693] A generative artificial intelligence model analyzes the question and generates an answer in a way that is easy for children to understand.

[0694] 2. Server

[0695] Format the generated answers into a format suitable for parents and children, creating content suitable for both.

[0696] Providing answers and additional content

[0697] 1. Server

[0698] The server sends the generated answer and related additional content (such as video links and experimental methods) to the terminal.

[0699] 2. Terminal

[0700] The device displays the generated answer and also presents additional related content.

[0701] Supporting parent-child dialogue

[0702] 1. Users

[0703] The child reads the answers provided and explains them to the parent.

[0704] Parents listen to their children's explanations and then have a dialogue about further questions and related topics.

[0705] 2. Terminal

[0706] The device suggests questions and topics to encourage dialogue between parents and children.

[0707] Learning history and feedback

[0708] 1. Server

[0709] The server records the learning history of each session and generates a list to recommend new questions and content relevant to the next learning session.

[0710] 2. Terminal

[0711] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[0712] Specific examples

[0713] For example, suppose a child at home types in a question: "Why is the sky blue?" This question is sent to a server via the device and analyzed by a generative AI model. The server generates an answer: "The sky is blue because sunlight hits tiny particles in the atmosphere, scattering the blue light," and displays it on the parent and child's devices. Furthermore, the server provides links to videos about the scattering of light in the atmosphere and simple experiments on light that can be done at home, allowing the parent and child to deepen their dialogue based on these.

[0714] Thus, the present invention is a system that provides an effective means for parents and children to learn and grow together.

[0715] The processing flow will be explained below.

[0716] Step 1:

[0717] Users: Parents and children enter login information using their own devices.

[0718] Step 2:

[0719] Terminal: Each terminal sends login information to the server.

[0720] Step 3:

[0721] Server: The server accesses the database to find a user account that matches the entered information. It generates an authentication token and returns it to the device. If the user is a new user, the device displays a profile creation screen.

[0722] Step 4:

[0723] User: New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[0724] Step 5:

[0725] Terminal: Sends the entered profile information to the server.

[0726] Step 6:

[0727] Server: The server stores the profile information in a database and sends a message to the device that authentication is complete.

[0728] Step 7:

[0729] User: Child types a question (e.g., "Why is the sky blue?") into a text box.

[0730] Step 8:

[0731] Terminal: Sends the entered question to the server as text data.

[0732] Step 9:

[0733] Server: The server receives the query and logs it.

[0734] Step 10:

[0735] Server: The server passes the received question to a generative AI model, which analyzes the question and generates an answer in a format that is easy for children to understand.

[0736] Step 11:

[0737] Server: Formats the generated answers into a format suitable for parents and children, creating content suitable for both.

[0738] Step 12:

[0739] Server: The server sends the generated answers and related additional content (such as video links and experimental methods) to the device.

[0740] Step 13:

[0741] Device: The device displays the generated answer and also suggests additional related content.

[0742] Step 14:

[0743] User: The child reads the presented answer and explains it to the parent. The parent listens to the child's explanation and engages in a dialogue about further questions and related topics.

[0744] Step 15:

[0745] Device: The device suggests questions and topics to encourage dialogue between parent and child.

[0746] Step 16:

[0747] Server: The server records the learning history of each session and generates a list to recommend new questions and content relevant to the next learning session.

[0748] Step 17:

[0749] On the device: The next time the user logs in, the server-provided recommendation list is displayed to the user.

[0750] Example 1

[0751] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0752] Conventional educational platforms lack a comprehensive environment for parent-child learning. In particular, they lack the ability to provide appropriate answers to user questions, foster parent-child dialogue, and utilize long-term learning histories. The present invention aims to address these issues and provide an effective means for parents and children to collaborate and deepen their learning.

[0753] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0754] In this invention, the server includes a user authentication and profile creation means, a data input means for receiving questions from users as text data and sending it to the server, an answer generation means for generating answers to the questions using a generative AI model, a presentation means for presenting the generated answers and related additional content to the user, a dialogue promotion means for suggesting topics to promote dialogue between parents and children, and a history storage and feedback means for recording learning history and suggesting new questions and content related to the next learning session. This enables parents and children to cooperate in deepening their learning and provides an effective learning environment over the long term.

[0755] "User authentication" is the process of identifying users and verifying their authorization to access a system.

[0756] "Profile Creation" is the process of creating a new user account by entering personal information and interests that will be used within the system.

[0757] "Data entry" is the process by which a user enters text data or questions into a system through a terminal.

[0758] A "generative artificial intelligence model" is an AI algorithm used to generate appropriate answers to questions from users.

[0759] "Answer generation" is the process of using a generative artificial intelligence model to generate an answer to an input question.

[0760] "Presentation" is the process of displaying the generated answer and any additional related content to the user.

[0761] "Dialogue facilitation" is the process of suggesting relevant topics and questions to encourage effective dialogue between parents and children.

[0762] "History archiving" is the process of recording each session's learning history in a database.

[0763] "Feedback" is the process of suggesting new questions or content to the user based on their learning history that will be useful for their next study.

[0764] This invention is an educational platform designed to promote learning between parents and children. This platform provides an environment where parents and children can cooperate and deepen their learning through a series of processes, from user authentication and question reception to AI-based answer generation, answer presentation, promotion of dialogue between parents and children, and storage and feedback of learning history. Specific hardware and software used include internet-enabled devices (PCs, tablets, smartphones, etc.) and a server.

[0765] User authentication and profile creation

[0766] 1. User:

[0767] Parents and children enter login information using their respective devices.

[0768] 2. Terminal:

[0769] Each device encrypts the entered login information and sends it to the server.

[0770] 3. Server:

[0771] The server accesses the database to find a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the server sends an instruction to display a profile creation screen on the device.

[0772] 4. User:

[0773] New users enter information such as their name, age, and interests on the profile creation screen.

[0774] 5. Terminal:

[0775] The entered profile information is encrypted and sent to the server.

[0776] 6. Server:

[0777] The server stores the received profile information in a database and returns a message to the terminal indicating that authentication has been completed.

[0778] Enter and submit your question

[0779] 1. User:

[0780] Children type what they want to know into the text box (e.g., "Why is the sky blue?").

[0781] 2. Terminal:

[0782] The entered question is sent to the server as text data.

[0783] 3. Server:

[0784] The query data is received and recorded in a database.

[0785] AI-powered answer generation

[0786] 1. Server:

[0787] The server passes the received question data to a generative artificial intelligence model (such as GPT-3).

[0788] 2. Server:

[0789] A generative artificial intelligence model analyzes the question and generates an answer in a way that is easy for children to understand.

[0790] 3. Server:

[0791] Format the generated answers in a parent-child friendly format.

[0792] Providing answers and additional content

[0793] 1. Server:

[0794] Send the formatted answers and related additional content (such as video links or experimental methods) to the device.

[0795] 2. Terminal:

[0796] It displays the generated answer and also suggests additional related content.

[0797] Supporting parent-child dialogue

[0798] 1. User:

[0799] The child reads the provided answer and explains it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[0800] 2. Terminal:

[0801] Suggest additional questions or topics to encourage dialogue between parent and child.

[0802] Learning history and feedback

[0803] 1. Server:

[0804] The learning history of each session is recorded in a database.

[0805] 2. Server:

[0806] A list of suggested new questions and content relevant to your next study will be generated and provided to your device the next time you log in.

[0807] Examples and prompts

[0808] As a concrete example, if a child in a household types in the question "Why is the sky blue?", this question is sent to a server via the device. The server passes the question data to a generative AI model (e.g., GPT-3), which analyzes the question and generates the answer "The sky is blue because sunlight collides with small particles in the atmosphere, scattering the blue light." Furthermore, the system provides links to videos about light scattering in the atmosphere and instructions for simple light experiments that can be carried out at home. Parents and children can use this information to deepen their learning.

[0809] Specific prompt examples:

[0810] 1. If a child asks, "Why is the sky blue?"

[0811] Prompt: "Why is the sky blue?"

[0812] 2. If you and your child want to dig deeper into the topic:

[0813] Prompt: "Explain in a way that children can understand how light scatters in the atmosphere."

[0814] This system allows parents and children to learn together, achieving an effective and long-term learning process.

[0815] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0816] User authentication and profile creation

[0817] Step 1:

[0818] Parents and children use their own devices to enter their username and password, which is then encrypted.

[0819] Input: Username, Password

[0820] Output: Encrypted login information

[0821] Step 2:

[0822] The terminal transmits the encrypted login information to the server.

[0823] Input: Encrypted login information

[0824] Output: Send to server

[0825] Step 3:

[0826] The server authenticates the login information it receives by checking it against a database. If it finds a matching account, it generates an authentication token and returns it to the device. If the user is a new user, it sends instructions to display a profile creation screen on the device.

[0827] Input: Encrypted login information

[0828] Output: Authentication token or profile creation instructions

[0829] Step 4:

[0830] New users enter information such as their name, age, and interests on the profile creation screen.

[0831] Input: Profile information (name, age, interests)

[0832] Output: Profile information

[0833] Step 5:

[0834] The terminal encrypts the input profile information and transmits it to the server.

[0835] Input: Profile information

[0836] Output: Encrypted profile information

[0837] Step 6:

[0838] The server stores the received profile information in a database and returns a message to the terminal indicating that authentication has been completed.

[0839] Input: Encrypted profile information

[0840] Output: Authentication complete message

[0841] Enter and submit your question

[0842] Step 1:

[0843] The user types what the child wants to know into a text box (e.g., "Why is the sky blue?").

[0844] Input: Question text

[0845] Output: Question text

[0846] Step 2:

[0847] The terminal transmits the input question to the server as text data.

[0848] Input: Question text

[0849] Output: Send to server

[0850] Step 3:

[0851] The server receives the query data and records it in a database.

[0852] Input: Question text

[0853] Output: Records in the database

[0854] AI-powered answer generation

[0855] Step 1:

[0856] The server passes the received question data to the generative artificial intelligence model.

[0857] Input: Question text

[0858] Output: Input to the AI ​​model

[0859] Step 2:

[0860] The server uses a generative artificial intelligence model to analyze the question and generate an answer in a format that is easy for children to understand.

[0861] Input: Question text

[0862] Output: Answer text

[0863] Step 3:

[0864] The server formats the generated answers in a format suitable for parent and child.

[0865] Input: Answer text

[0866] Output: Formatted answer

[0867] Providing answers and additional content

[0868] Step 1:

[0869] The server sends the formatted answers and related additional content (such as video links and experimental methods) to the device.

[0870] Input: Formatted answers, additional content

[0871] Output: Send to terminal

[0872] Step 2:

[0873] The terminal displays the generated answer and also presents additional related content.

[0874] Input: Formatted answers, additional content

[0875] Output: What is displayed to the user

[0876] Supporting parent-child dialogue

[0877] Step 1:

[0878] The user then has the child read the proposed answer and begin explaining it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[0879] Input: Suggested answer

[0880] Output: Parent-child interaction

[0881] Step 2:

[0882] The device suggests additional questions and topics to encourage dialogue between parent and child.

[0883] Input: Dialogue status

[0884] Output: Additional questions or topics

[0885] Learning history and feedback

[0886] Step 1:

[0887] The server records the learning history of each session in a database.

[0888] Input: Study session data

[0889] Output: Records in the database

[0890] Step 2:

[0891] The server generates a list of suggested new questions and content relevant to the next study session and provides it to the device the next time the user logs in.

[0892] Input: Learning history

[0893] Output: Generate and serve a list of recommendations

[0894] (Application example 1)

[0895] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0896] The modern educational environment does not provide enough opportunities for parents and children to learn together. While there are educational platforms that utilize the internet, there is a lack of learning through actual dialogue and sensory experiences. This results in a gap between theory and practice, making it difficult to maintain deep understanding and interest. Furthermore, there is a lack of systems that promote communication between parents and children while advancing learning.

[0897] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0898] In this invention, the server includes a stepwise authentication and profile creation means, a data input means for receiving and saving questions from users, an answer generation means for generating answers to the questions using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, a virtual experience means for inputting questions while parents and children tour the virtual facility, a dialogue promotion means for promoting dialogue between parents and children, and a history storage and feedback means for recording learning history and providing feedback for the next learning session. This makes it possible to provide an educational environment in which parents and children can learn together and promote deep understanding and dialogue through actual experiences.

[0899] "Multi-step authentication" is a method of verifying a user's identity through multiple steps when accessing a website.

[0900] "Profile creation" is a method of registering a user's personal information, learning history, etc., and creating a user-specific account.

[0901] "Data entry" refers to the act of a user entering questions or information into a system.

[0902] A "generative artificial intelligence model" refers to a system that uses artificial intelligence to generate answers to questions posed by users.

[0903] "Answer generation" is the process of creating appropriate answers to received questions.

[0904] "Presenting" refers to the act of displaying the generated answer and related content to the user.

[0905] "Virtual experience" refers to an experience in which a user engages in activities or sights in a virtual space using virtual reality technology.

[0906] "Promoting dialogue" refers to providing support to stimulate communication between parents and children.

[0907] "History storage" is a means of recording a user's learning history and ensuring that it can be referenced later.

[0908] "Feedback" refers to providing users with evaluations and areas for improvement based on their learning results and history.

[0909] "Virtual facility" refers to a facility for education or tours created using virtual reality technology.

[0910] This invention relates to a virtual science museum guide system that promotes learning between parents and children. This system is realized by combining the following multiple means and processes.

[0911] Overall system configuration

[0912] This system is based on users accessing the virtual reality space via their smartphones or head-mounted displays. The entire system is roughly divided into the server side and the terminal side.

[0913] Hardware and software used

[0914] Server: The system uses a server to store data and run the AI ​​model, which is built on AWS or Google Cloud Platform.

[0915] Database: A MySQL database is used to store user information, questions, answers, and learning history.

[0916] AI model: OpenAI's GPT series is used to generate answers to user questions.

[0917] Devices: Users can access the virtual reality space using an Oculus Quest 2 or an iPhone / Android smartphone.

[0918] Development environment: The virtual reality space is built using Unity, and communication between the server and client is managed using Node.js.

[0919] User authentication and profile creation

[0920] Users first access the system using a smartphone or VR device and enter their login information. This information is sent to the server, where the user information is verified against a MySQL database. If the user is an existing user, an authentication token is generated and sent back to the device. If the user is a new user, a profile creation screen is displayed, where information such as name, age, and interests is entered and saved in the database.

[0921] Enter data and submit questions

[0922] When parents and children visit an exhibit in the virtual museum and become interested in it, the child can enter a question in the text box, which is sent to the server and recorded as a log.

[0923] AI-powered answer generation

[0924] The server passes the received question to a generative AI model, which analyzes the question and generates an answer in a way that is easy for children to understand. The generated answer is then formatted in a way that is suitable for parents and children.

[0925] Providing answers and additional content

[0926] The generated answers and related additional content (e.g., video links and experimental procedures) are sent from the server to the parent and child's devices, where they are displayed on their smartphones or VR devices.

[0927] Supporting parent-child dialogue

[0928] The AI-generated answers will trigger a dialogue between parent and child, and additional questions and topics will be suggested to further the conversation.

[0929] Learning history and feedback

[0930] The server records the learning history of each session, and the next time the user logs in, the server generates a list of suggested new questions and content for the user to review.

[0931] Specific examples

[0932] For example, if a child types a question in the virtual museum such as "Why is the sky blue?", the question is sent to the server. A generative artificial intelligence model (OpenAI's GPT series) analyzes the question and generates the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light." This answer is displayed on the parent and child's devices, along with a link to a video about the scattering of light in the atmosphere and instructions for a simple light experiment that can be done at home. Parents and children can deepen their conversation based on this information.

[0933] Prompt Sentence Examples

[0934] Generate an answer to the question "Why is the sky blue?". The answer should be understandable to a 10-year-old child, and you should also provide additional relevant content (video links and simple experiments).

[0935] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0936] Step 1:

[0937] User authentication and profile creation

[0938] A user accesses the system from a terminal and enters their login information. This information is sent from the terminal to the server. The server accesses the MySQL database and verifies the user information. If the user is an existing user, an authentication token is generated and sent back to the terminal. If the user is a new user, a profile creation screen is displayed on the terminal, where the user enters information such as their name, age, and interests. This information is sent to the server and stored in the database.

[0939] Enter your login details or new profile details

[0940] Output: Authentication token or profile creation confirmation message

[0941] Step 2:

[0942] Virtual museum tour and question entry

[0943] Parents and children access the virtual museum using devices (smartphones or VR devices) and view the exhibits. Children can enter questions about exhibits that interest them in a text box and send them from their devices to the server. The server then records the received questions as a log.

[0944] Input: Virtual museum visit and question text

[0945] Output: Question data recorded on the server

[0946] Step 3:

[0947] AI-powered answer generation

[0948] The server passes the received question to a generative AI model (OpenAI's GPT series). The AI ​​model analyzes the question and generates an answer in a format that is easy for children to understand. The generated answer is then formatted so that it can be sent to the parent and child's device.

[0949] Input: Logged question

[0950] Output: Formatted answer

[0951] Step 4:

[0952] Providing answers and additional content

[0953] The server sends the generated answers and related additional content (e.g., video links and experimental procedures) to the parent and child's devices, which receive them and display them on their smartphones or VR devices.

[0954] Input: Formatted answers and additional content

[0955] Output: Answers and additional content displayed on the terminal

[0956] Step 5:

[0957] Supporting parent-child dialogue

[0958] The child reads the presented answers and explains them to the parent. The server then suggests additional questions and topics to the device to promote dialogue between the parent and child. The parent and child then advance their dialogue based on the topics suggested by the device.

[0959] Input: Suggested answers and additional content

[0960] Output: Additional questions or topics to further the conversation

[0961] Step 6:

[0962] Learning history and feedback

[0963] The server records the history of the learning session and stores it in a database. The next time the user logs in, the server generates a list of relevant new questions and content suggestions based on the previous learning history and sends it to the user's device.

[0964] Input: Training session data

[0965] Output: A list of suggested new questions or content

[0966] These specific processing steps enable parents and children to learn together through a tour of the virtual museum, promoting dialogue and effectively advancing education.

[0967] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0968] This invention is an educational platform that promotes learning between parents and children. This system provides an environment where parents and children can cooperate and deepen their learning through a series of processes, from user authentication and question reception, to emotion recognition using an emotion engine, answer generation using AI, answer presentation, promotion of dialogue between parents and children, and storage and feedback of learning history. Specifically, the system uses the following steps and means:

[0969] User authentication and profile creation

[0970] 1. Users

[0971] Parents and children enter login information using their respective devices.

[0972] 2. Terminal

[0973] Each device sends login information to the server.

[0974] 3. Server

[0975] The server accesses the database to find a user account that matches the entered information, generates an authentication token and returns it to the device, and if the user is a new user, displays a profile creation screen on the device.

[0976] 4. Users

[0977] New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[0978] 5. Terminal

[0979] The entered profile information is sent to the server.

[0980] 6. Server

[0981] The server stores the profile information in a database and sends a message to the device that authentication is complete.

[0982] Question input and emotion recognition

[0983] 1. Users

[0984] A child types a question (e.g., "Why is the sky blue?") into a text box.

[0985] 2. Terminal

[0986] The entered question is sent to the server as text data.

[0987] At this time, sensors such as a camera and microphone built into the device are used to analyze the child's facial expressions and tone of voice, and the information is sent to the emotion engine.

[0988] 3. Server

[0989] The server receives the question and records it as a log, and the emotion engine analyzes the received emotion data. The analysis results are reflected in the generation of answers.

[0990] AI-powered answer generation

[0991] 1. Server

[0992] The server passes the received question and emotion data to the generative artificial intelligence model.

[0993] A generative artificial intelligence model analyzes questions and emotional data, and generates answers that are easy for children to understand and take into account their emotional state.

[0994] 2. Server

[0995] Format the generated answers into a format suitable for parents and children, creating content suitable for both.

[0996] Providing answers and additional content

[0997] 1. Server

[0998] The server sends the generated answer and related additional content (such as video links and experimental methods) to the device.

[0999] 2. Terminal

[1000] The device displays the generated answer and offers additional related content.

[1001] Emotional Engine Feedback

[1002] 1. Users

[1003] The child reads the answers provided and explains them to the parent.

[1004] Parents listen to their children's explanations and then engage in dialogue about further questions and related topics.

[1005] 2. Terminal

[1006] The device suggests questions and topics to encourage dialogue between parent and child.

[1007] 3. Server

[1008] The emotion engine continuously analyzes the user's emotions during the conversation and provides the results as feedback in real time.

[1009] Learning history and feedback

[1010] 1. Server

[1011] The server records the learning history and emotional data for each session and generates a list of suggested new questions and content relevant to the next learning session.

[1012] 2. Terminal

[1013] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[1014] Specific examples

[1015] For example, suppose a child at home types in a question such as, "Why is the sky blue?" This question is sent to a server via the device, and an emotion engine analyzes the child's facial expressions and tone of voice to recognize a state of "excitement." The server then uses a generative AI model to generate the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light," and provides video links and experiment methods to further pique the child's interest.

[1016] The emotion engine continuously monitors the user's emotions during the interaction and suggests questions and topics to encourage dialogue between parent and child. In this way, feedback and learning content based on emotional state are provided, providing an effective means for parents and children to learn and grow together.

[1017] The processing flow will be explained below.

[1018] Step 1:

[1019] Users: Parents and children enter login information using their own devices.

[1020] Step 2:

[1021] Terminal: Each terminal sends login information to the server.

[1022] Step 3:

[1023] Server: The server accesses the database, searches for a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the profile creation screen is displayed on the device.

[1024] Step 4:

[1025] User: New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[1026] Step 5:

[1027] Terminal: Sends the entered profile information to the server.

[1028] Step 6:

[1029] Server: The server stores the profile information in a database and sends a message to the device that authentication is complete.

[1030] Step 7:

[1031] User: Child types a question (e.g., "Why is the sky blue?") into a text box.

[1032] Step 8:

[1033] Terminal: Sends the entered question to the server as text data.

[1034] In addition, sensors such as a camera and microphone built into the device are used to analyze the child's facial expressions and tone of voice, generating emotional data that is then sent to the server.

[1035] Step 9:

[1036] Server: The server receives the query and logs it.

[1037] The server uses an emotion engine to analyze the received emotion data.

[1038] Step 10:

[1039] Server: The server passes the question and emotion data to the generative AI model.

[1040] A generative artificial intelligence model analyzes the question and emotional data and generates an answer that is appropriate to the question and the child's emotions.

[1041] Step 11:

[1042] Server: Formats the generated answers into a format suitable for parents and children, creating content suitable for both.

[1043] Step 12:

[1044] Server: The server sends the generated answers and related additional content (such as video links and experimental methods) to the device.

[1045] Step 13:

[1046] Device: The device displays the generated answer and also suggests additional related content.

[1047] Step 14:

[1048] User: The child reads the given answer and explains it to the parent.

[1049] Parents listen to their children's explanations and then engage in dialogue about further questions and related topics.

[1050] The device analyzes facial expressions and tone of voice during conversation and generates emotional data.

[1051] Step 15:

[1052] Device: Based on emotional data, suggests questions and topics to promote dialogue between parents and children.

[1053] Step 16:

[1054] Server: The server records the learning history of each session, including emotional data during the conversation, and generates a list of suggested new questions and content for the next learning session.

[1055] Step 17:

[1056] On the device: The next time the user logs in, the server-provided recommendation list is displayed to the user.

[1057] Example 2

[1058] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1059] Conventional educational platforms lack the functionality to promote dialogue between parents and children to effectively deepen learning, or to provide appropriate feedback that takes into account their emotional state. They also lack systems that analyze users' emotional state and adjust learning content accordingly. This makes it difficult to increase motivation to learn and facilitate smooth communication between parents and children.

[1060] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1061] In this invention, the server includes a stepwise authentication and profile creation means, a data input means for receiving and saving questions from a user, an answer generation means for generating answers to the questions using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, an emotion recognition means for analyzing the user's emotional state using an emotion recognition engine, a dialogue promotion means for promoting dialogue between parent and child based on the analysis results, and a history storage and feedback means for recording learning history and emotional data and providing feedback the next time the child studies. As a result, when parents and children study together, appropriate feedback that takes into account the emotional state is provided, improving motivation to learn and enabling smooth communication between parent and child.

[1062] A "stepwise authentication method" is a method for verifying the authenticity of a user by going through multiple authentication steps when the user accesses a system.

[1063] The "profile creation means" is a means for a new user to input necessary information when registering with the system and create an individual profile.

[1064] "Data input means" refers to means for accepting questions and other input data from a user and storing it.

[1065] A "generative artificial intelligence model" is an artificial intelligence model used to generate appropriate answers to questions from users.

[1066] The "answer generation means" is a means for generating an answer to a user's question using a generative artificial intelligence model.

[1067] The "presentation means" is a means for presenting the generated answer and related additional content to the user.

[1068] The "emotion recognition means" is a means for analyzing the user's emotional state, and utilizes an emotion recognition engine.

[1069] "Dialogue promotion means" refers to a means for promoting dialogue between parents and children based on the analysis results.

[1070] The "history storage means" is a means for recording learning history and emotional data.

[1071] "Feedback means" refers to a means for providing appropriate feedback the next time the student studies.

[1072] The present invention is an educational platform designed to promote learning between parents and children. The system comprises a step-by-step authentication and profile creation means, a data input means, an answer generation means using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, an emotion recognition means using an emotion recognition engine, a dialogue promotion means, and a history storage and feedback means.

[1073] Hardware and software used

[1074] 1. Hardware

[1075] Devices: PCs, tablets, smartphones, etc. used by users

[1076] Server: Cloud service or on-premise dedicated server

[1077] Sensors: Built-in camera and microphone (to collect emotional data)

[1078] 2. Software

[1079] Authentication system: A system for multi-factor authentication (e.g., OAuth, SAML)

[1080] Database: A database system (e.g., MySQL, PostgreSQL) for storing user information and learning history.

[1081] Generative AI models: AI models that generate answers to questions (e.g., GPT-3, BERT)

[1082] Emotion recognition engine: A system that analyzes the user's facial expressions and tone of voice (e.g., Azure Emotion API, Google Cloud Speech-to-Text)

[1083] Web front end: Web technologies (e.g., HTML, CSS, JavaScript) used to provide the user interface

[1084] System operation explanation

[1085] User authentication and profile creation

[1086] Users (parents and children) use their respective devices to enter their username and password on the login screen. The device sends this information to the server, which searches the database for the corresponding user information. If authentication is successful, for new users, a profile creation screen is displayed. The user enters the required information and sends it to the server to create a profile.

[1087] Question input and emotion recognition

[1088] The user (child) enters a question (e.g., "Why is the sky blue?") and the device sends this information to the server. The device also uses the built-in camera and microphone to analyze the child's facial expressions and tone of voice, and sends emotional data to the server. The server receives the question and emotional data, stores it as a log, and passes it to the emotion engine.

[1089] AI-powered answer generation

[1090] The server uses a generative artificial intelligence model to generate appropriate answers based on the received questions and emotion data, and the answers are formatted in a format suitable for parents and children.

[1091] Providing answers and additional content

[1092] The server sends the generated answers and related additional content (such as video links and experimental methods) to the device, which displays them on the screen and supports parents and children in learning together.

[1093] Emotional Engine Feedback

[1094] The user (child) reads the presented answers and explains them to the parent. The emotion engine analyzes the user's emotions during the conversation and provides real-time feedback, further deepening the dialogue between parent and child.

[1095] Learning history and feedback

[1096] The server records the learning history and emotion data for each session and generates a list of suggestions for new questions and content that are relevant to the next learning session. The next time you log in, the server-provided recommendation list will be displayed.

[1097] Specific examples

[1098] For example, if a child types a question like "Why is the sky blue?", the question is sent to the server via the device. The emotion engine analyzes the child's facial expressions and tone of voice and recognizes their "curious" state. The server then uses a generative AI model to generate the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light," and provides video links and experiment methods to further pique the child's interest. In this way, feedback and learning content based on the child's emotional state are provided, creating an effective means for parents and children to learn and grow together.

[1099] Prompt Sentence Examples

[1100] Please explain in detail your approach to using an emotion engine to generate appropriate answers to science questions that interest children and promote dialogue between parents and children.

[1101] This educational platform provides a new environment for parents and children to deepen their learning together, and utilizes emotion recognition and artificial intelligence to support effective learning and communication.

[1102] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1103] Step 1:

[1104] User

[1105] Parents and children enter login information using their respective devices.

[1106] Input: Username, Password

[1107] Action: Enter the required information on the login screen and click the "Login" button.

[1108] Output: Login information is stored on the device.

[1109] Step 2:

[1110] Terminal

[1111] The login information is sent to the server over a secure channel.

[1112] Input: Username, Password

[1113] What it does: Encrypts the login information you enter and sends it to the server.

[1114] Output: Sends encrypted logging information to the server.

[1115] Step 3:

[1116] server

[1117] The received login information is checked against the database and the authentication result is returned.

[1118] Input: Encrypted login information

[1119] What it does: Decrypts the login information, performs a database query to find a matching user account, generates an authentication token and sends it back to the device.

[1120] Output: Authentication result (success or failure), authentication token

[1121] Step 4:

[1122] Servers and Terminals

[1123] For new users, the profile creation screen will be displayed on the device. For existing users, the device will transition to the main screen.

[1124] Input: Authentication result

[1125] Operation: Upon receiving the authentication result, the profile creation screen is displayed for new users, and the main screen is displayed for existing users.

[1126] Output: Profile creation screen or main screen

[1127] Step 5:

[1128] Users (new users only)

[1129] New users enter the required information on the profile creation screen and submit.

[1130] Input: Profile information such as name, age, interests, etc.

[1131] How it works: Enter the required information into the profile creation form and click the "Submit" button.

[1132] Output: Input profile information

[1133] Step 6:

[1134] Device (new users only)

[1135] The entered profile information is sent to the server.

[1136] Input: Profile information

[1137] Action: Sends profile information to the server.

[1138] Output: The profile information is sent to the server.

[1139] Step 7:

[1140] Server (new users only)

[1141] The profile information is stored in a database and an authentication completion message is sent to the terminal.

[1142] Input: Profile information

[1143] Action: Inserts profile information into the database, generates an authentication completion message, and sends it to the terminal.

[1144] Output: Authentication complete message

[1145] Step 8:

[1146] User

[1147] Children type their questions into the text box.

[1148] Input: Question text (e.g., "Why is the sky blue?")

[1149] Action: Enter a question in the text box and click the submit button.

[1150] Output: The question text entered

[1151] Step 9:

[1152] Terminal

[1153] The entered question is sent to the server as text data, and at the same time emotion data is collected using a camera, microphone, etc. and sent to the emotion engine.

[1154] Input: Question text, emotion data

[1155] How it works: Sends question text to the server, collects emotion data and sends it to the emotion engine.

[1156] Output: Question text sent to the server, emotion data sent to the emotion engine

[1157] Step 10:

[1158] server

[1159] It receives question text and emotion data, records them as a log, and generates answers based on the analysis results of the emotion engine.

[1160] Input: Question text, emotion data

[1161] How it works: The question text is logged, the emotion engine generates analysis results, and then passes them to a generative AI model to generate an answer.

[1162] Output: Generated answer text

[1163] Step 11:

[1164] server

[1165] Format the generated answers and convert them into a format suitable for parents and children.

[1166] Input: Generated answer text

[1167] What it does: Formats the answer text into HTML or other display format.

[1168] Output: Formatted answer content

[1169] Step 12:

[1170] Servers and Terminals

[1171] The generated answer and any associated additional content are sent to the terminal, which displays them.

[1172] Input: Formatted answer content, additional content (video links and experiment methods)

[1173] How it works: The server sends content to the device, which then displays it.

[1174] Output: Displayed answer content and additional content

[1175] Step 13:

[1176] User

[1177] The child reads the provided answer and explains it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[1178] Input: Proposed answer content

[1179] Actions: Child reads answer, explains to parent, and engages in dialogue.

[1180] Output: Parent-child interaction

[1181] Step 14:

[1182] Terminal

[1183] Suggest questions and topics to encourage dialogue between parents and children.

[1184] Input: Information during the conversation

[1185] What it does: The dialogue assistant displays suggestions at the appropriate time.

[1186] Output: Suggestions to encourage dialogue

[1187] Step 15:

[1188] server

[1189] The emotion engine analyzes the user's emotions during the conversation and provides the results as feedback in real time.

[1190] Input: Emotion data during conversation

[1191] Operation: Performs real-time sentiment analysis, generates feedback messages, and sends them to the device.

[1192] Output: Real-time feedback message

[1193] Step 16:

[1194] server

[1195] It records learning history and emotional data from each session and generates a list of suggested new questions and content that are relevant for the next learning session.

[1196] Input: learning history, emotion data

[1197] What it does: Saves session data to the database and the recommendation engine generates new suggestions.

[1198] Output: Suggestion list

[1199] Step 17:

[1200] Terminal

[1201] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[1202] Input: Suggestion list

[1203] Behavior: Shows recommended content on the redirected screen.

[1204] Output: Displayed recommendation list

[1205] These steps will enable parents and children to learn together and achieve effective learning and communication using emotion recognition and artificial intelligence.

[1206] (Application example 2)

[1207] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1208] Conventional worker education and training systems using factory robots have issues such as slow response to worker questions and problems and insufficient support to reduce stress and anxiety. In particular, there is a need to improve learning efficiency and reduce psychological burden in the work environment.

[1209] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a step-by-step authentication and profile creation means, a data input means for accepting and saving questions from users, a means for generating answers to questions using a generative artificial intelligence model, a means for presenting the generated answers and related additional content to the user, a dialogue promotion means for encouraging dialogue between parents and children, a history storage and feedback means for recording learning history and providing feedback for the next learning session, an emotion recognition means for analyzing the user's emotional state using an emotion engine and reflecting the results in answer generation, and an answer adjustment means for adjusting the tone of the answer based on the analyzed emotional state. This enables effective education and training of workers in factories and reduces their psychological burden.

[1210] "Step-by-step authentication" is a method for strengthening security by requiring a user to go through multiple authentication steps when logging into a system.

[1211] "Profile creation" is the process by which a new user registers with the system and enters the necessary information to generate an individual user profile.

[1212] "Data entry" is the process by which a user enters questions or information into a system and stores that data.

[1213] A "generative artificial intelligence model" is an AI technology that uses natural language processing to generate answers to input questions or information.

[1214] "Presentation" is the process of displaying generated answers and related content to the user.

[1215] "Dialogue promotion" is a function that the system supports to stimulate dialogue between parents and children or between workers.

[1216] "History storage and feedback" is a system that records learning history and dialogue history and provides feedback for the next learning or dialogue.

[1217] "Emotion recognition" is a technology that analyzes a user's facial expressions and tone of voice to determine their emotional state.

[1218] "Response adjustment" is the process of adjusting the tone and expression of the generated response based on the emotion recognition results, and providing it in a form that is appropriate for the user.

[1219] The present invention is a system for supporting the education and training of workers using factory robots. The system includes functions for step-by-step authentication and profile creation, data input for accepting and saving questions from users, generating answers to questions using a generative artificial intelligence model, presenting the generated answers and related additional content to the user, facilitating dialogue, recording learning history, and providing feedback for the next learning session. It also includes a means for emotion recognition using an emotion engine and adjusting the tone of the response based on the analyzed emotional state.

[1220] Configuration and Operation

[1221] The system consists of the following components:

[1222] 1. Step-by-step authentication and profile creation

[1223] The server performs step-by-step authentication when a user logs in and, for new users, provides a profile creation screen.

[1224] 2. Data Entry

[1225] The device receives questions from users and sends them as text data to the server. It also uses the device's camera and microphone to analyze the user's facial expressions and tone of voice, and sends the data to the emotion engine.

[1226] 3. Answer generation

[1227] The server uses a generative artificial intelligence model (e.g., DistilBERT) to generate answers to received questions.

[1228] 4. Presentation

[1229] The terminal displays the generated answers and associated additional content to the user.

[1230] 5. Promoting dialogue

[1231] The server suggests additional questions and topics to encourage interaction between users.

[1232] 6. History and Feedback

[1233] The server records learning history and emotional data and provides feedback to help with future learning and interaction.

[1234] 7. Emotion recognition and response adjustment

[1235] The emotion engine analyzes the user's facial expressions and tone of voice to determine their emotional state. Based on the analysis results, the server adjusts the tone of the generated response to present it in a manner appropriate for the user.

[1236] Specific examples

[1237] For example, suppose a worker inputs a question about how to operate a new piece of equipment. The question is sent via the device to the server, which then uses a generative AI model to generate an answer. The answer is then displayed on the device, along with relevant reference materials and video links. The emotion engine analyzes the worker's facial expressions and tone of voice, and if the worker is feeling stressed or anxious, the server adjusts the tone of the answer to reduce the worker's psychological burden.

[1238] Example prompts for generative AI models

[1239] "Question: How do I operate this new device?\nContext: Explain it in simple steps, don't stress me out."

[1240] This system enables effective education and training of workers within the factory and reduces the psychological burden on workers.

[1241] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1242] Step 1:

[1243] User Login

[1244] The user enters login information. The device sends this login information to the server. The server references the database to find a user account that matches the entered information, generates an authentication token, and sends it back to the device. If the user is a new user, a profile creation screen is displayed on the device.

[1245] Input: User login information

[1246] Output: Authentication token or profile creation screen

[1247] Step 2:

[1248] Profile Creation

[1249] A new user enters necessary information such as name, age, and interests on the profile creation screen. The device sends this profile information to the server. The server stores the profile information in a database and sends a message to the device confirming authentication.

[1250] Input: Profile information

[1251] Output: Message that profile information has been saved

[1252] Step 3:

[1253] Enter your question

[1254] The user enters a question into the text box. The device sends the entered question as text data to the server. At the same time, the device uses sensors such as a camera and microphone built into the device to analyze the user's facial expressions and tone of voice, and sends this emotional data to the emotion engine.

[1255] Input: Question text, facial expression data, tone of voice

[1256] Output: Send question text, send emotion data

[1257] Step 4:

[1258] Emotion recognition and question saving

[1259] The server logs the received questions in a database. The emotion engine analyzes the emotion data and determines the user's emotional state. The analysis results are fed back to the server and reflected in answer generation.

[1260] Input: Question text, emotion data

[1261] Output: Emotional state determination results, questions saved in a database

[1262] Step 5:

[1263] Generate answers

[1264] The server passes the received question and emotion data to a generative AI model (e.g., DistilBERT), which analyzes this information and generates an answer that is easy for the user to understand and takes into account their emotional state.

[1265] Input: Question text, emotion data

[1266] Output: The generated answer

[1267] Step 6:

[1268] Providing an answer

[1269] The server then formats the generated answers appropriately and sends them to the device along with any additional relevant content (e.g., video links and experimental procedures), which is then displayed to the user.

[1270] Input: Generated answers, related content

[1271] Output: Sending answers and related content to your device

[1272] Step 7:

[1273] Promoting dialogue

[1274] The user reads the presented answers and explains them to their parents or fellow workers, and the device suggests additional questions or topics to encourage dialogue between parents and children or fellow workers.

[1275] Input: Generated answers, related content

[1276] Output: Suggested additional questions or topics

[1277] Step 8:

[1278] Learning history storage and feedback

[1279] The server records the learning history and emotion data for each session and provides them as feedback the next time the user logs in. The device displays the recommendation list provided by the server to the user the next time the user logs in.

[1280] Input: learning history, emotion data

[1281] Output: Provide feedback, display recommendation list

[1282] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1283] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1284] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1285] [Third embodiment]

[1286] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1287] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1288] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1289] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1290] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1291] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1292] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1293] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1294] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1295] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1296] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1297] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1298] The present invention is an educational platform that promotes learning between parents and children. This platform provides an environment where parents and children can cooperate to deepen their learning through a series of processes, from user authentication and question reception to AI-based answer generation, answer presentation, promotion of dialogue between parents and children, and the storage and feedback of learning history. Specifically, the following steps and means are used:

[1299] User authentication and profile creation

[1300] 1. Users

[1301] Parents and children enter login information using their respective devices.

[1302] 2. Terminal

[1303] Each device sends login information to the server.

[1304] 3. Server

[1305] The server accesses the database to find a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the device displays a profile creation screen.

[1306] 4. Users

[1307] New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[1308] 5. Terminal

[1309] The entered profile information is sent to the server.

[1310] 6. Server

[1311] The server stores the profile information in a database and sends a message to the terminal indicating that authentication is complete.

[1312] Enter and submit your question

[1313] 1. Users

[1314] A child types a question (e.g., "Why is the sky blue?") into a text box.

[1315] 2. Terminal

[1316] The entered question is sent to the server as text data.

[1317] 3. Server

[1318] The server receives the query and records it in a log.

[1319] AI-powered answer generation

[1320] 1. Server

[1321] The server passes the received question to a generative artificial intelligence model.

[1322] A generative artificial intelligence model analyzes the question and generates an answer in a way that is easy for children to understand.

[1323] 2. Server

[1324] Format the generated answers into a format suitable for parents and children, creating content suitable for both.

[1325] Providing answers and additional content

[1326] 1. Server

[1327] The server sends the generated answer and related additional content (such as video links and experimental methods) to the terminal.

[1328] 2. Terminal

[1329] The device displays the generated answer and also presents additional related content.

[1330] Supporting parent-child dialogue

[1331] 1. Users

[1332] The child reads the answers provided and explains them to the parent.

[1333] Parents listen to their children's explanations and then have a dialogue about further questions and related topics.

[1334] 2. Terminal

[1335] The device suggests questions and topics to encourage dialogue between parents and children.

[1336] Learning history and feedback

[1337] 1. Server

[1338] The server records the learning history of each session and generates a list to recommend new questions and content relevant to the next learning session.

[1339] 2. Terminal

[1340] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[1341] Specific examples

[1342] For example, suppose a child at home types in a question: "Why is the sky blue?" This question is sent to a server via the device and analyzed by a generative AI model. The server generates an answer: "The sky is blue because sunlight hits tiny particles in the atmosphere, scattering the blue light," and displays it on the parent and child's devices. Furthermore, the server provides links to videos about the scattering of light in the atmosphere and simple experiments on light that can be done at home, allowing the parent and child to deepen their dialogue based on these.

[1343] Thus, the present invention is a system that provides an effective means for parents and children to learn and grow together.

[1344] The processing flow will be explained below.

[1345] Step 1:

[1346] Users: Parents and children enter login information using their own devices.

[1347] Step 2:

[1348] Terminal: Each terminal sends login information to the server.

[1349] Step 3:

[1350] Server: The server accesses the database to find a user account that matches the entered information. It generates an authentication token and returns it to the device. If the user is a new user, the device displays a profile creation screen.

[1351] Step 4:

[1352] User: New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[1353] Step 5:

[1354] Terminal: Sends the entered profile information to the server.

[1355] Step 6:

[1356] Server: The server stores the profile information in a database and sends a message to the device that authentication is complete.

[1357] Step 7:

[1358] User: Child types a question (e.g., "Why is the sky blue?") into a text box.

[1359] Step 8:

[1360] Terminal: Sends the entered question to the server as text data.

[1361] Step 9:

[1362] Server: The server receives the query and logs it.

[1363] Step 10:

[1364] Server: The server passes the received question to a generative AI model, which analyzes the question and generates an answer in a format that is easy for children to understand.

[1365] Step 11:

[1366] Server: Formats the generated answers into a format suitable for parents and children, creating content suitable for both.

[1367] Step 12:

[1368] Server: The server sends the generated answers and related additional content (such as video links and experimental methods) to the device.

[1369] Step 13:

[1370] Device: The device displays the generated answer and also suggests additional related content.

[1371] Step 14:

[1372] User: The child reads the presented answer and explains it to the parent. The parent listens to the child's explanation and engages in a dialogue about further questions and related topics.

[1373] Step 15:

[1374] Device: The device suggests questions and topics to encourage dialogue between parent and child.

[1375] Step 16:

[1376] Server: The server records the learning history of each session and generates a list to recommend new questions and content relevant to the next learning session.

[1377] Step 17:

[1378] On the device: The next time the user logs in, the server-provided recommendation list is displayed to the user.

[1379] Example 1

[1380] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1381] Conventional educational platforms lack a comprehensive environment for parent-child learning. In particular, they lack the ability to provide appropriate answers to user questions, foster parent-child dialogue, and utilize long-term learning histories. The present invention aims to address these issues and provide an effective means for parents and children to collaborate and deepen their learning.

[1382] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1383] In this invention, the server includes a user authentication and profile creation means, a data input means for receiving questions from users as text data and sending it to the server, an answer generation means for generating answers to the questions using a generative AI model, a presentation means for presenting the generated answers and related additional content to the user, a dialogue promotion means for suggesting topics to promote dialogue between parents and children, and a history storage and feedback means for recording learning history and suggesting new questions and content related to the next learning session. This enables parents and children to cooperate in deepening their learning and provides an effective learning environment over the long term.

[1384] "User authentication" is the process of identifying users and verifying their authorization to access a system.

[1385] "Profile Creation" is the process of creating a new user account by entering personal information and interests that will be used within the system.

[1386] "Data entry" is the process by which a user enters text data or questions into a system through a terminal.

[1387] A "generative artificial intelligence model" is an AI algorithm used to generate appropriate answers to questions from users.

[1388] "Answer generation" is the process of using a generative artificial intelligence model to generate an answer to an input question.

[1389] "Presentation" is the process of displaying the generated answer and any additional related content to the user.

[1390] "Dialogue facilitation" is the process of suggesting relevant topics and questions to encourage effective dialogue between parents and children.

[1391] "History archiving" is the process of recording each session's learning history in a database.

[1392] "Feedback" is the process of suggesting new questions or content to the user based on their learning history that will be useful for their next study.

[1393] This invention is an educational platform designed to promote learning between parents and children. This platform provides an environment where parents and children can cooperate and deepen their learning through a series of processes, from user authentication and question reception to AI-based answer generation, answer presentation, promotion of dialogue between parents and children, and storage and feedback of learning history. Specific hardware and software used include internet-enabled devices (PCs, tablets, smartphones, etc.) and a server.

[1394] User authentication and profile creation

[1395] 1. User:

[1396] Parents and children enter login information using their respective devices.

[1397] 2. Terminal:

[1398] Each device encrypts the entered login information and sends it to the server.

[1399] 3. Server:

[1400] The server accesses the database to find a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the server sends an instruction to display a profile creation screen on the device.

[1401] 4. User:

[1402] New users enter information such as their name, age, and interests on the profile creation screen.

[1403] 5. Terminal:

[1404] The entered profile information is encrypted and sent to the server.

[1405] 6. Server:

[1406] The server stores the received profile information in a database and returns a message to the terminal indicating that authentication has been completed.

[1407] Enter and submit your question

[1408] 1. User:

[1409] Children type what they want to know into the text box (e.g., "Why is the sky blue?").

[1410] 2. Terminal:

[1411] The entered question is sent to the server as text data.

[1412] 3. Server:

[1413] The query data is received and recorded in a database.

[1414] AI-powered answer generation

[1415] 1. Server:

[1416] The server passes the received question data to a generative artificial intelligence model (such as GPT-3).

[1417] 2. Server:

[1418] A generative artificial intelligence model analyzes the question and generates an answer in a way that is easy for children to understand.

[1419] 3. Server:

[1420] Format the generated answers in a parent-child friendly format.

[1421] Providing answers and additional content

[1422] 1. Server:

[1423] Send the formatted answers and related additional content (such as video links or experimental methods) to the device.

[1424] 2. Terminal:

[1425] It displays the generated answer and also suggests additional related content.

[1426] Supporting parent-child dialogue

[1427] 1. User:

[1428] The child reads the provided answer and explains it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[1429] 2. Terminal:

[1430] Suggest additional questions or topics to encourage dialogue between parent and child.

[1431] Learning history and feedback

[1432] 1. Server:

[1433] The learning history of each session is recorded in a database.

[1434] 2. Server:

[1435] A list of suggested new questions and content relevant to your next study will be generated and provided to your device the next time you log in.

[1436] Examples and prompts

[1437] As a concrete example, if a child in a household types in the question "Why is the sky blue?", this question is sent to a server via the device. The server passes the question data to a generative AI model (e.g., GPT-3), which analyzes the question and generates the answer "The sky is blue because sunlight collides with small particles in the atmosphere, scattering the blue light." Furthermore, the system provides links to videos about light scattering in the atmosphere and instructions for simple light experiments that can be carried out at home. Parents and children can use this information to deepen their learning.

[1438] Specific prompt examples:

[1439] 1. If a child asks, "Why is the sky blue?"

[1440] Prompt: "Why is the sky blue?"

[1441] 2. If you and your child want to dig deeper into the topic:

[1442] Prompt: "Explain in a way that children can understand how light scatters in the atmosphere."

[1443] This system allows parents and children to learn together, achieving an effective and long-term learning process.

[1444] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1445] User authentication and profile creation

[1446] Step 1:

[1447] Parents and children use their own devices to enter their username and password, which is then encrypted.

[1448] Input: Username, Password

[1449] Output: Encrypted login information

[1450] Step 2:

[1451] The terminal transmits the encrypted login information to the server.

[1452] Input: Encrypted login information

[1453] Output: Send to server

[1454] Step 3:

[1455] The server authenticates the login information it receives by checking it against a database. If it finds a matching account, it generates an authentication token and returns it to the device. If the user is a new user, it sends instructions to display a profile creation screen on the device.

[1456] Input: Encrypted login information

[1457] Output: Authentication token or profile creation instructions

[1458] Step 4:

[1459] New users enter information such as their name, age, and interests on the profile creation screen.

[1460] Input: Profile information (name, age, interests)

[1461] Output: Profile information

[1462] Step 5:

[1463] The terminal encrypts the input profile information and transmits it to the server.

[1464] Input: Profile information

[1465] Output: Encrypted profile information

[1466] Step 6:

[1467] The server stores the received profile information in a database and returns a message to the terminal indicating that authentication has been completed.

[1468] Input: Encrypted profile information

[1469] Output: Authentication complete message

[1470] Enter and submit your question

[1471] Step 1:

[1472] The user types what the child wants to know into a text box (e.g., "Why is the sky blue?").

[1473] Input: Question text

[1474] Output: Question text

[1475] Step 2:

[1476] The terminal transmits the input question to the server as text data.

[1477] Input: Question text

[1478] Output: Send to server

[1479] Step 3:

[1480] The server receives the query data and records it in a database.

[1481] Input: Question text

[1482] Output: Records in the database

[1483] AI-powered answer generation

[1484] Step 1:

[1485] The server passes the received question data to the generative artificial intelligence model.

[1486] Input: Question text

[1487] Output: Input to the AI ​​model

[1488] Step 2:

[1489] The server uses a generative artificial intelligence model to analyze the question and generate an answer in a format that is easy for children to understand.

[1490] Input: Question text

[1491] Output: Answer text

[1492] Step 3:

[1493] The server formats the generated answers in a format suitable for parent and child.

[1494] Input: Answer text

[1495] Output: Formatted answer

[1496] Providing answers and additional content

[1497] Step 1:

[1498] The server sends the formatted answers and related additional content (such as video links and experimental methods) to the device.

[1499] Input: Formatted answers, additional content

[1500] Output: Send to terminal

[1501] Step 2:

[1502] The terminal displays the generated answer and also presents additional related content.

[1503] Input: Formatted answers, additional content

[1504] Output: What is displayed to the user

[1505] Supporting parent-child dialogue

[1506] Step 1:

[1507] The user then has the child read the proposed answer and begin explaining it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[1508] Input: Suggested answer

[1509] Output: Parent-child interaction

[1510] Step 2:

[1511] The device suggests additional questions and topics to encourage dialogue between parent and child.

[1512] Input: Dialogue status

[1513] Output: Additional questions or topics

[1514] Learning history and feedback

[1515] Step 1:

[1516] The server records the learning history of each session in a database.

[1517] Input: Study session data

[1518] Output: Records in the database

[1519] Step 2:

[1520] The server generates a list of suggested new questions and content relevant to the next study session and provides it to the device the next time the user logs in.

[1521] Input: Learning history

[1522] Output: Generate and serve a list of recommendations

[1523] (Application example 1)

[1524] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1525] The modern educational environment does not provide enough opportunities for parents and children to learn together. While there are educational platforms that utilize the internet, there is a lack of learning through actual dialogue and sensory experiences. This results in a gap between theory and practice, making it difficult to maintain deep understanding and interest. Furthermore, there is a lack of systems that promote communication between parents and children while advancing learning.

[1526] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1527] In this invention, the server includes a stepwise authentication and profile creation means, a data input means for receiving and saving questions from users, an answer generation means for generating answers to the questions using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, a virtual experience means for inputting questions while parents and children tour the virtual facility, a dialogue promotion means for promoting dialogue between parents and children, and a history storage and feedback means for recording learning history and providing feedback for the next learning session. This makes it possible to provide an educational environment in which parents and children can learn together and promote deep understanding and dialogue through actual experiences.

[1528] "Multi-step authentication" is a method of verifying a user's identity through multiple steps when accessing a website.

[1529] "Profile creation" is a method of registering a user's personal information, learning history, etc., and creating a user-specific account.

[1530] "Data entry" refers to the act of a user entering questions or information into a system.

[1531] A "generative artificial intelligence model" refers to a system that uses artificial intelligence to generate answers to questions posed by users.

[1532] "Answer generation" is the process of creating appropriate answers to received questions.

[1533] "Presenting" refers to the act of displaying the generated answer and related content to the user.

[1534] "Virtual experience" refers to an experience in which a user engages in activities or sights in a virtual space using virtual reality technology.

[1535] "Promoting dialogue" refers to providing support to stimulate communication between parents and children.

[1536] "History storage" is a means of recording a user's learning history and ensuring that it can be referenced later.

[1537] "Feedback" refers to providing users with evaluations and areas for improvement based on their learning results and history.

[1538] "Virtual facility" refers to a facility for education or tours created using virtual reality technology.

[1539] This invention relates to a virtual science museum guide system that promotes learning between parents and children. This system is realized by combining the following multiple means and processes.

[1540] Overall system configuration

[1541] This system is based on users accessing the virtual reality space via their smartphones or head-mounted displays. The entire system is roughly divided into the server side and the terminal side.

[1542] Hardware and software used

[1543] Server: The system uses a server to store data and run the AI ​​model, which is built on AWS or Google Cloud Platform.

[1544] Database: A MySQL database is used to store user information, questions, answers, and learning history.

[1545] AI model: OpenAI's GPT series is used to generate answers to user questions.

[1546] Devices: Users can access the virtual reality space using an Oculus Quest 2 or an iPhone / Android smartphone.

[1547] Development environment: The virtual reality space is built using Unity, and communication between the server and client is managed using Node.js.

[1548] User authentication and profile creation

[1549] Users first access the system using a smartphone or VR device and enter their login information. This information is sent to the server, where the user information is verified against a MySQL database. If the user is an existing user, an authentication token is generated and sent back to the device. If the user is a new user, a profile creation screen is displayed, where information such as name, age, and interests is entered and saved in the database.

[1550] Enter data and submit questions

[1551] When parents and children visit an exhibit in the virtual museum and become interested in it, the child can enter a question in the text box, which is sent to the server and recorded as a log.

[1552] AI-powered answer generation

[1553] The server passes the received question to a generative AI model, which analyzes the question and generates an answer in a way that is easy for children to understand. The generated answer is then formatted in a way that is suitable for parents and children.

[1554] Providing answers and additional content

[1555] The generated answers and related additional content (e.g., video links and experimental procedures) are sent from the server to the parent and child's devices, where they are displayed on their smartphones or VR devices.

[1556] Supporting parent-child dialogue

[1557] The AI-generated answers will trigger a dialogue between parent and child, and additional questions and topics will be suggested to further the conversation.

[1558] Learning history and feedback

[1559] The server records the learning history of each session, and the next time the user logs in, the server generates a list of suggested new questions and content for the user to review.

[1560] Specific examples

[1561] For example, if a child types a question in the virtual museum such as "Why is the sky blue?", the question is sent to the server. A generative artificial intelligence model (OpenAI's GPT series) analyzes the question and generates the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light." This answer is displayed on the parent and child's devices, along with a link to a video about the scattering of light in the atmosphere and instructions for a simple light experiment that can be done at home. Parents and children can deepen their conversation based on this information.

[1562] Prompt Sentence Examples

[1563] Generate an answer to the question "Why is the sky blue?". The answer should be understandable to a 10-year-old child, and you should also provide additional relevant content (video links and simple experiments).

[1564] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1565] Step 1:

[1566] User authentication and profile creation

[1567] A user accesses the system from a terminal and enters their login information. This information is sent from the terminal to the server. The server accesses the MySQL database and verifies the user information. If the user is an existing user, an authentication token is generated and sent back to the terminal. If the user is a new user, a profile creation screen is displayed on the terminal, where the user enters information such as their name, age, and interests. This information is sent to the server and stored in the database.

[1568] Enter your login details or new profile details

[1569] Output: Authentication token or profile creation confirmation message

[1570] Step 2:

[1571] Virtual museum tour and question entry

[1572] Parents and children access the virtual museum using devices (smartphones or VR devices) and view the exhibits. Children can enter questions about exhibits that interest them in a text box and send them from their devices to the server. The server then records the received questions as a log.

[1573] Input: Virtual museum visit and question text

[1574] Output: Question data recorded on the server

[1575] Step 3:

[1576] AI-powered answer generation

[1577] The server passes the received question to a generative AI model (OpenAI's GPT series). The AI ​​model analyzes the question and generates an answer in a format that is easy for children to understand. The generated answer is then formatted so that it can be sent to the parent and child's device.

[1578] Input: Logged question

[1579] Output: Formatted answer

[1580] Step 4:

[1581] Providing answers and additional content

[1582] The server sends the generated answers and related additional content (e.g., video links and experimental procedures) to the parent and child's devices, which receive them and display them on their smartphones or VR devices.

[1583] Input: Formatted answers and additional content

[1584] Output: Answers and additional content displayed on the terminal

[1585] Step 5:

[1586] Supporting parent-child dialogue

[1587] The child reads the presented answers and explains them to the parent. The server then suggests additional questions and topics to the device to promote dialogue between the parent and child. The parent and child then advance their dialogue based on the topics suggested by the device.

[1588] Input: Suggested answers and additional content

[1589] Output: Additional questions or topics to further the conversation

[1590] Step 6:

[1591] Learning history and feedback

[1592] The server records the history of the learning session and stores it in a database. The next time the user logs in, the server generates a list of relevant new questions and content suggestions based on the previous learning history and sends it to the user's device.

[1593] Input: Training session data

[1594] Output: A list of suggested new questions or content

[1595] These specific processing steps enable parents and children to learn together through a tour of the virtual museum, promoting dialogue and effectively advancing education.

[1596] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1597] This invention is an educational platform that promotes learning between parents and children. This system provides an environment where parents and children can cooperate and deepen their learning through a series of processes, from user authentication and question reception, to emotion recognition using an emotion engine, answer generation using AI, answer presentation, promotion of dialogue between parents and children, and storage and feedback of learning history. Specifically, the system uses the following steps and means:

[1598] User authentication and profile creation

[1599] 1. Users

[1600] Parents and children enter login information using their respective devices.

[1601] 2. Terminal

[1602] Each device sends login information to the server.

[1603] 3. Server

[1604] The server accesses the database to find a user account that matches the entered information, generates an authentication token and returns it to the device, and if the user is a new user, displays a profile creation screen on the device.

[1605] 4. Users

[1606] New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[1607] 5. Terminal

[1608] The entered profile information is sent to the server.

[1609] 6. Server

[1610] The server stores the profile information in a database and sends a message to the device that authentication is complete.

[1611] Question input and emotion recognition

[1612] 1. Users

[1613] A child types a question (e.g., "Why is the sky blue?") into a text box.

[1614] 2. Terminal

[1615] The entered question is sent to the server as text data.

[1616] At this time, sensors such as a camera and microphone built into the device are used to analyze the child's facial expressions and tone of voice, and the information is sent to the emotion engine.

[1617] 3. Server

[1618] The server receives the question and records it as a log, and the emotion engine analyzes the received emotion data. The analysis results are reflected in the generation of answers.

[1619] AI-powered answer generation

[1620] 1. Server

[1621] The server passes the received question and emotion data to the generative artificial intelligence model.

[1622] A generative artificial intelligence model analyzes questions and emotional data, and generates answers that are easy for children to understand and take into account their emotional state.

[1623] 2. Server

[1624] Format the generated answers into a format suitable for parents and children, creating content suitable for both.

[1625] Providing answers and additional content

[1626] 1. Server

[1627] The server sends the generated answer and related additional content (such as video links and experimental methods) to the device.

[1628] 2. Terminal

[1629] The device displays the generated answer and offers additional related content.

[1630] Emotional Engine Feedback

[1631] 1. Users

[1632] The child reads the answers provided and explains them to the parent.

[1633] Parents listen to their children's explanations and then engage in dialogue about further questions and related topics.

[1634] 2. Terminal

[1635] The device suggests questions and topics to encourage dialogue between parent and child.

[1636] 3. Server

[1637] The emotion engine continuously analyzes the user's emotions during the conversation and provides the results as feedback in real time.

[1638] Learning history and feedback

[1639] 1. Server

[1640] The server records the learning history and emotional data for each session and generates a list of suggested new questions and content relevant to the next learning session.

[1641] 2. Terminal

[1642] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[1643] Specific examples

[1644] For example, suppose a child at home types in a question such as, "Why is the sky blue?" This question is sent to a server via the device, and an emotion engine analyzes the child's facial expressions and tone of voice to recognize a state of "excitement." The server then uses a generative AI model to generate the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light," and provides video links and experiment methods to further pique the child's interest.

[1645] The emotion engine continuously monitors the user's emotions during the interaction and suggests questions and topics to encourage dialogue between parent and child. In this way, feedback and learning content based on emotional state are provided, providing an effective means for parents and children to learn and grow together.

[1646] The processing flow will be explained below.

[1647] Step 1:

[1648] Users: Parents and children enter login information using their own devices.

[1649] Step 2:

[1650] Terminal: Each terminal sends login information to the server.

[1651] Step 3:

[1652] Server: The server accesses the database, searches for a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the profile creation screen is displayed on the device.

[1653] Step 4:

[1654] User: New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[1655] Step 5:

[1656] Terminal: Sends the entered profile information to the server.

[1657] Step 6:

[1658] Server: The server stores the profile information in a database and sends a message to the device that authentication is complete.

[1659] Step 7:

[1660] User: Child types a question (e.g., "Why is the sky blue?") into a text box.

[1661] Step 8:

[1662] Terminal: Sends the entered question to the server as text data.

[1663] In addition, sensors such as a camera and microphone built into the device are used to analyze the child's facial expressions and tone of voice, generating emotional data that is then sent to the server.

[1664] Step 9:

[1665] Server: The server receives the query and logs it.

[1666] The server uses an emotion engine to analyze the received emotion data.

[1667] Step 10:

[1668] Server: The server passes the question and emotion data to the generative AI model.

[1669] A generative artificial intelligence model analyzes the question and emotional data and generates an answer that is appropriate to the question and the child's emotions.

[1670] Step 11:

[1671] Server: Formats the generated answers into a format suitable for parents and children, creating content suitable for both.

[1672] Step 12:

[1673] Server: The server sends the generated answers and related additional content (such as video links and experimental methods) to the device.

[1674] Step 13:

[1675] Device: The device displays the generated answer and also suggests additional related content.

[1676] Step 14:

[1677] User: The child reads the given answer and explains it to the parent.

[1678] Parents listen to their children's explanations and then engage in dialogue about further questions and related topics.

[1679] The device analyzes facial expressions and tone of voice during conversation and generates emotional data.

[1680] Step 15:

[1681] Device: Based on emotional data, suggests questions and topics to promote dialogue between parents and children.

[1682] Step 16:

[1683] Server: The server records the learning history of each session, including emotional data during the conversation, and generates a list of suggested new questions and content for the next learning session.

[1684] Step 17:

[1685] On the device: The next time the user logs in, the server-provided recommendation list is displayed to the user.

[1686] Example 2

[1687] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1688] Conventional educational platforms lack the functionality to promote dialogue between parents and children to effectively deepen learning, or to provide appropriate feedback that takes into account their emotional state. They also lack systems that analyze users' emotional state and adjust learning content accordingly. This makes it difficult to increase motivation to learn and facilitate smooth communication between parents and children.

[1689] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1690] In this invention, the server includes a stepwise authentication and profile creation means, a data input means for receiving and saving questions from a user, an answer generation means for generating answers to the questions using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, an emotion recognition means for analyzing the user's emotional state using an emotion recognition engine, a dialogue promotion means for promoting dialogue between parent and child based on the analysis results, and a history storage and feedback means for recording learning history and emotional data and providing feedback the next time the child studies. As a result, when parents and children study together, appropriate feedback that takes into account the emotional state is provided, improving motivation to learn and enabling smooth communication between parent and child.

[1691] A "stepwise authentication method" is a method for verifying the authenticity of a user by going through multiple authentication steps when the user accesses a system.

[1692] The "profile creation means" is a means for a new user to input necessary information when registering with the system and create an individual profile.

[1693] "Data input means" refers to means for accepting questions and other input data from a user and storing it.

[1694] A "generative artificial intelligence model" is an artificial intelligence model used to generate appropriate answers to questions from users.

[1695] The "answer generation means" is a means for generating an answer to a user's question using a generative artificial intelligence model.

[1696] The "presentation means" is a means for presenting the generated answer and related additional content to the user.

[1697] The "emotion recognition means" is a means for analyzing the user's emotional state, and utilizes an emotion recognition engine.

[1698] "Dialogue promotion means" refers to a means for promoting dialogue between parents and children based on the analysis results.

[1699] The "history storage means" is a means for recording learning history and emotional data.

[1700] "Feedback means" refers to a means for providing appropriate feedback the next time the student studies.

[1701] The present invention is an educational platform designed to promote learning between parents and children. The system comprises a step-by-step authentication and profile creation means, a data input means, an answer generation means using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, an emotion recognition means using an emotion recognition engine, a dialogue promotion means, and a history storage and feedback means.

[1702] Hardware and software used

[1703] 1. Hardware

[1704] Devices: PCs, tablets, smartphones, etc. used by users

[1705] Server: Cloud service or on-premise dedicated server

[1706] Sensors: Built-in camera and microphone (to collect emotional data)

[1707] 2. Software

[1708] Authentication system: A system for multi-factor authentication (e.g., OAuth, SAML)

[1709] Database: A database system (e.g., MySQL, PostgreSQL) for storing user information and learning history.

[1710] Generative AI models: AI models that generate answers to questions (e.g., GPT-3, BERT)

[1711] Emotion recognition engine: A system that analyzes the user's facial expressions and tone of voice (e.g., Azure Emotion API, Google Cloud Speech-to-Text)

[1712] Web front end: Web technologies (e.g., HTML, CSS, JavaScript) used to provide the user interface

[1713] System operation explanation

[1714] User authentication and profile creation

[1715] Users (parents and children) use their respective devices to enter their username and password on the login screen. The device sends this information to the server, which searches the database for the corresponding user information. If authentication is successful, for new users, a profile creation screen is displayed. The user enters the required information and sends it to the server to create a profile.

[1716] Question input and emotion recognition

[1717] The user (child) enters a question (e.g., "Why is the sky blue?") and the device sends this information to the server. The device also uses the built-in camera and microphone to analyze the child's facial expressions and tone of voice, and sends emotional data to the server. The server receives the question and emotional data, stores it as a log, and passes it to the emotion engine.

[1718] AI-powered answer generation

[1719] The server uses a generative artificial intelligence model to generate appropriate answers based on the received questions and emotion data, and the answers are formatted in a format suitable for parents and children.

[1720] Providing answers and additional content

[1721] The server sends the generated answers and related additional content (such as video links and experimental methods) to the device, which displays them on the screen and supports parents and children in learning together.

[1722] Emotional Engine Feedback

[1723] The user (child) reads the presented answers and explains them to the parent. The emotion engine analyzes the user's emotions during the conversation and provides real-time feedback, further deepening the dialogue between parent and child.

[1724] Learning history and feedback

[1725] The server records the learning history and emotion data for each session and generates a list of suggestions for new questions and content that are relevant to the next learning session. The next time you log in, the server-provided recommendation list will be displayed.

[1726] Specific examples

[1727] For example, if a child types a question like "Why is the sky blue?", the question is sent to the server via the device. The emotion engine analyzes the child's facial expressions and tone of voice and recognizes their "curious" state. The server then uses a generative AI model to generate the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light," and provides video links and experiment methods to further pique the child's interest. In this way, feedback and learning content based on the child's emotional state are provided, creating an effective means for parents and children to learn and grow together.

[1728] Prompt Sentence Examples

[1729] Please explain in detail your approach to using an emotion engine to generate appropriate answers to science questions that interest children and promote dialogue between parents and children.

[1730] This educational platform provides a new environment for parents and children to deepen their learning together, and utilizes emotion recognition and artificial intelligence to support effective learning and communication.

[1731] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1732] Step 1:

[1733] User

[1734] Parents and children enter login information using their respective devices.

[1735] Input: Username, Password

[1736] Action: Enter the required information on the login screen and click the "Login" button.

[1737] Output: Login information is stored on the device.

[1738] Step 2:

[1739] Terminal

[1740] The login information is sent to the server over a secure channel.

[1741] Input: Username, Password

[1742] What it does: Encrypts the login information you enter and sends it to the server.

[1743] Output: Sends encrypted logging information to the server.

[1744] Step 3:

[1745] server

[1746] The received login information is checked against the database and the authentication result is returned.

[1747] Input: Encrypted login information

[1748] What it does: Decrypts the login information, performs a database query to find a matching user account, generates an authentication token and sends it back to the device.

[1749] Output: Authentication result (success or failure), authentication token

[1750] Step 4:

[1751] Servers and Terminals

[1752] For new users, the profile creation screen will be displayed on the device. For existing users, the device will transition to the main screen.

[1753] Input: Authentication result

[1754] Operation: Upon receiving the authentication result, the profile creation screen is displayed for new users, and the main screen is displayed for existing users.

[1755] Output: Profile creation screen or main screen

[1756] Step 5:

[1757] Users (new users only)

[1758] New users enter the required information on the profile creation screen and submit.

[1759] Input: Profile information such as name, age, interests, etc.

[1760] How it works: Enter the required information into the profile creation form and click the "Submit" button.

[1761] Output: Input profile information

[1762] Step 6:

[1763] Device (new users only)

[1764] The entered profile information is sent to the server.

[1765] Input: Profile information

[1766] Action: Sends profile information to the server.

[1767] Output: The profile information is sent to the server.

[1768] Step 7:

[1769] Server (new users only)

[1770] The profile information is stored in a database and an authentication completion message is sent to the terminal.

[1771] Input: Profile information

[1772] Action: Inserts profile information into the database, generates an authentication completion message, and sends it to the terminal.

[1773] Output: Authentication complete message

[1774] Step 8:

[1775] User

[1776] Children type their questions into the text box.

[1777] Input: Question text (e.g., "Why is the sky blue?")

[1778] Action: Enter a question in the text box and click the submit button.

[1779] Output: The question text entered

[1780] Step 9:

[1781] Terminal

[1782] The entered question is sent to the server as text data, and at the same time emotion data is collected using a camera, microphone, etc. and sent to the emotion engine.

[1783] Input: Question text, emotion data

[1784] How it works: Sends question text to the server, collects emotion data and sends it to the emotion engine.

[1785] Output: Question text sent to the server, emotion data sent to the emotion engine

[1786] Step 10:

[1787] server

[1788] It receives question text and emotion data, records them as a log, and generates answers based on the analysis results of the emotion engine.

[1789] Input: Question text, emotion data

[1790] How it works: The question text is logged, the emotion engine generates analysis results, and then passes them to a generative AI model to generate an answer.

[1791] Output: Generated answer text

[1792] Step 11:

[1793] server

[1794] Format the generated answers and convert them into a format suitable for parents and children.

[1795] Input: Generated answer text

[1796] What it does: Formats the answer text into HTML or other display format.

[1797] Output: Formatted answer content

[1798] Step 12:

[1799] Servers and Terminals

[1800] The generated answer and any associated additional content are sent to the terminal, which displays them.

[1801] Input: Formatted answer content, additional content (video links and experiment methods)

[1802] How it works: The server sends content to the device, which then displays it.

[1803] Output: Displayed answer content and additional content

[1804] Step 13:

[1805] User

[1806] The child reads the provided answer and explains it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[1807] Input: Proposed answer content

[1808] Actions: Child reads answer, explains to parent, and engages in dialogue.

[1809] Output: Parent-child interaction

[1810] Step 14:

[1811] Terminal

[1812] Suggest questions and topics to encourage dialogue between parents and children.

[1813] Input: Information during the conversation

[1814] What it does: The dialogue assistant displays suggestions at the appropriate time.

[1815] Output: Suggestions to encourage dialogue

[1816] Step 15:

[1817] server

[1818] The emotion engine analyzes the user's emotions during the conversation and provides the results as feedback in real time.

[1819] Input: Emotion data during conversation

[1820] Operation: Performs real-time sentiment analysis, generates feedback messages, and sends them to the device.

[1821] Output: Real-time feedback message

[1822] Step 16:

[1823] server

[1824] It records learning history and emotional data from each session and generates a list of suggested new questions and content that are relevant for the next learning session.

[1825] Input: learning history, emotion data

[1826] What it does: Saves session data to the database and the recommendation engine generates new suggestions.

[1827] Output: Suggestion list

[1828] Step 17:

[1829] Terminal

[1830] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[1831] Input: Suggestion list

[1832] Behavior: Shows recommended content on the redirected screen.

[1833] Output: Displayed recommendation list

[1834] These steps will enable parents and children to learn together and achieve effective learning and communication using emotion recognition and artificial intelligence.

[1835] (Application example 2)

[1836] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1837] Conventional worker education and training systems using factory robots have issues such as slow response to worker questions and problems and insufficient support to reduce stress and anxiety. In particular, there is a need to improve learning efficiency and reduce psychological burden in the work environment.

[1838] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a step-by-step authentication and profile creation means, a data input means for accepting and saving questions from users, a means for generating answers to questions using a generative artificial intelligence model, a means for presenting the generated answers and related additional content to the user, a dialogue promotion means for encouraging dialogue between parents and children, a history storage and feedback means for recording learning history and providing feedback for the next learning session, an emotion recognition means for analyzing the user's emotional state using an emotion engine and reflecting the results in answer generation, and an answer adjustment means for adjusting the tone of the answer based on the analyzed emotional state. This enables effective education and training of workers in factories and reduces their psychological burden.

[1839] "Step-by-step authentication" is a method for strengthening security by requiring a user to go through multiple authentication steps when logging into a system.

[1840] "Profile creation" is the process by which a new user registers with the system and enters the necessary information to generate an individual user profile.

[1841] "Data entry" is the process by which a user enters questions or information into a system and stores that data.

[1842] A "generative artificial intelligence model" is an AI technology that uses natural language processing to generate answers to input questions or information.

[1843] "Presentation" is the process of displaying generated answers and related content to the user.

[1844] "Dialogue promotion" is a function that the system supports to stimulate dialogue between parents and children or between workers.

[1845] "History storage and feedback" is a system that records learning history and dialogue history and provides feedback for the next learning or dialogue.

[1846] "Emotion recognition" is a technology that analyzes a user's facial expressions and tone of voice to determine their emotional state.

[1847] "Response adjustment" is the process of adjusting the tone and expression of the generated response based on the emotion recognition results, and providing it in a form that is appropriate for the user.

[1848] The present invention is a system for supporting the education and training of workers using factory robots. The system includes functions for step-by-step authentication and profile creation, data input for accepting and saving questions from users, generating answers to questions using a generative artificial intelligence model, presenting the generated answers and related additional content to the user, facilitating dialogue, recording learning history, and providing feedback for the next learning session. It also includes a means for emotion recognition using an emotion engine and adjusting the tone of the response based on the analyzed emotional state.

[1849] Configuration and Operation

[1850] The system consists of the following components:

[1851] 1. Step-by-step authentication and profile creation

[1852] The server performs step-by-step authentication when a user logs in and, for new users, provides a profile creation screen.

[1853] 2. Data Entry

[1854] The device receives questions from users and sends them as text data to the server. It also uses the device's camera and microphone to analyze the user's facial expressions and tone of voice, and sends the data to the emotion engine.

[1855] 3. Answer generation

[1856] The server uses a generative artificial intelligence model (e.g., DistilBERT) to generate answers to received questions.

[1857] 4. Presentation

[1858] The terminal displays the generated answers and associated additional content to the user.

[1859] 5. Promoting dialogue

[1860] The server suggests additional questions and topics to encourage interaction between users.

[1861] 6. History and Feedback

[1862] The server records learning history and emotional data and provides feedback to help with future learning and interaction.

[1863] 7. Emotion recognition and response adjustment

[1864] The emotion engine analyzes the user's facial expressions and tone of voice to determine their emotional state. Based on the analysis results, the server adjusts the tone of the generated response to present it in a manner appropriate for the user.

[1865] Specific examples

[1866] For example, suppose a worker inputs a question about how to operate a new piece of equipment. The question is sent via the device to the server, which then uses a generative AI model to generate an answer. The answer is then displayed on the device, along with relevant reference materials and video links. The emotion engine analyzes the worker's facial expressions and tone of voice, and if the worker is feeling stressed or anxious, the server adjusts the tone of the answer to reduce the worker's psychological burden.

[1867] Example prompts for generative AI models

[1868] "Question: How do I operate this new device?\nContext: Explain it in simple steps, don't stress me out."

[1869] This system enables effective education and training of workers within the factory and reduces the psychological burden on workers.

[1870] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1871] Step 1:

[1872] User Login

[1873] The user enters login information. The device sends this login information to the server. The server references the database to find a user account that matches the entered information, generates an authentication token, and sends it back to the device. If the user is a new user, a profile creation screen is displayed on the device.

[1874] Input: User login information

[1875] Output: Authentication token or profile creation screen

[1876] Step 2:

[1877] Profile Creation

[1878] A new user enters necessary information such as name, age, and interests on the profile creation screen. The device sends this profile information to the server. The server stores the profile information in a database and sends a message to the device confirming authentication.

[1879] Input: Profile information

[1880] Output: Message that profile information has been saved

[1881] Step 3:

[1882] Enter your question

[1883] The user enters a question into the text box. The device sends the entered question as text data to the server. At the same time, the device uses sensors such as a camera and microphone built into the device to analyze the user's facial expressions and tone of voice, and sends this emotional data to the emotion engine.

[1884] Input: Question text, facial expression data, tone of voice

[1885] Output: Send question text, send emotion data

[1886] Step 4:

[1887] Emotion recognition and question saving

[1888] The server logs the received questions in a database. The emotion engine analyzes the emotion data and determines the user's emotional state. The analysis results are fed back to the server and reflected in answer generation.

[1889] Input: Question text, emotion data

[1890] Output: Emotional state determination results, questions saved in a database

[1891] Step 5:

[1892] Generate answers

[1893] The server passes the received question and emotion data to a generative AI model (e.g., DistilBERT), which analyzes this information and generates an answer that is easy for the user to understand and takes into account their emotional state.

[1894] Input: Question text, emotion data

[1895] Output: The generated answer

[1896] Step 6:

[1897] Providing an answer

[1898] The server then formats the generated answers appropriately and sends them to the device along with any additional relevant content (e.g., video links and experimental procedures), which is then displayed to the user.

[1899] Input: Generated answers, related content

[1900] Output: Sending answers and related content to your device

[1901] Step 7:

[1902] Promoting dialogue

[1903] The user reads the presented answers and explains them to their parents or fellow workers, and the device suggests additional questions or topics to encourage dialogue between parents and children or fellow workers.

[1904] Input: Generated answers, related content

[1905] Output: Suggested additional questions or topics

[1906] Step 8:

[1907] Learning history storage and feedback

[1908] The server records the learning history and emotion data for each session and provides them as feedback the next time the user logs in. The device displays the recommendation list provided by the server to the user the next time the user logs in.

[1909] Input: learning history, emotion data

[1910] Output: Provide feedback, display recommendation list

[1911] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1912] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1913] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1914] [Fourth embodiment]

[1915] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1916] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1917] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1918] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1919] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1920] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1921] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1922] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1923] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1924] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1925] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1926] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1927] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1928] The present invention is an educational platform that promotes learning between parents and children. This platform provides an environment where parents and children can cooperate to deepen their learning through a series of processes, from user authentication and question reception to AI-based answer generation, answer presentation, promotion of dialogue between parents and children, and the storage and feedback of learning history. Specifically, the following steps and means are used:

[1929] User authentication and profile creation

[1930] 1. Users

[1931] Parents and children enter login information using their respective devices.

[1932] 2. Terminal

[1933] Each device sends login information to the server.

[1934] 3. Server

[1935] The server accesses the database to find a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the device displays a profile creation screen.

[1936] 4. Users

[1937] New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[1938] 5. Terminal

[1939] The entered profile information is sent to the server.

[1940] 6. Server

[1941] The server stores the profile information in a database and sends a message to the terminal indicating that authentication is complete.

[1942] Enter and submit your question

[1943] 1. Users

[1944] A child types a question (e.g., "Why is the sky blue?") into a text box.

[1945] 2. Terminal

[1946] The entered question is sent to the server as text data.

[1947] 3. Server

[1948] The server receives the query and records it in a log.

[1949] AI-powered answer generation

[1950] 1. Server

[1951] The server passes the received question to a generative artificial intelligence model.

[1952] A generative artificial intelligence model analyzes the question and generates an answer in a way that is easy for children to understand.

[1953] 2. Server

[1954] Format the generated answers into a format suitable for parents and children, creating content suitable for both.

[1955] Providing answers and additional content

[1956] 1. Server

[1957] The server sends the generated answer and related additional content (such as video links and experimental methods) to the terminal.

[1958] 2. Terminal

[1959] The device displays the generated answer and also presents additional related content.

[1960] Supporting parent-child dialogue

[1961] 1. Users

[1962] The child reads the answers provided and explains them to the parent.

[1963] Parents listen to their children's explanations and then have a dialogue about further questions and related topics.

[1964] 2. Terminal

[1965] The device suggests questions and topics to encourage dialogue between parents and children.

[1966] Learning history and feedback

[1967] 1. Server

[1968] The server records the learning history of each session and generates a list to recommend new questions and content relevant to the next learning session.

[1969] 2. Terminal

[1970] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[1971] Specific examples

[1972] For example, suppose a child at home types in a question: "Why is the sky blue?" This question is sent to a server via the device and analyzed by a generative AI model. The server generates an answer: "The sky is blue because sunlight hits tiny particles in the atmosphere, scattering the blue light," and displays it on the parent and child's devices. Furthermore, the server provides links to videos about the scattering of light in the atmosphere and simple experiments on light that can be done at home, allowing the parent and child to deepen their dialogue based on these.

[1973] Thus, the present invention is a system that provides an effective means for parents and children to learn and grow together.

[1974] The processing flow will be explained below.

[1975] Step 1:

[1976] Users: Parents and children enter login information using their own devices.

[1977] Step 2:

[1978] Terminal: Each terminal sends login information to the server.

[1979] Step 3:

[1980] Server: The server accesses the database to find a user account that matches the entered information. It generates an authentication token and returns it to the device. If the user is a new user, the device displays a profile creation screen.

[1981] Step 4:

[1982] User: New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[1983] Step 5:

[1984] Terminal: Sends the entered profile information to the server.

[1985] Step 6:

[1986] Server: The server stores the profile information in a database and sends a message to the device that authentication is complete.

[1987] Step 7:

[1988] User: Child types a question (e.g., "Why is the sky blue?") into a text box.

[1989] Step 8:

[1990] Terminal: Sends the entered question to the server as text data.

[1991] Step 9:

[1992] Server: The server receives the query and logs it.

[1993] Step 10:

[1994] Server: The server passes the received question to a generative AI model, which analyzes the question and generates an answer in a format that is easy for children to understand.

[1995] Step 11:

[1996] Server: Formats the generated answers into a format suitable for parents and children, creating content suitable for both.

[1997] Step 12:

[1998] Server: The server sends the generated answers and related additional content (such as video links and experimental methods) to the device.

[1999] Step 13:

[2000] Device: The device displays the generated answer and also suggests additional related content.

[2001] Step 14:

[2002] User: The child reads the presented answer and explains it to the parent. The parent listens to the child's explanation and engages in a dialogue about further questions and related topics.

[2003] Step 15:

[2004] Device: The device suggests questions and topics to encourage dialogue between parent and child.

[2005] Step 16:

[2006] Server: The server records the learning history of each session and generates a list to recommend new questions and content relevant to the next learning session.

[2007] Step 17:

[2008] On the device: The next time the user logs in, the server-provided recommendation list is displayed to the user.

[2009] Example 1

[2010] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2011] Conventional educational platforms lack a comprehensive environment for parent-child learning. In particular, they lack the ability to provide appropriate answers to user questions, foster parent-child dialogue, and utilize long-term learning histories. The present invention aims to address these issues and provide an effective means for parents and children to collaborate and deepen their learning.

[2012] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2013] In this invention, the server includes a user authentication and profile creation means, a data input means for receiving questions from users as text data and sending it to the server, an answer generation means for generating answers to the questions using a generative AI model, a presentation means for presenting the generated answers and related additional content to the user, a dialogue promotion means for suggesting topics to promote dialogue between parents and children, and a history storage and feedback means for recording learning history and suggesting new questions and content related to the next learning session. This enables parents and children to cooperate in deepening their learning and provides an effective learning environment over the long term.

[2014] "User authentication" is the process of identifying users and verifying their authorization to access a system.

[2015] "Profile Creation" is the process of creating a new user account by entering personal information and interests that will be used within the system.

[2016] "Data entry" is the process by which a user enters text data or questions into a system through a terminal.

[2017] A "generative artificial intelligence model" is an AI algorithm used to generate appropriate answers to questions from users.

[2018] "Answer generation" is the process of using a generative artificial intelligence model to generate an answer to an input question.

[2019] "Presentation" is the process of displaying the generated answer and any additional related content to the user.

[2020] "Dialogue facilitation" is the process of suggesting relevant topics and questions to encourage effective dialogue between parents and children.

[2021] "History archiving" is the process of recording each session's learning history in a database.

[2022] "Feedback" is the process of suggesting new questions or content to the user based on their learning history that will be useful for their next study.

[2023] This invention is an educational platform designed to promote learning between parents and children. This platform provides an environment where parents and children can cooperate and deepen their learning through a series of processes, from user authentication and question reception to AI-based answer generation, answer presentation, promotion of dialogue between parents and children, and storage and feedback of learning history. Specific hardware and software used include internet-enabled devices (PCs, tablets, smartphones, etc.) and a server.

[2024] User authentication and profile creation

[2025] 1. User:

[2026] Parents and children enter login information using their respective devices.

[2027] 2. Terminal:

[2028] Each device encrypts the entered login information and sends it to the server.

[2029] 3. Server:

[2030] The server accesses the database to find a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the server sends an instruction to display a profile creation screen on the device.

[2031] 4. User:

[2032] New users enter information such as their name, age, and interests on the profile creation screen.

[2033] 5. Terminal:

[2034] The entered profile information is encrypted and sent to the server.

[2035] 6. Server:

[2036] The server stores the received profile information in a database and returns a message to the terminal indicating that authentication has been completed.

[2037] Enter and submit your question

[2038] 1. User:

[2039] Children type what they want to know into the text box (e.g., "Why is the sky blue?").

[2040] 2. Terminal:

[2041] The entered question is sent to the server as text data.

[2042] 3. Server:

[2043] The query data is received and recorded in a database.

[2044] AI-powered answer generation

[2045] 1. Server:

[2046] The server passes the received question data to a generative artificial intelligence model (such as GPT-3).

[2047] 2. Server:

[2048] A generative artificial intelligence model analyzes the question and generates an answer in a way that is easy for children to understand.

[2049] 3. Server:

[2050] Format the generated answers in a parent-child friendly format.

[2051] Providing answers and additional content

[2052] 1. Server:

[2053] Send the formatted answers and related additional content (such as video links or experimental methods) to the device.

[2054] 2. Terminal:

[2055] It displays the generated answer and also suggests additional related content.

[2056] Supporting parent-child dialogue

[2057] 1. User:

[2058] The child reads the provided answer and explains it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[2059] 2. Terminal:

[2060] Suggest additional questions or topics to encourage dialogue between parent and child.

[2061] Learning history and feedback

[2062] 1. Server:

[2063] The learning history of each session is recorded in a database.

[2064] 2. Server:

[2065] A list of suggested new questions and content relevant to your next study will be generated and provided to your device the next time you log in.

[2066] Examples and prompts

[2067] As a concrete example, if a child in a household types in the question "Why is the sky blue?", this question is sent to a server via the device. The server passes the question data to a generative AI model (e.g., GPT-3), which analyzes the question and generates the answer "The sky is blue because sunlight collides with small particles in the atmosphere, scattering the blue light." Furthermore, the system provides links to videos about light scattering in the atmosphere and instructions for simple light experiments that can be carried out at home. Parents and children can use this information to deepen their learning.

[2068] Specific prompt examples:

[2069] 1. If a child asks, "Why is the sky blue?"

[2070] Prompt: "Why is the sky blue?"

[2071] 2. If you and your child want to dig deeper into the topic:

[2072] Prompt: "Explain in a way that children can understand how light scatters in the atmosphere."

[2073] This system allows parents and children to learn together, achieving an effective and long-term learning process.

[2074] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2075] User authentication and profile creation

[2076] Step 1:

[2077] Parents and children use their own devices to enter their username and password, which is then encrypted.

[2078] Input: Username, Password

[2079] Output: Encrypted login information

[2080] Step 2:

[2081] The terminal transmits the encrypted login information to the server.

[2082] Input: Encrypted login information

[2083] Output: Send to server

[2084] Step 3:

[2085] The server authenticates the login information it receives by checking it against a database. If it finds a matching account, it generates an authentication token and returns it to the device. If the user is a new user, it sends instructions to display a profile creation screen on the device.

[2086] Input: Encrypted login information

[2087] Output: Authentication token or profile creation instructions

[2088] Step 4:

[2089] New users enter information such as their name, age, and interests on the profile creation screen.

[2090] Input: Profile information (name, age, interests)

[2091] Output: Profile information

[2092] Step 5:

[2093] The terminal encrypts the input profile information and transmits it to the server.

[2094] Input: Profile information

[2095] Output: Encrypted profile information

[2096] Step 6:

[2097] The server stores the received profile information in a database and returns a message to the terminal indicating that authentication has been completed.

[2098] Input: Encrypted profile information

[2099] Output: Authentication complete message

[2100] Enter and submit your question

[2101] Step 1:

[2102] The user types what the child wants to know into a text box (e.g., "Why is the sky blue?").

[2103] Input: Question text

[2104] Output: Question text

[2105] Step 2:

[2106] The terminal transmits the input question to the server as text data.

[2107] Input: Question text

[2108] Output: Send to server

[2109] Step 3:

[2110] The server receives the query data and records it in a database.

[2111] Input: Question text

[2112] Output: Records in the database

[2113] AI-powered answer generation

[2114] Step 1:

[2115] The server passes the received question data to the generative artificial intelligence model.

[2116] Input: Question text

[2117] Output: Input to the AI ​​model

[2118] Step 2:

[2119] The server uses a generative artificial intelligence model to analyze the question and generate an answer in a format that is easy for children to understand.

[2120] Input: Question text

[2121] Output: Answer text

[2122] Step 3:

[2123] The server formats the generated answers in a format suitable for parent and child.

[2124] Input: Answer text

[2125] Output: Formatted answer

[2126] Providing answers and additional content

[2127] Step 1:

[2128] The server sends the formatted answers and related additional content (such as video links and experimental methods) to the device.

[2129] Input: Formatted answers, additional content

[2130] Output: Send to terminal

[2131] Step 2:

[2132] The terminal displays the generated answer and also presents additional related content.

[2133] Input: Formatted answers, additional content

[2134] Output: What is displayed to the user

[2135] Supporting parent-child dialogue

[2136] Step 1:

[2137] The user then has the child read the proposed answer and begin explaining it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[2138] Input: Suggested answer

[2139] Output: Parent-child interaction

[2140] Step 2:

[2141] The device suggests additional questions and topics to encourage dialogue between parent and child.

[2142] Input: Dialogue status

[2143] Output: Additional questions or topics

[2144] Learning history and feedback

[2145] Step 1:

[2146] The server records the learning history of each session in a database.

[2147] Input: Study session data

[2148] Output: Records in the database

[2149] Step 2:

[2150] The server generates a list of suggested new questions and content relevant to the next study session and provides it to the device the next time the user logs in.

[2151] Input: Learning history

[2152] Output: Generate and serve a list of recommendations

[2153] (Application example 1)

[2154] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2155] The modern educational environment does not provide enough opportunities for parents and children to learn together. While there are educational platforms that utilize the internet, there is a lack of learning through actual dialogue and sensory experiences. This results in a gap between theory and practice, making it difficult to maintain deep understanding and interest. Furthermore, there is a lack of systems that promote communication between parents and children while advancing learning.

[2156] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2157] In this invention, the server includes a stepwise authentication and profile creation means, a data input means for receiving and saving questions from users, an answer generation means for generating answers to the questions using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, a virtual experience means for inputting questions while parents and children tour the virtual facility, a dialogue promotion means for promoting dialogue between parents and children, and a history storage and feedback means for recording learning history and providing feedback for the next learning session. This makes it possible to provide an educational environment in which parents and children can learn together and promote deep understanding and dialogue through actual experiences.

[2158] "Multi-step authentication" is a method of verifying a user's identity through multiple steps when accessing a website.

[2159] "Profile creation" is a method of registering a user's personal information, learning history, etc., and creating a user-specific account.

[2160] "Data entry" refers to the act of a user entering questions or information into a system.

[2161] A "generative artificial intelligence model" refers to a system that uses artificial intelligence to generate answers to questions posed by users.

[2162] "Answer generation" is the process of creating appropriate answers to received questions.

[2163] "Presenting" refers to the act of displaying the generated answer and related content to the user.

[2164] "Virtual experience" refers to an experience in which a user engages in activities or sights in a virtual space using virtual reality technology.

[2165] "Promoting dialogue" refers to providing support to stimulate communication between parents and children.

[2166] "History storage" is a means of recording a user's learning history and ensuring that it can be referenced later.

[2167] "Feedback" refers to providing users with evaluations and areas for improvement based on their learning results and history.

[2168] "Virtual facility" refers to a facility for education or tours created using virtual reality technology.

[2169] This invention relates to a virtual science museum guide system that promotes learning between parents and children. This system is realized by combining the following multiple means and processes.

[2170] Overall system configuration

[2171] This system is based on users accessing the virtual reality space via their smartphones or head-mounted displays. The entire system is roughly divided into the server side and the terminal side.

[2172] Hardware and software used

[2173] Server: The system uses a server to store data and run the AI ​​model, which is built on AWS or Google Cloud Platform.

[2174] Database: A MySQL database is used to store user information, questions, answers, and learning history.

[2175] AI model: OpenAI's GPT series is used to generate answers to user questions.

[2176] Devices: Users can access the virtual reality space using an Oculus Quest 2 or an iPhone / Android smartphone.

[2177] Development environment: The virtual reality space is built using Unity, and communication between the server and client is managed using Node.js.

[2178] User authentication and profile creation

[2179] Users first access the system using a smartphone or VR device and enter their login information. This information is sent to the server, where the user information is verified against a MySQL database. If the user is an existing user, an authentication token is generated and sent back to the device. If the user is a new user, a profile creation screen is displayed, where information such as name, age, and interests is entered and saved in the database.

[2180] Enter data and submit questions

[2181] When parents and children visit an exhibit in the virtual museum and become interested in it, the child can enter a question in the text box, which is sent to the server and recorded as a log.

[2182] AI-powered answer generation

[2183] The server passes the received question to a generative AI model, which analyzes the question and generates an answer in a way that is easy for children to understand. The generated answer is then formatted in a way that is suitable for parents and children.

[2184] Providing answers and additional content

[2185] The generated answers and related additional content (e.g., video links and experimental procedures) are sent from the server to the parent and child's devices, where they are displayed on their smartphones or VR devices.

[2186] Supporting parent-child dialogue

[2187] The AI-generated answers will trigger a dialogue between parent and child, and additional questions and topics will be suggested to further the conversation.

[2188] Learning history and feedback

[2189] The server records the learning history of each session, and the next time the user logs in, the server generates a list of suggested new questions and content for the user to review.

[2190] Specific examples

[2191] For example, if a child types a question in the virtual museum such as "Why is the sky blue?", the question is sent to the server. A generative artificial intelligence model (OpenAI's GPT series) analyzes the question and generates the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light." This answer is displayed on the parent and child's devices, along with a link to a video about the scattering of light in the atmosphere and instructions for a simple light experiment that can be done at home. Parents and children can deepen their conversation based on this information.

[2192] Prompt Sentence Examples

[2193] Generate an answer to the question "Why is the sky blue?". The answer should be understandable to a 10-year-old child, and you should also provide additional relevant content (video links and simple experiments).

[2194] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2195] Step 1:

[2196] User authentication and profile creation

[2197] A user accesses the system from a terminal and enters their login information. This information is sent from the terminal to the server. The server accesses the MySQL database and verifies the user information. If the user is an existing user, an authentication token is generated and sent back to the terminal. If the user is a new user, a profile creation screen is displayed on the terminal, where the user enters information such as their name, age, and interests. This information is sent to the server and stored in the database.

[2198] Enter your login details or new profile details

[2199] Output: Authentication token or profile creation confirmation message

[2200] Step 2:

[2201] Virtual museum tour and question entry

[2202] Parents and children access the virtual museum using devices (smartphones or VR devices) and view the exhibits. Children can enter questions about exhibits that interest them in a text box and send them from their devices to the server. The server then records the received questions as a log.

[2203] Input: Virtual museum visit and question text

[2204] Output: Question data recorded on the server

[2205] Step 3:

[2206] AI-powered answer generation

[2207] The server passes the received question to a generative AI model (OpenAI's GPT series). The AI ​​model analyzes the question and generates an answer in a format that is easy for children to understand. The generated answer is then formatted so that it can be sent to the parent and child's device.

[2208] Input: Logged question

[2209] Output: Formatted answer

[2210] Step 4:

[2211] Providing answers and additional content

[2212] The server sends the generated answers and related additional content (e.g., video links and experimental procedures) to the parent and child's devices, which receive them and display them on their smartphones or VR devices.

[2213] Input: Formatted answers and additional content

[2214] Output: Answers and additional content displayed on the terminal

[2215] Step 5:

[2216] Supporting parent-child dialogue

[2217] The child reads the presented answers and explains them to the parent. The server then suggests additional questions and topics to the device to promote dialogue between the parent and child. The parent and child then advance their dialogue based on the topics suggested by the device.

[2218] Input: Suggested answers and additional content

[2219] Output: Additional questions or topics to further the conversation

[2220] Step 6:

[2221] Learning history and feedback

[2222] The server records the history of the learning session and stores it in a database. The next time the user logs in, the server generates a list of relevant new questions and content suggestions based on the previous learning history and sends it to the user's device.

[2223] Input: Training session data

[2224] Output: A list of suggested new questions or content

[2225] These specific processing steps enable parents and children to learn together through a tour of the virtual museum, promoting dialogue and effectively advancing education.

[2226] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2227] This invention is an educational platform that promotes learning between parents and children. This system provides an environment where parents and children can cooperate and deepen their learning through a series of processes, from user authentication and question reception, to emotion recognition using an emotion engine, answer generation using AI, answer presentation, promotion of dialogue between parents and children, and storage and feedback of learning history. Specifically, the system uses the following steps and means:

[2228] User authentication and profile creation

[2229] 1. Users

[2230] Parents and children enter login information using their respective devices.

[2231] 2. Terminal

[2232] Each device sends login information to the server.

[2233] 3. Server

[2234] The server accesses the database to find a user account that matches the entered information, generates an authentication token and returns it to the device, and if the user is a new user, displays a profile creation screen on the device.

[2235] 4. Users

[2236] New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[2237] 5. Terminal

[2238] The entered profile information is sent to the server.

[2239] 6. Server

[2240] The server stores the profile information in a database and sends a message to the device that authentication is complete.

[2241] Question input and emotion recognition

[2242] 1. Users

[2243] A child types a question (e.g., "Why is the sky blue?") into a text box.

[2244] 2. Terminal

[2245] The entered question is sent to the server as text data.

[2246] At this time, sensors such as a camera and microphone built into the device are used to analyze the child's facial expressions and tone of voice, and the information is sent to the emotion engine.

[2247] 3. Server

[2248] The server receives the question and records it as a log, and the emotion engine analyzes the received emotion data. The analysis results are reflected in the generation of answers.

[2249] AI-powered answer generation

[2250] 1. Server

[2251] The server passes the received question and emotion data to the generative artificial intelligence model.

[2252] A generative artificial intelligence model analyzes questions and emotional data, and generates answers that are easy for children to understand and take into account their emotional state.

[2253] 2. Server

[2254] Format the generated answers into a format suitable for parents and children, creating content suitable for both.

[2255] Providing answers and additional content

[2256] 1. Server

[2257] The server sends the generated answer and related additional content (such as video links and experimental methods) to the device.

[2258] 2. Terminal

[2259] The device displays the generated answer and offers additional related content.

[2260] Emotional Engine Feedback

[2261] 1. Users

[2262] The child reads the answers provided and explains them to the parent.

[2263] Parents listen to their children's explanations and then engage in dialogue about further questions and related topics.

[2264] 2. Terminal

[2265] The device suggests questions and topics to encourage dialogue between parent and child.

[2266] 3. Server

[2267] The emotion engine continuously analyzes the user's emotions during the conversation and provides the results as feedback in real time.

[2268] Learning history and feedback

[2269] 1. Server

[2270] The server records the learning history and emotional data for each session and generates a list of suggested new questions and content relevant to the next learning session.

[2271] 2. Terminal

[2272] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[2273] Specific examples

[2274] For example, suppose a child at home types in a question such as, "Why is the sky blue?" This question is sent to a server via the device, and an emotion engine analyzes the child's facial expressions and tone of voice to recognize a state of "excitement." The server then uses a generative AI model to generate the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light," and provides video links and experiment methods to further pique the child's interest.

[2275] The emotion engine continuously monitors the user's emotions during the interaction and suggests questions and topics to encourage dialogue between parent and child. In this way, feedback and learning content based on emotional state are provided, providing an effective means for parents and children to learn and grow together.

[2276] The processing flow will be explained below.

[2277] Step 1:

[2278] Users: Parents and children enter login information using their own devices.

[2279] Step 2:

[2280] Terminal: Each terminal sends login information to the server.

[2281] Step 3:

[2282] Server: The server accesses the database, searches for a user account that matches the entered information, generates an authentication token, and returns it to the device. If the user is a new user, the profile creation screen is displayed on the device.

[2283] Step 4:

[2284] User: New users enter the required information (name, age, interests, etc.) on the profile creation screen.

[2285] Step 5:

[2286] Terminal: Sends the entered profile information to the server.

[2287] Step 6:

[2288] Server: The server stores the profile information in a database and sends a message to the device that authentication is complete.

[2289] Step 7:

[2290] User: Child types a question (e.g., "Why is the sky blue?") into a text box.

[2291] Step 8:

[2292] Terminal: Sends the entered question to the server as text data.

[2293] In addition, sensors such as a camera and microphone built into the device are used to analyze the child's facial expressions and tone of voice, generating emotional data that is then sent to the server.

[2294] Step 9:

[2295] Server: The server receives the query and logs it.

[2296] The server uses an emotion engine to analyze the received emotion data.

[2297] Step 10:

[2298] Server: The server passes the question and emotion data to the generative AI model.

[2299] A generative artificial intelligence model analyzes the question and emotional data and generates an answer that is appropriate to the question and the child's emotions.

[2300] Step 11:

[2301] Server: Formats the generated answers into a format suitable for parents and children, creating content suitable for both.

[2302] Step 12:

[2303] Server: The server sends the generated answers and related additional content (such as video links and experimental methods) to the device.

[2304] Step 13:

[2305] Device: The device displays the generated answer and also suggests additional related content.

[2306] Step 14:

[2307] User: The child reads the given answer and explains it to the parent.

[2308] Parents listen to their children's explanations and then engage in dialogue about further questions and related topics.

[2309] The device analyzes facial expressions and tone of voice during conversation and generates emotional data.

[2310] Step 15:

[2311] Device: Based on emotional data, suggests questions and topics to promote dialogue between parents and children.

[2312] Step 16:

[2313] Server: The server records the learning history of each session, including emotional data during the conversation, and generates a list of suggested new questions and content for the next learning session.

[2314] Step 17:

[2315] On the device: The next time the user logs in, the server-provided recommendation list is displayed to the user.

[2316] Example 2

[2317] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2318] Conventional educational platforms lack the functionality to promote dialogue between parents and children to effectively deepen learning, or to provide appropriate feedback that takes into account their emotional state. They also lack systems that analyze users' emotional state and adjust learning content accordingly. This makes it difficult to increase motivation to learn and facilitate smooth communication between parents and children.

[2319] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2320] In this invention, the server includes a stepwise authentication and profile creation means, a data input means for receiving and saving questions from a user, an answer generation means for generating answers to the questions using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, an emotion recognition means for analyzing the user's emotional state using an emotion recognition engine, a dialogue promotion means for promoting dialogue between parent and child based on the analysis results, and a history storage and feedback means for recording learning history and emotional data and providing feedback the next time the child studies. As a result, when parents and children study together, appropriate feedback that takes into account the emotional state is provided, improving motivation to learn and enabling smooth communication between parent and child.

[2321] A "stepwise authentication method" is a method for verifying the authenticity of a user by going through multiple authentication steps when the user accesses a system.

[2322] The "profile creation means" is a means for a new user to input necessary information when registering with the system and create an individual profile.

[2323] "Data input means" refers to means for accepting questions and other input data from a user and storing it.

[2324] A "generative artificial intelligence model" is an artificial intelligence model used to generate appropriate answers to questions from users.

[2325] The "answer generation means" is a means for generating an answer to a user's question using a generative artificial intelligence model.

[2326] The "presentation means" is a means for presenting the generated answer and related additional content to the user.

[2327] The "emotion recognition means" is a means for analyzing the user's emotional state, and utilizes an emotion recognition engine.

[2328] "Dialogue promotion means" refers to a means for promoting dialogue between parents and children based on the analysis results.

[2329] The "history storage means" is a means for recording learning history and emotional data.

[2330] "Feedback means" refers to a means for providing appropriate feedback the next time the student studies.

[2331] The present invention is an educational platform designed to promote learning between parents and children. The system comprises a step-by-step authentication and profile creation means, a data input means, an answer generation means using a generative artificial intelligence model, a presentation means for presenting the generated answers and related additional content to the user, an emotion recognition means using an emotion recognition engine, a dialogue promotion means, and a history storage and feedback means.

[2332] Hardware and software used

[2333] 1. Hardware

[2334] Devices: PCs, tablets, smartphones, etc. used by users

[2335] Server: Cloud service or on-premise dedicated server

[2336] Sensors: Built-in camera and microphone (to collect emotional data)

[2337] 2. Software

[2338] Authentication system: A system for multi-factor authentication (e.g., OAuth, SAML)

[2339] Database: A database system (e.g., MySQL, PostgreSQL) for storing user information and learning history.

[2340] Generative AI models: AI models that generate answers to questions (e.g., GPT-3, BERT)

[2341] Emotion recognition engine: A system that analyzes the user's facial expressions and tone of voice (e.g., Azure Emotion API, Google Cloud Speech-to-Text)

[2342] Web front end: Web technologies (e.g., HTML, CSS, JavaScript) used to provide the user interface

[2343] System operation explanation

[2344] User authentication and profile creation

[2345] Users (parents and children) use their respective devices to enter their username and password on the login screen. The device sends this information to the server, which searches the database for the corresponding user information. If authentication is successful, for new users, a profile creation screen is displayed. The user enters the required information and sends it to the server to create a profile.

[2346] Question input and emotion recognition

[2347] The user (child) enters a question (e.g., "Why is the sky blue?") and the device sends this information to the server. The device also uses the built-in camera and microphone to analyze the child's facial expressions and tone of voice, and sends emotional data to the server. The server receives the question and emotional data, stores it as a log, and passes it to the emotion engine.

[2348] AI-powered answer generation

[2349] The server uses a generative artificial intelligence model to generate appropriate answers based on the received questions and emotion data, and the answers are formatted in a format suitable for parents and children.

[2350] Providing answers and additional content

[2351] The server sends the generated answers and related additional content (such as video links and experimental methods) to the device, which displays them on the screen and supports parents and children in learning together.

[2352] Emotional Engine Feedback

[2353] The user (child) reads the presented answers and explains them to the parent. The emotion engine analyzes the user's emotions during the conversation and provides real-time feedback, further deepening the dialogue between parent and child.

[2354] Learning history and feedback

[2355] The server records the learning history and emotion data for each session and generates a list of suggestions for new questions and content that are relevant to the next learning session. The next time you log in, the server-provided recommendation list will be displayed.

[2356] Specific examples

[2357] For example, if a child types a question like "Why is the sky blue?", the question is sent to the server via the device. The emotion engine analyzes the child's facial expressions and tone of voice and recognizes their "curious" state. The server then uses a generative AI model to generate the answer, "The sky is blue because sunlight collides with tiny particles in the atmosphere, scattering the blue light," and provides video links and experiment methods to further pique the child's interest. In this way, feedback and learning content based on the child's emotional state are provided, creating an effective means for parents and children to learn and grow together.

[2358] Prompt Sentence Examples

[2359] Please explain in detail your approach to using an emotion engine to generate appropriate answers to science questions that interest children and promote dialogue between parents and children.

[2360] This educational platform provides a new environment for parents and children to deepen their learning together, and utilizes emotion recognition and artificial intelligence to support effective learning and communication.

[2361] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2362] Step 1:

[2363] User

[2364] Parents and children enter login information using their respective devices.

[2365] Input: Username, Password

[2366] Action: Enter the required information on the login screen and click the "Login" button.

[2367] Output: Login information is stored on the device.

[2368] Step 2:

[2369] Terminal

[2370] The login information is sent to the server over a secure channel.

[2371] Input: Username, Password

[2372] What it does: Encrypts the login information you enter and sends it to the server.

[2373] Output: Sends encrypted logging information to the server.

[2374] Step 3:

[2375] server

[2376] The received login information is checked against the database and the authentication result is returned.

[2377] Input: Encrypted login information

[2378] What it does: Decrypts the login information, performs a database query to find a matching user account, generates an authentication token and sends it back to the device.

[2379] Output: Authentication result (success or failure), authentication token

[2380] Step 4:

[2381] Servers and Terminals

[2382] For new users, the profile creation screen will be displayed on the device. For existing users, the device will transition to the main screen.

[2383] Input: Authentication result

[2384] Operation: Upon receiving the authentication result, the profile creation screen is displayed for new users, and the main screen is displayed for existing users.

[2385] Output: Profile creation screen or main screen

[2386] Step 5:

[2387] Users (new users only)

[2388] New users enter the required information on the profile creation screen and submit.

[2389] Input: Profile information such as name, age, interests, etc.

[2390] How it works: Enter the required information into the profile creation form and click the "Submit" button.

[2391] Output: Input profile information

[2392] Step 6:

[2393] Device (new users only)

[2394] The entered profile information is sent to the server.

[2395] Input: Profile information

[2396] Action: Sends profile information to the server.

[2397] Output: The profile information is sent to the server.

[2398] Step 7:

[2399] Server (new users only)

[2400] The profile information is stored in a database and an authentication completion message is sent to the terminal.

[2401] Input: Profile information

[2402] Action: Inserts profile information into the database, generates an authentication completion message, and sends it to the terminal.

[2403] Output: Authentication complete message

[2404] Step 8:

[2405] User

[2406] Children type their questions into the text box.

[2407] Input: Question text (e.g., "Why is the sky blue?")

[2408] Action: Enter a question in the text box and click the submit button.

[2409] Output: The question text entered

[2410] Step 9:

[2411] Terminal

[2412] The entered question is sent to the server as text data, and at the same time emotion data is collected using a camera, microphone, etc. and sent to the emotion engine.

[2413] Input: Question text, emotion data

[2414] How it works: Sends question text to the server, collects emotion data and sends it to the emotion engine.

[2415] Output: Question text sent to the server, emotion data sent to the emotion engine

[2416] Step 10:

[2417] server

[2418] It receives question text and emotion data, records them as a log, and generates answers based on the analysis results of the emotion engine.

[2419] Input: Question text, emotion data

[2420] How it works: The question text is logged, the emotion engine generates analysis results, and then passes them to a generative AI model to generate an answer.

[2421] Output: Generated answer text

[2422] Step 11:

[2423] server

[2424] Format the generated answers and convert them into a format suitable for parents and children.

[2425] Input: Generated answer text

[2426] What it does: Formats the answer text into HTML or other display format.

[2427] Output: Formatted answer content

[2428] Step 12:

[2429] Servers and Terminals

[2430] The generated answer and any associated additional content are sent to the terminal, which displays them.

[2431] Input: Formatted answer content, additional content (video links and experiment methods)

[2432] How it works: The server sends content to the device, which then displays it.

[2433] Output: Displayed answer content and additional content

[2434] Step 13:

[2435] User

[2436] The child reads the provided answer and explains it to the parent, who then listens to the child's explanation and engages in a dialogue about further questions and related topics.

[2437] Input: Proposed answer content

[2438] Actions: Child reads answer, explains to parent, and engages in dialogue.

[2439] Output: Parent-child interaction

[2440] Step 14:

[2441] Terminal

[2442] Suggest questions and topics to encourage dialogue between parents and children.

[2443] Input: Information during the conversation

[2444] What it does: The dialogue assistant displays suggestions at the appropriate time.

[2445] Output: Suggestions to encourage dialogue

[2446] Step 15:

[2447] server

[2448] The emotion engine analyzes the user's emotions during the conversation and provides the results as feedback in real time.

[2449] Input: Emotion data during conversation

[2450] Operation: Performs real-time sentiment analysis, generates feedback messages, and sends them to the device.

[2451] Output: Real-time feedback message

[2452] Step 16:

[2453] server

[2454] It records learning history and emotional data from each session and generates a list of suggested new questions and content that are relevant for the next learning session.

[2455] Input: learning history, emotion data

[2456] What it does: Saves session data to the database and the recommendation engine generates new suggestions.

[2457] Output: Suggestion list

[2458] Step 17:

[2459] Terminal

[2460] The next time the user logs in, the server-provided recommendations list is displayed to the user.

[2461] Input: Suggestion list

[2462] Behavior: Shows recommended content on the redirected screen.

[2463] Output: Displayed recommendation list

[2464] These steps will enable parents and children to learn together and achieve effective learning and communication using emotion recognition and artificial intelligence.

[2465] (Application example 2)

[2466] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2467] Conventional worker education and training systems using factory robots have issues such as slow response to worker questions and problems and insufficient support to reduce stress and anxiety. In particular, there is a need to improve learning efficiency and reduce psychological burden in the work environment.

[2468] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a step-by-step authentication and profile creation means, a data input means for accepting and saving questions from users, a means for generating answers to questions using a generative artificial intelligence model, a means for presenting the generated answers and related additional content to the user, a dialogue promotion means for encouraging dialogue between parents and children, a history storage and feedback means for recording learning history and providing feedback for the next learning session, an emotion recognition means for analyzing the user's emotional state using an emotion engine and reflecting the results in answer generation, and an answer adjustment means for adjusting the tone of the answer based on the analyzed emotional state. This enables effective education and training of workers in factories and reduces their psychological burden.

[2469] "Step-by-step authentication" is a method for strengthening security by requiring a user to go through multiple authentication steps when logging into a system.

[2470] "Profile creation" is the process by which a new user registers with the system and enters the necessary information to generate an individual user profile.

[2471] "Data entry" is the process by which a user enters questions or information into a system and stores that data.

[2472] A "generative artificial intelligence model" is an AI technology that uses natural language processing to generate answers to input questions or information.

[2473] "Presentation" is the process of displaying generated answers and related content to the user.

[2474] "Dialogue promotion" is a function that the system supports to stimulate dialogue between parents and children or between workers.

[2475] "History storage and feedback" is a system that records learning history and dialogue history and provides feedback for the next learning or dialogue.

[2476] "Emotion recognition" is a technology that analyzes a user's facial expressions and tone of voice to determine their emotional state.

[2477] "Response adjustment" is the process of adjusting the tone and expression of the generated response based on the emotion recognition results, and providing it in a form that is appropriate for the user.

[2478] The present invention is a system for supporting the education and training of workers using factory robots. The system includes functions for step-by-step authentication and profile creation, data input for accepting and saving questions from users, generating answers to questions using a generative artificial intelligence model, presenting the generated answers and related additional content to the user, facilitating dialogue, recording learning history, and providing feedback for the next learning session. It also includes a means for emotion recognition using an emotion engine and adjusting the tone of the response based on the analyzed emotional state.

[2479] Configuration and Operation

[2480] The system consists of the following components:

[2481] 1. Step-by-step authentication and profile creation

[2482] The server performs step-by-step authentication when a user logs in and, for new users, provides a profile creation screen.

[2483] 2. Data Entry

[2484] The device receives questions from users and sends them as text data to the server. It also uses the device's camera and microphone to analyze the user's facial expressions and tone of voice, and sends the data to the emotion engine.

[2485] 3. Answer generation

[2486] The server uses a generative artificial intelligence model (e.g., DistilBERT) to generate answers to received questions.

[2487] 4. Presentation

[2488] The terminal displays the generated answers and associated additional content to the user.

[2489] 5. Promoting dialogue

[2490] The server suggests additional questions and topics to encourage interaction between users.

[2491] 6. History and Feedback

[2492] The server records learning history and emotional data and provides feedback to help with future learning and interaction.

[2493] 7. Emotion recognition and response adjustment

[2494] The emotion engine analyzes the user's facial expressions and tone of voice to determine their emotional state. Based on the analysis results, the server adjusts the tone of the generated response to present it in a manner appropriate for the user.

[2495] Specific examples

[2496] For example, suppose a worker inputs a question about how to operate a new piece of equipment. The question is sent via the device to the server, which then uses a generative AI model to generate an answer. The answer is then displayed on the device, along with relevant reference materials and video links. The emotion engine analyzes the worker's facial expressions and tone of voice, and if the worker is feeling stressed or anxious, the server adjusts the tone of the answer to reduce the worker's psychological burden.

[2497] Example prompts for generative AI models

[2498] "Question: How do I operate this new device?\nContext: Explain it in simple steps, don't stress me out."

[2499] This system enables effective education and training of workers within the factory and reduces the psychological burden on workers.

[2500] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2501] Step 1:

[2502] User Login

[2503] The user enters login information. The device sends this login information to the server. The server references the database to find a user account that matches the entered information, generates an authentication token, and sends it back to the device. If the user is a new user, a profile creation screen is displayed on the device.

[2504] Input: User login information

[2505] Output: Authentication token or profile creation screen

[2506] Step 2:

[2507] Profile Creation

[2508] A new user enters necessary information such as name, age, and interests on the profile creation screen. The device sends this profile information to the server. The server stores the profile information in a database and sends a message to the device confirming authentication.

[2509] Input: Profile information

[2510] Output: Message that profile information has been saved

[2511] Step 3:

[2512] Enter your question

[2513] The user enters a question into the text box. The device sends the entered question as text data to the server. At the same time, the device uses sensors such as a camera and microphone built into the device to analyze the user's facial expressions and tone of voice, and sends this emotional data to the emotion engine.

[2514] Input: Question text, facial expression data, tone of voice

[2515] Output: Send question text, send emotion data

[2516] Step 4:

[2517] Emotion recognition and question saving

[2518] The server logs the received questions in a database. The emotion engine analyzes the emotion data and determines the user's emotional state. The analysis results are fed back to the server and reflected in answer generation.

[2519] Input: Question text, emotion data

[2520] Output: Emotional state determination results, questions saved in a database

[2521] Step 5:

[2522] Generate answers

[2523] The server passes the received question and emotion data to a generative AI model (e.g., DistilBERT), which analyzes this information and generates an answer that is easy for the user to understand and takes into account their emotional state.

[2524] Input: Question text, emotion data

[2525] Output: The generated answer

[2526] Step 6:

[2527] Providing an answer

[2528] The server then formats the generated answers appropriately and sends them to the device along with any additional relevant content (e.g., video links and experimental procedures), which is then displayed to the user.

[2529] Input: Generated answers, related content

[2530] Output: Sending answers and related content to your device

[2531] Step 7:

[2532] Promoting dialogue

[2533] The user reads the presented answers and explains them to their parents or fellow workers, and the device suggests additional questions or topics to encourage dialogue between parents and children or fellow workers.

[2534] Input: Generated answers, related content

[2535] Output: Suggested additional questions or topics

[2536] Step 8:

[2537] Learning history storage and feedback

[2538] The server records the learning history and emotion data for each session and provides them as feedback the next time the user logs in. The device displays the recommendation list provided by the server to the user the next time the user logs in.

[2539] Input: learning history, emotion data

[2540] Output: Provide feedback, display recommendation list

[2541] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2542] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2543] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2544] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2545] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2546] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2547] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2548] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2549] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2550] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2551] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2552] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2553] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2554] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2555] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2556] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2557] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2558] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2559] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2560] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2561] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2562] The following is further disclosed regarding the above embodiment.

[2563] (Claim 1)

[2564] An educational platform designed to facilitate parent-child learning together, comprising:

[2565] a step-by-step authentication and profile creation procedure;

[2566] data input means for receiving and storing queries from users;

[2567] an answer generation means for generating answers to questions using a generative artificial intelligence model;

[2568] a presentation means for presenting the generated answer and related additional content to the user;

[2569] Dialogue promotion measures to promote parent-child dialogue;

[2570] a history storage and feedback means for recording the learning history and providing feedback the next time the learning is performed;

[2571] A system including:

[2572] (Claim 2)

[2573] 2. The system according to claim 1, further comprising a suggestion means for suggesting new related questions or content based on the learning history.

[2574] (Claim 3)

[2575] 2. The system according to claim 1, further comprising an answer format changing means for providing answers in a format suited to each of the parent and child based on the profiles of both the parent and child.

[2576] "Example 1"

[2577] (Claim 1)

[2578] a user authentication and profile creation means;

[2579] a data input means for receiving a question from a user as text data and transmitting the same to a server;

[2580] an answer generation means for generating answers to questions using a generative artificial intelligence model;

[2581] a presentation means for presenting the generated answer and related additional content to the user;

[2582] A dialogue promotion tool that suggests topics to encourage dialogue bet...

Claims

1. An educational platform designed to facilitate parent-child learning together, comprising: a step-by-step authentication and profile creation procedure; data input means for receiving and storing queries from users; an answer generation means for generating answers to questions using a generative artificial intelligence model; a presentation means for presenting the generated answer and related additional content to the user; Dialogue promotion measures to promote parent-child dialogue; a history storage and feedback means for recording a learning history and providing feedback the next time the learning is performed; A system including:

2. The system according to claim 1 , further comprising a suggestion means for suggesting new related questions or content based on the learning history.

3. 2. The system according to claim 1, further comprising an answer format changing means for providing answers in a format suited to each of the parent and child based on the profiles of both the parent and child.

Images