System

Abstract

A system is provided.SOLUTION: The system includes a generation and AI means for generating appropriate educational contents on the basis of the learning history of the user, a means for providing the generated educational contents to the user, and a means for collecting feedback information from the user and reflecting it on the next content provision.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Families with children who are not attending school face the challenge of insufficient educational continuity and psychological support, resulting in inadequate academic improvement and mental health care for their children. Furthermore, children tend to become isolated, raising concerns about a decline in their social and communication skills. Conventional educational systems and psychological support rely on specific times and places, making it difficult to meet these needs. The purpose of this invention is to provide a new method for reducing the anxiety and stress felt by children who are not attending school and promoting their learning progress. [Means for solving the problem]

[0005] The present invention provides a system including a generation AI means for generating appropriate educational content based on a user's learning history, a means for providing the generated educational content to the user, and a means for collecting feedback information from the user and reflecting it in the next content provision. The system also includes a generation AI means for analyzing the user's psychological state and providing appropriate interactive therapy, and a means for anonymizing and saving the content of the interactive therapy and reflecting it in the next therapy session. These problems are further solved by providing a means for acquiring detailed information about the workshop selected by the user and managing reservation information, a means for sending confirmation messages and reminder emails after a reservation is made, and a means for collecting feedback information after the workshop is completed and utilizing it to improve future workshops.

[0006] "Users" refer to children and their guardians who use this system.

[0007] "Learning history" refers to the record of learning activities that a user has performed on this system.

[0008] "Educational content" includes learning materials and educational resources generated by generative AI.

[0009] "Generative AI" refers to artificial intelligence technology that analyzes a user's individual learning history and psychological state to generate appropriate educational content or interactive therapy.

[0010] "Feedback information" refers to evaluations and comments provided by users after completing learning or therapy.

[0011] "Conversational therapy" refers to a counseling-style method in which generative AI provides psychological support through dialogue with the user.

[0012] "Workshop" refers to a group activity or training session designed to improve social and communication skills.

[0013] "Reservation information" refers to a record of the date, time, and detailed information for a user to participate in a specific workshop.

[0014] "Confirmation Message" refers to the confirmation notification sent to a user when a reservation is completed.

[0015] "Reminder Email" refers to a reminder notice sent to a User prior to the scheduled Workshop.

[0016] "Anonymization" refers to the process of removing or modifying personal information so that users can no longer be identified.

[0017] "Database" refers to an information system for centrally managing users' learning history, feedback information, reservation information, etc. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9]1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] The present invention is a system that provides new educational tools and psychological support to families with children who are not attending school. This system utilizes generative AI to provide personalized educational content and interactive therapy based on the user's learning history and psychological state. A specific embodiment of this system is described below.

[0040] 1. User authentication module

[0041] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[0042] 2. Educational content provision module

[0043] After logging in to their personal page, the user (child) accesses the educational content page. The server calls the generation AI to generate appropriate educational content based on the user's learning history and interests. The generated educational content ranges from video learning materials to interactive workbooks. Once the user has finished learning, feedback information is collected and reflected the next time content is provided.

[0044] 3. Interactive Therapy Module

[0045] When a user (child or guardian) accesses the psychological support page, the server launches an interactive generation AI to generate an initial conversation message. The user enters and sends a message about the worries or stress they want to discuss, and the server sends the message to the generation AI. The generation AI generates appropriate advice and provides it to the user via the server. The content of the conversation is anonymized and saved, and is reflected in the next therapy session.

[0046] 4. Workshop Management Module

[0047] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[0048] Specific examples

[0049] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generation AI to generate an educational math video based on the child's past learning history. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[0050] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue with the AI. For example, if they are worried about their friendships at school, they can enter their concerns and receive appropriate advice from the AI. The content of this dialogue is anonymized and reflected in the next therapy session.

[0051] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[0052] In this way, the present invention provides new educational tools and psychological support to families with children who are not attending school, and provides comprehensive support for children's learning and mental health.

[0053] The processing flow will be explained below.

[0054] 1. User authentication module

[0055] Processing Steps

[0056] Step 1:

[0057] The user accesses the login screen.

[0058] Step 2:

[0059] The server sends the HTML of the login page to the client.

[0060] Step 3:

[0061] The user enters the user ID and password and clicks the submit button.

[0062] Step 4:

[0063] The terminal sends the input information to the server as a POST request.

[0064] Step 5:

[0065] The server queries the database for the received user ID and password to verify the authentication information.

[0066] Step 6:

[0067] If the server has matching credentials, it starts a session and generates an authentication token.

[0068] Step 7:

[0069] The server sends the authentication token to the user's device and returns the HTML of the My Page as a response.

[0070] Step 8:

[0071] The user is redirected to their My Page and login is complete.

[0072] 2. Educational content provision module

[0073] Processing Steps

[0074] Step 1:

[0075] After the user (child) logs in to their My Page, they access the educational content page.

[0076] Step 2:

[0077] The server sends the HTML of the educational content page to the client.

[0078] Step 3:

[0079] The user clicks the "Start Learning" button.

[0080] Step 4:

[0081] The terminal sends the information to the server as a request.

[0082] Step 5:

[0083] The server calls the generation AI and generates appropriate educational content based on the user's learning history and interests.

[0084] Step 6:

[0085] The generative AI generates appropriate educational content (e.g., video teaching materials for mathematics) and sends the information back to the server.

[0086] Step 7:

[0087] The server transmits the generated content to the user terminal.

[0088] Step 8:

[0089] After the user has finished studying the content, they click the "Feedback" button.

[0090] Step 9:

[0091] The terminal sends feedback information to the server.

[0092] Step 10:

[0093] The server stores the feedback in a database and uses it to suggest content next time.

[0094] 3. Interactive Therapy Module

[0095] Processing Steps

[0096] Step 1:

[0097] The user (child or guardian) accesses the psychological support page.

[0098] Step 2:

[0099] The server sends the HTML of the psychological support page to the client.

[0100] Step 3:

[0101] The user clicks the "Start conversation" button.

[0102] Step 4:

[0103] The terminal sends the information to the server as a request.

[0104] Step 5:

[0105] The server calls the dialogue generation AI (therapy module) and asks it to generate the initial dialogue message.

[0106] Step 6:

[0107] The generation AI generates the initial dialogue message and sends that information back to the server.

[0108] Step 7:

[0109] The server sends the generated message to the user terminal.

[0110] Step 8:

[0111] The user initiates a dialogue with the AI ​​and inputs a message about a specific concern or stress.

[0112] Step 9:

[0113] The terminal sends the message to the server.

[0114] Step 10:

[0115] The server then asks the generation AI to analyze the message and generate appropriate advice.

[0116] Step 11:

[0117] The generation AI generates advice and sends the information back to the server.

[0118] Step 12:

[0119] The server transmits the generated advice message to the user terminal.

[0120] Step 13:

[0121] The server anonymizes the conversation and stores it in a database.

[0122] 4. Workshop Management Module

[0123] Processing Steps

[0124] Step 1:

[0125] A user visits the workshop listing page.

[0126] Step 2:

[0127] The server retrieves available workshops and sends the HTML of the list page to the client.

[0128] Step 3:

[0129] The user selects the workshop they wish to participate in and clicks the "Apply for Participation" button.

[0130] Step 4:

[0131] The device sends a request to the server containing the selected workshop ID.

[0132] Step 5:

[0133] The server retrieves detailed information about the selected workshop from the database and displays a reservation screen for the user.

[0134] Step 6:

[0135] The user enters the reservation information (date, time and additional details) and clicks submit.

[0136] Step 7:

[0137] The terminal sends the reservation information to the server as a POST request.

[0138] Step 8:

[0139] The server stores the reservation information in a database and generates a reservation confirmation message.

[0140] Step 9:

[0141] The server sends a reservation confirmation message to the user terminal and simultaneously sends a reminder email.

[0142] Step 10:

[0143] After the workshop is over, users can access the feedback page and enter their impressions and ratings.

[0144] Step 11:

[0145] The terminal sends feedback information to the server.

[0146] Step 12:

[0147] The server stores the feedback in a database and uses it to improve future workshops.

[0148] This shows a concrete process flow for providing comprehensive educational support and psychological support to families with children who are not attending school.

[0149] Example 1

[0150] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0151] Traditional educational and psychological support systems lacked the flexibility to respond to individual needs, making it difficult to provide sufficient academic and psychological support to families with children who were not attending school. Furthermore, the process of collecting feedback and reflecting it in the next content offering was inefficient, and the procedures for booking and participating in workshops were complicated.

[0152] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0153] In this invention, the server includes a means for accepting and authenticating user input information, a means for generating appropriate educational content using a generation AI based on the user's learning history, and a means for providing the generated educational content to the user. This makes it possible to provide educational content customized for each user and further improve the next educational content based on the results.

[0154] The server further includes a means for collecting feedback information from users and reflecting it in the next content provision, a means for analyzing the psychological state of the user and providing appropriate interactive therapy using a generation AI, a means for anonymizing and saving the content of the interactive therapy and reflecting it in the next therapy session, a means for acquiring detailed information about the workshop selected by the user and managing reservation information, a means for sending a confirmation message and a reminder email after a reservation is made, and a means for collecting feedback information after the workshop ends and using it to improve future workshops.This makes it possible to provide comprehensive support that meets the individual needs of users and improve the quality of education and psychological support.

[0155] "Users" refers to people who use this system, and primarily includes children who are not attending school and their parents.

[0156] "Educational content" refers to various learning resources such as teaching materials, workbooks, and videos that users can use to study.

[0157] "Generative AI" refers to an artificial intelligence model that generates appropriate educational content or interactive therapy based on user information.

[0158] "Feedback information" refers to information such as evaluations, impressions, and learning outcomes provided by users after using content or services.

[0159] "Conversational therapy" refers to a form of therapy in which the user and generative AI provide psychological support and advice through dialogue.

[0160] "Mental state" refers to the user's mental and emotional state, and serves as basic data for the generation AI to analyze and provide appropriate advice.

[0161] "Workshop" refers to a group activity or educational session based on a specific theme that users can book in advance to attend.

[0162] "Reservation Information" refers to data related to a reservation, such as the date, time, and personal information provided by a User to participate in a Workshop.

[0163] A "reminder email" refers to a notification email sent to users before the start of a workshop, and is used to reconfirm the participation date and time, etc.

[0164] This invention relates to a system that provides new educational tools and psychological support to families with children who are not attending school. The system utilizes generative AI models to provide personalized educational content and interactive therapy based on the user's learning history and psychological state.

[0165] This system uses the following hardware and software:

[0166] Devices: PCs, smartphones, tablets, etc.

[0167] Server: Web server (e.g. Apache, Nginx)

[0168] Database: MySQL, PostgreSQL, etc.

[0169] Generative AI models: GPT-3, etc.

[0170] When a user accesses the system, they first enter their login information using a terminal. The terminal then sends the entered user ID and password to the server. The server queries the database for this information, and if there is a matching record, the authentication is successful and the session begins. If the authentication is successful, the server sends the HTML of the user's personal page to the user.

[0171] When a user logs in to their personal page and accesses the educational content page, the server invokes the generative AI model to generate appropriate educational content based on the user's learning history and interests. This generated educational content ranges from video learning materials to interactive question sets. After the user has completed their learning, feedback information is collected and reflected in the next content provision.

[0172] Additionally, when a user accesses the psychological support page, the server activates an interactive generative AI model to generate an initial dialogue message. The user enters and sends a message about the worries or stress they want to discuss, and the server sends the message to the generative AI. The generative AI then generates appropriate advice and provides it to the user via the server. The content of the dialogue is anonymized and saved, and is reflected in the next therapy session.

[0173] Furthermore, when a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, after the workshop ends, feedback information is collected from the user and used to improve future workshops.

[0174] As a concrete example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generation AI to generate an educational math video based on the child's past learning history. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[0175] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue with the AI. For example, if they are worried about their friendships at school, they can enter their concerns and receive appropriate advice from the AI. The content of this dialogue is anonymized and reflected in the next therapy session.

[0176] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[0177] An example of a prompt is:

[0178] Educational content generation: "Create an educational video for math for a 10-year-old. Make it interesting and take into account their learning history."

[0179] Talking Therapy: "My 10-year-old is having trouble with friendships at school. Please provide some appropriate advice."

[0180] In this way, this system provides new educational tools and psychological support to families with children who are not attending school, providing comprehensive support for children's learning and mental health.

[0181] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0182] User Authentication Module

[0183] Step 1:

[0184] A user enters a user ID and password on the login page. The inputs provided are "user123" and "password789".

[0185] Step 2:

[0186] The device sends this input information to the server using the HTTPS protocol, where it is encrypted using SSL / TLS.

[0187] Step 3:

[0188] The server queries the database to verify that the entered user ID and password are correct. Specifically, it uses an SQL query to find the corresponding user record. Based on this query, the authentication result (success or failure) is returned.

[0189] Step 4:

[0190] The server returns the authentication result, and if the input information is correct, it returns a message indicating successful authentication. If the information is invalid, it returns an error message. If authentication is successful, a session ID is generated and saved in the session database along with the user information.

[0191] Step 5:

[0192] The server starts a session, generates a personal page for the user in HTML format, and sends it to the terminal using the HTTPS protocol. The HTML document is then output.

[0193] Educational content provision module

[0194] Step 1:

[0195] A user accesses the educational content page from My Page. An "access request to the educational content page" is provided as input.

[0196] Step 2:

[0197] The server calls a generative AI model (e.g., GPT-3) and generates new educational content based on the user's learning history (past lesson plans and areas of strength and weakness). This generation uses the input learning history data and generated data from the generative AI model to output optimal educational content. Specifically, the prompt used is, "Generate an educational math video for a 10-year-old child. Please take their past learning history into consideration and make the content interesting."

[0198] Step 3:

[0199] The server provides the generated educational content to users in the form of HTML pages or video files. This content can be in a variety of formats, such as videos, interactive questions, or quizzes. The output is the "generated educational content."

[0200] Step 4:

[0201] View or consume user-generated educational content, for example, watching a 20-minute math video and completing an interactive quiz.

[0202] Step 5:

[0203] The user inputs feedback about the content (e.g., difficulty, comprehension, interest). Feedback information is provided as input.

[0204] Step 6:

[0205] The device sends feedback information to the server via an HTTP POST request. The feedback data is sent in JSON format, and the server stores it in a database. The feedback information is saved as output.

[0206] Interactive Therapy Module

[0207] Step 1:

[0208] A user (child or guardian) accesses the psychological support page. A "request to access the psychological support page" is provided as input.

[0209] Step 2:

[0210] The server runs a generative conversational AI model (e.g., GPT-3), generates an initial conversation message (e.g., "Hello, what would you like to talk about today?"), and sends it to the user as an HTML page. The initial conversation message is provided as output.

[0211] Step 3:

[0212] The user inputs their worries or stress. As input, a "message about worries or stress" is provided. For example, the user might input, "I got into a fight with a friend at school and I don't know what to do."

[0213] Step 4:

[0214] The server sends the user's input message to the AI ​​generator, which then generates appropriate advice. The AI ​​then uses past dialogue data and psychological knowledge to create a reply. The output is "appropriate advice."

[0215] Step 5:

[0216] The server sends the generated advice to the user. For example, advice such as "If you get into a fight with a friend, it's important to calm down and sort out your feelings" is sent in HTML format. The "generated advice" is provided as output.

[0217] Step 6:

[0218] The server anonymizes the conversation content, stores it in a database, and reflects it in the next therapy session. The server outputs the "anonymized conversation content."

[0219] Workshop Management Module

[0220] Step 1:

[0221] A user accesses the workshop listing page. A "request to access the workshop listing page" is provided as input.

[0222] Step 2:

[0223] The server retrieves the currently available workshop information from the database and displays it in HTML format. The output provided is "Workshop Information."

[0224] Step 3:

[0225] The user selects the workshop they wish to attend, enters the necessary information (name, desired date and time of attendance, etc.), and presses the reservation button. The "reservation information" is provided as input.

[0226] Step 4:

[0227] The server saves the reservation information to the database. The data is inserted into the reservation table using an SQL query. The output is provided as "Saved Reservation Information".

[0228] Step 5:

[0229] After the reservation is complete, the server generates a reservation confirmation message (e.g., "Thank you for your reservation. The date and time you will attend the workshop is ____.") and sends it to the user. The "reservation confirmation message" is provided as an output.

[0230] Step 6:

[0231] Before the workshop starts, the server sends a reminder email. For example, it sends a reminder email the day before the workshop starts. The output is "Reminder Email".

[0232] Step 7:

[0233] After the workshop, the server collects feedback from users and stores it in a database. This information is used to improve the content of the next workshop. The input is "feedback information," and the output is "saved feedback information."

[0234] In this way, the system can continue to provide personalized educational content and psychological support to children who are not attending school and their families.

[0235] (Application example 1)

[0236] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0237] In modern society, the number of families with children who do not attend school is increasing, and new educational methods and psychological support are needed to address this issue, but the current system is not sufficient.In addition, there are no means to provide support to these children in physical stores, so a system that allows them to receive effective support even while visiting a physical store is needed.

[0238] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0239] In this invention, the server includes a generating AI means for generating appropriate educational content based on the user's learning history, a means for providing the generated educational content to the user, a means for collecting feedback information from the user and reflecting it in the next content provision, and a means for displaying information on a guidance device in a physical store and providing information about learning spaces and educational events. This makes it possible to provide personalized educational support and psychological support to children who are not attending school even in a physical store.

[0240] "Generative AI means" are means that use artificial intelligence to automatically generate appropriate educational content and psychological support based on the user's learning history and interests.

[0241] The "means for providing educational content" refers to a device or software for visually or audibly providing the generated educational content to the user.

[0242] The "means for collecting feedback information" is a system that collects evaluations and impressions of the learning or therapy provided by the user after use and reflects them in the content of the next service.

[0243] "In-store guidance devices" refer to devices such as robots and tablets installed in physical stores that display information and provide guidance to visitors.

[0244] "Means for providing information about learning spaces and educational events" is a system for providing visitors with information about learning spaces and educational events available within physical stores and encouraging participation.

[0245] The "means for providing information about psychological support services" is a system that provides users with information about psychological support services that can be used online through information devices in physical stores, and promotes their use.

[0246] The "means for supporting participation in workshops" is a system that uses a guidance device in a physical store to obtain detailed information about workshops that the user is interested in and supports them in making reservations to participate.

[0247] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school, and is implemented using guidance devices installed in physical stores. This system is broadly composed of four modules: a user authentication module, an educational content provision module, a dialogue therapy module, and a workshop management module.

[0248] First, in the user authentication module, when a user accesses the system, they enter their login information into a terminal installed in the physical store. The login information is sent to the server, which then queries the database for authentication. If authentication is successful, the user can proceed to the next step.

[0249] Next, in the educational content provision module, a generative AI generates appropriate educational content based on the authenticated user's learning history. This generative AI uses a model such as OpenAI GPT-4. The generated educational content is provided through guidance devices (e.g., robots or tablets) in the physical store, allowing users to receive appropriate learning materials and continue their learning. After learning, users input feedback information, which is collected by the server and reflected in the next content provision.

[0250] In the interactive therapy module, if a user needs psychological support, they can interact with the generative AI via a guide device in a physical store. When the user inputs their worries or stress, the server sends the information to the generative AI, which generates appropriate advice. This generative AI model uses a powerful model capable of natural language processing. The content of the conversation is anonymized and reflected in the next therapy session.

[0251] The workshop management module allows users to obtain detailed information about the workshop they wish to participate in through the information device in the physical store and make a reservation to participate. The server stores the reservation information in a database and sends confirmation messages and reminder emails. In addition, feedback information is collected after the workshop is completed, which is used to improve future workshops.

[0252] Hardware used:

[0253] Guidance devices in physical stores (robots and tablets)

[0254] server

[0255] Database

[0256] Software used:

[0257] Pepper SDK (used for robot control systems)

[0258] OpenAI GPT-4 (generative AI model)

[0259] Apache or NGINX (web server)

[0260] MySQL or PostgreSQL (database)

[0261] Specific examples

[0262] 1. Providing educational content

[0263] Sample prompt: "Generate the best math learning materials based on your past learning history. Create video materials at a 5th grade level that fit your current learning progress."

[0264] 2. Dialogic Therapy Responses

[0265] Sample prompt: "A 10-year-old child is asking for advice about friendships at school. Please provide appropriate advice."

[0266] 3. Workshop Management Guide

[0267] Example prompt: "Write a script that provides detailed information about an online workshop next Saturday and takes reservations for participants."

[0268] This system will enable children who are not attending school to receive individualized educational and psychological support even within a physical store, providing an environment where they can receive learning and psychological support.

[0269] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0270] Step 1:

[0271] The user enters login information into the information device in the physical store. The user ID and password are used as input data, which are sent from the terminal to the server. The server receives this information and queries the database to perform authentication. If authentication is successful, the server generates a message indicating successful authentication and sends it to the terminal.

[0272] Step 2:

[0273] After authenticating, the user requests educational content. The request is sent from the device to the server, which retrieves the user's learning history data from a database. The server then invokes a generative AI model (e.g., OpenAI GPT-4) and passes the prompt sentence to the generative AI model to generate appropriate educational content. The generated educational content is then sent back to the server, which then sends it to the device.

[0274] Step 3:

[0275] The user receives the educational content generated on the device and studies it. After studying, the user enters feedback information into the device. The entered feedback information is sent from the device to the server, which stores it in a database. The feedback information is used the next time content is generated.

[0276] Step 4:

[0277] When a user needs psychological support, they access the psychological support page through their device and enter their worries and stress. The entered data is sent to the server, which then sends prompts to the generative AI model, causing it to generate appropriate interactive therapy content. The generated dialogue message is then sent back to the server, which then sends it to the device.

[0278] Step 5:

[0279] The user receives the content of the interactive therapy and receives support. The user can continue to enter additional feedback or questions as needed. The content of the conversation is anonymized on the server side and stored in a database. It will be reflected in the next therapy session.

[0280] Step 6:

[0281] When a user wishes to participate in a workshop, they access the workshop list page from their device, select the workshop they wish to attend, and enter their reservation information. The entered reservation information is sent from the device to the server, which stores it in a database. The server also generates a confirmation message and a reminder email and sends them to the user's registered email address.

[0282] Step 7:

[0283] After the workshop, users input feedback information through their devices. The information is then sent to the server, which stores it in a database. This information is used to improve future workshops.

[0284] Each of the above steps works as an ongoing process, providing a comprehensive system of education and psychological support within the brick-and-mortar store.

[0285] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0286] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school. This system utilizes generative AI and an emotion engine to provide personalized educational content and interactive therapy based on the user's learning history, psychological state, and emotional information. A specific embodiment of this system is described below.

[0287] 1. User authentication module

[0288] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[0289] 2. Educational content provision module

[0290] After logging in to their personal page, the user (child) accesses the educational content page. The server calls the generation AI to generate appropriate educational content based on the user's learning history and emotional information obtained by the emotion engine. The generated educational content ranges from video learning materials to interactive workbooks. Once the user has finished learning, feedback information is collected and reflected the next time content is provided.

[0291] 3. Interactive Therapy Module

[0292] When a user (child or guardian) accesses the psychological support page, the server activates the dialogue generation AI and emotion engine to generate an initial dialogue message. When the user enters and sends a message about the worries or stress they want to discuss, the server sends the message and the user's emotional information to the generation AI. The generation AI generates appropriate advice and provides it to the user via the server. The dialogue content and emotional information are anonymized and saved, and are reflected in the next therapy session.

[0293] 4. Workshop Management Module

[0294] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[0295] 5. Emotion Recognition by Emotion Engine

[0296] During the processing of each module, the emotion engine constantly analyzes the user's emotions. For example, the educational content provision module analyzes the user's facial expressions and tone of voice while learning to understand their level of concentration and emotional state. Based on this information, the generative AI creates more appropriate content.

[0297] Specific examples

[0298] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server activates the generative AI and emotion engine to generate an educational math video based on the child's past learning history and current emotional state. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[0299] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue between the generative AI and the emotion engine. For example, if the user is worried about friendships at school, they can enter their emotional information along with the details of their worries, and receive appropriate advice from the generative AI. The content of this dialogue and emotional information are anonymized and reflected in the next therapy session.

[0300] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[0301] In this way, this invention provides new educational tools and psychological support to families with children who are not attending school, comprehensively supporting children's learning and mental health. By combining generative AI with an emotion engine, a more personalized approach can be achieved, increasing user satisfaction.

[0302] The processing flow will be explained below.

[0303] 1. User authentication module

[0304] Processing Steps

[0305] Step 1:

[0306] The user accesses the login screen.

[0307] Step 2:

[0308] The server sends the HTML of the login page to the client.

[0309] Step 3:

[0310] The user enters the user ID and password and clicks the submit button.

[0311] Step 4:

[0312] The terminal sends the input information to the server as a POST request.

[0313] Step 5:

[0314] The server queries the database for the received user ID and password to verify the authentication information.

[0315] Step 6:

[0316] If the server has matching credentials, it starts a session and generates an authentication token.

[0317] Step 7:

[0318] The server sends the authentication token to the user's device and returns the HTML of the My Page as a response.

[0319] Step 8:

[0320] The user is redirected to their My Page and login is complete.

[0321] 2. Educational content provision module

[0322] Processing Steps

[0323] Step 1:

[0324] After the user (child) logs in to their My Page, they access the educational content page.

[0325] Step 2:

[0326] The server sends the HTML of the educational content page to the client.

[0327] Step 3:

[0328] The user clicks the "Start Learning" button.

[0329] Step 4:

[0330] The terminal sends the information to the server as a request.

[0331] Step 5:

[0332] The server calls the generation AI and emotion engine to generate appropriate educational content based on the user's learning history and emotional information.

[0333] Step 6:

[0334] The generative AI generates appropriate educational content (e.g., video teaching materials for mathematics) and sends the information back to the server.

[0335] Step 7:

[0336] The server transmits the generated content to the user terminal.

[0337] Step 8:

[0338] After the user has finished studying the content, they click the "Feedback" button.

[0339] Step 9:

[0340] The device sends feedback information (such as learning satisfaction and emotional state during learning) to the server.

[0341] Step 10:

[0342] The server stores the feedback in a database and uses it to suggest content next time.

[0343] 3. Interactive Therapy Module

[0344] Processing Steps

[0345] Step 1:

[0346] The user (child or guardian) accesses the psychological support page.

[0347] Step 2:

[0348] The server sends the HTML of the psychological support page to the client.

[0349] Step 3:

[0350] The user clicks the "Start conversation" button.

[0351] Step 4:

[0352] The terminal sends the information to the server as a request.

[0353] Step 5:

[0354] The server calls the dialogue generation AI and emotion engine and asks them to generate the initial dialogue message.

[0355] Step 6:

[0356] The generation AI generates the initial dialogue message and sends that information back to the server.

[0357] Step 7:

[0358] The server sends the generated message to the user terminal.

[0359] Step 8:

[0360] The user initiates a dialogue with the AI ​​and inputs a message about a specific concern or stress.

[0361] Step 9:

[0362] The terminal sends the message to the server.

[0363] Step 10:

[0364] The emotion engine analyzes the emotional state (e.g., sadness or anxiety) from the message entered by the user.

[0365] Step 11:

[0366] The server sends the message and emotional state to the generation AI and asks it to generate appropriate advice.

[0367] Step 12:

[0368] The generation AI generates advice and sends the information back to the server.

[0369] Step 13:

[0370] The server transmits the generated advice message to the user terminal.

[0371] Step 14:

[0372] The server anonymizes the dialogue content and emotional information and stores it in a database.

[0373] 4. Workshop Management Module

[0374] Processing Steps

[0375] Step 1:

[0376] A user visits the workshop listing page.

[0377] Step 2:

[0378] The server retrieves available workshops and sends the HTML of the list page to the client.

[0379] Step 3:

[0380] The user selects the workshop they wish to participate in and clicks the "Apply for Participation" button.

[0381] Step 4:

[0382] The device sends a request to the server containing the selected workshop ID.

[0383] Step 5:

[0384] The server retrieves detailed information about the selected workshop from the database and displays a reservation screen for the user.

[0385] Step 6:

[0386] The user enters the reservation information (date, time and additional details) and clicks submit.

[0387] Step 7:

[0388] The terminal sends the reservation information to the server as a POST request.

[0389] Step 8:

[0390] The server stores the reservation information in a database and generates a reservation confirmation message.

[0391] Step 9:

[0392] The server sends a reservation confirmation message to the user terminal and simultaneously sends a reminder email.

[0393] Step 10:

[0394] After the workshop is over, users can access the feedback page and enter their impressions and ratings.

[0395] Step 11:

[0396] The terminal sends feedback information to the server.

[0397] Step 12:

[0398] The server stores the feedback in a database and uses it to improve future workshops.

[0399] 5. Emotion Recognition by Emotion Engine

[0400] Processing Steps

[0401] Step 1:

[0402] The server activates an emotion engine and analyzes the user's emotions in real time.

[0403] Step 2:

[0404] The device transmits the user's facial expressions and voice to the emotion engine via the camera and microphone.

[0405] Step 3:

[0406] An emotion engine analyzes the user's emotional state (e.g., joy, surprise, sadness).

[0407] Step 4:

[0408] The server sends this emotional information to the generation AI and other modules, which then reflect it in their respective processing.

[0409] Step 5:

[0410] The emotion engine anonymizes the user's emotional data and stores it in a database for future learning and therapy sessions.

[0411] Example 2

[0412] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0413] In today's education system, it is difficult to provide personalized educational methods and psychological support to children who are refusing to go to school. In particular, traditional educational content rarely takes into account children's learning history or emotional state, making it difficult to support efficient learning. Furthermore, there is a lack of systems for providing appropriate interactive therapy to children with psychological problems. Furthermore, there are challenges in efficiently managing workshops to improve social skills and collecting feedback.

[0414] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0415] In this invention, the server includes a means for performing authentication based on the user's login information, a generation AI means for generating appropriate educational content based on the user's learning history and emotional state, a means for providing the generated educational content to the user, a means for collecting feedback information from the user and reflecting it in the next content provision, and a means for analyzing the user's emotional information and reflecting it in the educational content. This makes it possible to provide personalized educational content and psychological support to children who are not attending school, and to comprehensively support the children's learning effectiveness and mental health.

[0416] "User login information" refers to the identification information required for a user to access a system, and generally refers to a combination of a user ID and password.

[0417] "Authentication methods" refers to the processes and functions used to verify a user's login information and confirm their access rights to a system.

[0418] "Study history" is data that records the user's past learning content and progress.

[0419] "Emotional state" refers to the emotional response or psychological state a user exhibits at a particular point in time.

[0420] "Generative AI means" refers to processes and functions that use artificial intelligence to generate personalized educational content or interactive therapy based on a user's learning history and emotional state.

[0421] "Educational content" refers to materials such as teaching materials, workbooks, and videos that users use for learning.

[0422] "Feedback information" refers to opinions and evaluations provided by users regarding educational content, workshops, etc.

[0423] "Emotional information" refers to the user's emotional data and information analyzed by the emotion engine.

[0424] "Interactive therapy" refers to the process and functionality of providing interactive counseling and advice to assist a user with their psychological condition.

[0425] "Workshop" refers to an online or offline session organized for a specific learning or activity purpose.

[0426] "Reservation Information" refers to the dates and participant information provided by a User to participate in a particular workshop or seminar.

[0427] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school. The system utilizes generative AI and an emotion engine to provide personalized educational content and interactive therapy based on the user's learning history, psychological state, and emotional information. A specific embodiment of this system is described below.

[0428] 1. User authentication module

[0429] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[0430] 2. Educational content provision module

[0431] After logging in to their personal page, the user (child) accesses the educational content page. The server launches the generation AI, specifically using OpenAI's GPT-3 and EmotionAnalyzer as an emotion engine. This generates appropriate educational content based on the user's learning history and emotional information. The generated educational content ranges from video learning materials to interactive workbooks. When the user has finished learning, feedback information is sent from the device to the server, and is reflected the next time content is provided. A specific example of a prompt is as follows:

[0432] "Generate educational content for mathematics suitable for a 10-year-old child. Create video materials that are fun to learn based on their past learning history and current emotional state."

[0433] 3. Interactive Therapy Module

[0434] When a user (child or guardian) accesses the psychological support page, the server launches the interactive generation AI. Specifically, ChatGPT and EmotionAnalyzer are used to generate the initial conversation message. When the user enters and sends a message about the worries or stress they want to discuss, the server sends the message and the user's emotional information to the generation AI. The generation AI then generates appropriate advice and provides it to the user via the server. The content of the conversation and emotional information are anonymized and saved, and will be reflected in the next therapy session. Specific examples of prompts are as follows:

[0435] "Please advise the user if they are having trouble with friendships at school. Their recent emotional state is unsettling."

[0436] 4. Workshop Management Module

[0437] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[0438] 5. Emotion Recognition by Emotion Engine

[0439] During the processing of each module, the emotion engine, EmotionAnalyzer, constantly analyzes the user's emotions. For example, the educational content provision module analyzes the user's facial expressions and tone of voice while learning to understand their level of concentration and emotional state. Based on this information, the generative AI creates more appropriate content. The emotional information collected by the emotion engine is stored in a database and used for future improvements and customization.

[0440] Specific examples

[0441] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generative AI (GPT-3) and an emotion engine (EmotionAnalyzer) to generate an educational math video based on the child's past learning history and current emotional state. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[0442] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses the psychological support page and initiates a dialogue between the generative AI (ChatGPT) and the emotion engine (EmotionAnalyzer). For example, if the user is worried about friendships at school, they can enter their emotional information along with the details of their worries, and receive appropriate advice from the generative AI. The content of this dialogue and emotional information are anonymized and reflected in the next therapy session.

[0443] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[0444] In this way, this invention provides new educational tools and psychological support to families with children who are not attending school, comprehensively supporting children's learning and mental health. By combining generative AI with an emotion engine, a more personalized approach can be achieved, increasing user satisfaction.

[0445] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0446] User authentication process

[0447] Step 1:

[0448] The user accesses the system's login page in a browser.

[0449] Input: User enters a URL

[0450] Output: Login page displayed

[0451] Step 2:

[0452] The terminal enters the user ID and password into the form.

[0453] Input: User ID and password

[0454] Output: Authentication data entered into the form

[0455] Step 3:

[0456] The terminal clicks the submit button and sends the form data to the server.

[0457] Input: The authentication data entered

[0458] Output: Sends authentication data to the server

[0459] Step 4:

[0460] The server queries the database for the authentication data it receives and finds a matching record.

[0461] Input: Authentication data

[0462] Output: Authentication result (success or failure)

[0463] Step 5:

[0464] The server returns the authentication result to the terminal.

[0465] Input: Authentication result

[0466] Output: Redirect to my page on success, error message on failure

[0467] Educational content provision process flow

[0468] Step 1:

[0469] The user accesses the educational content page on their My Page.

[0470] Input: User clicks on the "Educational Content" button

[0471] Output: Display of educational content page

[0472] Step 2:

[0473] The server retrieves the user's profile information (learning history, emotional state) from the database.

[0474] Input: User ID

[0475] Output: Learning history and emotional information

[0476] Step 3:

[0477] The server sends the user's learning history and emotional information to the generation AI, which then generates a prompt.

[0478] Input: Learning history, emotional information, prompt sentence

[0479] Output: Generated educational content

[0480] Step 4:

[0481] The server sends the generated educational content (videos, workbooks, etc.) to the terminal.

[0482] Input: Generated educational content

[0483] Output: Educational content delivery

[0484] Step 5:

[0485] Users learn by using educational content.

[0486] Input: Educational Content

[0487] Output: Learning progress

[0488] Step 6:

[0489] After the device has completed learning, it inputs the user's feedback and sends it to the server.

[0490] Input: Feedback information

[0491] Output: Sending feedback to the server

[0492] Step 7:

[0493] The server stores the feedback data in a database and reflects it in the next content generation.

[0494] Input: Feedback information

[0495] Output: Save to database and reflect next time

[0496] Interactive Therapy Process

[0497] Step 1:

[0498] The user clicks the "Psychological Support" button on their personal page.

[0499] Input: User clicks "Emotional Support" button

[0500] Output: Display of psychological support page

[0501] Step 2:

[0502] The server calls ChatGPT and EmotionAnalyzer and sends a prompt to generate the initial message.

[0503] Input: Initial prompt statement

[0504] Output: Initial interaction message

[0505] Step 3:

[0506] The server sends the generated initial interaction message to the terminal.

[0507] Input: Initial conversation message

[0508] Output: First message delivered

[0509] Step 4:

[0510] The device inputs the user's concerns and questions and sends them to the server.

[0511] Input: Your concerns or questions

[0512] Output: Sending the consultation details to the server

[0513] Step 5:

[0514] The server sends the received message and emotional information to the generation AI, which then generates a prompt.

[0515] Input: User message and emotion information

[0516] Output: The generated advice

[0517] Step 6:

[0518] The server transmits the generated advice to the terminal.

[0519] Input: Generated advice

[0520] Output: Advice delivery

[0521] Step 7:

[0522] The server anonymizes the content of the conversation and emotional information and stores it in a database.

[0523] Input: Dialogue content and emotion information

[0524] Output: Anonymized data storage

[0525] Workshop management process flow

[0526] Step 1:

[0527] A user visits the workshop listing page.

[0528] Input: User clicks "Workshop List" button

[0529] Output: Workshop list page

[0530] Step 2:

[0531] The server retrieves currently available workshop information from the database and displays it on the terminal.

[0532] Input: User request

[0533] Output: Display workshop information

[0534] Step 3:

[0535] The user selects the workshop they wish to attend, enters information in the reservation form and submits it.

[0536] Input: Reservation information

[0537] Output: Send reservation information to the server

[0538] Step 4:

[0539] The server stores the reservation information in a database.

[0540] Input: Reservation information

[0541] Output: Save reservation information

[0542] Step 5:

[0543] The server sends a confirmation message of the reservation completion to the terminal and schedules a reminder email.

[0544] Input: Booking completion trigger

[0545] Output: Confirmation message and reminder email sent

[0546] Step 6:

[0547] After the workshop is over, the terminal displays a feedback form, and the user enters and submits feedback information.

[0548] Input: Feedback information

[0549] Output: Send feedback information to the server

[0550] Step 7:

[0551] The server stores the feedback data in a database and uses it to improve the next workshop.

[0552] Input: Feedback information

[0553] Output: Save to database and reflect in next improvement

[0554] Emotion recognition processing flow by the emotion engine

[0555] Step 1:

[0556] The server monitors webcam and microphone input in real time.

[0557] Input: User's camera video and audio

[0558] Output: Real-time video and audio data

[0559] Step 2:

[0560] The emotion engine EmotionAnalyzer analyzes the user's facial expressions and tone of voice.

[0561] Input: Camera video and audio data

[0562] Output: User's emotional information

[0563] Step 3:

[0564] The server stores the analysis results (emotional information) in a database in real time.

[0565] Input: Emotion information

[0566] Output: Save to database

[0567] Step 4:

[0568] It is used by generative AI to generate content and advice based on emotional information.

[0569] Input: Emotion information

[0570] Output: More personalized content and advice

[0571] In this way, each processing step works in conjunction with each other to realize a system that provides optimal education and psychological support to children who are not attending school.

[0572] (Application example 2)

[0573] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0574] In modern society, the number of families with children who do not attend school is increasing, which results in children not receiving an appropriate education and often experiencing psychological stress. It is also difficult for parents and children to receive education and psychological support through in-store activities. In response to this, there is a need for a system that provides integrated, personalized educational content and psychological support that parents and children can easily access within a physical store.

[0575] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a generation AI means for generating appropriate educational content based on the user's learning history, a means for providing the generated educational content to the user, and a means for collecting feedback information from the user and reflecting it in the next content provision. This makes it possible to provide personalized educational content based on the user's learning history.

[0576] The server also includes a generating AI means for analyzing the user's psychological state and providing an appropriate conversational therapy, and a means for anonymizing and saving the content of the conversational therapy and reflecting it in the next therapy session, thereby enabling the provision of personalized conversational therapy based on the user's psychological state.

[0577] The server also includes a means for acquiring detailed information about the workshop selected by the user and managing reservation information, a means for sending a confirmation message and a reminder email after the reservation is made, and a means for collecting feedback information after the workshop is completed and using it to improve future workshops. This allows users to easily participate in workshops held in physical stores and increase their effectiveness.

[0578] Finally, it includes a means to provide educational content and interactive therapy in brick-and-mortar stores as a smartphone app, allowing parents and children to easily receive education and psychological support within the brick-and-mortar store.

[0579] "Generative AI means" is an artificial intelligence technology that automatically generates personalized educational content and interactive therapy based on the user's learning history and psychological state.

[0580] The "means for providing educational content" refers to a mechanism for appropriately providing the generated educational content to users, enabling them to view and use it.

[0581] "Means for collecting feedback information" refers to the process of collecting opinions and reactions from users and reflecting that information in the next content generation and provision.

[0582] "Means for analyzing psychological state" refers to technology that analyzes the user's emotions and psychological state and uses the results to provide personalized interactive therapy.

[0583] "Means for providing interactive therapy" is a system that uses generative AI to provide advice and counseling based on the user's psychological state.

[0584] The "means for managing reservation information" is a system that acquires reservation information for workshops that users wish to participate in and efficiently manages that information.

[0585] The "means for sending a confirmation message and a reminder email" is a process for sending a confirmation message and a reminder email to a user after the workshop is booked.

[0586] The "means for collecting feedback information from the workshop" is a system for collecting feedback information from users after the workshop is completed and using this information to improve future workshops.

[0587] The "smartphone app for providing educational content and interactive therapy in brick-and-mortar stores" is a mobile application designed to allow parents and children to easily receive education and psychological support in brick-and-mortar stores.

[0588] This invention relates to a system for parents and children to receive personalized educational content and psychological support in a brick-and-mortar store. The system includes a generating AI means, a means for providing educational content, a means for collecting feedback information, a means for analyzing psychological states, a means for providing interactive therapy, a means for managing reservation information, a means for sending confirmation messages and reminder emails, a means for collecting feedback information on workshops, and a smartphone app for provision in the brick-and-mortar store.

[0589] Program Generation

[0590] The system uses the following hardware and software:

[0591] Hardware

[0592] Smartphone (iOS / Android)

[0593] software

[0594] Generative AI engine (OpenAI GPT-4)

[0595] Emotion Engine (Emotion API)

[0596] Frontend (React Native)

[0597] Backend (Node.js, Express)

[0598] Database (MongoDB)

[0599] Processing Description

[0600] Educational content provision function

[0601] The server uses generative AI to generate appropriate educational content based on the user's learning history and emotional information. This content is provided to the user via a smartphone application. After the user uses the content, feedback information is collected and reflected in the next content provision.

[0602] Interactive Therapy Features

[0603] If the user needs psychological support, the server uses an emotion engine to analyze the user's psychological state and uses generative AI to provide appropriate conversational therapy. The conversation content is anonymized and used in the next session.

[0604] Workshop management function

[0605] The server obtains detailed information about the workshop selected by the user and manages the reservation information. After the reservation, a confirmation message and a reminder email are sent. After the workshop ends, the server collects user feedback information to help improve future workshops.

[0606] Use in physical stores

[0607] The smartphone app, which provides educational content and interactive therapy, is designed for easy use by parents and children in physical stores, seamlessly delivering functionality through the app and enriching the in-store experience.

[0608] Specific examples

[0609] For example, if a 10-year-old child wants to learn educational history content at a bookstore, he or she will follow the steps below. First, he or she logs in to a smartphone app. Next, the device sends learning history and emotional information to the server. The server then sends a request to the generation AI to generate an appropriate educational history video. The generated video is then returned to the device and provided to the user. After learning, feedback information is collected and reflected in the next content.

[0610] In addition, if a parent is feeling stressed about their child's friendships at school, they can use the psychological support function. The device sends the consultation content and emotional information to the server, and receives a counseling message from the AI ​​that generates it.

[0611] Example prompts for generative AI models

[0612] 1. Educational Content:

[0613] User ID: 12345's learning history is as follows: Math: Good, Social Studies: Bad. Current emotional state is "concentration." Please generate an educational history video suitable for this user.

[0614] 2. Talking Therapy:

[0615] User ID: 67890 is worried about friendships at school. Emotional state: "Stress." Please generate an appropriate counseling message.

[0616] 3. Workshop Management:

[0617] View a list of available workshops.

[0618] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0619] Step 1:

[0620] The server receives authentication information for a user to log in to a smartphone app. The input is a user ID and password, which the server checks against the database and starts a session if a matching record is found. The output is the HTML of the user's personal page if successful.

[0621] Step 2:

[0622] The server receives the user's learning history and emotional information and sends it to the backend as input data required to generate educational content. The input data is the learning history and current emotional state, and appropriate educational content is generated using a generative AI engine (GPT-4). The output is the generated educational content (videos and workbooks).

[0623] Step 3:

[0624] The server sends the generated educational content to the smartphone application, which then provides it to the user. The user uses this content to study. The input is the generated educational content, and the output is the user's usage status.

[0625] Step 4:

[0626] After the device has finished learning, it collects feedback information from the user and sends it to the server. The input is the user's feedback information, and the server stores this information in a database and reflects it in the next content generation. The output is updated feedback data.

[0627] Step 5:

[0628] The server receives a request for psychological support from the user and analyzes the emotional information using an emotion engine. The input is the user's psychological state and the content of the consultation, and an appropriate counseling message is generated using a generative AI engine. The output is the generated counseling message.

[0629] Step 6:

[0630] The server sends the generated counseling message to the terminal, which then provides it to the user. The input is the generated counseling message, which the user confirms and, if necessary, provides additional consultation. The output is the user's response.

[0631] Step 7:

[0632] The server obtains the details of the workshop selected by the user and manages the reservation information. The input is the selected workshop information, which the server saves in the database. The output is a reservation confirmation message.

[0633] Step 8:

[0634] After the reservation is completed, the server generates a confirmation message and a reminder email and sends them to the terminal. The input is the reservation information, and the output is the confirmation message and the reminder email.

[0635] Step 9:

[0636] After the workshop, the terminal collects feedback information from users and sends it to the server. The input is the user feedback information, which the server stores in a database and uses to improve future workshops. The output is updated feedback data.

[0637] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0638] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0639] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0640] [Second embodiment]

[0641] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0642] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0643] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0644] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0645] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0646] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0647] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0648] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0649] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0650] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0651] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0652] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0653] The present invention is a system that provides new educational tools and psychological support to families with children who are not attending school. This system utilizes generative AI to provide personalized educational content and interactive therapy based on the user's learning history and psychological state. A specific embodiment of this system is described below.

[0654] 1. User authentication module

[0655] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[0656] 2. Educational content provision module

[0657] After logging in to their personal page, the user (child) accesses the educational content page. The server calls the generation AI to generate appropriate educational content based on the user's learning history and interests. The generated educational content ranges from video learning materials to interactive workbooks. Once the user has finished learning, feedback information is collected and reflected the next time content is provided.

[0658] 3. Interactive Therapy Module

[0659] When a user (child or guardian) accesses the psychological support page, the server launches an interactive generation AI to generate an initial conversation message. The user enters and sends a message about the worries or stress they want to discuss, and the server sends the message to the generation AI. The generation AI generates appropriate advice and provides it to the user via the server. The content of the conversation is anonymized and saved, and is reflected in the next therapy session.

[0660] 4. Workshop Management Module

[0661] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[0662] Specific examples

[0663] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generation AI to generate an educational math video based on the child's past learning history. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[0664] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue with the AI. For example, if they are worried about their friendships at school, they can enter their concerns and receive appropriate advice from the AI. The content of this dialogue is anonymized and reflected in the next therapy session.

[0665] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[0666] In this way, the present invention provides new educational tools and psychological support to families with children who are not attending school, and provides comprehensive support for children's learning and mental health.

[0667] The processing flow will be explained below.

[0668] 1. User authentication module

[0669] Processing Steps

[0670] Step 1:

[0671] The user accesses the login screen.

[0672] Step 2:

[0673] The server sends the HTML of the login page to the client.

[0674] Step 3:

[0675] The user enters the user ID and password and clicks the submit button.

[0676] Step 4:

[0677] The terminal sends the input information to the server as a POST request.

[0678] Step 5:

[0679] The server queries the database for the received user ID and password to verify the authentication information.

[0680] Step 6:

[0681] If the server has matching credentials, it starts a session and generates an authentication token.

[0682] Step 7:

[0683] The server sends the authentication token to the user's device and returns the HTML of the My Page as a response.

[0684] Step 8:

[0685] The user is redirected to their My Page and login is complete.

[0686] 2. Educational content provision module

[0687] Processing Steps

[0688] Step 1:

[0689] After the user (child) logs in to their My Page, they access the educational content page.

[0690] Step 2:

[0691] The server sends the HTML of the educational content page to the client.

[0692] Step 3:

[0693] The user clicks the "Start Learning" button.

[0694] Step 4:

[0695] The terminal sends the information to the server as a request.

[0696] Step 5:

[0697] The server calls the generation AI and generates appropriate educational content based on the user's learning history and interests.

[0698] Step 6:

[0699] The generative AI generates appropriate educational content (e.g., video teaching materials for mathematics) and sends the information back to the server.

[0700] Step 7:

[0701] The server transmits the generated content to the user terminal.

[0702] Step 8:

[0703] After the user has finished studying the content, they click the "Feedback" button.

[0704] Step 9:

[0705] The terminal sends feedback information to the server.

[0706] Step 10:

[0707] The server stores the feedback in a database and uses it to suggest content next time.

[0708] 3. Interactive Therapy Module

[0709] Processing Steps

[0710] Step 1:

[0711] The user (child or guardian) accesses the psychological support page.

[0712] Step 2:

[0713] The server sends the HTML of the psychological support page to the client.

[0714] Step 3:

[0715] The user clicks the "Start conversation" button.

[0716] Step 4:

[0717] The terminal sends the information to the server as a request.

[0718] Step 5:

[0719] The server calls the dialogue generation AI (therapy module) and asks it to generate the initial dialogue message.

[0720] Step 6:

[0721] The generation AI generates the initial dialogue message and sends that information back to the server.

[0722] Step 7:

[0723] The server sends the generated message to the user terminal.

[0724] Step 8:

[0725] The user initiates a dialogue with the AI ​​and inputs a message about a specific concern or stress.

[0726] Step 9:

[0727] The terminal sends the message to the server.

[0728] Step 10:

[0729] The server then asks the generation AI to analyze the message and generate appropriate advice.

[0730] Step 11:

[0731] The generation AI generates advice and sends the information back to the server.

[0732] Step 12:

[0733] The server transmits the generated advice message to the user terminal.

[0734] Step 13:

[0735] The server anonymizes the conversation and stores it in a database.

[0736] 4. Workshop Management Module

[0737] Processing Steps

[0738] Step 1:

[0739] A user visits the workshop listing page.

[0740] Step 2:

[0741] The server retrieves available workshops and sends the HTML of the list page to the client.

[0742] Step 3:

[0743] The user selects the workshop they wish to participate in and clicks the "Apply for Participation" button.

[0744] Step 4:

[0745] The device sends a request to the server containing the selected workshop ID.

[0746] Step 5:

[0747] The server retrieves detailed information about the selected workshop from the database and displays a reservation screen for the user.

[0748] Step 6:

[0749] The user enters the reservation information (date, time and additional details) and clicks submit.

[0750] Step 7:

[0751] The terminal sends the reservation information to the server as a POST request.

[0752] Step 8:

[0753] The server stores the reservation information in a database and generates a reservation confirmation message.

[0754] Step 9:

[0755] The server sends a reservation confirmation message to the user terminal and simultaneously sends a reminder email.

[0756] Step 10:

[0757] After the workshop is over, users can access the feedback page and enter their impressions and ratings.

[0758] Step 11:

[0759] The terminal sends feedback information to the server.

[0760] Step 12:

[0761] The server stores the feedback in a database and uses it to improve future workshops.

[0762] This shows a concrete process flow for providing comprehensive educational support and psychological support to families with children who are not attending school.

[0763] Example 1

[0764] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0765] Traditional educational and psychological support systems lacked the flexibility to respond to individual needs, making it difficult to provide sufficient academic and psychological support to families with children who were not attending school. Furthermore, the process of collecting feedback and reflecting it in the next content offering was inefficient, and the procedures for booking and participating in workshops were complicated.

[0766] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0767] In this invention, the server includes a means for accepting and authenticating user input information, a means for generating appropriate educational content using a generation AI based on the user's learning history, and a means for providing the generated educational content to the user. This makes it possible to provide educational content customized for each user and further improve the next educational content based on the results.

[0768] The server further includes a means for collecting feedback information from users and reflecting it in the next content provision, a means for analyzing the psychological state of the user and providing appropriate interactive therapy using a generation AI, a means for anonymizing and saving the content of the interactive therapy and reflecting it in the next therapy session, a means for acquiring detailed information about the workshop selected by the user and managing reservation information, a means for sending a confirmation message and a reminder email after a reservation is made, and a means for collecting feedback information after the workshop ends and using it to improve future workshops.This makes it possible to provide comprehensive support that meets the individual needs of users and improve the quality of education and psychological support.

[0769] "Users" refers to people who use this system, and primarily includes children who are not attending school and their parents.

[0770] "Educational content" refers to various learning resources such as teaching materials, workbooks, and videos that users can use to study.

[0771] "Generative AI" refers to an artificial intelligence model that generates appropriate educational content or interactive therapy based on user information.

[0772] "Feedback information" refers to information such as evaluations, impressions, and learning outcomes provided by users after using content or services.

[0773] "Conversational therapy" refers to a form of therapy in which the user and generative AI provide psychological support and advice through dialogue.

[0774] "Mental state" refers to the user's mental and emotional state, and serves as basic data for the generation AI to analyze and provide appropriate advice.

[0775] "Workshop" refers to a group activity or educational session based on a specific theme that users can book in advance to attend.

[0776] "Reservation Information" refers to data related to a reservation, such as the date, time, and personal information provided by a User to participate in a Workshop.

[0777] A "reminder email" refers to a notification email sent to users before the start of a workshop, and is used to reconfirm the participation date and time, etc.

[0778] This invention relates to a system that provides new educational tools and psychological support to families with children who are not attending school. The system utilizes generative AI models to provide personalized educational content and interactive therapy based on the user's learning history and psychological state.

[0779] This system uses the following hardware and software:

[0780] Devices: PCs, smartphones, tablets, etc.

[0781] Server: Web server (e.g. Apache, Nginx)

[0782] Database: MySQL, PostgreSQL, etc.

[0783] Generative AI models: GPT-3, etc.

[0784] When a user accesses the system, they first enter their login information using a terminal. The terminal then sends the entered user ID and password to the server. The server queries the database for this information, and if there is a matching record, the authentication is successful and the session begins. If the authentication is successful, the server sends the HTML of the user's personal page to the user.

[0785] When a user logs in to their personal page and accesses the educational content page, the server invokes the generative AI model to generate appropriate educational content based on the user's learning history and interests. This generated educational content ranges from video learning materials to interactive question sets. After the user has completed their learning, feedback information is collected and reflected in the next content provision.

[0786] Additionally, when a user accesses the psychological support page, the server activates an interactive generative AI model to generate an initial dialogue message. The user enters and sends a message about the worries or stress they want to discuss, and the server sends the message to the generative AI. The generative AI then generates appropriate advice and provides it to the user via the server. The content of the dialogue is anonymized and saved, and is reflected in the next therapy session.

[0787] Furthermore, when a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, after the workshop ends, feedback information is collected from the user and used to improve future workshops.

[0788] As a concrete example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generation AI to generate an educational math video based on the child's past learning history. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[0789] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue with the AI. For example, if they are worried about their friendships at school, they can enter their concerns and receive appropriate advice from the AI. The content of this dialogue is anonymized and reflected in the next therapy session.

[0790] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[0791] An example of a prompt is:

[0792] Educational content generation: "Create an educational video for math for a 10-year-old. Make it interesting and take into account their learning history."

[0793] Talking Therapy: "My 10-year-old is having trouble with friendships at school. Please provide some appropriate advice."

[0794] In this way, this system provides new educational tools and psychological support to families with children who are not attending school, providing comprehensive support for children's learning and mental health.

[0795] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0796] User Authentication Module

[0797] Step 1:

[0798] A user enters a user ID and password on the login page. The inputs provided are "user123" and "password789".

[0799] Step 2:

[0800] The device sends this input information to the server using the HTTPS protocol, where it is encrypted using SSL / TLS.

[0801] Step 3:

[0802] The server queries the database to verify that the entered user ID and password are correct. Specifically, it uses an SQL query to find the corresponding user record. Based on this query, the authentication result (success or failure) is returned.

[0803] Step 4:

[0804] The server returns the authentication result, and if the input information is correct, it returns a message indicating successful authentication. If the information is invalid, it returns an error message. If authentication is successful, a session ID is generated and saved in the session database along with the user information.

[0805] Step 5:

[0806] The server starts a session, generates a personal page for the user in HTML format, and sends it to the terminal using the HTTPS protocol. The HTML document is then output.

[0807] Educational content provision module

[0808] Step 1:

[0809] A user accesses the educational content page from My Page. An "access request to the educational content page" is provided as input.

[0810] Step 2:

[0811] The server calls a generative AI model (e.g., GPT-3) and generates new educational content based on the user's learning history (past lesson plans and areas of strength and weakness). This generation uses the input learning history data and generated data from the generative AI model to output optimal educational content. Specifically, the prompt used is, "Generate an educational math video for a 10-year-old child. Please take their past learning history into consideration and make the content interesting."

[0812] Step 3:

[0813] The server provides the generated educational content to users in the form of HTML pages or video files. This content can be in a variety of formats, such as videos, interactive questions, or quizzes. The output is the "generated educational content."

[0814] Step 4:

[0815] View or consume user-generated educational content, for example, watching a 20-minute math video and completing an interactive quiz.

[0816] Step 5:

[0817] The user inputs feedback about the content (e.g., difficulty, comprehension, interest). Feedback information is provided as input.

[0818] Step 6:

[0819] The device sends feedback information to the server via an HTTP POST request. The feedback data is sent in JSON format, and the server stores it in a database. The feedback information is saved as output.

[0820] Interactive Therapy Module

[0821] Step 1:

[0822] A user (child or guardian) accesses the psychological support page. A "request to access the psychological support page" is provided as input.

[0823] Step 2:

[0824] The server runs a generative conversational AI model (e.g., GPT-3), generates an initial conversation message (e.g., "Hello, what would you like to talk about today?"), and sends it to the user as an HTML page. The initial conversation message is provided as output.

[0825] Step 3:

[0826] The user inputs their worries or stress. As input, a "message about worries or stress" is provided. For example, the user might input, "I got into a fight with a friend at school and I don't know what to do."

[0827] Step 4:

[0828] The server sends the user's input message to the AI ​​generator, which then generates appropriate advice. The AI ​​then uses past dialogue data and psychological knowledge to create a reply. The output is "appropriate advice."

[0829] Step 5:

[0830] The server sends the generated advice to the user. For example, advice such as "If you get into a fight with a friend, it's important to calm down and sort out your feelings" is sent in HTML format. The "generated advice" is provided as output.

[0831] Step 6:

[0832] The server anonymizes the conversation content, stores it in a database, and reflects it in the next therapy session. The server outputs the "anonymized conversation content."

[0833] Workshop Management Module

[0834] Step 1:

[0835] A user accesses the workshop listing page. A "request to access the workshop listing page" is provided as input.

[0836] Step 2:

[0837] The server retrieves the currently available workshop information from the database and displays it in HTML format. The output provided is "Workshop Information."

[0838] Step 3:

[0839] The user selects the workshop they wish to attend, enters the necessary information (name, desired date and time of attendance, etc.), and presses the reservation button. The "reservation information" is provided as input.

[0840] Step 4:

[0841] The server saves the reservation information to the database. The data is inserted into the reservation table using an SQL query. The output is provided as "Saved Reservation Information".

[0842] Step 5:

[0843] After the reservation is complete, the server generates a reservation confirmation message (e.g., "Thank you for your reservation. The date and time you will attend the workshop is ____.") and sends it to the user. The "reservation confirmation message" is provided as an output.

[0844] Step 6:

[0845] Before the workshop starts, the server sends a reminder email. For example, it sends a reminder email the day before the workshop starts. The output is "Reminder Email".

[0846] Step 7:

[0847] After the workshop, the server collects feedback from users and stores it in a database. This information is used to improve the content of the next workshop. The input is "feedback information," and the output is "saved feedback information."

[0848] In this way, the system can continue to provide personalized educational content and psychological support to children who are not attending school and their families.

[0849] (Application example 1)

[0850] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0851] In modern society, the number of families with children who do not attend school is increasing, and new educational methods and psychological support are needed to address this issue, but the current system is not sufficient.In addition, there are no means to provide support to these children in physical stores, so a system that allows them to receive effective support even while visiting a physical store is needed.

[0852] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0853] In this invention, the server includes a generating AI means for generating appropriate educational content based on the user's learning history, a means for providing the generated educational content to the user, a means for collecting feedback information from the user and reflecting it in the next content provision, and a means for displaying information on a guidance device in a physical store and providing information about learning spaces and educational events. This makes it possible to provide personalized educational support and psychological support to children who are not attending school even in a physical store.

[0854] "Generative AI means" are means that use artificial intelligence to automatically generate appropriate educational content and psychological support based on the user's learning history and interests.

[0855] The "means for providing educational content" refers to a device or software for visually or audibly providing the generated educational content to the user.

[0856] The "means for collecting feedback information" is a system that collects evaluations and impressions of the learning or therapy provided by the user after use and reflects them in the content of the next service.

[0857] "In-store guidance devices" refer to devices such as robots and tablets installed in physical stores that display information and provide guidance to visitors.

[0858] "Means for providing information about learning spaces and educational events" is a system for providing visitors with information about learning spaces and educational events available within physical stores and encouraging participation.

[0859] The "means for providing information about psychological support services" is a system that provides users with information about psychological support services that can be used online through information devices in physical stores, and promotes their use.

[0860] The "means for supporting participation in workshops" is a system that uses a guidance device in a physical store to obtain detailed information about workshops that the user is interested in and supports them in making reservations to participate.

[0861] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school, and is implemented using guidance devices installed in physical stores. This system is broadly composed of four modules: a user authentication module, an educational content provision module, a dialogue therapy module, and a workshop management module.

[0862] First, in the user authentication module, when a user accesses the system, they enter their login information into a terminal installed in the physical store. The login information is sent to the server, which then queries the database for authentication. If authentication is successful, the user can proceed to the next step.

[0863] Next, in the educational content provision module, a generative AI generates appropriate educational content based on the authenticated user's learning history. This generative AI uses a model such as OpenAI GPT-4. The generated educational content is provided through guidance devices (e.g., robots or tablets) in the physical store, allowing users to receive appropriate learning materials and continue their learning. After learning, users input feedback information, which is collected by the server and reflected in the next content provision.

[0864] In the interactive therapy module, if a user needs psychological support, they can interact with the generative AI via a guide device in a physical store. When the user inputs their worries or stress, the server sends the information to the generative AI, which generates appropriate advice. This generative AI model uses a powerful model capable of natural language processing. The content of the conversation is anonymized and reflected in the next therapy session.

[0865] The workshop management module allows users to obtain detailed information about the workshop they wish to participate in through the information device in the physical store and make a reservation to participate. The server stores the reservation information in a database and sends confirmation messages and reminder emails. In addition, feedback information is collected after the workshop is completed, which is used to improve future workshops.

[0866] Hardware used:

[0867] Guidance devices in physical stores (robots and tablets)

[0868] server

[0869] Database

[0870] Software used:

[0871] Pepper SDK (used for robot control systems)

[0872] OpenAI GPT-4 (generative AI model)

[0873] Apache or NGINX (web server)

[0874] MySQL or PostgreSQL (database)

[0875] Specific examples

[0876] 1. Providing educational content

[0877] Sample prompt: "Generate the best math learning materials based on your past learning history. Create video materials at a 5th grade level that fit your current learning progress."

[0878] 2. Dialogic Therapy Responses

[0879] Sample prompt: "A 10-year-old child is asking for advice about friendships at school. Please provide appropriate advice."

[0880] 3. Workshop Management Guide

[0881] Example prompt: "Write a script that provides detailed information about an online workshop next Saturday and takes reservations for participants."

[0882] This system will enable children who are not attending school to receive individualized educational and psychological support even within a physical store, providing an environment where they can receive learning and psychological support.

[0883] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0884] Step 1:

[0885] The user enters login information into the information device in the physical store. The user ID and password are used as input data, which are sent from the terminal to the server. The server receives this information and queries the database to perform authentication. If authentication is successful, the server generates a message indicating successful authentication and sends it to the terminal.

[0886] Step 2:

[0887] After authenticating, the user requests educational content. The request is sent from the device to the server, which retrieves the user's learning history data from a database. The server then invokes a generative AI model (e.g., OpenAI GPT-4) and passes the prompt sentence to the generative AI model to generate appropriate educational content. The generated educational content is then sent back to the server, which then sends it to the device.

[0888] Step 3:

[0889] The user receives the educational content generated on the device and studies it. After studying, the user enters feedback information into the device. The entered feedback information is sent from the device to the server, which stores it in a database. The feedback information is used the next time content is generated.

[0890] Step 4:

[0891] When a user needs psychological support, they access the psychological support page through their device and enter their worries and stress. The entered data is sent to the server, which then sends prompts to the generative AI model, causing it to generate appropriate interactive therapy content. The generated dialogue message is then sent back to the server, which then sends it to the device.

[0892] Step 5:

[0893] The user receives the content of the interactive therapy and receives support. The user can continue to enter additional feedback or questions as needed. The content of the conversation is anonymized on the server side and stored in a database. It will be reflected in the next therapy session.

[0894] Step 6:

[0895] When a user wishes to participate in a workshop, they access the workshop list page from their device, select the workshop they wish to attend, and enter their reservation information. The entered reservation information is sent from the device to the server, which stores it in a database. The server also generates a confirmation message and a reminder email and sends them to the user's registered email address.

[0896] Step 7:

[0897] After the workshop, users input feedback information through their devices. The information is then sent to the server, which stores it in a database. This information is used to improve future workshops.

[0898] Each of the above steps works as an ongoing process, providing a comprehensive system of education and psychological support within the brick-and-mortar store.

[0899] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0900] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school. This system utilizes generative AI and an emotion engine to provide personalized educational content and interactive therapy based on the user's learning history, psychological state, and emotional information. A specific embodiment of this system is described below.

[0901] 1. User authentication module

[0902] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[0903] 2. Educational content provision module

[0904] After logging in to their personal page, the user (child) accesses the educational content page. The server calls the generation AI to generate appropriate educational content based on the user's learning history and emotional information obtained by the emotion engine. The generated educational content ranges from video learning materials to interactive workbooks. Once the user has finished learning, feedback information is collected and reflected the next time content is provided.

[0905] 3. Interactive Therapy Module

[0906] When a user (child or guardian) accesses the psychological support page, the server activates the dialogue generation AI and emotion engine to generate an initial dialogue message. When the user enters and sends a message about the worries or stress they want to discuss, the server sends the message and the user's emotional information to the generation AI. The generation AI generates appropriate advice and provides it to the user via the server. The dialogue content and emotional information are anonymized and saved, and are reflected in the next therapy session.

[0907] 4. Workshop Management Module

[0908] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[0909] 5. Emotion Recognition by Emotion Engine

[0910] During the processing of each module, the emotion engine constantly analyzes the user's emotions. For example, the educational content provision module analyzes the user's facial expressions and tone of voice while learning to understand their level of concentration and emotional state. Based on this information, the generative AI creates more appropriate content.

[0911] Specific examples

[0912] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server activates the generative AI and emotion engine to generate an educational math video based on the child's past learning history and current emotional state. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[0913] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue between the generative AI and the emotion engine. For example, if the user is worried about friendships at school, they can enter their emotional information along with the details of their worries, and receive appropriate advice from the generative AI. The content of this dialogue and emotional information are anonymized and reflected in the next therapy session.

[0914] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[0915] In this way, this invention provides new educational tools and psychological support to families with children who are not attending school, comprehensively supporting children's learning and mental health. By combining generative AI with an emotion engine, a more personalized approach can be achieved, increasing user satisfaction.

[0916] The processing flow will be explained below.

[0917] 1. User authentication module

[0918] Processing Steps

[0919] Step 1:

[0920] The user accesses the login screen.

[0921] Step 2:

[0922] The server sends the HTML of the login page to the client.

[0923] Step 3:

[0924] The user enters the user ID and password and clicks the submit button.

[0925] Step 4:

[0926] The terminal sends the input information to the server as a POST request.

[0927] Step 5:

[0928] The server queries the database for the received user ID and password to verify the authentication information.

[0929] Step 6:

[0930] If the server has matching credentials, it starts a session and generates an authentication token.

[0931] Step 7:

[0932] The server sends the authentication token to the user's device and returns the HTML of the My Page as a response.

[0933] Step 8:

[0934] The user is redirected to their My Page and login is complete.

[0935] 2. Educational content provision module

[0936] Processing Steps

[0937] Step 1:

[0938] After the user (child) logs in to their My Page, they access the educational content page.

[0939] Step 2:

[0940] The server sends the HTML of the educational content page to the client.

[0941] Step 3:

[0942] The user clicks the "Start Learning" button.

[0943] Step 4:

[0944] The terminal sends the information to the server as a request.

[0945] Step 5:

[0946] The server calls the generation AI and emotion engine to generate appropriate educational content based on the user's learning history and emotional information.

[0947] Step 6:

[0948] The generative AI generates appropriate educational content (e.g., video teaching materials for mathematics) and sends the information back to the server.

[0949] Step 7:

[0950] The server transmits the generated content to the user terminal.

[0951] Step 8:

[0952] After the user has finished studying the content, they click the "Feedback" button.

[0953] Step 9:

[0954] The device sends feedback information (such as learning satisfaction and emotional state during learning) to the server.

[0955] Step 10:

[0956] The server stores the feedback in a database and uses it to suggest content next time.

[0957] 3. Interactive Therapy Module

[0958] Processing Steps

[0959] Step 1:

[0960] The user (child or guardian) accesses the psychological support page.

[0961] Step 2:

[0962] The server sends the HTML of the psychological support page to the client.

[0963] Step 3:

[0964] The user clicks the "Start conversation" button.

[0965] Step 4:

[0966] The terminal sends the information to the server as a request.

[0967] Step 5:

[0968] The server calls the dialogue generation AI and emotion engine and asks them to generate the initial dialogue message.

[0969] Step 6:

[0970] The generation AI generates the initial dialogue message and sends that information back to the server.

[0971] Step 7:

[0972] The server sends the generated message to the user terminal.

[0973] Step 8:

[0974] The user initiates a dialogue with the AI ​​and inputs a message about a specific concern or stress.

[0975] Step 9:

[0976] The terminal sends the message to the server.

[0977] Step 10:

[0978] The emotion engine analyzes the emotional state (e.g., sadness or anxiety) from the message entered by the user.

[0979] Step 11:

[0980] The server sends the message and emotional state to the generation AI and asks it to generate appropriate advice.

[0981] Step 12:

[0982] The generation AI generates advice and sends the information back to the server.

[0983] Step 13:

[0984] The server transmits the generated advice message to the user terminal.

[0985] Step 14:

[0986] The server anonymizes the dialogue content and emotional information and stores it in a database.

[0987] 4. Workshop Management Module

[0988] Processing Steps

[0989] Step 1:

[0990] A user visits the workshop listing page.

[0991] Step 2:

[0992] The server retrieves available workshops and sends the HTML of the list page to the client.

[0993] Step 3:

[0994] The user selects the workshop they wish to participate in and clicks the "Apply for Participation" button.

[0995] Step 4:

[0996] The device sends a request to the server containing the selected workshop ID.

[0997] Step 5:

[0998] The server retrieves detailed information about the selected workshop from the database and displays a reservation screen for the user.

[0999] Step 6:

[1000] The user enters the reservation information (date, time and additional details) and clicks submit.

[1001] Step 7:

[1002] The terminal sends the reservation information to the server as a POST request.

[1003] Step 8:

[1004] The server stores the reservation information in a database and generates a reservation confirmation message.

[1005] Step 9:

[1006] The server sends a reservation confirmation message to the user terminal and simultaneously sends a reminder email.

[1007] Step 10:

[1008] After the workshop is over, users can access the feedback page and enter their impressions and ratings.

[1009] Step 11:

[1010] The terminal sends feedback information to the server.

[1011] Step 12:

[1012] The server stores the feedback in a database and uses it to improve future workshops.

[1013] 5. Emotion Recognition by Emotion Engine

[1014] Processing Steps

[1015] Step 1:

[1016] The server activates an emotion engine and analyzes the user's emotions in real time.

[1017] Step 2:

[1018] The device transmits the user's facial expressions and voice to the emotion engine via the camera and microphone.

[1019] Step 3:

[1020] An emotion engine analyzes the user's emotional state (e.g., joy, surprise, sadness).

[1021] Step 4:

[1022] The server sends this emotional information to the generation AI and other modules, which then reflect it in their respective processing.

[1023] Step 5:

[1024] The emotion engine anonymizes the user's emotional data and stores it in a database for future learning and therapy sessions.

[1025] Example 2

[1026] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1027] In today's education system, it is difficult to provide personalized educational methods and psychological support to children who are refusing to go to school. In particular, traditional educational content rarely takes into account children's learning history or emotional state, making it difficult to support efficient learning. Furthermore, there is a lack of systems for providing appropriate interactive therapy to children with psychological problems. Furthermore, there are challenges in efficiently managing workshops to improve social skills and collecting feedback.

[1028] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1029] In this invention, the server includes a means for performing authentication based on the user's login information, a generation AI means for generating appropriate educational content based on the user's learning history and emotional state, a means for providing the generated educational content to the user, a means for collecting feedback information from the user and reflecting it in the next content provision, and a means for analyzing the user's emotional information and reflecting it in the educational content. This makes it possible to provide personalized educational content and psychological support to children who are not attending school, and to comprehensively support the children's learning effectiveness and mental health.

[1030] "User login information" refers to the identification information required for a user to access a system, and generally refers to a combination of a user ID and password.

[1031] "Authentication methods" refers to the processes and functions used to verify a user's login information and confirm their access rights to a system.

[1032] "Study history" is data that records the user's past learning content and progress.

[1033] "Emotional state" refers to the emotional response or psychological state a user exhibits at a particular point in time.

[1034] "Generative AI means" refers to processes and functions that use artificial intelligence to generate personalized educational content or interactive therapy based on a user's learning history and emotional state.

[1035] "Educational content" refers to materials such as teaching materials, workbooks, and videos that users use for learning.

[1036] "Feedback information" refers to opinions and evaluations provided by users regarding educational content, workshops, etc.

[1037] "Emotional information" refers to the user's emotional data and information analyzed by the emotion engine.

[1038] "Interactive therapy" refers to the process and functionality of providing interactive counseling and advice to assist a user with their psychological condition.

[1039] "Workshop" refers to an online or offline session organized for a specific learning or activity purpose.

[1040] "Reservation Information" refers to the dates and participant information provided by a User to participate in a particular workshop or seminar.

[1041] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school. The system utilizes generative AI and an emotion engine to provide personalized educational content and interactive therapy based on the user's learning history, psychological state, and emotional information. A specific embodiment of this system is described below.

[1042] 1. User authentication module

[1043] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[1044] 2. Educational content provision module

[1045] After logging in to their personal page, the user (child) accesses the educational content page. The server launches the generation AI, specifically using OpenAI's GPT-3 and EmotionAnalyzer as an emotion engine. This generates appropriate educational content based on the user's learning history and emotional information. The generated educational content ranges from video learning materials to interactive workbooks. When the user has finished learning, feedback information is sent from the device to the server, and is reflected the next time content is provided. A specific example of a prompt is as follows:

[1046] "Generate educational content for mathematics suitable for a 10-year-old child. Create video materials that are fun to learn based on their past learning history and current emotional state."

[1047] 3. Interactive Therapy Module

[1048] When a user (child or guardian) accesses the psychological support page, the server launches the interactive generation AI. Specifically, ChatGPT and EmotionAnalyzer are used to generate the initial conversation message. When the user enters and sends a message about the worries or stress they want to discuss, the server sends the message and the user's emotional information to the generation AI. The generation AI then generates appropriate advice and provides it to the user via the server. The content of the conversation and emotional information are anonymized and saved, and will be reflected in the next therapy session. Specific examples of prompts are as follows:

[1049] "Please advise the user if they are having trouble with friendships at school. Their recent emotional state is unsettling."

[1050] 4. Workshop Management Module

[1051] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[1052] 5. Emotion Recognition by Emotion Engine

[1053] During the processing of each module, the emotion engine, EmotionAnalyzer, constantly analyzes the user's emotions. For example, the educational content provision module analyzes the user's facial expressions and tone of voice while learning to understand their level of concentration and emotional state. Based on this information, the generative AI creates more appropriate content. The emotional information collected by the emotion engine is stored in a database and used for future improvements and customization.

[1054] Specific examples

[1055] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generative AI (GPT-3) and an emotion engine (EmotionAnalyzer) to generate an educational math video based on the child's past learning history and current emotional state. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[1056] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses the psychological support page and initiates a dialogue between the generative AI (ChatGPT) and the emotion engine (EmotionAnalyzer). For example, if the user is worried about friendships at school, they can enter their emotional information along with the details of their worries, and receive appropriate advice from the generative AI. The content of this dialogue and emotional information are anonymized and reflected in the next therapy session.

[1057] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[1058] In this way, this invention provides new educational tools and psychological support to families with children who are not attending school, comprehensively supporting children's learning and mental health. By combining generative AI with an emotion engine, a more personalized approach can be achieved, increasing user satisfaction.

[1059] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1060] User authentication process

[1061] Step 1:

[1062] The user accesses the system's login page in a browser.

[1063] Input: User enters a URL

[1064] Output: Login page displayed

[1065] Step 2:

[1066] The terminal enters the user ID and password into the form.

[1067] Input: User ID and password

[1068] Output: Authentication data entered into the form

[1069] Step 3:

[1070] The terminal clicks the submit button and sends the form data to the server.

[1071] Input: The authentication data entered

[1072] Output: Sends authentication data to the server

[1073] Step 4:

[1074] The server queries the database for the authentication data it receives and finds a matching record.

[1075] Input: Authentication data

[1076] Output: Authentication result (success or failure)

[1077] Step 5:

[1078] The server returns the authentication result to the terminal.

[1079] Input: Authentication result

[1080] Output: Redirect to my page on success, error message on failure

[1081] Educational content provision process flow

[1082] Step 1:

[1083] The user accesses the educational content page on their My Page.

[1084] Input: User clicks on the "Educational Content" button

[1085] Output: Display of educational content page

[1086] Step 2:

[1087] The server retrieves the user's profile information (learning history, emotional state) from the database.

[1088] Input: User ID

[1089] Output: Learning history and emotional information

[1090] Step 3:

[1091] The server sends the user's learning history and emotional information to the generation AI, which then generates a prompt.

[1092] Input: Learning history, emotional information, prompt sentence

[1093] Output: Generated educational content

[1094] Step 4:

[1095] The server sends the generated educational content (videos, workbooks, etc.) to the terminal.

[1096] Input: Generated educational content

[1097] Output: Educational content delivery

[1098] Step 5:

[1099] Users learn by using educational content.

[1100] Input: Educational Content

[1101] Output: Learning progress

[1102] Step 6:

[1103] After the device has completed learning, it inputs the user's feedback and sends it to the server.

[1104] Input: Feedback information

[1105] Output: Sending feedback to the server

[1106] Step 7:

[1107] The server stores the feedback data in a database and reflects it in the next content generation.

[1108] Input: Feedback information

[1109] Output: Save to database and reflect next time

[1110] Interactive Therapy Process

[1111] Step 1:

[1112] The user clicks the "Psychological Support" button on their personal page.

[1113] Input: User clicks "Emotional Support" button

[1114] Output: Display of psychological support page

[1115] Step 2:

[1116] The server calls ChatGPT and EmotionAnalyzer and sends a prompt to generate the initial message.

[1117] Input: Initial prompt statement

[1118] Output: Initial interaction message

[1119] Step 3:

[1120] The server sends the generated initial interaction message to the terminal.

[1121] Input: Initial conversation message

[1122] Output: First message delivered

[1123] Step 4:

[1124] The device inputs the user's concerns and questions and sends them to the server.

[1125] Input: Your concerns or questions

[1126] Output: Sending the consultation details to the server

[1127] Step 5:

[1128] The server sends the received message and emotional information to the generation AI, which then generates a prompt.

[1129] Input: User message and emotion information

[1130] Output: The generated advice

[1131] Step 6:

[1132] The server transmits the generated advice to the terminal.

[1133] Input: Generated advice

[1134] Output: Advice delivery

[1135] Step 7:

[1136] The server anonymizes the content of the conversation and emotional information and stores it in a database.

[1137] Input: Dialogue content and emotion information

[1138] Output: Anonymized data storage

[1139] Workshop management process flow

[1140] Step 1:

[1141] A user visits the workshop listing page.

[1142] Input: User clicks "Workshop List" button

[1143] Output: Workshop list page

[1144] Step 2:

[1145] The server retrieves currently available workshop information from the database and displays it on the terminal.

[1146] Input: User request

[1147] Output: Display workshop information

[1148] Step 3:

[1149] The user selects the workshop they wish to attend, enters information in the reservation form and submits it.

[1150] Input: Reservation information

[1151] Output: Send reservation information to the server

[1152] Step 4:

[1153] The server stores the reservation information in a database.

[1154] Input: Reservation information

[1155] Output: Save reservation information

[1156] Step 5:

[1157] The server sends a confirmation message of the reservation completion to the terminal and schedules a reminder email.

[1158] Input: Booking completion trigger

[1159] Output: Confirmation message and reminder email sent

[1160] Step 6:

[1161] After the workshop is over, the terminal displays a feedback form, and the user enters and submits feedback information.

[1162] Input: Feedback information

[1163] Output: Send feedback information to the server

[1164] Step 7:

[1165] The server stores the feedback data in a database and uses it to improve the next workshop.

[1166] Input: Feedback information

[1167] Output: Save to database and reflect in next improvement

[1168] Emotion recognition processing flow by the emotion engine

[1169] Step 1:

[1170] The server monitors webcam and microphone input in real time.

[1171] Input: User's camera video and audio

[1172] Output: Real-time video and audio data

[1173] Step 2:

[1174] The emotion engine EmotionAnalyzer analyzes the user's facial expressions and tone of voice.

[1175] Input: Camera video and audio data

[1176] Output: User's emotional information

[1177] Step 3:

[1178] The server stores the analysis results (emotional information) in a database in real time.

[1179] Input: Emotion information

[1180] Output: Save to database

[1181] Step 4:

[1182] It is used by generative AI to generate content and advice based on emotional information.

[1183] Input: Emotion information

[1184] Output: More personalized content and advice

[1185] In this way, each processing step works in conjunction with each other to realize a system that provides optimal education and psychological support to children who are not attending school.

[1186] (Application example 2)

[1187] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1188] In modern society, the number of families with children who do not attend school is increasing, which results in children not receiving an appropriate education and often experiencing psychological stress. It is also difficult for parents and children to receive education and psychological support through in-store activities. In response to this, there is a need for a system that provides integrated, personalized educational content and psychological support that parents and children can easily access within a physical store.

[1189] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a generation AI means for generating appropriate educational content based on the user's learning history, a means for providing the generated educational content to the user, and a means for collecting feedback information from the user and reflecting it in the next content provision. This makes it possible to provide personalized educational content based on the user's learning history.

[1190] The server also includes a generating AI means for analyzing the user's psychological state and providing an appropriate conversational therapy, and a means for anonymizing and saving the content of the conversational therapy and reflecting it in the next therapy session, thereby enabling the provision of personalized conversational therapy based on the user's psychological state.

[1191] The server also includes a means for acquiring detailed information about the workshop selected by the user and managing reservation information, a means for sending a confirmation message and a reminder email after the reservation is made, and a means for collecting feedback information after the workshop is completed and using it to improve future workshops. This allows users to easily participate in workshops held in physical stores and increase their effectiveness.

[1192] Finally, it includes a means to provide educational content and interactive therapy in brick-and-mortar stores as a smartphone app, allowing parents and children to easily receive education and psychological support within the brick-and-mortar store.

[1193] "Generative AI means" is an artificial intelligence technology that automatically generates personalized educational content and interactive therapy based on the user's learning history and psychological state.

[1194] The "means for providing educational content" refers to a mechanism for appropriately providing the generated educational content to users, enabling them to view and use it.

[1195] "Means for collecting feedback information" refers to the process of collecting opinions and reactions from users and reflecting that information in the next content generation and provision.

[1196] "Means for analyzing psychological state" refers to technology that analyzes the user's emotions and psychological state and uses the results to provide personalized interactive therapy.

[1197] "Means for providing interactive therapy" is a system that uses generative AI to provide advice and counseling based on the user's psychological state.

[1198] The "means for managing reservation information" is a system that acquires reservation information for workshops that users wish to participate in and efficiently manages that information.

[1199] The "means for sending a confirmation message and a reminder email" is a process for sending a confirmation message and a reminder email to a user after the workshop is booked.

[1200] The "means for collecting feedback information from the workshop" is a system for collecting feedback information from users after the workshop is completed and using this information to improve future workshops.

[1201] The "smartphone app for providing educational content and interactive therapy in brick-and-mortar stores" is a mobile application designed to allow parents and children to easily receive education and psychological support in brick-and-mortar stores.

[1202] This invention relates to a system for parents and children to receive personalized educational content and psychological support in a brick-and-mortar store. The system includes a generating AI means, a means for providing educational content, a means for collecting feedback information, a means for analyzing psychological states, a means for providing interactive therapy, a means for managing reservation information, a means for sending confirmation messages and reminder emails, a means for collecting feedback information on workshops, and a smartphone app for provision in the brick-and-mortar store.

[1203] Program Generation

[1204] The system uses the following hardware and software:

[1205] Hardware

[1206] Smartphone (iOS / Android)

[1207] software

[1208] Generative AI engine (OpenAI GPT-4)

[1209] Emotion Engine (Emotion API)

[1210] Frontend (React Native)

[1211] Backend (Node.js, Express)

[1212] Database (MongoDB)

[1213] Processing Description

[1214] Educational content provision function

[1215] The server uses generative AI to generate appropriate educational content based on the user's learning history and emotional information. This content is provided to the user via a smartphone application. After the user uses the content, feedback information is collected and reflected in the next content provision.

[1216] Interactive Therapy Features

[1217] If the user needs psychological support, the server uses an emotion engine to analyze the user's psychological state and uses generative AI to provide appropriate conversational therapy. The conversation content is anonymized and used in the next session.

[1218] Workshop management function

[1219] The server obtains detailed information about the workshop selected by the user and manages the reservation information. After the reservation, a confirmation message and a reminder email are sent. After the workshop ends, the server collects user feedback information to help improve future workshops.

[1220] Use in physical stores

[1221] The smartphone app, which provides educational content and interactive therapy, is designed for easy use by parents and children in physical stores, seamlessly delivering functionality through the app and enriching the in-store experience.

[1222] Specific examples

[1223] For example, if a 10-year-old child wants to learn educational history content at a bookstore, he or she will follow the steps below. First, he or she logs in to a smartphone app. Next, the device sends learning history and emotional information to the server. The server then sends a request to the generation AI to generate an appropriate educational history video. The generated video is then returned to the device and provided to the user. After learning, feedback information is collected and reflected in the next content.

[1224] In addition, if a parent is feeling stressed about their child's friendships at school, they can use the psychological support function. The device sends the consultation content and emotional information to the server, and receives a counseling message from the AI ​​that generates it.

[1225] Example prompts for generative AI models

[1226] 1. Educational Content:

[1227] User ID: 12345's learning history is as follows: Math: Good, Social Studies: Bad. Current emotional state is "concentration." Please generate an educational history video suitable for this user.

[1228] 2. Talking Therapy:

[1229] User ID: 67890 is worried about friendships at school. Emotional state: "Stress." Please generate an appropriate counseling message.

[1230] 3. Workshop Management:

[1231] View a list of available workshops.

[1232] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1233] Step 1:

[1234] The server receives authentication information for a user to log in to a smartphone app. The input is a user ID and password, which the server checks against the database and starts a session if a matching record is found. The output is the HTML of the user's personal page if successful.

[1235] Step 2:

[1236] The server receives the user's learning history and emotional information and sends it to the backend as input data required to generate educational content. The input data is the learning history and current emotional state, and appropriate educational content is generated using a generative AI engine (GPT-4). The output is the generated educational content (videos and workbooks).

[1237] Step 3:

[1238] The server sends the generated educational content to the smartphone application, which then provides it to the user. The user uses this content to study. The input is the generated educational content, and the output is the user's usage status.

[1239] Step 4:

[1240] After the device has finished learning, it collects feedback information from the user and sends it to the server. The input is the user's feedback information, and the server stores this information in a database and reflects it in the next content generation. The output is updated feedback data.

[1241] Step 5:

[1242] The server receives a request for psychological support from the user and analyzes the emotional information using an emotion engine. The input is the user's psychological state and the content of the consultation, and an appropriate counseling message is generated using a generative AI engine. The output is the generated counseling message.

[1243] Step 6:

[1244] The server sends the generated counseling message to the terminal, which then provides it to the user. The input is the generated counseling message, which the user confirms and, if necessary, provides additional consultation. The output is the user's response.

[1245] Step 7:

[1246] The server obtains the details of the workshop selected by the user and manages the reservation information. The input is the selected workshop information, which the server saves in the database. The output is a reservation confirmation message.

[1247] Step 8:

[1248] After the reservation is completed, the server generates a confirmation message and a reminder email and sends them to the terminal. The input is the reservation information, and the output is the confirmation message and the reminder email.

[1249] Step 9:

[1250] After the workshop, the terminal collects feedback information from users and sends it to the server. The input is the user feedback information, which the server stores in a database and uses to improve future workshops. The output is updated feedback data.

[1251] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1252] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1253] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1254] [Third embodiment]

[1255] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1256] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1257] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1258] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1259] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1260] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1261] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1262] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1263] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1264] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1265] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1266] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1267] The present invention is a system that provides new educational tools and psychological support to families with children who are not attending school. This system utilizes generative AI to provide personalized educational content and interactive therapy based on the user's learning history and psychological state. A specific embodiment of this system is described below.

[1268] 1. User authentication module

[1269] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[1270] 2. Educational content provision module

[1271] After logging in to their personal page, the user (child) accesses the educational content page. The server calls the generation AI to generate appropriate educational content based on the user's learning history and interests. The generated educational content ranges from video learning materials to interactive workbooks. Once the user has finished learning, feedback information is collected and reflected the next time content is provided.

[1272] 3. Interactive Therapy Module

[1273] When a user (child or guardian) accesses the psychological support page, the server launches an interactive generation AI to generate an initial conversation message. The user enters and sends a message about the worries or stress they want to discuss, and the server sends the message to the generation AI. The generation AI generates appropriate advice and provides it to the user via the server. The content of the conversation is anonymized and saved, and is reflected in the next therapy session.

[1274] 4. Workshop Management Module

[1275] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[1276] Specific examples

[1277] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generation AI to generate an educational math video based on the child's past learning history. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[1278] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue with the AI. For example, if they are worried about their friendships at school, they can enter their concerns and receive appropriate advice from the AI. The content of this dialogue is anonymized and reflected in the next therapy session.

[1279] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[1280] In this way, the present invention provides new educational tools and psychological support to families with children who are not attending school, and provides comprehensive support for children's learning and mental health.

[1281] The processing flow will be explained below.

[1282] 1. User authentication module

[1283] Processing Steps

[1284] Step 1:

[1285] The user accesses the login screen.

[1286] Step 2:

[1287] The server sends the HTML of the login page to the client.

[1288] Step 3:

[1289] The user enters the user ID and password and clicks the submit button.

[1290] Step 4:

[1291] The terminal sends the input information to the server as a POST request.

[1292] Step 5:

[1293] The server queries the database for the received user ID and password to verify the authentication information.

[1294] Step 6:

[1295] If the server has matching credentials, it starts a session and generates an authentication token.

[1296] Step 7:

[1297] The server sends the authentication token to the user's device and returns the HTML of the My Page as a response.

[1298] Step 8:

[1299] The user is redirected to their My Page and login is complete.

[1300] 2. Educational content provision module

[1301] Processing Steps

[1302] Step 1:

[1303] After the user (child) logs in to their My Page, they access the educational content page.

[1304] Step 2:

[1305] The server sends the HTML of the educational content page to the client.

[1306] Step 3:

[1307] The user clicks the "Start Learning" button.

[1308] Step 4:

[1309] The terminal sends the information to the server as a request.

[1310] Step 5:

[1311] The server calls the generation AI and generates appropriate educational content based on the user's learning history and interests.

[1312] Step 6:

[1313] The generative AI generates appropriate educational content (e.g., video teaching materials for mathematics) and sends the information back to the server.

[1314] Step 7:

[1315] The server transmits the generated content to the user terminal.

[1316] Step 8:

[1317] After the user has finished studying the content, they click the "Feedback" button.

[1318] Step 9:

[1319] The terminal sends feedback information to the server.

[1320] Step 10:

[1321] The server stores the feedback in a database and uses it to suggest content next time.

[1322] 3. Interactive Therapy Module

[1323] Processing Steps

[1324] Step 1:

[1325] The user (child or guardian) accesses the psychological support page.

[1326] Step 2:

[1327] The server sends the HTML of the psychological support page to the client.

[1328] Step 3:

[1329] The user clicks the "Start conversation" button.

[1330] Step 4:

[1331] The terminal sends the information to the server as a request.

[1332] Step 5:

[1333] The server calls the dialogue generation AI (therapy module) and asks it to generate the initial dialogue message.

[1334] Step 6:

[1335] The generation AI generates the initial dialogue message and sends that information back to the server.

[1336] Step 7:

[1337] The server sends the generated message to the user terminal.

[1338] Step 8:

[1339] The user initiates a dialogue with the AI ​​and inputs a message about a specific concern or stress.

[1340] Step 9:

[1341] The terminal sends the message to the server.

[1342] Step 10:

[1343] The server then asks the generation AI to analyze the message and generate appropriate advice.

[1344] Step 11:

[1345] The generation AI generates advice and sends the information back to the server.

[1346] Step 12:

[1347] The server transmits the generated advice message to the user terminal.

[1348] Step 13:

[1349] The server anonymizes the conversation and stores it in a database.

[1350] 4. Workshop Management Module

[1351] Processing Steps

[1352] Step 1:

[1353] A user visits the workshop listing page.

[1354] Step 2:

[1355] The server retrieves available workshops and sends the HTML of the list page to the client.

[1356] Step 3:

[1357] The user selects the workshop they wish to participate in and clicks the "Apply for Participation" button.

[1358] Step 4:

[1359] The device sends a request to the server containing the selected workshop ID.

[1360] Step 5:

[1361] The server retrieves detailed information about the selected workshop from the database and displays a reservation screen for the user.

[1362] Step 6:

[1363] The user enters the reservation information (date, time and additional details) and clicks submit.

[1364] Step 7:

[1365] The terminal sends the reservation information to the server as a POST request.

[1366] Step 8:

[1367] The server stores the reservation information in a database and generates a reservation confirmation message.

[1368] Step 9:

[1369] The server sends a reservation confirmation message to the user terminal and simultaneously sends a reminder email.

[1370] Step 10:

[1371] After the workshop is over, users can access the feedback page and enter their impressions and ratings.

[1372] Step 11:

[1373] The terminal sends feedback information to the server.

[1374] Step 12:

[1375] The server stores the feedback in a database and uses it to improve future workshops.

[1376] This shows a concrete process flow for providing comprehensive educational support and psychological support to families with children who are not attending school.

[1377] Example 1

[1378] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1379] Traditional educational and psychological support systems lacked the flexibility to respond to individual needs, making it difficult to provide sufficient academic and psychological support to families with children who were not attending school. Furthermore, the process of collecting feedback and reflecting it in the next content offering was inefficient, and the procedures for booking and participating in workshops were complicated.

[1380] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1381] In this invention, the server includes a means for accepting and authenticating user input information, a means for generating appropriate educational content using a generation AI based on the user's learning history, and a means for providing the generated educational content to the user. This makes it possible to provide educational content customized for each user and further improve the next educational content based on the results.

[1382] The server further includes a means for collecting feedback information from users and reflecting it in the next content provision, a means for analyzing the psychological state of the user and providing appropriate interactive therapy using a generation AI, a means for anonymizing and saving the content of the interactive therapy and reflecting it in the next therapy session, a means for acquiring detailed information about the workshop selected by the user and managing reservation information, a means for sending a confirmation message and a reminder email after a reservation is made, and a means for collecting feedback information after the workshop ends and using it to improve future workshops.This makes it possible to provide comprehensive support that meets the individual needs of users and improve the quality of education and psychological support.

[1383] "Users" refers to people who use this system, and primarily includes children who are not attending school and their parents.

[1384] "Educational content" refers to various learning resources such as teaching materials, workbooks, and videos that users can use to study.

[1385] "Generative AI" refers to an artificial intelligence model that generates appropriate educational content or interactive therapy based on user information.

[1386] "Feedback information" refers to information such as evaluations, impressions, and learning outcomes provided by users after using content or services.

[1387] "Conversational therapy" refers to a form of therapy in which the user and generative AI provide psychological support and advice through dialogue.

[1388] "Mental state" refers to the user's mental and emotional state, and serves as basic data for the generation AI to analyze and provide appropriate advice.

[1389] "Workshop" refers to a group activity or educational session based on a specific theme that users can book in advance to attend.

[1390] "Reservation Information" refers to data related to a reservation, such as the date, time, and personal information provided by a User to participate in a Workshop.

[1391] A "reminder email" refers to a notification email sent to users before the start of a workshop, and is used to reconfirm the participation date and time, etc.

[1392] This invention relates to a system that provides new educational tools and psychological support to families with children who are not attending school. The system utilizes generative AI models to provide personalized educational content and interactive therapy based on the user's learning history and psychological state.

[1393] This system uses the following hardware and software:

[1394] Devices: PCs, smartphones, tablets, etc.

[1395] Server: Web server (e.g. Apache, Nginx)

[1396] Database: MySQL, PostgreSQL, etc.

[1397] Generative AI models: GPT-3, etc.

[1398] When a user accesses the system, they first enter their login information using a terminal. The terminal then sends the entered user ID and password to the server. The server queries the database for this information, and if there is a matching record, the authentication is successful and the session begins. If the authentication is successful, the server sends the HTML of the user's personal page to the user.

[1399] When a user logs in to their personal page and accesses the educational content page, the server invokes the generative AI model to generate appropriate educational content based on the user's learning history and interests. This generated educational content ranges from video learning materials to interactive question sets. After the user has completed their learning, feedback information is collected and reflected in the next content provision.

[1400] Additionally, when a user accesses the psychological support page, the server activates an interactive generative AI model to generate an initial dialogue message. The user enters and sends a message about the worries or stress they want to discuss, and the server sends the message to the generative AI. The generative AI then generates appropriate advice and provides it to the user via the server. The content of the dialogue is anonymized and saved, and is reflected in the next therapy session.

[1401] Furthermore, when a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, after the workshop ends, feedback information is collected from the user and used to improve future workshops.

[1402] As a concrete example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generation AI to generate an educational math video based on the child's past learning history. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[1403] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue with the AI. For example, if they are worried about their friendships at school, they can enter their concerns and receive appropriate advice from the AI. The content of this dialogue is anonymized and reflected in the next therapy session.

[1404] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[1405] An example of a prompt is:

[1406] Educational content generation: "Create an educational video for math for a 10-year-old. Make it interesting and take into account their learning history."

[1407] Talking Therapy: "My 10-year-old is having trouble with friendships at school. Please provide some appropriate advice."

[1408] In this way, this system provides new educational tools and psychological support to families with children who are not attending school, providing comprehensive support for children's learning and mental health.

[1409] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1410] User Authentication Module

[1411] Step 1:

[1412] A user enters a user ID and password on the login page. The inputs provided are "user123" and "password789".

[1413] Step 2:

[1414] The device sends this input information to the server using the HTTPS protocol, where it is encrypted using SSL / TLS.

[1415] Step 3:

[1416] The server queries the database to verify that the entered user ID and password are correct. Specifically, it uses an SQL query to find the corresponding user record. Based on this query, the authentication result (success or failure) is returned.

[1417] Step 4:

[1418] The server returns the authentication result, and if the input information is correct, it returns a message indicating successful authentication. If the information is invalid, it returns an error message. If authentication is successful, a session ID is generated and saved in the session database along with the user information.

[1419] Step 5:

[1420] The server starts a session, generates a personal page for the user in HTML format, and sends it to the terminal using the HTTPS protocol. The HTML document is then output.

[1421] Educational content provision module

[1422] Step 1:

[1423] A user accesses the educational content page from My Page. An "access request to the educational content page" is provided as input.

[1424] Step 2:

[1425] The server calls a generative AI model (e.g., GPT-3) and generates new educational content based on the user's learning history (past lesson plans and areas of strength and weakness). This generation uses the input learning history data and generated data from the generative AI model to output optimal educational content. Specifically, the prompt used is, "Generate an educational math video for a 10-year-old child. Please take their past learning history into consideration and make the content interesting."

[1426] Step 3:

[1427] The server provides the generated educational content to users in the form of HTML pages or video files. This content can be in a variety of formats, such as videos, interactive questions, or quizzes. The output is the "generated educational content."

[1428] Step 4:

[1429] View or consume user-generated educational content, for example, watching a 20-minute math video and completing an interactive quiz.

[1430] Step 5:

[1431] The user inputs feedback about the content (e.g., difficulty, comprehension, interest). Feedback information is provided as input.

[1432] Step 6:

[1433] The device sends feedback information to the server via an HTTP POST request. The feedback data is sent in JSON format, and the server stores it in a database. The feedback information is saved as output.

[1434] Interactive Therapy Module

[1435] Step 1:

[1436] A user (child or guardian) accesses the psychological support page. A "request to access the psychological support page" is provided as input.

[1437] Step 2:

[1438] The server runs a generative conversational AI model (e.g., GPT-3), generates an initial conversation message (e.g., "Hello, what would you like to talk about today?"), and sends it to the user as an HTML page. The initial conversation message is provided as output.

[1439] Step 3:

[1440] The user inputs their worries or stress. As input, a "message about worries or stress" is provided. For example, the user might input, "I got into a fight with a friend at school and I don't know what to do."

[1441] Step 4:

[1442] The server sends the user's input message to the AI ​​generator, which then generates appropriate advice. The AI ​​then uses past dialogue data and psychological knowledge to create a reply. The output is "appropriate advice."

[1443] Step 5:

[1444] The server sends the generated advice to the user. For example, advice such as "If you get into a fight with a friend, it's important to calm down and sort out your feelings" is sent in HTML format. The "generated advice" is provided as output.

[1445] Step 6:

[1446] The server anonymizes the conversation content, stores it in a database, and reflects it in the next therapy session. The server outputs the "anonymized conversation content."

[1447] Workshop Management Module

[1448] Step 1:

[1449] A user accesses the workshop listing page. A "request to access the workshop listing page" is provided as input.

[1450] Step 2:

[1451] The server retrieves the currently available workshop information from the database and displays it in HTML format. The output provided is "Workshop Information."

[1452] Step 3:

[1453] The user selects the workshop they wish to attend, enters the necessary information (name, desired date and time of attendance, etc.), and presses the reservation button. The "reservation information" is provided as input.

[1454] Step 4:

[1455] The server saves the reservation information to the database. The data is inserted into the reservation table using an SQL query. The output is provided as "Saved Reservation Information".

[1456] Step 5:

[1457] After the reservation is complete, the server generates a reservation confirmation message (e.g., "Thank you for your reservation. The date and time you will attend the workshop is ____.") and sends it to the user. The "reservation confirmation message" is provided as an output.

[1458] Step 6:

[1459] Before the workshop starts, the server sends a reminder email. For example, it sends a reminder email the day before the workshop starts. The output is "Reminder Email".

[1460] Step 7:

[1461] After the workshop, the server collects feedback from users and stores it in a database. This information is used to improve the content of the next workshop. The input is "feedback information," and the output is "saved feedback information."

[1462] In this way, the system can continue to provide personalized educational content and psychological support to children who are not attending school and their families.

[1463] (Application example 1)

[1464] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1465] In modern society, the number of families with children who do not attend school is increasing, and new educational methods and psychological support are needed to address this issue, but the current system is not sufficient.In addition, there are no means to provide support to these children in physical stores, so a system that allows them to receive effective support even while visiting a physical store is needed.

[1466] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1467] In this invention, the server includes a generating AI means for generating appropriate educational content based on the user's learning history, a means for providing the generated educational content to the user, a means for collecting feedback information from the user and reflecting it in the next content provision, and a means for displaying information on a guidance device in a physical store and providing information about learning spaces and educational events. This makes it possible to provide personalized educational support and psychological support to children who are not attending school even in a physical store.

[1468] "Generative AI means" are means that use artificial intelligence to automatically generate appropriate educational content and psychological support based on the user's learning history and interests.

[1469] The "means for providing educational content" refers to a device or software for visually or audibly providing the generated educational content to the user.

[1470] The "means for collecting feedback information" is a system that collects evaluations and impressions of the learning or therapy provided by the user after use and reflects them in the content of the next service.

[1471] "In-store guidance devices" refer to devices such as robots and tablets installed in physical stores that display information and provide guidance to visitors.

[1472] "Means for providing information about learning spaces and educational events" is a system for providing visitors with information about learning spaces and educational events available within physical stores and encouraging participation.

[1473] The "means for providing information about psychological support services" is a system that provides users with information about psychological support services that can be used online through information devices in physical stores, and promotes their use.

[1474] The "means for supporting participation in workshops" is a system that uses a guidance device in a physical store to obtain detailed information about workshops that the user is interested in and supports them in making reservations to participate.

[1475] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school, and is implemented using guidance devices installed in physical stores. This system is broadly composed of four modules: a user authentication module, an educational content provision module, a dialogue therapy module, and a workshop management module.

[1476] First, in the user authentication module, when a user accesses the system, they enter their login information into a terminal installed in the physical store. The login information is sent to the server, which then queries the database for authentication. If authentication is successful, the user can proceed to the next step.

[1477] Next, in the educational content provision module, a generative AI generates appropriate educational content based on the authenticated user's learning history. This generative AI uses a model such as OpenAI GPT-4. The generated educational content is provided through guidance devices (e.g., robots or tablets) in the physical store, allowing users to receive appropriate learning materials and continue their learning. After learning, users input feedback information, which is collected by the server and reflected in the next content provision.

[1478] In the interactive therapy module, if a user needs psychological support, they can interact with the generative AI via a guide device in a physical store. When the user inputs their worries or stress, the server sends the information to the generative AI, which generates appropriate advice. This generative AI model uses a powerful model capable of natural language processing. The content of the conversation is anonymized and reflected in the next therapy session.

[1479] The workshop management module allows users to obtain detailed information about the workshop they wish to participate in through the information device in the physical store and make a reservation to participate. The server stores the reservation information in a database and sends confirmation messages and reminder emails. In addition, feedback information is collected after the workshop is completed, which is used to improve future workshops.

[1480] Hardware used:

[1481] Guidance devices in physical stores (robots and tablets)

[1482] server

[1483] Database

[1484] Software used:

[1485] Pepper SDK (used for robot control systems)

[1486] OpenAI GPT-4 (generative AI model)

[1487] Apache or NGINX (web server)

[1488] MySQL or PostgreSQL (database)

[1489] Specific examples

[1490] 1. Providing educational content

[1491] Sample prompt: "Generate the best math learning materials based on your past learning history. Create video materials at a 5th grade level that fit your current learning progress."

[1492] 2. Dialogic Therapy Responses

[1493] Sample prompt: "A 10-year-old child is asking for advice about friendships at school. Please provide appropriate advice."

[1494] 3. Workshop Management Guide

[1495] Example prompt: "Write a script that provides detailed information about an online workshop next Saturday and takes reservations for participants."

[1496] This system will enable children who are not attending school to receive individualized educational and psychological support even within a physical store, providing an environment where they can receive learning and psychological support.

[1497] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1498] Step 1:

[1499] The user enters login information into the information device in the physical store. The user ID and password are used as input data, which are sent from the terminal to the server. The server receives this information and queries the database to perform authentication. If authentication is successful, the server generates a message indicating successful authentication and sends it to the terminal.

[1500] Step 2:

[1501] After authenticating, the user requests educational content. The request is sent from the device to the server, which retrieves the user's learning history data from a database. The server then invokes a generative AI model (e.g., OpenAI GPT-4) and passes the prompt sentence to the generative AI model to generate appropriate educational content. The generated educational content is then sent back to the server, which then sends it to the device.

[1502] Step 3:

[1503] The user receives the educational content generated on the device and studies it. After studying, the user enters feedback information into the device. The entered feedback information is sent from the device to the server, which stores it in a database. The feedback information is used the next time content is generated.

[1504] Step 4:

[1505] When a user needs psychological support, they access the psychological support page through their device and enter their worries and stress. The entered data is sent to the server, which then sends prompts to the generative AI model, causing it to generate appropriate interactive therapy content. The generated dialogue message is then sent back to the server, which then sends it to the device.

[1506] Step 5:

[1507] The user receives the content of the interactive therapy and receives support. The user can continue to enter additional feedback or questions as needed. The content of the conversation is anonymized on the server side and stored in a database. It will be reflected in the next therapy session.

[1508] Step 6:

[1509] When a user wishes to participate in a workshop, they access the workshop list page from their device, select the workshop they wish to attend, and enter their reservation information. The entered reservation information is sent from the device to the server, which stores it in a database. The server also generates a confirmation message and a reminder email and sends them to the user's registered email address.

[1510] Step 7:

[1511] After the workshop, users input feedback information through their devices. The information is then sent to the server, which stores it in a database. This information is used to improve future workshops.

[1512] Each of the above steps works as an ongoing process, providing a comprehensive system of education and psychological support within the brick-and-mortar store.

[1513] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1514] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school. This system utilizes generative AI and an emotion engine to provide personalized educational content and interactive therapy based on the user's learning history, psychological state, and emotional information. A specific embodiment of this system is described below.

[1515] 1. User authentication module

[1516] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[1517] 2. Educational content provision module

[1518] After logging in to their personal page, the user (child) accesses the educational content page. The server calls the generation AI to generate appropriate educational content based on the user's learning history and emotional information obtained by the emotion engine. The generated educational content ranges from video learning materials to interactive workbooks. Once the user has finished learning, feedback information is collected and reflected the next time content is provided.

[1519] 3. Interactive Therapy Module

[1520] When a user (child or guardian) accesses the psychological support page, the server activates the dialogue generation AI and emotion engine to generate an initial dialogue message. When the user enters and sends a message about the worries or stress they want to discuss, the server sends the message and the user's emotional information to the generation AI. The generation AI generates appropriate advice and provides it to the user via the server. The dialogue content and emotional information are anonymized and saved, and are reflected in the next therapy session.

[1521] 4. Workshop Management Module

[1522] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[1523] 5. Emotion Recognition by Emotion Engine

[1524] During the processing of each module, the emotion engine constantly analyzes the user's emotions. For example, the educational content provision module analyzes the user's facial expressions and tone of voice while learning to understand their level of concentration and emotional state. Based on this information, the generative AI creates more appropriate content.

[1525] Specific examples

[1526] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server activates the generative AI and emotion engine to generate an educational math video based on the child's past learning history and current emotional state. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[1527] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue between the generative AI and the emotion engine. For example, if the user is worried about friendships at school, they can enter their emotional information along with the details of their worries, and receive appropriate advice from the generative AI. The content of this dialogue and emotional information are anonymized and reflected in the next therapy session.

[1528] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[1529] In this way, this invention provides new educational tools and psychological support to families with children who are not attending school, comprehensively supporting children's learning and mental health. By combining generative AI with an emotion engine, a more personalized approach can be achieved, increasing user satisfaction.

[1530] The processing flow will be explained below.

[1531] 1. User authentication module

[1532] Processing Steps

[1533] Step 1:

[1534] The user accesses the login screen.

[1535] Step 2:

[1536] The server sends the HTML of the login page to the client.

[1537] Step 3:

[1538] The user enters the user ID and password and clicks the submit button.

[1539] Step 4:

[1540] The terminal sends the input information to the server as a POST request.

[1541] Step 5:

[1542] The server queries the database for the received user ID and password to verify the authentication information.

[1543] Step 6:

[1544] If the server has matching credentials, it starts a session and generates an authentication token.

[1545] Step 7:

[1546] The server sends the authentication token to the user's device and returns the HTML of the My Page as a response.

[1547] Step 8:

[1548] The user is redirected to their My Page and login is complete.

[1549] 2. Educational content provision module

[1550] Processing Steps

[1551] Step 1:

[1552] After the user (child) logs in to their My Page, they access the educational content page.

[1553] Step 2:

[1554] The server sends the HTML of the educational content page to the client.

[1555] Step 3:

[1556] The user clicks the "Start Learning" button.

[1557] Step 4:

[1558] The terminal sends the information to the server as a request.

[1559] Step 5:

[1560] The server calls the generation AI and emotion engine to generate appropriate educational content based on the user's learning history and emotional information.

[1561] Step 6:

[1562] The generative AI generates appropriate educational content (e.g., video teaching materials for mathematics) and sends the information back to the server.

[1563] Step 7:

[1564] The server transmits the generated content to the user terminal.

[1565] Step 8:

[1566] After the user has finished studying the content, they click the "Feedback" button.

[1567] Step 9:

[1568] The device sends feedback information (such as learning satisfaction and emotional state during learning) to the server.

[1569] Step 10:

[1570] The server stores the feedback in a database and uses it to suggest content next time.

[1571] 3. Interactive Therapy Module

[1572] Processing Steps

[1573] Step 1:

[1574] The user (child or guardian) accesses the psychological support page.

[1575] Step 2:

[1576] The server sends the HTML of the psychological support page to the client.

[1577] Step 3:

[1578] The user clicks the "Start conversation" button.

[1579] Step 4:

[1580] The terminal sends the information to the server as a request.

[1581] Step 5:

[1582] The server calls the dialogue generation AI and emotion engine and asks them to generate the initial dialogue message.

[1583] Step 6:

[1584] The generation AI generates the initial dialogue message and sends that information back to the server.

[1585] Step 7:

[1586] The server sends the generated message to the user terminal.

[1587] Step 8:

[1588] The user initiates a dialogue with the AI ​​and inputs a message about a specific concern or stress.

[1589] Step 9:

[1590] The terminal sends the message to the server.

[1591] Step 10:

[1592] The emotion engine analyzes the emotional state (e.g., sadness or anxiety) from the message entered by the user.

[1593] Step 11:

[1594] The server sends the message and emotional state to the generation AI and asks it to generate appropriate advice.

[1595] Step 12:

[1596] The generation AI generates advice and sends the information back to the server.

[1597] Step 13:

[1598] The server transmits the generated advice message to the user terminal.

[1599] Step 14:

[1600] The server anonymizes the dialogue content and emotional information and stores it in a database.

[1601] 4. Workshop Management Module

[1602] Processing Steps

[1603] Step 1:

[1604] A user visits the workshop listing page.

[1605] Step 2:

[1606] The server retrieves available workshops and sends the HTML of the list page to the client.

[1607] Step 3:

[1608] The user selects the workshop they wish to participate in and clicks the "Apply for Participation" button.

[1609] Step 4:

[1610] The device sends a request to the server containing the selected workshop ID.

[1611] Step 5:

[1612] The server retrieves detailed information about the selected workshop from the database and displays a reservation screen for the user.

[1613] Step 6:

[1614] The user enters the reservation information (date, time and additional details) and clicks submit.

[1615] Step 7:

[1616] The terminal sends the reservation information to the server as a POST request.

[1617] Step 8:

[1618] The server stores the reservation information in a database and generates a reservation confirmation message.

[1619] Step 9:

[1620] The server sends a reservation confirmation message to the user terminal and simultaneously sends a reminder email.

[1621] Step 10:

[1622] After the workshop is over, users can access the feedback page and enter their impressions and ratings.

[1623] Step 11:

[1624] The terminal sends feedback information to the server.

[1625] Step 12:

[1626] The server stores the feedback in a database and uses it to improve future workshops.

[1627] 5. Emotion Recognition by Emotion Engine

[1628] Processing Steps

[1629] Step 1:

[1630] The server activates an emotion engine and analyzes the user's emotions in real time.

[1631] Step 2:

[1632] The device transmits the user's facial expressions and voice to the emotion engine via the camera and microphone.

[1633] Step 3:

[1634] An emotion engine analyzes the user's emotional state (e.g., joy, surprise, sadness).

[1635] Step 4:

[1636] The server sends this emotional information to the generation AI and other modules, which then reflect it in their respective processing.

[1637] Step 5:

[1638] The emotion engine anonymizes the user's emotional data and stores it in a database for future learning and therapy sessions.

[1639] Example 2

[1640] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1641] In today's education system, it is difficult to provide personalized educational methods and psychological support to children who are refusing to go to school. In particular, traditional educational content rarely takes into account children's learning history or emotional state, making it difficult to support efficient learning. Furthermore, there is a lack of systems for providing appropriate interactive therapy to children with psychological problems. Furthermore, there are challenges in efficiently managing workshops to improve social skills and collecting feedback.

[1642] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1643] In this invention, the server includes a means for performing authentication based on the user's login information, a generation AI means for generating appropriate educational content based on the user's learning history and emotional state, a means for providing the generated educational content to the user, a means for collecting feedback information from the user and reflecting it in the next content provision, and a means for analyzing the user's emotional information and reflecting it in the educational content. This makes it possible to provide personalized educational content and psychological support to children who are not attending school, and to comprehensively support the children's learning effectiveness and mental health.

[1644] "User login information" refers to the identification information required for a user to access a system, and generally refers to a combination of a user ID and password.

[1645] "Authentication methods" refers to the processes and functions used to verify a user's login information and confirm their access rights to a system.

[1646] "Study history" is data that records the user's past learning content and progress.

[1647] "Emotional state" refers to the emotional response or psychological state a user exhibits at a particular point in time.

[1648] "Generative AI means" refers to processes and functions that use artificial intelligence to generate personalized educational content or interactive therapy based on a user's learning history and emotional state.

[1649] "Educational content" refers to materials such as teaching materials, workbooks, and videos that users use for learning.

[1650] "Feedback information" refers to opinions and evaluations provided by users regarding educational content, workshops, etc.

[1651] "Emotional information" refers to the user's emotional data and information analyzed by the emotion engine.

[1652] "Interactive therapy" refers to the process and functionality of providing interactive counseling and advice to assist a user with their psychological condition.

[1653] "Workshop" refers to an online or offline session organized for a specific learning or activity purpose.

[1654] "Reservation Information" refers to the dates and participant information provided by a User to participate in a particular workshop or seminar.

[1655] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school. The system utilizes generative AI and an emotion engine to provide personalized educational content and interactive therapy based on the user's learning history, psychological state, and emotional information. A specific embodiment of this system is described below.

[1656] 1. User authentication module

[1657] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[1658] 2. Educational content provision module

[1659] After logging in to their personal page, the user (child) accesses the educational content page. The server launches the generation AI, specifically using OpenAI's GPT-3 and EmotionAnalyzer as an emotion engine. This generates appropriate educational content based on the user's learning history and emotional information. The generated educational content ranges from video learning materials to interactive workbooks. When the user has finished learning, feedback information is sent from the device to the server, and is reflected the next time content is provided. A specific example of a prompt is as follows:

[1660] "Generate educational content for mathematics suitable for a 10-year-old child. Create video materials that are fun to learn based on their past learning history and current emotional state."

[1661] 3. Interactive Therapy Module

[1662] When a user (child or guardian) accesses the psychological support page, the server launches the interactive generation AI. Specifically, ChatGPT and EmotionAnalyzer are used to generate the initial conversation message. When the user enters and sends a message about the worries or stress they want to discuss, the server sends the message and the user's emotional information to the generation AI. The generation AI then generates appropriate advice and provides it to the user via the server. The content of the conversation and emotional information are anonymized and saved, and will be reflected in the next therapy session. Specific examples of prompts are as follows:

[1663] "Please advise the user if they are having trouble with friendships at school. Their recent emotional state is unsettling."

[1664] 4. Workshop Management Module

[1665] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[1666] 5. Emotion Recognition by Emotion Engine

[1667] During the processing of each module, the emotion engine, EmotionAnalyzer, constantly analyzes the user's emotions. For example, the educational content provision module analyzes the user's facial expressions and tone of voice while learning to understand their level of concentration and emotional state. Based on this information, the generative AI creates more appropriate content. The emotional information collected by the emotion engine is stored in a database and used for future improvements and customization.

[1668] Specific examples

[1669] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generative AI (GPT-3) and an emotion engine (EmotionAnalyzer) to generate an educational math video based on the child's past learning history and current emotional state. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[1670] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses the psychological support page and initiates a dialogue between the generative AI (ChatGPT) and the emotion engine (EmotionAnalyzer). For example, if the user is worried about friendships at school, they can enter their emotional information along with the details of their worries, and receive appropriate advice from the generative AI. The content of this dialogue and emotional information are anonymized and reflected in the next therapy session.

[1671] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[1672] In this way, this invention provides new educational tools and psychological support to families with children who are not attending school, comprehensively supporting children's learning and mental health. By combining generative AI with an emotion engine, a more personalized approach can be achieved, increasing user satisfaction.

[1673] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1674] User authentication process

[1675] Step 1:

[1676] The user accesses the system's login page in a browser.

[1677] Input: User enters a URL

[1678] Output: Login page displayed

[1679] Step 2:

[1680] The terminal enters the user ID and password into the form.

[1681] Input: User ID and password

[1682] Output: Authentication data entered into the form

[1683] Step 3:

[1684] The terminal clicks the submit button and sends the form data to the server.

[1685] Input: The authentication data entered

[1686] Output: Sends authentication data to the server

[1687] Step 4:

[1688] The server queries the database for the authentication data it receives and finds a matching record.

[1689] Input: Authentication data

[1690] Output: Authentication result (success or failure)

[1691] Step 5:

[1692] The server returns the authentication result to the terminal.

[1693] Input: Authentication result

[1694] Output: Redirect to my page on success, error message on failure

[1695] Educational content provision process flow

[1696] Step 1:

[1697] The user accesses the educational content page on their My Page.

[1698] Input: User clicks on the "Educational Content" button

[1699] Output: Display of educational content page

[1700] Step 2:

[1701] The server retrieves the user's profile information (learning history, emotional state) from the database.

[1702] Input: User ID

[1703] Output: Learning history and emotional information

[1704] Step 3:

[1705] The server sends the user's learning history and emotional information to the generation AI, which then generates a prompt.

[1706] Input: Learning history, emotional information, prompt sentence

[1707] Output: Generated educational content

[1708] Step 4:

[1709] The server sends the generated educational content (videos, workbooks, etc.) to the terminal.

[1710] Input: Generated educational content

[1711] Output: Educational content delivery

[1712] Step 5:

[1713] Users learn by using educational content.

[1714] Input: Educational Content

[1715] Output: Learning progress

[1716] Step 6:

[1717] After the device has completed learning, it inputs the user's feedback and sends it to the server.

[1718] Input: Feedback information

[1719] Output: Sending feedback to the server

[1720] Step 7:

[1721] The server stores the feedback data in a database and reflects it in the next content generation.

[1722] Input: Feedback information

[1723] Output: Save to database and reflect next time

[1724] Interactive Therapy Process

[1725] Step 1:

[1726] The user clicks the "Psychological Support" button on their personal page.

[1727] Input: User clicks "Emotional Support" button

[1728] Output: Display of psychological support page

[1729] Step 2:

[1730] The server calls ChatGPT and EmotionAnalyzer and sends a prompt to generate the initial message.

[1731] Input: Initial prompt statement

[1732] Output: Initial interaction message

[1733] Step 3:

[1734] The server sends the generated initial interaction message to the terminal.

[1735] Input: Initial conversation message

[1736] Output: First message delivered

[1737] Step 4:

[1738] The device inputs the user's concerns and questions and sends them to the server.

[1739] Input: Your concerns or questions

[1740] Output: Sending the consultation details to the server

[1741] Step 5:

[1742] The server sends the received message and emotional information to the generation AI, which then generates a prompt.

[1743] Input: User message and emotion information

[1744] Output: The generated advice

[1745] Step 6:

[1746] The server transmits the generated advice to the terminal.

[1747] Input: Generated advice

[1748] Output: Advice delivery

[1749] Step 7:

[1750] The server anonymizes the content of the conversation and emotional information and stores it in a database.

[1751] Input: Dialogue content and emotion information

[1752] Output: Anonymized data storage

[1753] Workshop management process flow

[1754] Step 1:

[1755] A user visits the workshop listing page.

[1756] Input: User clicks "Workshop List" button

[1757] Output: Workshop list page

[1758] Step 2:

[1759] The server retrieves currently available workshop information from the database and displays it on the terminal.

[1760] Input: User request

[1761] Output: Display workshop information

[1762] Step 3:

[1763] The user selects the workshop they wish to attend, enters information in the reservation form and submits it.

[1764] Input: Reservation information

[1765] Output: Send reservation information to the server

[1766] Step 4:

[1767] The server stores the reservation information in a database.

[1768] Input: Reservation information

[1769] Output: Save reservation information

[1770] Step 5:

[1771] The server sends a confirmation message of the reservation completion to the terminal and schedules a reminder email.

[1772] Input: Booking completion trigger

[1773] Output: Confirmation message and reminder email sent

[1774] Step 6:

[1775] After the workshop is over, the terminal displays a feedback form, and the user enters and submits feedback information.

[1776] Input: Feedback information

[1777] Output: Send feedback information to the server

[1778] Step 7:

[1779] The server stores the feedback data in a database and uses it to improve the next workshop.

[1780] Input: Feedback information

[1781] Output: Save to database and reflect in next improvement

[1782] Emotion recognition processing flow by the emotion engine

[1783] Step 1:

[1784] The server monitors webcam and microphone input in real time.

[1785] Input: User's camera video and audio

[1786] Output: Real-time video and audio data

[1787] Step 2:

[1788] The emotion engine EmotionAnalyzer analyzes the user's facial expressions and tone of voice.

[1789] Input: Camera video and audio data

[1790] Output: User's emotional information

[1791] Step 3:

[1792] The server stores the analysis results (emotional information) in a database in real time.

[1793] Input: Emotion information

[1794] Output: Save to database

[1795] Step 4:

[1796] It is used by generative AI to generate content and advice based on emotional information.

[1797] Input: Emotion information

[1798] Output: More personalized content and advice

[1799] In this way, each processing step works in conjunction with each other to realize a system that provides optimal education and psychological support to children who are not attending school.

[1800] (Application example 2)

[1801] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1802] In modern society, the number of families with children who do not attend school is increasing, which results in children not receiving an appropriate education and often experiencing psychological stress. It is also difficult for parents and children to receive education and psychological support through in-store activities. In response to this, there is a need for a system that provides integrated, personalized educational content and psychological support that parents and children can easily access within a physical store.

[1803] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a generation AI means for generating appropriate educational content based on the user's learning history, a means for providing the generated educational content to the user, and a means for collecting feedback information from the user and reflecting it in the next content provision. This makes it possible to provide personalized educational content based on the user's learning history.

[1804] The server also includes a generating AI means for analyzing the user's psychological state and providing an appropriate conversational therapy, and a means for anonymizing and saving the content of the conversational therapy and reflecting it in the next therapy session, thereby enabling the provision of personalized conversational therapy based on the user's psychological state.

[1805] The server also includes a means for acquiring detailed information about the workshop selected by the user and managing reservation information, a means for sending a confirmation message and a reminder email after the reservation is made, and a means for collecting feedback information after the workshop is completed and using it to improve future workshops. This allows users to easily participate in workshops held in physical stores and increase their effectiveness.

[1806] Finally, it includes a means to provide educational content and interactive therapy in brick-and-mortar stores as a smartphone app, allowing parents and children to easily receive education and psychological support within the brick-and-mortar store.

[1807] "Generative AI means" is an artificial intelligence technology that automatically generates personalized educational content and interactive therapy based on the user's learning history and psychological state.

[1808] The "means for providing educational content" refers to a mechanism for appropriately providing the generated educational content to users, enabling them to view and use it.

[1809] "Means for collecting feedback information" refers to the process of collecting opinions and reactions from users and reflecting that information in the next content generation and provision.

[1810] "Means for analyzing psychological state" refers to technology that analyzes the user's emotions and psychological state and uses the results to provide personalized interactive therapy.

[1811] "Means for providing interactive therapy" is a system that uses generative AI to provide advice and counseling based on the user's psychological state.

[1812] The "means for managing reservation information" is a system that acquires reservation information for workshops that users wish to participate in and efficiently manages that information.

[1813] The "means for sending a confirmation message and a reminder email" is a process for sending a confirmation message and a reminder email to a user after the workshop is booked.

[1814] The "means for collecting feedback information from the workshop" is a system for collecting feedback information from users after the workshop is completed and using this information to improve future workshops.

[1815] The "smartphone app for providing educational content and interactive therapy in brick-and-mortar stores" is a mobile application designed to allow parents and children to easily receive education and psychological support in brick-and-mortar stores.

[1816] This invention relates to a system for parents and children to receive personalized educational content and psychological support in a brick-and-mortar store. The system includes a generating AI means, a means for providing educational content, a means for collecting feedback information, a means for analyzing psychological states, a means for providing interactive therapy, a means for managing reservation information, a means for sending confirmation messages and reminder emails, a means for collecting feedback information on workshops, and a smartphone app for provision in the brick-and-mortar store.

[1817] Program Generation

[1818] The system uses the following hardware and software:

[1819] Hardware

[1820] Smartphone (iOS / Android)

[1821] software

[1822] Generative AI engine (OpenAI GPT-4)

[1823] Emotion Engine (Emotion API)

[1824] Frontend (React Native)

[1825] Backend (Node.js, Express)

[1826] Database (MongoDB)

[1827] Processing Description

[1828] Educational content provision function

[1829] The server uses generative AI to generate appropriate educational content based on the user's learning history and emotional information. This content is provided to the user via a smartphone application. After the user uses the content, feedback information is collected and reflected in the next content provision.

[1830] Interactive Therapy Features

[1831] If the user needs psychological support, the server uses an emotion engine to analyze the user's psychological state and uses generative AI to provide appropriate conversational therapy. The conversation content is anonymized and used in the next session.

[1832] Workshop management function

[1833] The server obtains detailed information about the workshop selected by the user and manages the reservation information. After the reservation, a confirmation message and a reminder email are sent. After the workshop ends, the server collects user feedback information to help improve future workshops.

[1834] Use in physical stores

[1835] The smartphone app, which provides educational content and interactive therapy, is designed for easy use by parents and children in physical stores, seamlessly delivering functionality through the app and enriching the in-store experience.

[1836] Specific examples

[1837] For example, if a 10-year-old child wants to learn educational history content at a bookstore, he or she will follow the steps below. First, he or she logs in to a smartphone app. Next, the device sends learning history and emotional information to the server. The server then sends a request to the generation AI to generate an appropriate educational history video. The generated video is then returned to the device and provided to the user. After learning, feedback information is collected and reflected in the next content.

[1838] In addition, if a parent is feeling stressed about their child's friendships at school, they can use the psychological support function. The device sends the consultation content and emotional information to the server, and receives a counseling message from the AI ​​that generates it.

[1839] Example prompts for generative AI models

[1840] 1. Educational Content:

[1841] User ID: 12345's learning history is as follows: Math: Good, Social Studies: Bad. Current emotional state is "concentration." Please generate an educational history video suitable for this user.

[1842] 2. Talking Therapy:

[1843] User ID: 67890 is worried about friendships at school. Emotional state: "Stress." Please generate an appropriate counseling message.

[1844] 3. Workshop Management:

[1845] View a list of available workshops.

[1846] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1847] Step 1:

[1848] The server receives authentication information for a user to log in to a smartphone app. The input is a user ID and password, which the server checks against the database and starts a session if a matching record is found. The output is the HTML of the user's personal page if successful.

[1849] Step 2:

[1850] The server receives the user's learning history and emotional information and sends it to the backend as input data required to generate educational content. The input data is the learning history and current emotional state, and appropriate educational content is generated using a generative AI engine (GPT-4). The output is the generated educational content (videos and workbooks).

[1851] Step 3:

[1852] The server sends the generated educational content to the smartphone application, which then provides it to the user. The user uses this content to study. The input is the generated educational content, and the output is the user's usage status.

[1853] Step 4:

[1854] After the device has finished learning, it collects feedback information from the user and sends it to the server. The input is the user's feedback information, and the server stores this information in a database and reflects it in the next content generation. The output is updated feedback data.

[1855] Step 5:

[1856] The server receives a request for psychological support from the user and analyzes the emotional information using an emotion engine. The input is the user's psychological state and the content of the consultation, and an appropriate counseling message is generated using a generative AI engine. The output is the generated counseling message.

[1857] Step 6:

[1858] The server sends the generated counseling message to the terminal, which then provides it to the user. The input is the generated counseling message, which the user confirms and, if necessary, provides additional consultation. The output is the user's response.

[1859] Step 7:

[1860] The server obtains the details of the workshop selected by the user and manages the reservation information. The input is the selected workshop information, which the server saves in the database. The output is a reservation confirmation message.

[1861] Step 8:

[1862] After the reservation is completed, the server generates a confirmation message and a reminder email and sends them to the terminal. The input is the reservation information, and the output is the confirmation message and the reminder email.

[1863] Step 9:

[1864] After the workshop, the terminal collects feedback information from users and sends it to the server. The input is the user feedback information, which the server stores in a database and uses to improve future workshops. The output is updated feedback data.

[1865] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1866] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1867] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1868] [Fourth embodiment]

[1869] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1870] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1871] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1872] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1873] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1874] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1875] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1876] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1877] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1878] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1879] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1880] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1881] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1882] The present invention is a system that provides new educational tools and psychological support to families with children who are not attending school. This system utilizes generative AI to provide personalized educational content and interactive therapy based on the user's learning history and psychological state. A specific embodiment of this system is described below.

[1883] 1. User authentication module

[1884] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[1885] 2. Educational content provision module

[1886] After logging in to their personal page, the user (child) accesses the educational content page. The server calls the generation AI to generate appropriate educational content based on the user's learning history and interests. The generated educational content ranges from video learning materials to interactive workbooks. Once the user has finished learning, feedback information is collected and reflected the next time content is provided.

[1887] 3. Interactive Therapy Module

[1888] When a user (child or guardian) accesses the psychological support page, the server launches an interactive generation AI to generate an initial conversation message. The user enters and sends a message about the worries or stress they want to discuss, and the server sends the message to the generation AI. The generation AI generates appropriate advice and provides it to the user via the server. The content of the conversation is anonymized and saved, and is reflected in the next therapy session.

[1889] 4. Workshop Management Module

[1890] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[1891] Specific examples

[1892] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generation AI to generate an educational math video based on the child's past learning history. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[1893] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue with the AI. For example, if they are worried about their friendships at school, they can enter their concerns and receive appropriate advice from the AI. The content of this dialogue is anonymized and reflected in the next therapy session.

[1894] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[1895] In this way, the present invention provides new educational tools and psychological support to families with children who are not attending school, and provides comprehensive support for children's learning and mental health.

[1896] The processing flow will be explained below.

[1897] 1. User authentication module

[1898] Processing Steps

[1899] Step 1:

[1900] The user accesses the login screen.

[1901] Step 2:

[1902] The server sends the HTML of the login page to the client.

[1903] Step 3:

[1904] The user enters the user ID and password and clicks the submit button.

[1905] Step 4:

[1906] The terminal sends the input information to the server as a POST request.

[1907] Step 5:

[1908] The server queries the database for the received user ID and password to verify the authentication information.

[1909] Step 6:

[1910] If the server has matching credentials, it starts a session and generates an authentication token.

[1911] Step 7:

[1912] The server sends the authentication token to the user's device and returns the HTML of the My Page as a response.

[1913] Step 8:

[1914] The user is redirected to their My Page and login is complete.

[1915] 2. Educational content provision module

[1916] Processing Steps

[1917] Step 1:

[1918] After the user (child) logs in to their My Page, they access the educational content page.

[1919] Step 2:

[1920] The server sends the HTML of the educational content page to the client.

[1921] Step 3:

[1922] The user clicks the "Start Learning" button.

[1923] Step 4:

[1924] The terminal sends the information to the server as a request.

[1925] Step 5:

[1926] The server calls the generation AI and generates appropriate educational content based on the user's learning history and interests.

[1927] Step 6:

[1928] The generative AI generates appropriate educational content (e.g., video teaching materials for mathematics) and sends the information back to the server.

[1929] Step 7:

[1930] The server transmits the generated content to the user terminal.

[1931] Step 8:

[1932] After the user has finished studying the content, they click the "Feedback" button.

[1933] Step 9:

[1934] The terminal sends feedback information to the server.

[1935] Step 10:

[1936] The server stores the feedback in a database and uses it to suggest content next time.

[1937] 3. Interactive Therapy Module

[1938] Processing Steps

[1939] Step 1:

[1940] The user (child or guardian) accesses the psychological support page.

[1941] Step 2:

[1942] The server sends the HTML of the psychological support page to the client.

[1943] Step 3:

[1944] The user clicks the "Start conversation" button.

[1945] Step 4:

[1946] The terminal sends the information to the server as a request.

[1947] Step 5:

[1948] The server calls the dialogue generation AI (therapy module) and asks it to generate the initial dialogue message.

[1949] Step 6:

[1950] The generation AI generates the initial dialogue message and sends that information back to the server.

[1951] Step 7:

[1952] The server sends the generated message to the user terminal.

[1953] Step 8:

[1954] The user initiates a dialogue with the AI ​​and inputs a message about a specific concern or stress.

[1955] Step 9:

[1956] The terminal sends the message to the server.

[1957] Step 10:

[1958] The server then asks the generation AI to analyze the message and generate appropriate advice.

[1959] Step 11:

[1960] The generation AI generates advice and sends the information back to the server.

[1961] Step 12:

[1962] The server transmits the generated advice message to the user terminal.

[1963] Step 13:

[1964] The server anonymizes the conversation and stores it in a database.

[1965] 4. Workshop Management Module

[1966] Processing Steps

[1967] Step 1:

[1968] A user visits the workshop listing page.

[1969] Step 2:

[1970] The server retrieves available workshops and sends the HTML of the list page to the client.

[1971] Step 3:

[1972] The user selects the workshop they wish to participate in and clicks the "Apply for Participation" button.

[1973] Step 4:

[1974] The device sends a request to the server containing the selected workshop ID.

[1975] Step 5:

[1976] The server retrieves detailed information about the selected workshop from the database and displays a reservation screen for the user.

[1977] Step 6:

[1978] The user enters the reservation information (date, time and additional details) and clicks submit.

[1979] Step 7:

[1980] The terminal sends the reservation information to the server as a POST request.

[1981] Step 8:

[1982] The server stores the reservation information in a database and generates a reservation confirmation message.

[1983] Step 9:

[1984] The server sends a reservation confirmation message to the user terminal and simultaneously sends a reminder email.

[1985] Step 10:

[1986] After the workshop is over, users can access the feedback page and enter their impressions and ratings.

[1987] Step 11:

[1988] The terminal sends feedback information to the server.

[1989] Step 12:

[1990] The server stores the feedback in a database and uses it to improve future workshops.

[1991] This shows a concrete process flow for providing comprehensive educational support and psychological support to families with children who are not attending school.

[1992] Example 1

[1993] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1994] Traditional educational and psychological support systems lacked the flexibility to respond to individual needs, making it difficult to provide sufficient academic and psychological support to families with children who were not attending school. Furthermore, the process of collecting feedback and reflecting it in the next content offering was inefficient, and the procedures for booking and participating in workshops were complicated.

[1995] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1996] In this invention, the server includes a means for accepting and authenticating user input information, a means for generating appropriate educational content using a generation AI based on the user's learning history, and a means for providing the generated educational content to the user. This makes it possible to provide educational content customized for each user and further improve the next educational content based on the results.

[1997] The server further includes a means for collecting feedback information from users and reflecting it in the next content provision, a means for analyzing the psychological state of the user and providing appropriate interactive therapy using a generation AI, a means for anonymizing and saving the content of the interactive therapy and reflecting it in the next therapy session, a means for acquiring detailed information about the workshop selected by the user and managing reservation information, a means for sending a confirmation message and a reminder email after a reservation is made, and a means for collecting feedback information after the workshop ends and using it to improve future workshops.This makes it possible to provide comprehensive support that meets the individual needs of users and improve the quality of education and psychological support.

[1998] "Users" refers to people who use this system, and primarily includes children who are not attending school and their parents.

[1999] "Educational content" refers to various learning resources such as teaching materials, workbooks, and videos that users can use to study.

[2000] "Generative AI" refers to an artificial intelligence model that generates appropriate educational content or interactive therapy based on user information.

[2001] "Feedback information" refers to information such as evaluations, impressions, and learning outcomes provided by users after using content or services.

[2002] "Conversational therapy" refers to a form of therapy in which the user and generative AI provide psychological support and advice through dialogue.

[2003] "Mental state" refers to the user's mental and emotional state, and serves as basic data for the generation AI to analyze and provide appropriate advice.

[2004] "Workshop" refers to a group activity or educational session based on a specific theme that users can book in advance to attend.

[2005] "Reservation Information" refers to data related to a reservation, such as the date, time, and personal information provided by a User to participate in a Workshop.

[2006] A "reminder email" refers to a notification email sent to users before the start of a workshop, and is used to reconfirm the participation date and time, etc.

[2007] This invention relates to a system that provides new educational tools and psychological support to families with children who are not attending school. The system utilizes generative AI models to provide personalized educational content and interactive therapy based on the user's learning history and psychological state.

[2008] This system uses the following hardware and software:

[2009] Devices: PCs, smartphones, tablets, etc.

[2010] Server: Web server (e.g. Apache, Nginx)

[2011] Database: MySQL, PostgreSQL, etc.

[2012] Generative AI models: GPT-3, etc.

[2013] When a user accesses the system, they first enter their login information using a terminal. The terminal then sends the entered user ID and password to the server. The server queries the database for this information, and if there is a matching record, the authentication is successful and the session begins. If the authentication is successful, the server sends the HTML of the user's personal page to the user.

[2014] When a user logs in to their personal page and accesses the educational content page, the server invokes the generative AI model to generate appropriate educational content based on the user's learning history and interests. This generated educational content ranges from video learning materials to interactive question sets. After the user has completed their learning, feedback information is collected and reflected in the next content provision.

[2015] Additionally, when a user accesses the psychological support page, the server activates an interactive generative AI model to generate an initial dialogue message. The user enters and sends a message about the worries or stress they want to discuss, and the server sends the message to the generative AI. The generative AI then generates appropriate advice and provides it to the user via the server. The content of the dialogue is anonymized and saved, and is reflected in the next therapy session.

[2016] Furthermore, when a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, after the workshop ends, feedback information is collected from the user and used to improve future workshops.

[2017] As a concrete example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server launches a generation AI to generate an educational math video based on the child's past learning history. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[2018] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue with the AI. For example, if they are worried about their friendships at school, they can enter their concerns and receive appropriate advice from the AI. The content of this dialogue is anonymized and reflected in the next therapy session.

[2019] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[2020] An example of a prompt is:

[2021] Educational content generation: "Create an educational video for math for a 10-year-old. Make it interesting and take into account their learning history."

[2022] Talking Therapy: "My 10-year-old is having trouble with friendships at school. Please provide some appropriate advice."

[2023] In this way, this system provides new educational tools and psychological support to families with children who are not attending school, providing comprehensive support for children's learning and mental health.

[2024] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2025] User Authentication Module

[2026] Step 1:

[2027] A user enters a user ID and password on the login page. The inputs provided are "user123" and "password789".

[2028] Step 2:

[2029] The device sends this input information to the server using the HTTPS protocol, where it is encrypted using SSL / TLS.

[2030] Step 3:

[2031] The server queries the database to verify that the entered user ID and password are correct. Specifically, it uses an SQL query to find the corresponding user record. Based on this query, the authentication result (success or failure) is returned.

[2032] Step 4:

[2033] The server returns the authentication result, and if the input information is correct, it returns a message indicating successful authentication. If the information is invalid, it returns an error message. If authentication is successful, a session ID is generated and saved in the session database along with the user information.

[2034] Step 5:

[2035] The server starts a session, generates a personal page for the user in HTML format, and sends it to the terminal using the HTTPS protocol. The HTML document is then output.

[2036] Educational content provision module

[2037] Step 1:

[2038] A user accesses the educational content page from My Page. An "access request to the educational content page" is provided as input.

[2039] Step 2:

[2040] The server calls a generative AI model (e.g., GPT-3) and generates new educational content based on the user's learning history (past lesson plans and areas of strength and weakness). This generation uses the input learning history data and generated data from the generative AI model to output optimal educational content. Specifically, the prompt used is, "Generate an educational math video for a 10-year-old child. Please take their past learning history into consideration and make the content interesting."

[2041] Step 3:

[2042] The server provides the generated educational content to users in the form of HTML pages or video files. This content can be in a variety of formats, such as videos, interactive questions, or quizzes. The output is the "generated educational content."

[2043] Step 4:

[2044] View or consume user-generated educational content, for example, watching a 20-minute math video and completing an interactive quiz.

[2045] Step 5:

[2046] The user inputs feedback about the content (e.g., difficulty, comprehension, interest). Feedback information is provided as input.

[2047] Step 6:

[2048] The device sends feedback information to the server via an HTTP POST request. The feedback data is sent in JSON format, and the server stores it in a database. The feedback information is saved as output.

[2049] Interactive Therapy Module

[2050] Step 1:

[2051] A user (child or guardian) accesses the psychological support page. A "request to access the psychological support page" is provided as input.

[2052] Step 2:

[2053] The server runs a generative conversational AI model (e.g., GPT-3), generates an initial conversation message (e.g., "Hello, what would you like to talk about today?"), and sends it to the user as an HTML page. The initial conversation message is provided as output.

[2054] Step 3:

[2055] The user inputs their worries or stress. As input, a "message about worries or stress" is provided. For example, the user might input, "I got into a fight with a friend at school and I don't know what to do."

[2056] Step 4:

[2057] The server sends the user's input message to the AI ​​generator, which then generates appropriate advice. The AI ​​then uses past dialogue data and psychological knowledge to create a reply. The output is "appropriate advice."

[2058] Step 5:

[2059] The server sends the generated advice to the user. For example, advice such as "If you get into a fight with a friend, it's important to calm down and sort out your feelings" is sent in HTML format. The "generated advice" is provided as output.

[2060] Step 6:

[2061] The server anonymizes the conversation content, stores it in a database, and reflects it in the next therapy session. The server outputs the "anonymized conversation content."

[2062] Workshop Management Module

[2063] Step 1:

[2064] A user accesses the workshop listing page. A "request to access the workshop listing page" is provided as input.

[2065] Step 2:

[2066] The server retrieves the currently available workshop information from the database and displays it in HTML format. The output provided is "Workshop Information."

[2067] Step 3:

[2068] The user selects the workshop they wish to attend, enters the necessary information (name, desired date and time of attendance, etc.), and presses the reservation button. The "reservation information" is provided as input.

[2069] Step 4:

[2070] The server saves the reservation information to the database. The data is inserted into the reservation table using an SQL query. The output is provided as "Saved Reservation Information".

[2071] Step 5:

[2072] After the reservation is complete, the server generates a reservation confirmation message (e.g., "Thank you for your reservation. The date and time you will attend the workshop is ____.") and sends it to the user. The "reservation confirmation message" is provided as an output.

[2073] Step 6:

[2074] Before the workshop starts, the server sends a reminder email. For example, it sends a reminder email the day before the workshop starts. The output is "Reminder Email".

[2075] Step 7:

[2076] After the workshop, the server collects feedback from users and stores it in a database. This information is used to improve the content of the next workshop. The input is "feedback information," and the output is "saved feedback information."

[2077] In this way, the system can continue to provide personalized educational content and psychological support to children who are not attending school and their families.

[2078] (Application example 1)

[2079] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2080] In modern society, the number of families with children who do not attend school is increasing, and new educational methods and psychological support are needed to address this issue, but the current system is not sufficient.In addition, there are no means to provide support to these children in physical stores, so a system that allows them to receive effective support even while visiting a physical store is needed.

[2081] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2082] In this invention, the server includes a generating AI means for generating appropriate educational content based on the user's learning history, a means for providing the generated educational content to the user, a means for collecting feedback information from the user and reflecting it in the next content provision, and a means for displaying information on a guidance device in a physical store and providing information about learning spaces and educational events. This makes it possible to provide personalized educational support and psychological support to children who are not attending school even in a physical store.

[2083] "Generative AI means" are means that use artificial intelligence to automatically generate appropriate educational content and psychological support based on the user's learning history and interests.

[2084] The "means for providing educational content" refers to a device or software for visually or audibly providing the generated educational content to the user.

[2085] The "means for collecting feedback information" is a system that collects evaluations and impressions of the learning or therapy provided by the user after use and reflects them in the content of the next service.

[2086] "In-store guidance devices" refer to devices such as robots and tablets installed in physical stores that display information and provide guidance to visitors.

[2087] "Means for providing information about learning spaces and educational events" is a system for providing visitors with information about learning spaces and educational events available within physical stores and encouraging participation.

[2088] The "means for providing information about psychological support services" is a system that provides users with information about psychological support services that can be used online through information devices in physical stores, and promotes their use.

[2089] The "means for supporting participation in workshops" is a system that uses a guidance device in a physical store to obtain detailed information about workshops that the user is interested in and supports them in making reservations to participate.

[2090] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school, and is implemented using guidance devices installed in physical stores. This system is broadly composed of four modules: a user authentication module, an educational content provision module, a dialogue therapy module, and a workshop management module.

[2091] First, in the user authentication module, when a user accesses the system, they enter their login information into a terminal installed in the physical store. The login information is sent to the server, which then queries the database for authentication. If authentication is successful, the user can proceed to the next step.

[2092] Next, in the educational content provision module, a generative AI generates appropriate educational content based on the authenticated user's learning history. This generative AI uses a model such as OpenAI GPT-4. The generated educational content is provided through guidance devices (e.g., robots or tablets) in the physical store, allowing users to receive appropriate learning materials and continue their learning. After learning, users input feedback information, which is collected by the server and reflected in the next content provision.

[2093] In the interactive therapy module, if a user needs psychological support, they can interact with the generative AI via a guide device in a physical store. When the user inputs their worries or stress, the server sends the information to the generative AI, which generates appropriate advice. This generative AI model uses a powerful model capable of natural language processing. The content of the conversation is anonymized and reflected in the next therapy session.

[2094] The workshop management module allows users to obtain detailed information about the workshop they wish to participate in through the information device in the physical store and make a reservation to participate. The server stores the reservation information in a database and sends confirmation messages and reminder emails. In addition, feedback information is collected after the workshop is completed, which is used to improve future workshops.

[2095] Hardware used:

[2096] Guidance devices in physical stores (robots and tablets)

[2097] server

[2098] Database

[2099] Software used:

[2100] Pepper SDK (used for robot control systems)

[2101] OpenAI GPT-4 (generative AI model)

[2102] Apache or NGINX (web server)

[2103] MySQL or PostgreSQL (database)

[2104] Specific examples

[2105] 1. Providing educational content

[2106] Sample prompt: "Generate the best math learning materials based on your past learning history. Create video materials at a 5th grade level that fit your current learning progress."

[2107] 2. Dialogic Therapy Responses

[2108] Sample prompt: "A 10-year-old child is asking for advice about friendships at school. Please provide appropriate advice."

[2109] 3. Workshop Management Guide

[2110] Example prompt: "Write a script that provides detailed information about an online workshop next Saturday and takes reservations for participants."

[2111] This system will enable children who are not attending school to receive individualized educational and psychological support even within a physical store, providing an environment where they can receive learning and psychological support.

[2112] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2113] Step 1:

[2114] The user enters login information into the information device in the physical store. The user ID and password are used as input data, which are sent from the terminal to the server. The server receives this information and queries the database to perform authentication. If authentication is successful, the server generates a message indicating successful authentication and sends it to the terminal.

[2115] Step 2:

[2116] After authenticating, the user requests educational content. The request is sent from the device to the server, which retrieves the user's learning history data from a database. The server then invokes a generative AI model (e.g., OpenAI GPT-4) and passes the prompt sentence to the generative AI model to generate appropriate educational content. The generated educational content is then sent back to the server, which then sends it to the device.

[2117] Step 3:

[2118] The user receives the educational content generated on the device and studies it. After studying, the user enters feedback information into the device. The entered feedback information is sent from the device to the server, which stores it in a database. The feedback information is used the next time content is generated.

[2119] Step 4:

[2120] When a user needs psychological support, they access the psychological support page through their device and enter their worries and stress. The entered data is sent to the server, which then sends prompts to the generative AI model, causing it to generate appropriate interactive therapy content. The generated dialogue message is then sent back to the server, which then sends it to the device.

[2121] Step 5:

[2122] The user receives the content of the interactive therapy and receives support. The user can continue to enter additional feedback or questions as needed. The content of the conversation is anonymized on the server side and stored in a database. It will be reflected in the next therapy session.

[2123] Step 6:

[2124] When a user wishes to participate in a workshop, they access the workshop list page from their device, select the workshop they wish to attend, and enter their reservation information. The entered reservation information is sent from the device to the server, which stores it in a database. The server also generates a confirmation message and a reminder email and sends them to the user's registered email address.

[2125] Step 7:

[2126] After the workshop, users input feedback information through their devices. The information is then sent to the server, which stores it in a database. This information is used to improve future workshops.

[2127] Each of the above steps works as an ongoing process, providing a comprehensive system of education and psychological support within the brick-and-mortar store.

[2128] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2129] This invention is a system that provides new educational tools and psychological support to families with children who are not attending school. This system utilizes generative AI and an emotion engine to provide personalized educational content and interactive therapy based on the user's learning history, psychological state, and emotional information. A specific embodiment of this system is described below.

[2130] 1. User authentication module

[2131] When a user accesses the system, they must first log in. The terminal enters the user ID and password and sends them to the server. The server queries the database for that information, and if there is a matching record, it starts a session. If authentication is successful, the server sends the HTML of the user's personal page.

[2132] 2. Educational content provision module

[2133] After logging in to their personal page, the user (child) accesses the educational content page. The server calls the generation AI to generate appropriate educational content based on the user's learning history and emotional information obtained by the emotion engine. The generated educational content ranges from video learning materials to interactive workbooks. Once the user has finished learning, feedback information is collected and reflected the next time content is provided.

[2134] 3. Interactive Therapy Module

[2135] When a user (child or guardian) accesses the psychological support page, the server activates the dialogue generation AI and emotion engine to generate an initial dialogue message. When the user enters and sends a message about the worries or stress they want to discuss, the server sends the message and the user's emotional information to the generation AI. The generation AI generates appropriate advice and provides it to the user via the server. The dialogue content and emotional information are anonymized and saved, and are reflected in the next therapy session.

[2136] 4. Workshop Management Module

[2137] When a user accesses the workshop list page, the server displays information about currently available workshops. The user selects the workshop they wish to attend and completes the reservation procedure. The reservation information is sent to the server and stored in a database. After the reservation is complete, a confirmation message and a reminder email are sent. In addition, feedback information is collected from the user after the workshop is completed and used to improve future workshops.

[2138] 5. Emotion Recognition by Emotion Engine

[2139] During the processing of each module, the emotion engine constantly analyzes the user's emotions. For example, the educational content provision module analyzes the user's facial expressions and tone of voice while learning to understand their level of concentration and emotional state. Based on this information, the generative AI creates more appropriate content.

[2140] Specific examples

[2141] For example, if a 10-year-old child wants to use educational math content, the following steps are taken: First, the user enters their login information and sends it to the server. If authentication is successful, they are redirected to their personal page. Next, when the user accesses the educational content page, the server activates the generative AI and emotion engine to generate an educational math video based on the child's past learning history and current emotional state. The user watches this video and enters feedback after completing the learning. This feedback is sent to the server and reflected the next time content is generated.

[2142] Additionally, if a user experiences psychological stress, they can use interactive therapy. The user accesses a psychological support page and begins a dialogue between the generative AI and the emotion engine. For example, if the user is worried about friendships at school, they can enter their emotional information along with the details of their worries, and receive appropriate advice from the generative AI. The content of this dialogue and emotional information are anonymized and reflected in the next therapy session.

[2143] Furthermore, to improve social interaction, users can make a reservation to participate in an online workshop. After the reservation is completed, the server sends a confirmation message and a reminder email just before the workshop. After the workshop, feedback from users is collected and used to improve the next workshop.

[2144] In this way, this invention provides new educational tools and psychological support to families with children who are not attending school, comprehensively supporting children's learning and mental health. By combining generative AI with an emotion engine, a more personalized approach can be achieved, increasing user satisfaction.

[2145] The processing flow will be explained below.

[2146] 1. User authentication module

[2147] Processing Steps

[2148] Step 1:

[2149] The user accesses the login screen.

[2150] Step 2:

[2151] The server sends the HTML of the login page to the client.

[2152] Step 3:

[2153] The user enters the user ID and password and clicks the submit button.

[2154] Step 4:

[2155] The terminal sends the input information to the server as a POST request.

[2156] Step 5:

[2157] The server queries the database for the received user ID and password to verify the authentication information.

[2158] Step 6:

[2159] If the server has matching credentials, it starts a session and generates an authentication token.

[2160] Step 7:

[2161] The server sends the authentication token to the user's device and returns the HTML of the My Page as a response.

[2162] Step 8:

[2163] The user is redirected to their My Page and login is complete.

[2164] 2. Educational content provision module

[2165] Processing Steps

[2166] Step 1:

[2167] After the user (child) logs in to their My Page, they access the educational content page.

[2168] Step 2:

[2169] The server sends the HTML of the educational content page to the client.

[2170] Step 3:

[2171] The user clicks the "Start Learning" button.

[2172] Step 4:

[2173] The terminal sends the information to the server as a request.

[2174] Step 5:

[2175] The server calls the generation AI and emotion engine to generate appropriate educational content based on the user's learning history and emotional information.

[2176] Step 6:

[2177] The generative AI generates appropriate educational content (e.g., video teaching materials for mathematics) and sends the information back to the server.

[2178] Step 7:

[2179] The server transmits the generated content to the user terminal.

[2180] Step 8:

[2181] After the user has finished studying the content, they click the "Feedback" button.

[2182] Step 9:

[2183] The device sends feedback information (such as learning satisfaction and emotional state during learning) to the server.

[2184] Step 10:

[2185] The server stores the feedback in a database and uses it to suggest content next time.

[2186] 3. Interactive Therapy Module

[2187] Processing Steps

[2188] Step 1:

[2189] The user (child or guardian) accesses the psychological support page.

[2190] Step 2:

[2191] The server sends the HTML of the psychological support page to the client.

[2192] Step 3:

[2193] The user clicks the "Start conversation" button.

[2194] Step 4:

[2195] The terminal sends the information to the server as a request.

[2196] Step 5:

[2197] The server calls the dialogue generation AI and emotion engine and asks them to generate the initial dialogue message.

[2198] Step 6:

[2199] The generation AI generates the initial dialogue message and sends that information back to the server.

[2200] Step 7:

[2201] The server sends the generated message to the user terminal.

[2202] Step 8:

[2203] The user initiates a dialogue with the AI ​​and inputs a message about a specific concern or stress.

[2204] Step 9:

[2205] The terminal sends the message to the server.

[2206] Step 10:

[2207] The emotion engine analyzes the emotional state (e.g., sadness or anxiety) from the message entered by the user.

[2208] Step 11:

[2209] The server sends the message and emotional state to the generation AI and asks it to generate appropriate advice.

[2210] Step 12:

[2211] The generation AI generates advice and sends the information back to the server.

[2212] Step 13:

[2213] The server transmits the generated advice message to the user terminal.

[2214] Step 14:

[2215] The server anonymizes the dialogue content and emotional information and stores it in a database.

[2216] 4. Workshop Management Module

[2217] Processing Steps

[2218] Step 1:

[2219] A user visits the workshop listing page.

[2220] Step 2:

[2221] The server retrieves available workshops and sends the HTML of the list page to the client.

[2222] Step 3:

[2223] The user selects the workshop they wish to participate in and clicks the "Apply for Participation" button.

[2224] Step 4:

[2225] The device sends a request to the server containing the selected workshop ID.

[2226] Step 5:

[2227] The server retrieves detailed information about the selected workshop from the database and displays a reservation screen for the user.

[2228] Step 6:

[2229] The user enters the reservation information (date, time and additional details) and clicks submit.

[2230] Step 7:

[2231] The terminal sends the reservation information to the server as a POST request.

[2232] Step 8:

[2233] The server stores the reservation information in a database and generates a reservation confirmation message.

[2234] Step 9:

[2235] The server sends a reservation confirmation message to the user terminal and simultaneously sends a reminder email.

[2236] Step 10:

[2237] After the workshop is over, users can access the feedback page and enter their impressions and ratings.

[2238] Step 11:

[2239] The terminal sends feedback information to the server.

[2240] Step 12:

[2241] The server stores the feedback in a database and uses it to improve future workshops.

[2242] 5. Emotion Recognition by Emotion Engine

[2243] Processing Steps

[2244] Step 1:

[2245] The server activates an emotion engine and analyzes the user's emotions in real time.

[2246] Step 2:

[2247] The device transmits the user's facial expressions and voice to the emotion engine via the camera and microphone.

[2248] Step 3:

[2249] An emotion engine analyzes the user's emotional state (e.g., joy, surprise, sadness).

[2250] Step 4:

[2251] The server sends this emotional information to the generation AI and other modules, which then reflect it in their respective processing.

[2252] Step 5:

[2253] The emotion engine anonymizes the user's emotional data and stores it in a database for future learning and therapy sessions.

[2254] Example 2

[2255] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2256] In today's education system, it is difficult to provide personalized educational methods and psychological support to children who are refusing to go to school. In particular, traditional educational content rarely takes into account children's learning history or emotional state, making it difficult to support efficient learning. Furthermore, there is a lack of systems for providing appropriate interactive therapy to children with psychological problems. Furthermore, there are challenges in efficiently managing workshops to improve social skills and collecting feedback.

[2257] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2258] In this invention, the server includes a means for performing authentication based on the user's login information, a generation AI means for generating appropriate educational content based on the user's learning history and emotional state, a means for providing the generated educational content to the user, a means for collecting feedback information from the user and reflecting it in the next content provision, and a means for analyzing the user's emotional information and reflecting it in the educational content. This makes it possible to provide personalized educational content and psychological support to children who are not attending school, and to comprehensively support the children's learning effectiveness and mental health.

[2259] "User login information" refers to the identification information required for a user to access a system, and generally refers to a combination of a user ID and password.

[2260] "Authentication methods" refers to the processes and functions used to verify a user's login information and confirm t...

Claims

1. A generation AI means for generating appropriate educational content based on the user's learning history; means for providing the generated educational content to a user; A means of collecting feedback information from users and reflecting it in the next content offering; A system including:

2. 10. The system of claim 1, A generative AI means for analyzing the user's psychological state and providing appropriate interactive therapy; A means to anonymize and store the content of conversational therapy sessions and incorporate it into future therapy sessions; The system further comprises:

3. 10. The system of claim 1, A means for acquiring detailed information about the workshop selected by the user and managing reservation information; A means of sending confirmation messages and reminder emails after booking; A method for collecting feedback after the workshop and using it to improve future workshops. The system further comprises:

Images