System

Abstract

To provide a system for realizing smooth homework management in a home.SOLUTION: An information input means of an educational institution for inputting detailed information of a homework assignment, a server means for collecting homework assignment information and storing the homework assignment information in a database, a notification means for notifying the stored homework assignment information, a terminal means for displaying the notified homework assignment information, a progress input means for inputting a progress status of the homework assignment, a server means for receiving data and storing the data in the database, a question input means for inputting a question related to the homework assignment, the system includes an answer display means for displaying an answer, an evaluation means for evaluating a stress level and motivation on the basis of progress data of a homework, a generation means for generating a feedback message for a guardian on the basis of an evaluation result, a notification means for transmitting the feedback message to a guardian terminal and notifying it, and a display means for displaying the feedback message.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Problems exist, such as children not completing their homework, causing trouble at home, or being scolded at school or cram school for not putting enough effort into their homework. Furthermore, communication about homework between parents and children can be lackluster, leading to a negative atmosphere at home. Furthermore, questions that arise during homework cannot be resolved immediately, reducing the effectiveness of independent learning. There is a need for a system that can solve these problems and enable smooth homework management within the home. [Means for solving the problem]

[0005] The present invention provides the following means:

[0006] First, an information input means of the educational institution is prepared for inputting detailed homework information. Next, a server means is provided for collecting homework information from the information input means of the educational institution and storing it in a database. Furthermore, a notification means is provided for notifying the homework information stored by the server means, and a terminal means is configured for displaying the homework information notified by the notification means. Also included is a progress input means for inputting homework progress using the terminal means, receiving that data, and storing it in a database.

[0007] In addition, the system has a question input means for inputting questions about homework using a terminal means, and provides a server means for receiving questions from the question input means and generating answers to the questions using a generative AI means. The answers are sent to the terminal means and displayed.

[0008] Furthermore, the server means is equipped with an evaluation means for evaluating the stress level and motivation based on the homework progress data, and a generation means for generating a feedback message for the parent based on the evaluation results. The feedback message is sent to the parent's terminal and notified, providing the parent with appropriate support and advice on how to encourage the parent.

[0009] "Information input method of educational institution" means the method by which a teacher or educational personnel inputs homework details, including online systems and digital tools.

[0010] "Server means" refers to a device or system that receives and stores data over a network and transmits the data as needed.

[0011] The "notification means" is a means for transmitting information notified from the server means to the terminal, and includes push notification and the like.

[0012] "Terminal means" refers to a device used by a user to check and input detailed information and progress of homework, and includes smartphones, tablets, PCs, etc.

[0013] The "progress input means" is a means for a user to input the progress of their homework, and refers to an application that includes a GUI (Graphical User Interface).

[0014] The "question input means" is a means for users to input questions about homework, and includes chatbots and question forms.

[0015] "Generative AI methods" refers to technologies that use natural language processing and machine learning techniques to automatically generate answers to questions from users.

[0016] The "answer display means" is a means for displaying the generated answer to the user, and has a function of displaying the answer on the screen of the terminal.

[0017] "Assessment tools" refer to technologies and systems for assessing children's stress levels and motivation based on homework progress data.

[0018] "Generation means" refers to a technique for generating a feedback message based on the evaluation results.

[0019] "Parent Device" means a device used by a parent that has the ability to receive and display feedback messages and notifications. [Brief explanation of the drawings]

[0020] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0021] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0022] First, the terms used in the following description will be explained.

[0023] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0024] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0025] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0026] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0027] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0028] [First embodiment]

[0029] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0030] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0031] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0032] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0033] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0034] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0035] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0036] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0037] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0038] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0039] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0040] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0041] The present invention is a system for ensuring that children do their homework and for facilitating communication between family members. This system is implemented using an educational institution, a server, and terminals of parents and children. The details of the system's processing are explained below.

[0042] Entering and collecting homework information

[0043] 1. Means of inputting information for educational institutions

[0044] It begins with the teacher using the school's online system to enter detailed information about the homework (such as the assignment content, deadline, and reference materials).

[0045] 2. Information collection by the server

[0046] The server connects to the school's system and collects the entered homework information.

[0047] The collected homework information is stored in a database and prepared for notification to each household's device.

[0048] Homework information notification and display

[0049] 1. Means of notification

[0050] The server generates notifications based on homework information collected from educational institutions.

[0051] Send push notifications to devices (parents' and children's smartphones, tablets, etc.).

[0052] 2. Displaying information on a terminal

[0053] The terminal displays the notified homework information on the screen so that the user can check it.

[0054] Homework progress management

[0055] 1. Progress input method

[0056] The user (child) opens the app and enters their homework progress.

[0057] For example, enter specific progress information such as "Math assignment 1 50% complete."

[0058] 2. Data storage by server

[0059] The server receives the progress data and stores it in a database.

[0060] Asking questions and using the AI ​​assistant

[0061] 1. Question input method

[0062] Users (children) enter any questions they have about their homework into the app's question input field.

[0063] For example, enter "I don't know how to solve problem 3."

[0064] 2. Answer generation using generative AI

[0065] The server receives the question and uses generative AI to generate an appropriate answer.

[0066] The confirmed answer is sent to the terminal and displayed to the user.

[0067] Feedback to parents

[0068] 1. Evaluation methods

[0069] The server assesses the child's stress level and motivation based on homework progress data and questions.

[0070] 2. Means of generation and notification

[0071] The server generates a feedback message for parents based on the evaluation results.

[0072] The message includes specific support methods such as, "Your child's stress is increasing. Some encouraging words would be effective."

[0073] 3. Feedback display on parental devices

[0074] The device (parent's smartphone) receives the feedback message and displays it as a notification.

[0075] The user (parent) communicates with their child based on the displayed feedback.

[0076] Specific examples

[0077] Example 1: Homework progress tracking

[0078] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[0079] The server receives the progress data and stores it in a database.

[0080] The device also notifies parents of the progress, allowing them to check the progress.

[0081] Example 2: Questions and real-time support

[0082] The user (child) enters a question saying, "I don't know how to write a history report."

[0083] The server receives the question, and the generative AI generates a "sample report structure."

[0084] The device displays the answers, making it easier for children to write their reports.

[0085] Example 3: Parent feedback

[0086] The server analyzes the progress data and determines that the child's stress level is high.

[0087] The server generates a feedback message to inform the parent that their child is struggling and should be encouraged.

[0088] The device provides feedback to parents and suggests appropriate ways to encourage their child.

[0089] As a result, the present invention improves the efficiency with which children tackle their homework, facilitates communication within the family, and provides a beneficial environment for both children and parents.

[0090] The processing flow will be explained below.

[0091] Step 1:

[0092] The teacher enters detailed information about the homework (such as the assignment content, deadline, and reference materials) into the school's online system.

[0093] Step 2:

[0094] The server collects homework information from the school system and stores it in a database.

[0095] Step 3:

[0096] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[0097] Step 4:

[0098] Your device will receive a notification and display the homework details on the screen.

[0099] The user (child) checks the displayed homework information.

[0100] Step 5:

[0101] The user (child) enters their homework progress through the app (e.g., math assignment 1 is 50% complete).

[0102] The terminal collects this progress data and sends it to the server.

[0103] Step 6:

[0104] The server stores the received progress data in a database.

[0105] The server also notifies the parent's device of the updated progress.

[0106] Step 7:

[0107] If the user (child) has a question while working on their homework, they can enter it in the question input field within the app (e.g., "I don't know how to solve problem 3").

[0108] The terminal sends a question to the server.

[0109] Step 8:

[0110] The server analyzes the received question and generates an appropriate answer using generative AI.

[0111] The server sends the generated response to the terminal.

[0112] Step 9:

[0113] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[0114] Step 10:

[0115] The server analyzes homework progress data and question content to assess the child's stress level and motivation.

[0116] The server generates a feedback message for the parent based on the evaluation results.

[0117] Step 11:

[0118] The server sends a feedback message to the parent's device (e.g., "Your child is experiencing increased stress. Some encouraging words would be helpful").

[0119] Step 12:

[0120] The device (parent's smartphone) receives the feedback message and notifies the parent.

[0121] The user (parent) can check the notifications and use them to communicate with their child.

[0122] As described above, the present invention is a system that helps children to efficiently tackle their homework and allows parents to provide appropriate support through these processing steps.

[0123] Example 1

[0124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0125] Ensuring that children do their homework reliably and maintaining smooth communication among family members are major challenges in modern families. To solve these problems, it is important to efficiently share homework information, manage children's homework progress, and provide appropriate support. However, doing these tasks manually requires a great deal of effort and time, making it difficult to achieve effective results. Therefore, a system that can solve these problems effectively and efficiently is needed.

[0126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0127] In this invention, the server includes an input unit for inputting detailed information about homework from educational institutions, a unit for collecting homework information and storing it in a database, and a unit for notifying the user of the stored homework information. This allows for efficient collection of homework information from educational institutions and appropriate sharing within the home. Furthermore, the server unit uses a generative AI model to generate answers to children's questions, thereby supporting smooth communication between family members.

[0128] "Input means for educational institutions to input detailed information about homework" refers to a system or software that allows educational institutions (teachers) to input detailed information about homework (such as assignment content, submission deadline, reference materials, etc.).

[0129] "Server means for collecting homework information and storing it in a database" refers to a server that has the role of acquiring homework information input by educational institutions and storing it in a database.

[0130] "Means for notifying saved homework information" refers to the function of notifying parents and children's devices of homework information saved on the server.

[0131] "Device means for displaying homework information" refers to the function that displays notified homework information on devices such as smartphones and tablets used by parents and children.

[0132] "A means for inputting homework progress" refers to an application or interface that allows a child to input their homework progress.

[0133] "A means for inputting questions about homework" refers to an application or interface that allows a child to input questions about homework into the system.

[0134] "Server means for generating answers to questions using a generative AI model" refers to a server that generates answers to questions from children using a generative AI model (e.g., GPT-3 (registered trademark)).

[0135] "Answer display means for transmitting the generated answer to the terminal means and displaying it" refers to a function for transmitting the generated answer to the terminal of the parent or child and displaying it.

[0136] "Evaluation means for evaluating stress levels and motivation based on homework progress data" refers to a server that has the function of evaluating a child's stress levels and motivation based on homework progress data entered by the child.

[0137] The "means for generating a feedback message for parents" refers to a server function that generates a feedback message for parents based on the evaluation results obtained by the evaluation means.

[0138] The "notification means for sending a feedback message to a parent terminal and notifying the parent" refers to a function for sending a generated feedback message to a parent terminal and notifying the parent.

[0139] "Display means for displaying a feedback message" refers to a function for displaying the notified feedback message on the parent's terminal.

[0140] The present invention provides a system for ensuring that children do their homework and for facilitating communication between family members. This system is implemented using an educational institution, a server, and terminals of parents and children. The details of this system are described below.

[0141] Entering and collecting homework information

[0142] First, we will explain how educational institutions input detailed homework information. Teachers use the school's online system (e.g., Google® Classroom or MICROSOFT® TEAMS®) to input detailed homework information (such as assignment content, submission deadline, and reference materials). This includes entering the assignment content in text, setting a calendar for the submission deadline, and adding linked reference materials.

[0143] Next, the server collects homework information. The server collects homework information entered by educational institutions via APIs such as Google Classroom. The collected data is temporarily stored in JSON format and then saved in a database such as MySQL (registered trademark) or PostgreSQL. The saved data is sorted by household and prepared for push notifications.

[0144] Homework information notification and display

[0145] Next, we will explain how homework information is notified. The server generates a notification message based on the collected homework information. A template engine (for example, Handlebars.js) is used to generate the notification, creating a specific message such as "Japanese homework from Mr. / Ms. XX: Kanji practice, deadline is XX / XX."

[0146] Devices (parents' and children's smartphones and tablets) receive notifications using Firebase Cloud Messaging (FCM), which are then displayed as a pop-up in a dedicated app (e.g., HomeWork Tracker) where detailed information can be viewed.

[0147] Homework progress management

[0148] Next, we will explain how to manage homework progress. Users (children) use a dedicated app (HomeWork Tracker) to enter their homework progress. The input form has pull-down menus and sliders, making it easy to enter progress such as "Math assignment 1 progress: 50% complete."

[0149] The server receives the progress data entered by the user in real time and stores it in a database, strictly managing transactions (e.g., ACID characteristics) to maintain data consistency.

[0150] Asking questions and using the AI ​​assistant

[0151] If a user (child) has a question about their homework, they can write it down in the question input field of the dedicated app. For example, they can write, "I don't know the stroke order of the kanji."

[0152] The server receives the entered question and generates an appropriate answer using a generative AI model such as OpenAI's (registered trademark) GPT-3. For example, it generates an answer such as "The stroke order for kanji is as follows..." and sends it to the user's device. When generating the answer, it uses an appropriate prompt. An example of a specific prompt would be "Please tell me the stroke order for kanji."

[0153] Feedback to parents

[0154] Finally, we will explain the feedback method. The server evaluates the child's stress level and motivation based on homework progress data and question content. This evaluation uses a machine learning model (e.g., regression analysis using scikit-learn). If the stress level is determined to be high, a feedback message such as "The child is struggling and needs encouragement" is generated.

[0155] The server sends the generated feedback message to the parent's device, where it is received through a dedicated app (HomeWork Tracker) and displayed as a notification. Based on this feedback message, parents can communicate appropriately with their children.

[0156] Specific examples

[0157] Specific examples are given below.

[0158] Example 1: Homework progress tracking

[0159] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[0160] The server receives the progress data and stores it in a database.

[0161] The device also notifies parents of the progress, who can then check the progress.

[0162] Example 2: Questions and real-time support

[0163] The user (child) enters a question such as, "I don't know how to write a history report."

[0164] The server receives the question, and the generative AI generates a "sample report structure."

[0165] The device displays the generated answers, making it easier for children to write their reports.

[0166] Example 3: Parent feedback

[0167] The server analyzes the progress data and assesses that the child's stress level is high.

[0168] The server generates a feedback message to inform the parent that "your child is struggling and needs some encouragement."

[0169] The device will then notify the parent of the feedback message and suggest appropriate ways to respond.

[0170] In this way, the present invention improves the efficiency with which children tackle their homework, facilitates communication within the family, and provides a beneficial environment for both children and parents.

[0171] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0172] Step 1:

[0173] The user (teacher) logs into an online system such as Google Classroom or Microsoft Teams and enters detailed information about the homework (such as the assignment content, deadline, and reference materials). The information entered is temporarily stored in the system's database, allowing the teacher to provide complete details of the homework assigned to the student.

[0174] Step 2:

[0175] The server collects homework information entered by educational institutions via APIs such as Google Classroom. The collected data is first temporarily saved in JSON format and then stored in a database such as MySQL or PostgreSQL. The saved data is sorted by household and prepared for push notifications. This ensures that homework information is accurately reflected in the database.

[0176] Step 3:

[0177] The server generates a notification message based on the collected homework information. A template engine (for example, Handlebars.js) is used to generate the notification, creating a specific message such as "Japanese homework from Teacher X: Kanji practice, deadline is X / X." The generated notification message is then ready to be sent to each household's device.

[0178] Step 4:

[0179] Devices (parents' and children's smartphones and tablets) receive notifications using Firebase Cloud Messaging (FCM). The received notification is displayed as a pop-up in a dedicated app (e.g., HomeWork Tracker) where detailed information can be checked. This information is cached on the device and can be accessed by the user at any time.

[0180] Step 5:

[0181] Users (children) use a dedicated app (HomeWork Tracker) to enter their homework progress. The input form has pull-down menus and sliders, making it easy to enter progress such as "Math assignment 1 progress: 50% complete." The entered information is immediately sent to the server.

[0182] Step 6:

[0183] The server receives the progress data entered by the user in real time and stores it in a database. At this time, transaction management (e.g., ACID characteristics) is strictly enforced to maintain data consistency. The received data is stored in an analysis table for subsequent processing.

[0184] Step 7:

[0185] If a user (child) has a question about their homework, they can write it down in the question input field of the dedicated app. For example, they can write "I don't know the stroke order of kanji." This input is immediately sent to the server.

[0186] Step 8:

[0187] The server receives the question and generates an appropriate answer using a generative AI model such as OpenAI's GPT-3. For example, an answer such as "The stroke order for kanji characters is as follows..." is generated. The generated answer is then sent to the user's device.

[0188] Step 9:

[0189] The device receives the answer from the server and displays it on the dedicated app screen. The user (child) can use this answer as a reference to proceed with their homework. The answer is cached on the device and can be reviewed later.

[0190] Step 10:

[0191] The server analyzes homework progress data and questions to assess children's stress levels and motivation. This assessment is performed using machine learning models (e.g., regression analysis using scikit-learn). The results are stored in a database and used to generate feedback for parents.

[0192] Step 11:

[0193] The server generates a feedback message for parents based on the evaluation results, including specific support methods such as, "Your child is experiencing increasing stress. Some encouraging words would be effective."

[0194] Step 12:

[0195] The server then sends the generated feedback message to the parent's device, which receives the message via a dedicated app and displays it as a notification.The parent can then communicate with their child based on this feedback.

[0196] (Application example 1)

[0197] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0198] Conventional home learning support systems were unable to provide sufficient support for children when they were doing their homework, and communication with parents was also limited. As a result, children's motivation and understanding when doing homework often decreased, making it difficult for parents to provide support. Furthermore, there was no system in place to effectively utilize educational support services and products in physical stores.

[0199] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0200] In this invention, the server includes an educational institution information input means for inputting detailed homework information, a server means for collecting homework information and storing it in a database, a notification means for notifying homework information, a terminal means for displaying the notified homework information on the terminal, a progress input means for inputting homework progress, a server means for receiving progress data and storing it in a database, a question input means for inputting homework-related questions, a generative AI means for generating answers to the questions, an answer display means for sending the generated answers to the terminal and displaying them, an evaluation means for evaluating stress levels and motivation based on homework progress data, a generation means for generating feedback messages for parents, a notification means for sending the feedback messages to the parent terminal and notifying them, a display means for displaying the feedback messages on the parent terminal, a prompt generation means for inputting prompts to the generative AI means for generating answers to homework questions, and a commercial terminal means for providing homework progress and AI assistant functions to sell educational support products and services in physical stores. This enables management of children's homework progress, prompt responses to questions, appropriate feedback to parents, and effective provision of educational support services in physical stores.

[0201] "Homework details" refers to information such as the content of assignments assigned to students by educational institutions, submission deadlines, and reference materials.

[0202] "Institutional information entry means" means an online system or device through which teachers enter homework details.

[0203] "Server Means" means a server for collecting, storing, processing and communicating homework information and subsequent progress and question data from an educational institution.

[0204] "Notification means" refers to a means that has the function of pushing homework information received from the server and generated feedback messages to the terminal.

[0205] "Terminal means" refers to a device that displays notified homework information and feedback messages, such as a smartphone, tablet, or computer.

[0206] "Homework progress" is information that indicates the progress and completion rate of a student's homework.

[0207] The "progress input means" is an interface that allows students to input their homework progress.

[0208] The "question input means" is an interface that allows students to input doubts or questions about their homework.

[0209] "Generative AI means" is an AI (artificial intelligence) system that uses natural language processing to automatically generate appropriate answers to students' questions.

[0210] "Answer display means" refers to a means for displaying the answer generated by the generative AI means on a terminal.

[0211] "Evaluation measures" are measures that analyze homework progress data and questions to assess students' stress levels and motivation.

[0212] The "generation means" is a means for generating a feedback message for parents based on the evaluation results obtained by the evaluation means.

[0213] "Prompt generation means" refers to a means for generating a prompt sentence to be input to the generative AI means.

[0214] "Commercial Terminal Means" means dedicated terminals or devices installed in a physical store to provide educational support products and services.

[0215] MODE FOR CARRYING OUT THE INVENTION

[0216] The present invention is a system for ensuring that children do their homework and for facilitating smooth communication within the family. Specific embodiments for carrying out the present invention are described below.

[0217] 1. Entering and collecting homework information

[0218] Educational institution information entry method

[0219] Teachers at educational institutions use online systems and devices to input homework details (such as assignment content, deadlines, and reference materials), which are then collected by the server and stored in its database.

[0220] Server information collection

[0221] The server receives homework information entered through the educational institution's information entry means, and stores this information in a database within the server for subsequent processing.

[0222] 2. Notification and display of homework information

[0223] Notification means

[0224] The server generates a notification message based on the homework information received from the educational institution, and sends the notification to the device (smartphone, tablet, etc.) as a push notification.

[0225] Displaying information via terminal means

[0226] The device displays the homework information received from the server on the screen, allowing the user to check detailed information about the homework.

[0227] 3. Homework progress management

[0228] Progress input method

[0229] The user (child) can use the device to input their homework progress, for example, by entering specific progress information such as "50% complete for Math Assignment 1."

[0230] Data storage by server

[0231] The server receives the progress data entered in this way and stores it in a database. This progress information is also sent to the parent's device.

[0232] 4. Asking questions and using AI assistants

[0233] Question input method

[0234] Users (children) can enter questions they have about their homework into the question input form on the device. For example, they can enter a question like, "I don't know how to solve problem 3."

[0235] Answer generation using generative AI methods

[0236] The server receives the user's question and generates an appropriate answer using a generative AI model, which uses natural language processing to generate an answer to the question.

[0237] Answer display means

[0238] The server-generated answer is sent to the terminal and immediately displayed to the user.

[0239] 5. Feedback to parents

[0240] Evaluation methods

[0241] The server assesses the child's stress level and motivation based on homework progress data and questions.

[0242] Generation and notification methods

[0243] Based on the evaluation results, the server generates a feedback message for the parent, including specific support methods such as "Your child's stress is increasing. Some words of encouragement would be effective." The generated message is then sent to the parent's device.

[0244] Feedback display on parental device

[0245] The parent device receives this feedback message and displays the feedback content, which parents can use as a reference when communicating with their children.

[0246] 6. Prompt Generation Methods

[0247] A prompt generator is used to input a prompt to the generator AI. This prompt is converted into an appropriate format depending on the specific question. The following is an example of a prompt:

[0248] Examples of prompts:

[0249] "I received a question from the home learning material 'Math Drills' saying 'I don't understand problem 3.' Please give me some hints on how to solve it."

[0250] 7. In-store use

[0251] Commercial terminal means can be installed in physical stores to provide homework progress and AI assistant functions, and this commercial terminal is intended to effectively provide educational support products and services.

[0252] With the above-described configuration, the present invention can improve the efficiency with which children do their homework, facilitate communication within the home, and create an environment that is beneficial to both parents and children.

[0253] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0254] Step 1: Institution Enters Homework Information

[0255] Using the institution's information entry means, the teacher enters the homework details (such as assignment content, deadline, reference materials, etc.) into the online system. This input information forms the basis for the data collected by the server in the next processing step.

[0256] Input: Homework details by educational institution

[0257] Output: Homework information entered into the online system

[0258] Step 2: Server collects homework information

[0259] The server collects homework information from the educational institution's information input means and stores the information in a database. Through this process, detailed homework information is centrally managed in the database.

[0260] Input: Homework information entered into the online system

[0261] Output: Homework information stored in the database

[0262] Step 3: Generate and send notifications

[0263] The server generates a notification message to be sent to the device based on the saved homework information, and pushes this message to the device using a notification means, allowing the user to receive the homework information promptly.

[0264] Input: Homework information in the database

[0265] Output: Homework information notification message to the terminal

[0266] Step 4: View homework information on your device

[0267] The terminal displays the homework information received from the server on the screen, allowing the user to check the content of the homework and the deadline for submission.

[0268] Input: Notification message from the server

[0269] Output: Homework information displayed on the terminal screen

[0270] Step 5: User enters homework progress

[0271] The user (child) inputs their homework progress via the device. For example, they input specific progress information such as "50% completion of math assignment 1."

[0272] Input: Homework progress information

[0273] Output: Homework progress information entered into the terminal

[0274] Step 6: Saving Progress Data on the Server

[0275] The server receives the homework progress information sent by the user, stores it in a database, and also notifies the parent / guardian of this progress information.

[0276] Input: Progress information from the user

[0277] Output: Progress information stored in a database and parental notification messages

[0278] Step 7: User enters question

[0279] The user (child) enters any questions about their homework into the question input form on the device. For example, they enter a question such as, "I don't know how to solve problem 3."

[0280] Input: User question

[0281] Output: Question input to terminal completed

[0282] Step 8: AI answer generation by the server

[0283] The server receives the user's question and generates an appropriate answer using a generative AI model, which inputs the prompt sentence generated by the prompt generation means and performs natural language processing.

[0284] Input: User question, prompt

[0285] Output: The generated answer

[0286] Step 9: Viewing Answers via Terminal

[0287] The server generates a response and sends it to the terminal, which receives it and displays it immediately to the user.

[0288] Input: Generated answer from the server

[0289] Output: Answer displayed on the terminal screen

[0290] Step 10: Server evaluation and feedback generation

[0291] The server evaluates the user's stress level and motivation based on the homework progress data and questions, and generates a feedback message for parents based on the evaluation results.

[0292] Input: Homework progress data, questions

[0293] Output: The generated feedback message

[0294] Step 11: Feedback notification and display on parent device

[0295] The server sends the generated feedback message to the parent's device, which receives it and displays the feedback content, allowing the parent to understand the detailed status of their child's homework and provide appropriate support.

[0296] Input: The generated feedback message

[0297] Output: Notification and feedback displayed on the parent's device

[0298] Step 12: Use prompt generators

[0299] A prompt generation means is used to input a prompt sentence into a generative AI means for generating answers to questions about homework. For example, a prompt sentence such as "I received a question from the homework textbook 'Math Drills' saying 'I don't understand problem 3.' Please give me a hint on how to solve it" is generated and input into the AI ​​model.

[0300] Input: User question

[0301] Output: The prompt generated by the prompt generator

[0302] Step 13: In-store use

[0303] Using commercial terminals installed in physical stores, homework progress and AI assistant functions are provided, allowing parents and children to easily use educational support products and services in physical stores.

[0304] Input: Progress information, AI assistant function

[0305] Output: Providing educational support services in physical stores

[0306] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0307] The present invention is a system for helping children to efficiently complete their homework and facilitating communication between family members. This system is implemented by combining an educational institution, a server, and devices of parents and children, with an emotion engine that recognizes the user's emotions.

[0308] Entering and collecting homework information

[0309] 1. Means of inputting information for educational institutions

[0310] The teacher uses the school's online system to enter detailed information about the homework (such as the assignment, deadline, and reference materials).

[0311] 2. Information collection by the server

[0312] The server collects homework information from the school system and stores it in a database.

[0313] Homework information notification and display

[0314] 1. Means of notification

[0315] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[0316] 2. Displaying information on a terminal

[0317] The device receives a notification and displays detailed homework information on the screen so that the user (child) can check it.

[0318] Homework progress management

[0319] 1. Progress input method

[0320] The user (child) enters their homework progress through the app (e.g., "Math assignment 1 is 50% complete").

[0321] The terminal collects this progress data and sends it to the server.

[0322] 2. Data storage by server

[0323] The server stores the received progress data in a database.

[0324] The server also notifies the parent's device of the updated progress.

[0325] Asking questions and using the AI ​​assistant

[0326] 1. Question input method

[0327] If the user (child) has any questions while working on their homework, they can enter their question in the question input field within the app (e.g., "I don't know how to solve problem 3").

[0328] The terminal sends a question to the server.

[0329] 2. Answer generation using generative AI

[0330] The server analyzes the received question and generates an appropriate answer using generative AI.

[0331] The server sends the generated response to the terminal.

[0332] 3. Answer display means

[0333] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[0334] Emotion recognition by emotion engine

[0335] 1. Emotional Engine Means

[0336] The device analyzes the user's facial expressions, voice, or text input in real time to recognize emotions.

[0337] For example, facial expressions can be analyzed through the camera function to detect "confusion" or "stress."

[0338] 2. Sending Emotional Data

[0339] The device transmits the recognized emotion data to the server.

[0340] Feedback to parents

[0341] 1. Evaluation methods

[0342] The server analyzes the homework progress data and the recognized emotional data to assess the child's stress level and motivation.

[0343] 2. Means of generation and notification

[0344] The server generates a feedback message for the parents based on the evaluation results.

[0345] The feedback message includes specific ways to provide support, such as, "Your child seems to be having trouble. He or she may need help."

[0346] 3. Feedback display on parental devices

[0347] The device (parent's smartphone) receives the feedback message and displays it as a notification.

[0348] The user (parent) communicates with their child based on the displayed feedback.

[0349] Specific examples

[0350] Example 1: Homework progress tracking

[0351] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[0352] The server receives the progress data and stores it in a database.

[0353] The device also notifies parents of the progress, allowing them to check the progress.

[0354] Example 2: Questions and real-time support

[0355] The user (child) enters a question saying, "I don't know how to write a history report."

[0356] The server receives the question, and the generative AI generates a "sample report structure."

[0357] The device displays the answers, making it easier for children to write their reports.

[0358] Example 3: Parent feedback

[0359] The server analyzes the progress data and determines that the child's stress level is high.

[0360] The server generates a feedback message to inform the parent that their child is struggling and should be encouraged.

[0361] The device provides feedback to parents and suggests appropriate ways to encourage their child.

[0362] Example 4: Using the Emotion Engine

[0363] The user (child) shows an expression of frustration while solving a problem.

[0364] The device uses an emotion engine to recognize "confusion" and transmits the emotion data to the server.

[0365] The server generates feedback messages based on the recognized emotions and progress data.

[0366] The device notifies the parent, "Your child appears to be in trouble and may need help."

[0367] The user (parent) checks the notification and provides advice to the child.

[0368] In this way, the present invention is a system that can improve communication within the home by creating an environment in which the user can work on their homework while taking into consideration the user's emotions.

[0369] The processing flow will be explained below.

[0370] Step 1:

[0371] The teacher enters detailed information about the homework (such as the assignment content, deadline, and reference materials) into the school's online system.

[0372] Step 2:

[0373] The server collects homework information from the school system and stores it in a database.

[0374] Step 3:

[0375] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[0376] Step 4:

[0377] Your device will receive a notification and display the homework details on the screen.

[0378] The user (child) checks the displayed homework information.

[0379] Step 5:

[0380] The user (child) enters their homework progress through the app (e.g., "Math assignment 1 is 50% complete").

[0381] The terminal collects this progress data and sends it to the server.

[0382] Step 6:

[0383] The server stores the received progress data in a database.

[0384] The server also notifies the parent's device of the updated progress.

[0385] Step 7:

[0386] If the user (child) has a question while working on their homework, they can enter it in the question input field within the app (e.g., "I don't know how to solve problem 3").

[0387] The terminal sends a question to the server.

[0388] Step 8:

[0389] The server analyzes the questions it receives using generative AI and generates appropriate answers.

[0390] The server generates a response and sends it to the terminal.

[0391] Step 9:

[0392] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[0393] Step 10:

[0394] While the user (child) is working on their homework, the device uses an emotion engine to analyze the user's facial expressions, voice, or text input in real time and recognize their emotions.

[0395] For example, it can detect "confusion" and "stress" through the camera function.

[0396] Step 11:

[0397] The device transmits the recognized emotion data to the server.

[0398] Step 12:

[0399] The server analyzes homework progress data and emotional data to assess the child's stress level and motivation.

[0400] Based on the evaluation results, a feedback message for parents is generated.

[0401] Step 13:

[0402] The server sends a feedback message to the parent's device (e.g., "Your child seems to be in trouble. They may need help.").

[0403] Step 14:

[0404] The device (parent's smartphone) receives the feedback message and notifies the parent.

[0405] The user (parent) can check the notifications and use them to communicate with their child.

[0406] Step 15:

[0407] The user (parent) can give advice and words of encouragement to their child based on the displayed feedback.

[0408] For example, by encouraging children to "solve the problem together," we can strengthen learning support within the home.

[0409] As described above, through the processing steps of the present invention, a system is provided that utilizes an emotion engine to reduce the difficulties children face when doing their homework and allows parents to provide support at an appropriate time.

[0410] Example 2

[0411] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0412] In today's educational environment, it is important for teachers to manage students' homework and monitor their progress, but this requires a lot of time and effort. Furthermore, there are often no means to quickly resolve questions or difficulties students have when working on their homework. Furthermore, it is not possible to monitor students' emotions and stress levels and provide appropriate feedback to parents. As a result, students' learning efficiency declines and communication between families becomes insufficient.

[0413] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes an information input means of an educational institution for inputting detailed information about homework, a server means for collecting homework information from the information input means of the educational institution and storing it in a database, a notification means for notifying the homework information stored by the server means, a terminal means for displaying the homework information notified from the notification means, a progress input means for inputting the progress of homework using the terminal means, a server means for receiving data from the progress input means and storing it in a database, a question input means for inputting a question about homework using the terminal means, a server means for receiving a question from the question input means and generating an answer to the question using a generative AI means, and the server The system includes an answer display means for transmitting answers generated by the answer analysis means to a terminal means and displaying them, an emotion analysis means for the terminal means to recognize emotions by analyzing facial expressions, voice, or text input, a server means for receiving emotion data from the emotion analysis means and storing it in a database, an evaluation means for the server means to evaluate stress levels and motivation based on homework progress data and emotion data, a generation means for generating feedback messages for parents based on the evaluation results from the evaluation means, a notification means for transmitting the feedback message from the generation means to a parent terminal and notifying the parent, and a display means for displaying the feedback message on the parent terminal. This enables efficient homework management, rapid question resolution, monitoring of student emotions, and provision of appropriate feedback.

[0414] "Information input means for educational institutions" refers to the means by which teachers can input detailed information about homework (such as assignment content, submission deadlines, and reference materials) through the school's online system.

[0415] The "server means" is a means for storing homework information collected from the information input means of the educational institution in a database and for managing data communication with the notification means and the terminal means.

[0416] The "notification means" is a means for transmitting homework information, progress status, etc. stored by the server means to the user terminal as a push notification.

[0417] "Terminal means" refers to devices (smartphones, tablets, etc.) used by parents and children, and is a means of displaying homework information, progress, feedback messages, etc.

[0418] The "progress input means" is a means by which a child can input the progress of their homework through an application.

[0419] The "question input means" is a means by which a child inputs a question about homework through an application.

[0420] A "generative AI method" is a method that uses an AI model to create an answer to a question based on a generated prompt.

[0421] The "answer display means" is a means for transmitting the answer generated by the generative AI means to the terminal means and displaying it.

[0422] The "emotion analysis means" is a means by which the terminal means analyzes the user's facial expression, voice, or text input and recognizes emotions.

[0423] The "assessment tool" is a tool for assessing stress levels and motivation based on homework progress data and perceived emotional data.

[0424] The "generation means" is a means for generating a feedback message for parents based on the results of the evaluation means.

[0425] A "feedback message" is a message that tells parents what problems their child is facing or what state their child is in while studying.

[0426] The "display means" is a means for displaying a feedback message on the parent terminal.

[0427] The present invention is a system for helping children to efficiently complete their homework and facilitating communication between family members. This system is implemented using an educational institution, a server, and devices of parents and children, in combination with an emotion engine that recognizes the user's emotions.

[0428] Entering and collecting homework information

[0429] A teacher at an educational institution uses the school's online system (e.g., Google Classroom) to enter detailed information about the homework assignment (such as the assignment content, deadline, and reference materials).

[0430] The server periodically retrieves this information and stores it in an internal database (e.g., MySQL).

[0431] Homework information notification and display

[0432] The server generates push notifications to user devices (parents' and children's smartphones and tablets) based on the homework information it retrieves, and these notifications are sent using a service such as Firebase Cloud Messaging.

[0433] The device displays the received notification on the screen so that the user (child) can check detailed information about the homework.

[0434] Homework progress management

[0435] The user (child) enters their homework progress in the application's progress input field (e.g., "Math assignment 1 is 50% complete").

[0436] The device sends the entered progress data to the server, which stores the received progress data in a database and notifies the parent device of the progress status.

[0437] Asking questions and using the AI ​​assistant

[0438] The user (child) enters a question about their homework into the application's question input field (e.g., "I don't know how to solve problem 3").

[0439] The device sends a question to the server. The server receives the question data and generates a prompt that inputs the question into a generative AI model (e.g., OpenAI's GPT-4 (registered trademark)). The generative AI analyzes the prompt and generates an appropriate answer. The server sends the generated answer to the device, and the device displays the received answer to provide a specific solution or a guide on how to solve the problem.

[0440] Emotion recognition by emotion engine

[0441] The device analyzes the user's (child's) facial expressions, voice, or text input in real time via a camera and microphone to recognize emotions. For example, it can detect "confusion" or "stress" using an emotion analysis engine such as Amazon Rekognition.

[0442] The device sends the recognized emotion data to a server, which then evaluates the stress level and motivation based on the homework progress data and emotion data.

[0443] Feedback to parents

[0444] The server generates a feedback message for the parents based on the evaluation results, including specific support methods such as "Your child seems to be having trouble. He or she may need help."

[0445] The server sends the feedback message to the parent's device, which then notifies the parent by displaying a notification, allowing the parent to communicate appropriately with their child based on this feedback.

[0446] Examples of concrete examples and prompts

[0447] Example 1: Homework progress management

[0448] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[0449] The server receives the progress data and stores it in a database.

[0450] The device also notifies parents of the progress, who can then check the progress.

[0451] Example prompt sentence:

[0452] "Design a system for children to report their progress on their language arts homework and notify their parents."

[0453] Example 2: Questions and real-time support

[0454] The user (child) enters a question such as, "I don't know how to write a history report."

[0455] The server receives the question, and the generative AI generates an example of a report structure.

[0456] The device displays the answers, making it easier for children to write their reports.

[0457] Example prompt sentence:

[0458] "Design a system that allows your child to ask questions and support them in writing their history report."

[0459] Example 3: Feedback to parents

[0460] The server analyzes the progress and emotional data and assesses that the child's stress level is high.

[0461] The server generates a feedback message to inform the parent that "your child is struggling and needs some encouragement."

[0462] The device receives the feedback and suggests the appropriate way to speak to the user.

[0463] Example prompt sentence:

[0464] "Design a system that analyzes children's stress levels and provides feedback to parents."

[0465] Example 4: Using an Emotion Engine

[0466] The user (child) shows signs of frustration while solving the problem.

[0467] The device uses an emotion engine to recognize "confusion" and transmits the emotion data to the server.

[0468] The server generates a feedback message based on the recognized emotion and progress data.

[0469] The device will notify the parent, "Your child seems to be in trouble and may need help," allowing the parent to offer advice to the child.

[0470] Example prompt sentence:

[0471] "Design a system that analyzes children's emotions and provides feedback to parents."

[0472] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0473] Understood. Below is a detailed explanation of the system program processing flow, broken down into steps.

[0474] Step 1:

[0475] Homework information entered by teachers at educational institutions

[0476] Input: The teacher logs into the school's online system (e.g., Google Classroom) and enters detailed information about the homework (such as the assignment content, deadline, and reference materials).

[0477] Action: A teacher fills in the required information in a web form and clicks the submit button.

[0478] Output: Homework information is saved in the online system database.

[0479] Step 2:

[0480] Collection of homework information by the server

[0481] Input: New homework information is added to the online system database.

[0482] How it works: The server periodically contacts the online system via the API to check for new homework information.

[0483] Output: The server retrieves the new homework information and stores it in its own database (e.g., MySQL).

[0484] Step 3:

[0485] Server-generated and sent notifications

[0486] Input: New homework information stored in the server's database.

[0487] How it works: The server generates the push notification content based on the homework information and sends it to the user's (child's and guardian's) device using services such as Firebase Cloud Messaging.

[0488] Output: A push notification is sent to the user device.

[0489] Step 4:

[0490] Receiving and displaying notifications on your device

[0491] Input: The push notification sent by the server.

[0492] What it does: Your device receives a notification and displays it in the notification area or within the app.

[0493] Output: The user (child) can check the detailed information of the homework.

[0494] Step 5:

[0495] Children input their homework progress

[0496] Input: The user (child) enters their homework progress into the app's input field (e.g., "Math assignment 1 is 50% complete").

[0497] What happens: A user enters text into a progress input field in the app and clicks the submit button.

[0498] Output: Progress information is saved to the device's temporary storage area.

[0499] Step 6:

[0500] Device sends progress data

[0501] Input: Progress information stored on the device.

[0502] Operation: The device sends progress information to the server via the API.

[0503] Output: Progress data is sent to the server and stored in the server's database.

[0504] Step 7:

[0505] Server-based progress data storage and parental notification

[0506] Input: Progress data sent to the server.

[0507] How it works: The server stores progress data in a database and also notifies the parent's device of this information.

[0508] Output: Progress is notified to the parent's device.

[0509] Step 8:

[0510] Children input questions

[0511] Input: The user (child) enters a question about their homework into the app's question input field (e.g., "I don't know how to solve problem 3").

[0512] How it works: A user enters text into the app's question input field and clicks the submit button.

[0513] Output: The question is saved in the device's temporary storage area.

[0514] Step 9:

[0515] Sending question data from the device

[0516] Input: Questions saved on your device.

[0517] How it works: The device sends the question to the server via the API.

[0518] Output: The query data is sent to the server and stored on the server.

[0519] Step 10:

[0520] Server analyzes questions and generates answers

[0521] Input: Question data stored on the server.

[0522] How it works: The server receives question data and generates a prompt that feeds the question into a generative AI model (e.g., OpenAI's GPT-4). The generative AI analyzes the prompt and generates an appropriate answer.

[0523] Output: The generated answer is retrieved by the server.

[0524] Step 11:

[0525] Server sends answer

[0526] Input: An answer generated by a generative AI model.

[0527] Action: The server generates a response and sends it to the device.

[0528] Output: The response data is sent to the terminal.

[0529] Step 12:

[0530] Displaying answers on the device

[0531] Input: The response data sent from the server.

[0532] What it does: The answer the device receives is displayed in the app.

[0533] Output: The user (child) can receive a concrete solution or guide.

[0534] Step 13:

[0535] Analysis of emotion data on the device

[0536] Input: User (child) facial expression, voice, or text input data.

[0537] How it works: The device collects data through the camera and microphone and analyzes emotions using an emotion analysis engine (e.g., Amazon Rekognition).

[0538] Output: The analyzed emotion data is generated and temporarily saved.

[0539] Step 14:

[0540] Sending emotional data by device

[0541] Input: Parsed emotion data.

[0542] Operation: The device sends emotion data to the server.

[0543] Output: The emotion data is sent to the server and stored in a database.

[0544] Step 15:

[0545] Server-generated ratings and feedback

[0546] Input: Progress and emotion data stored on the server.

[0547] How it works: The server evaluates the stress level and motivation based on the progress data and emotional data, and generates a feedback message for the parent.

[0548] Output: The generated feedback message is retrieved by the server.

[0549] Step 16:

[0550] Server sending feedback messages

[0551] Input: The generated feedback message.

[0552] Operation: The server sends a feedback message to the parent terminal.

[0553] Output: A feedback message is sent to the parent device.

[0554] Step 17:

[0555] Parental feedback display

[0556] Input: The feedback message sent by the server.

[0557] What it does: The parent device receives the feedback message and displays it in a notification or in the app.

[0558] Output: Parents can understand their child's situation and provide appropriate support.

[0559] (Application example 2)

[0560] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0561] In today's educational environment, it is important for children to complete their homework efficiently while maintaining smooth communication with their families. However, there is no centralized system that can manage homework progress, questions, or even grasp children's emotional state. Similar problems exist at brick-and-mortar learning events, which can potentially reduce the quality of children's learning experience. A comprehensive system to overcome these issues is needed.

[0562] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an educational institution's information input means for inputting detailed homework information, server means for collecting homework information from the educational institution's information input means and storing it in a database, notification means, terminal means, progress input means, question input means, generative AI means, answer display means, evaluation means, generation means, notification means, display means, emotion engine means for emotion recognition, means for transmitting emotion data acquired using the emotion engine means to the server means, and means for applying the emotion engine means to events and in-store activities. This enables children to efficiently complete their homework and learning activities and allows parents to provide appropriate support as needed, making similar support possible at learning events held in physical stores.

[0563] "Information input means of educational institutions" refers to systems or means for inputting detailed information about homework from educational institutions such as schools and cram schools.

[0564] "Server means" refers to means that performs the functions and roles of a server, such as collecting, storing, analyzing, and notifying homework information.

[0565] "Notification means" refers to means for notifying the user of collected homework information, progress, feedback messages, etc.

[0566] "Terminal means" refers to a device used by a user, such as a smartphone, tablet, or PC, which is capable of displaying and inputting information.

[0567] The "progress input means" is a means for the user to input the progress status of homework or tasks.

[0568] The "question input means" is a means for the user to input questions about homework or learning content.

[0569] "Generative AI methods" are artificial intelligence methods for generating appropriate answers to questions, and use technologies such as natural language processing.

[0570] The "answer display means" is a means for displaying the answer generated by the generative AI to the user.

[0571] The "evaluation means" is a means for evaluating the user's stress level and motivation based on homework progress data and emotional data.

[0572] The "generation means" is a means for generating a feedback message for parents based on the evaluation results obtained by the evaluation means.

[0573] The "emotion engine means" is a means for analyzing the user's facial expressions, voice, text, etc., and recognizing emotions.

[0574] "Means to be applied to activities in physical stores" refers to means that use emotion engine means to recognize and evaluate users' emotions during learning events and activities in physical stores and provide appropriate support.

[0575] The present invention is a comprehensive system for enabling children to efficiently complete their homework and for facilitating smooth communication within the family. Specific embodiments for realizing the present invention will be described in detail below.

[0576] Program processing

[0577] The system consists of multiple hardware and software components. The hardware includes smartphones, tablets, PCs, and servers, all of which require an internet connection. The software includes emotion recognition APIs (e.g., Microsoft Azure Emotion API), a notification system, a database (e.g., MySQL), and generative AI (e.g., GPT-3).

[0578] Server Roles

[0579] The server includes means for:

[0580] 1. Information input method for educational institutions: An online system where educational institutions input detailed information about homework (such as assignment content and submission deadlines).

[0581] 2. Database: Storage for homework information and progress data.

[0582] 3. Notification system: A system that notifies users of saved homework information, progress, feedback messages, etc.

[0583] 4. Generative AI: Artificial intelligence that generates appropriate answers to questions from users.

[0584] 5. Evaluation method: A system that evaluates the user's stress level and motivation based on homework progress data and emotional data.

[0585] Device Role

[0586] Terminals (smartphones, tablets, PCs) include means with the following functions:

[0587] 1. Information display method: The device displays notified homework information, progress, and AI-generated answers on the screen.

[0588] 2. Progress input means: A means for children to input their homework progress.

[0589] 3. Question input means: A means for children to input questions about their homework.

[0590] 4. Emotion engine means: A means for recognizing the user's emotions using a camera or microphone and sending that data to the server.

[0591] Managing connections

[0592] The server evaluates the user's stress level and motivation based on the homework progress data and questions, and generates a feedback message for parents based on the evaluation results, including specific instructions on the child's learning progress and the support needed.

[0593] Specific examples

[0594] Specific examples of progress management

[0595] For example, a scenario in which a child enters that their homework progress is 30% and a parent checks the progress. The device collects the progress data, the server evaluates it, and notifies the parent of the results.

[0596] Specific examples of emotion recognition

[0597] If a child shows a confused expression while working on their homework, the device's camera will capture the expression, and the emotion engine will recognize the expression as "confused" and send it to the server. The server will then analyze the emotion data and notify the parent or guardian, "Your child is confused. They may need help."

[0598] Prompt Sentence Examples

[0599] Examples of prompts for question input are as follows:

[0600] "My child says he can't solve problem 3 in his math homework. Do you have any solutions or hints?"

[0601] "Child A showed signs of confusion when doing his math homework, suggesting high stress levels. Please provide specific advice."

[0602] Thus, the present invention provides a means for improving the educational environment and enhancing communication among family members.

[0603] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0604] Step 1:

[0605] Using the educational institution's information input method, the teacher enters detailed information about the homework (such as the assignment content and submission deadline) into the online system.

[0606] Input: Homework details entered by the teacher.

[0607] Output: Homework information stored in the institution's system.

[0608] Step 2:

[0609] The server collects homework information from the institution's system and stores it in a database.

[0610] Input: Homework information obtained from the institution's system.

[0611] Output: Homework information stored in the server's database.

[0612] Step 3:

[0613] The server notifies the terminal of new homework information.

[0614] Input: Homework information stored in the database.

[0615] Output: Push notification to device.

[0616] Step 4:

[0617] Displays notifications received by the device on the screen.

[0618] Input: Homework information sent from the server.

[0619] Output: Homework information displayed on the terminal screen.

[0620] Step 5:

[0621] The user (child) uses the device to enter their homework progress.

[0622] Input: Homework progress input by the child.

[0623] Output: Progress data entered into the terminal.

[0624] Step 6:

[0625] The device sends the progress data to the server, which stores it in a database.

[0626] Input: Progress data sent from the device.

[0627] Output: Progress data stored in the server database.

[0628] Step 7:

[0629] The user (child) enters a homework question into the terminal.

[0630] Input: The question entered by the child.

[0631] Output: Question data entered into the terminal.

[0632] Step 8:

[0633] The terminal transmits the question data to the server.

[0634] Input: Question data sent from the terminal.

[0635] Output: The query data received by the server.

[0636] Step 9:

[0637] The server uses generative AI to generate answers to questions.

[0638] Input: The query data received by the server.

[0639] Output: Answer data generated by the generative AI.

[0640] Step 10:

[0641] The server sends the generated answer to the terminal, which displays the answer.

[0642] Input: Answer data generated by generative AI.

[0643] Output: The answer displayed on the terminal.

[0644] Step 11:

[0645] The device's camera is used to capture the child's facial expressions and analyze them using an emotion engine.

[0646] Input: Image data captured by the device's camera.

[0647] Output: Parsed emotion data.

[0648] Step 12:

[0649] The device sends the emotion data to the server, which stores it in a database.

[0650] Input: Emotion data sent from the device.

[0651] Output: Emotion data stored in the server database.

[0652] Step 13:

[0653] The server evaluates the homework based on progress data and emotional data.

[0654] Input: Progress data and emotion data.

[0655] Output: Evaluation results.

[0656] Step 14:

[0657] The server generates a feedback message based on the evaluation results and notifies the parents.

[0658] Input: Evaluation result.

[0659] Output: Feedback message to parent.

[0660] Step 15:

[0661] Parents check the feedback messages and provide appropriate support to their children.

[0662] Input: Feedback message.

[0663] Output: Parental supportive behavior.

[0664] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0665] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0666] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0667] [Second embodiment]

[0668] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0669] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0670] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0671] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0672] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0673] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0674] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0675] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0676] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0677] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0678] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0679] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0680] The present invention is a system for ensuring that children do their homework and for facilitating communication between family members. This system is implemented using an educational institution, a server, and terminals of parents and children. The details of the system's processing are explained below.

[0681] Entering and collecting homework information

[0682] 1. Means of inputting information for educational institutions

[0683] It begins with the teacher using the school's online system to enter detailed information about the homework (such as the assignment content, deadline, and reference materials).

[0684] 2. Information collection by the server

[0685] The server connects to the school's system and collects the entered homework information.

[0686] The collected homework information is stored in a database and prepared for notification to each household's device.

[0687] Homework information notification and display

[0688] 1. Means of notification

[0689] The server generates notifications based on homework information collected from educational institutions.

[0690] Send push notifications to devices (parents' and children's smartphones, tablets, etc.).

[0691] 2. Displaying information on a terminal

[0692] The terminal displays the notified homework information on the screen so that the user can check it.

[0693] Homework progress management

[0694] 1. Progress input method

[0695] The user (child) opens the app and enters their homework progress.

[0696] For example, enter specific progress information such as "Math assignment 1 50% complete."

[0697] 2. Data storage by server

[0698] The server receives the progress data and stores it in a database.

[0699] Asking questions and using the AI ​​assistant

[0700] 1. Question input method

[0701] Users (children) enter any questions they have about their homework into the app's question input field.

[0702] For example, enter "I don't know how to solve problem 3."

[0703] 2. Answer generation using generative AI

[0704] The server receives the question and uses generative AI to generate an appropriate answer.

[0705] The confirmed answer is sent to the terminal and displayed to the user.

[0706] Feedback to parents

[0707] 1. Evaluation methods

[0708] The server assesses the child's stress level and motivation based on homework progress data and questions.

[0709] 2. Means of generation and notification

[0710] The server generates a feedback message for parents based on the evaluation results.

[0711] The message includes specific support methods such as, "Your child's stress is increasing. Some encouraging words would be effective."

[0712] 3. Feedback display on parental devices

[0713] The device (parent's smartphone) receives the feedback message and displays it as a notification.

[0714] The user (parent) communicates with their child based on the displayed feedback.

[0715] Specific examples

[0716] Example 1: Homework progress tracking

[0717] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[0718] The server receives the progress data and stores it in a database.

[0719] The device also notifies parents of the progress, allowing them to check the progress.

[0720] Example 2: Questions and real-time support

[0721] The user (child) enters a question saying, "I don't know how to write a history report."

[0722] The server receives the question, and the generative AI generates a "sample report structure."

[0723] The device displays the answers, making it easier for children to write their reports.

[0724] Example 3: Parent feedback

[0725] The server analyzes the progress data and determines that the child's stress level is high.

[0726] The server generates a feedback message to inform the parent that their child is struggling and should be encouraged.

[0727] The device provides feedback to parents and suggests appropriate ways to encourage their child.

[0728] As a result, the present invention improves the efficiency with which children tackle their homework, facilitates communication within the family, and provides a beneficial environment for both children and parents.

[0729] The processing flow will be explained below.

[0730] Step 1:

[0731] The teacher enters detailed information about the homework (such as the assignment content, deadline, and reference materials) into the school's online system.

[0732] Step 2:

[0733] The server collects homework information from the school system and stores it in a database.

[0734] Step 3:

[0735] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[0736] Step 4:

[0737] Your device will receive a notification and display the homework details on the screen.

[0738] The user (child) checks the displayed homework information.

[0739] Step 5:

[0740] The user (child) enters their homework progress through the app (e.g., math assignment 1 is 50% complete).

[0741] The terminal collects this progress data and sends it to the server.

[0742] Step 6:

[0743] The server stores the received progress data in a database.

[0744] The server also notifies the parent's device of the updated progress.

[0745] Step 7:

[0746] If the user (child) has a question while working on their homework, they can enter it in the question input field within the app (e.g., "I don't know how to solve problem 3").

[0747] The terminal sends a question to the server.

[0748] Step 8:

[0749] The server analyzes the received question and generates an appropriate answer using generative AI.

[0750] The server sends the generated response to the terminal.

[0751] Step 9:

[0752] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[0753] Step 10:

[0754] The server analyzes homework progress data and question content to assess the child's stress level and motivation.

[0755] The server generates a feedback message for the parent based on the evaluation results.

[0756] Step 11:

[0757] The server sends a feedback message to the parent's device (e.g., "Your child is experiencing increased stress. Some encouraging words would be helpful").

[0758] Step 12:

[0759] The device (parent's smartphone) receives the feedback message and notifies the parent.

[0760] The user (parent) can check the notifications and use them to communicate with their child.

[0761] As described above, the present invention is a system that helps children to efficiently tackle their homework and allows parents to provide appropriate support through these processing steps.

[0762] Example 1

[0763] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0764] Ensuring that children do their homework reliably and maintaining smooth communication among family members are major challenges in modern families. To solve these problems, it is important to efficiently share homework information, manage children's homework progress, and provide appropriate support. However, doing these tasks manually requires a great deal of effort and time, making it difficult to achieve effective results. Therefore, a system that can solve these problems effectively and efficiently is needed.

[0765] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0766] In this invention, the server includes an input unit for inputting detailed information about homework from educational institutions, a unit for collecting homework information and storing it in a database, and a unit for notifying the user of the stored homework information. This allows for efficient collection of homework information from educational institutions and appropriate sharing within the home. Furthermore, the server unit uses a generative AI model to generate answers to children's questions, thereby supporting smooth communication between family members.

[0767] "Input means for educational institutions to input detailed information about homework" refers to a system or software that allows educational institutions (teachers) to input detailed information about homework (such as assignment content, submission deadline, reference materials, etc.).

[0768] "Server means for collecting homework information and storing it in a database" refers to a server that has the role of acquiring homework information input by educational institutions and storing it in a database.

[0769] "Means for notifying saved homework information" refers to the function of notifying parents and children's devices of homework information saved on the server.

[0770] "Device means for displaying homework information" refers to the function that displays notified homework information on devices such as smartphones and tablets used by parents and children.

[0771] "A means for inputting homework progress" refers to an application or interface that allows a child to input their homework progress.

[0772] "A means for inputting questions about homework" refers to an application or interface that allows a child to input questions about homework into the system.

[0773] "Server means for generating answers to questions using a generative AI model" refers to a server that generates answers to questions posed by children using a generative AI model (e.g., GPT-3).

[0774] "Answer display means for transmitting the generated answer to the terminal means and displaying it" refers to a function for transmitting the generated answer to the terminal of the parent or child and displaying it.

[0775] "Evaluation means for evaluating stress levels and motivation based on homework progress data" refers to a server that has the function of evaluating a child's stress levels and motivation based on homework progress data entered by the child.

[0776] The "means for generating a feedback message for parents" refers to a server function that generates a feedback message for parents based on the evaluation results obtained by the evaluation means.

[0777] The "notification means for sending a feedback message to a parent terminal and notifying the parent" refers to a function for sending a generated feedback message to a parent terminal and notifying the parent.

[0778] "Display means for displaying a feedback message" refers to a function for displaying the notified feedback message on the parent's terminal.

[0779] The present invention provides a system for ensuring that children do their homework and for facilitating communication between family members. This system is implemented using an educational institution, a server, and terminals of parents and children. The details of this system are described below.

[0780] Entering and collecting homework information

[0781] First, we will explain how educational institutions input detailed homework information. Teachers use the school's online system (e.g., Google Classroom or Microsoft Teams) to input detailed homework information (such as assignment content, submission deadline, and reference materials). This includes entering the assignment content as text, setting a calendar for the submission deadline, and adding linked reference materials.

[0782] Next, the server collects homework information. The server collects homework information entered by educational institutions via APIs such as Google Classroom. The collected data is temporarily stored in JSON format and then saved in a database such as MySQL or PostgreSQL. The saved data is sorted by household and prepared for push notifications.

[0783] Homework information notification and display

[0784] Next, we will explain how homework information is notified. The server generates a notification message based on the collected homework information. A template engine (for example, Handlebars.js) is used to generate the notification, creating a specific message such as "Japanese homework from Mr. / Ms. XX: Kanji practice, deadline is XX / XX."

[0785] Devices (parents' and children's smartphones and tablets) receive notifications using Firebase Cloud Messaging (FCM), which are then displayed as a pop-up in a dedicated app (e.g., HomeWork Tracker) where detailed information can be viewed.

[0786] Homework progress management

[0787] Next, we will explain how to manage homework progress. Users (children) use a dedicated app (HomeWork Tracker) to enter their homework progress. The input form has pull-down menus and sliders, making it easy to enter progress such as "Math assignment 1 progress: 50% complete."

[0788] The server receives the progress data entered by the user in real time and stores it in a database, strictly managing transactions (e.g., ACID characteristics) to maintain data consistency.

[0789] Asking questions and using the AI ​​assistant

[0790] If a user (child) has a question about their homework, they can write it down in the question input field of the dedicated app. For example, they can write, "I don't know the stroke order of the kanji."

[0791] The server receives the entered question and generates an appropriate answer using a generative AI model such as OpenAI's GPT-3. For example, it might generate an answer such as "The stroke order for kanji is as follows..." and send it to the user's device. When generating the answer, it uses an appropriate prompt. An example of a specific prompt would be "Please tell me the stroke order for kanji."

[0792] Feedback to parents

[0793] Finally, we will explain the feedback method. The server evaluates the child's stress level and motivation based on homework progress data and question content. This evaluation uses a machine learning model (e.g., regression analysis using scikit-learn). If the stress level is determined to be high, a feedback message such as "The child is struggling and needs encouragement" is generated.

[0794] The server sends the generated feedback message to the parent's device, where it is received through a dedicated app (HomeWork Tracker) and displayed as a notification. Based on this feedback message, parents can communicate appropriately with their children.

[0795] Specific examples

[0796] Specific examples are given below.

[0797] Example 1: Homework progress tracking

[0798] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[0799] The server receives the progress data and stores it in a database.

[0800] The device also notifies parents of the progress, who can then check the progress.

[0801] Example 2: Questions and real-time support

[0802] The user (child) enters a question such as, "I don't know how to write a history report."

[0803] The server receives the question, and the generative AI generates a "sample report structure."

[0804] The device displays the generated answers, making it easier for children to write their reports.

[0805] Example 3: Parent feedback

[0806] The server analyzes the progress data and assesses that the child's stress level is high.

[0807] The server generates a feedback message to inform the parent that "your child is struggling and needs some encouragement."

[0808] The device will then notify the parent of the feedback message and suggest appropriate ways to respond.

[0809] In this way, the present invention improves the efficiency with which children tackle their homework, facilitates communication within the family, and provides a beneficial environment for both children and parents.

[0810] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0811] Step 1:

[0812] The user (teacher) logs into an online system such as Google Classroom or Microsoft Teams and enters detailed information about the homework (such as the assignment content, deadline, and reference materials). The information entered is temporarily stored in the system's database, allowing the teacher to provide complete details of the homework assigned to the student.

[0813] Step 2:

[0814] The server collects homework information entered by educational institutions via APIs such as Google Classroom. The collected data is first temporarily saved in JSON format and then stored in a database such as MySQL or PostgreSQL. The saved data is sorted by household and prepared for push notifications. This ensures that homework information is accurately reflected in the database.

[0815] Step 3:

[0816] The server generates a notification message based on the collected homework information. A template engine (for example, Handlebars.js) is used to generate the notification, creating a specific message such as "Japanese homework from Teacher X: Kanji practice, deadline is X / X." The generated notification message is then ready to be sent to each household's device.

[0817] Step 4:

[0818] Devices (parents' and children's smartphones and tablets) receive notifications using Firebase Cloud Messaging (FCM). The received notification is displayed as a pop-up in a dedicated app (e.g., HomeWork Tracker) where detailed information can be checked. This information is cached on the device and can be accessed by the user at any time.

[0819] Step 5:

[0820] Users (children) use a dedicated app (HomeWork Tracker) to enter their homework progress. The input form has pull-down menus and sliders, making it easy to enter progress such as "Math assignment 1 progress: 50% complete." The entered information is immediately sent to the server.

[0821] Step 6:

[0822] The server receives the progress data entered by the user in real time and stores it in a database. At this time, transaction management (e.g., ACID characteristics) is strictly enforced to maintain data consistency. The received data is stored in an analysis table for subsequent processing.

[0823] Step 7:

[0824] If a user (child) has a question about their homework, they can write it down in the question input field of the dedicated app. For example, they can write "I don't know the stroke order of kanji." This input is immediately sent to the server.

[0825] Step 8:

[0826] The server receives the question and generates an appropriate answer using a generative AI model such as OpenAI's GPT-3. For example, an answer such as "The stroke order for kanji characters is as follows..." is generated. The generated answer is then sent to the user's device.

[0827] Step 9:

[0828] The device receives the answer from the server and displays it on the dedicated app screen. The user (child) can use this answer as a reference to proceed with their homework. The answer is cached on the device and can be reviewed later.

[0829] Step 10:

[0830] The server analyzes homework progress data and questions to assess children's stress levels and motivation. This assessment is performed using machine learning models (e.g., regression analysis using scikit-learn). The results are stored in a database and used to generate feedback for parents.

[0831] Step 11:

[0832] The server generates a feedback message for parents based on the evaluation results, including specific support methods such as, "Your child is experiencing increasing stress. Some encouraging words would be effective."

[0833] Step 12:

[0834] The server then sends the generated feedback message to the parent's device, which receives the message via a dedicated app and displays it as a notification.The parent can then communicate with their child based on this feedback.

[0835] (Application example 1)

[0836] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0837] Conventional home learning support systems were unable to provide sufficient support for children when they were doing their homework, and communication with parents was also limited. As a result, children's motivation and understanding when doing homework often decreased, making it difficult for parents to provide support. Furthermore, there was no system in place to effectively utilize educational support services and products in physical stores.

[0838] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0839] In this invention, the server includes an educational institution information input means for inputting detailed homework information, a server means for collecting homework information and storing it in a database, a notification means for notifying homework information, a terminal means for displaying the notified homework information on the terminal, a progress input means for inputting homework progress, a server means for receiving progress data and storing it in a database, a question input means for inputting homework-related questions, a generative AI means for generating answers to the questions, an answer display means for sending the generated answers to the terminal and displaying them, an evaluation means for evaluating stress levels and motivation based on homework progress data, a generation means for generating feedback messages for parents, a notification means for sending the feedback messages to the parent terminal and notifying them, a display means for displaying the feedback messages on the parent terminal, a prompt generation means for inputting prompts to the generative AI means for generating answers to homework questions, and a commercial terminal means for providing homework progress and AI assistant functions to sell educational support products and services in physical stores. This enables management of children's homework progress, prompt responses to questions, appropriate feedback to parents, and effective provision of educational support services in physical stores.

[0840] "Homework details" refers to information such as the content of assignments assigned to students by educational institutions, submission deadlines, and reference materials.

[0841] "Institutional information entry means" means an online system or device through which teachers enter homework details.

[0842] "Server Means" means a server for collecting, storing, processing and communicating homework information and subsequent progress and question data from an educational institution.

[0843] "Notification means" refers to a means that has the function of pushing homework information received from the server and generated feedback messages to the terminal.

[0844] "Terminal means" refers to a device that displays notified homework information and feedback messages, such as a smartphone, tablet, or computer.

[0845] "Homework progress" is information that indicates the progress and completion rate of a student's homework.

[0846] The "progress input means" is an interface that allows students to input their homework progress.

[0847] The "question input means" is an interface that allows students to input doubts or questions about their homework.

[0848] "Generative AI means" is an AI (artificial intelligence) system that uses natural language processing to automatically generate appropriate answers to students' questions.

[0849] "Answer display means" refers to a means for displaying the answer generated by the generative AI means on a terminal.

[0850] "Evaluation measures" are measures that analyze homework progress data and questions to assess students' stress levels and motivation.

[0851] The "generation means" is a means for generating a feedback message for parents based on the evaluation results obtained by the evaluation means.

[0852] "Prompt generation means" refers to a means for generating a prompt sentence to be input to the generative AI means.

[0853] "Commercial Terminal Means" means dedicated terminals or devices installed in a physical store to provide educational support products and services.

[0854] MODE FOR CARRYING OUT THE INVENTION

[0855] The present invention is a system for ensuring that children do their homework and for facilitating smooth communication within the family. Specific embodiments for carrying out the present invention are described below.

[0856] 1. Entering and collecting homework information

[0857] Educational institution information entry method

[0858] Teachers at educational institutions use online systems and devices to input homework details (such as assignment content, deadlines, and reference materials), which are then collected by the server and stored in its database.

[0859] Server information collection

[0860] The server receives homework information entered through the educational institution's information entry means, and stores this information in a database within the server for subsequent processing.

[0861] 2. Notification and display of homework information

[0862] Notification means

[0863] The server generates a notification message based on the homework information received from the educational institution, and sends the notification to the device (smartphone, tablet, etc.) as a push notification.

[0864] Displaying information via terminal means

[0865] The device displays the homework information received from the server on the screen, allowing the user to check detailed information about the homework.

[0866] 3. Homework progress management

[0867] Progress input method

[0868] The user (child) can use the device to input their homework progress, for example, by entering specific progress information such as "50% complete for Math Assignment 1."

[0869] Data storage by server

[0870] The server receives the progress data entered in this way and stores it in a database. This progress information is also sent to the parent's device.

[0871] 4. Asking questions and using AI assistants

[0872] Question input method

[0873] Users (children) can enter questions they have about their homework into the question input form on the device. For example, they can enter a question like, "I don't know how to solve problem 3."

[0874] Answer generation using generative AI methods

[0875] The server receives the user's question and generates an appropriate answer using a generative AI model, which uses natural language processing to generate an answer to the question.

[0876] Answer display means

[0877] The server-generated answer is sent to the terminal and immediately displayed to the user.

[0878] 5. Feedback to parents

[0879] Evaluation methods

[0880] The server assesses the child's stress level and motivation based on homework progress data and questions.

[0881] Generation and notification methods

[0882] Based on the evaluation results, the server generates a feedback message for the parent, including specific support methods such as "Your child's stress is increasing. Some words of encouragement would be effective." The generated message is then sent to the parent's device.

[0883] Feedback display on parental device

[0884] The parent device receives this feedback message and displays the feedback content, which parents can use as a reference when communicating with their children.

[0885] 6. Prompt Generation Methods

[0886] A prompt generator is used to input a prompt to the generator AI. This prompt is converted into an appropriate format depending on the specific question. The following is an example of a prompt:

[0887] Examples of prompts:

[0888] "I received a question from the home learning material 'Math Drills' saying 'I don't understand problem 3.' Please give me some hints on how to solve it."

[0889] 7. In-store use

[0890] Commercial terminal means can be installed in physical stores to provide homework progress and AI assistant functions, and this commercial terminal is intended to effectively provide educational support products and services.

[0891] With the above-described configuration, the present invention can improve the efficiency with which children do their homework, facilitate communication within the home, and create an environment that is beneficial to both parents and children.

[0892] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0893] Step 1: Institution Enters Homework Information

[0894] Using the institution's information entry means, the teacher enters the homework details (such as assignment content, deadline, reference materials, etc.) into the online system. This input information forms the basis for the data collected by the server in the next processing step.

[0895] Input: Homework details by educational institution

[0896] Output: Homework information entered into the online system

[0897] Step 2: Server collects homework information

[0898] The server collects homework information from the educational institution's information input means and stores the information in a database. Through this process, detailed homework information is centrally managed in the database.

[0899] Input: Homework information entered into the online system

[0900] Output: Homework information stored in the database

[0901] Step 3: Generate and send notifications

[0902] The server generates a notification message to be sent to the device based on the saved homework information, and pushes this message to the device using a notification means, allowing the user to receive the homework information promptly.

[0903] Input: Homework information in the database

[0904] Output: Homework information notification message to the terminal

[0905] Step 4: View homework information on your device

[0906] The terminal displays the homework information received from the server on the screen, allowing the user to check the content of the homework and the deadline for submission.

[0907] Input: Notification message from the server

[0908] Output: Homework information displayed on the terminal screen

[0909] Step 5: User enters homework progress

[0910] The user (child) inputs their homework progress via the device. For example, they input specific progress information such as "50% completion of math assignment 1."

[0911] Input: Homework progress information

[0912] Output: Homework progress information entered into the terminal

[0913] Step 6: Saving Progress Data on the Server

[0914] The server receives the homework progress information sent by the user, stores it in a database, and also notifies the parent / guardian of this progress information.

[0915] Input: Progress information from the user

[0916] Output: Progress information stored in a database and parental notification messages

[0917] Step 7: User enters question

[0918] The user (child) enters any questions about their homework into the question input form on the device. For example, they enter a question such as, "I don't know how to solve problem 3."

[0919] Input: User question

[0920] Output: Question input to terminal completed

[0921] Step 8: AI answer generation by the server

[0922] The server receives the user's question and generates an appropriate answer using a generative AI model, which inputs the prompt sentence generated by the prompt generation means and performs natural language processing.

[0923] Input: User question, prompt

[0924] Output: The generated answer

[0925] Step 9: Viewing Answers via Terminal

[0926] The server generates a response and sends it to the terminal, which receives it and displays it immediately to the user.

[0927] Input: Generated answer from the server

[0928] Output: Answer displayed on the terminal screen

[0929] Step 10: Server evaluation and feedback generation

[0930] The server evaluates the user's stress level and motivation based on the homework progress data and questions, and generates a feedback message for parents based on the evaluation results.

[0931] Input: Homework progress data, questions

[0932] Output: The generated feedback message

[0933] Step 11: Feedback notification and display on parent device

[0934] The server sends the generated feedback message to the parent's device, which receives it and displays the feedback content, allowing the parent to understand the detailed status of their child's homework and provide appropriate support.

[0935] Input: The generated feedback message

[0936] Output: Notification and feedback displayed on the parent's device

[0937] Step 12: Use prompt generators

[0938] A prompt generation means is used to input a prompt sentence into a generative AI means for generating answers to questions about homework. For example, a prompt sentence such as "I received a question from the homework textbook 'Math Drills' saying 'I don't understand problem 3.' Please give me a hint on how to solve it" is generated and input into the AI ​​model.

[0939] Input: User question

[0940] Output: The prompt generated by the prompt generator

[0941] Step 13: In-store use

[0942] Using commercial terminals installed in physical stores, homework progress and AI assistant functions are provided, allowing parents and children to easily use educational support products and services in physical stores.

[0943] Input: Progress information, AI assistant function

[0944] Output: Providing educational support services in physical stores

[0945] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0946] The present invention is a system for helping children to efficiently complete their homework and facilitating communication between family members. This system is implemented by combining an educational institution, a server, and devices of parents and children, with an emotion engine that recognizes the user's emotions.

[0947] Entering and collecting homework information

[0948] 1. Means of inputting information for educational institutions

[0949] The teacher uses the school's online system to enter detailed information about the homework (such as the assignment, deadline, and reference materials).

[0950] 2. Information collection by the server

[0951] The server collects homework information from the school system and stores it in a database.

[0952] Homework information notification and display

[0953] 1. Means of notification

[0954] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[0955] 2. Displaying information on a terminal

[0956] The device receives a notification and displays detailed homework information on the screen so that the user (child) can check it.

[0957] Homework progress management

[0958] 1. Progress input method

[0959] The user (child) enters their homework progress through the app (e.g., "Math assignment 1 is 50% complete").

[0960] The terminal collects this progress data and sends it to the server.

[0961] 2. Data storage by server

[0962] The server stores the received progress data in a database.

[0963] The server also notifies the parent's device of the updated progress.

[0964] Asking questions and using the AI ​​assistant

[0965] 1. Question input method

[0966] If the user (child) has any questions while working on their homework, they can enter their question in the question input field within the app (e.g., "I don't know how to solve problem 3").

[0967] The terminal sends a question to the server.

[0968] 2. Answer generation using generative AI

[0969] The server analyzes the received question and generates an appropriate answer using generative AI.

[0970] The server sends the generated response to the terminal.

[0971] 3. Answer display means

[0972] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[0973] Emotion recognition by emotion engine

[0974] 1. Emotional Engine Means

[0975] The device analyzes the user's facial expressions, voice, or text input in real time to recognize emotions.

[0976] For example, facial expressions can be analyzed through the camera function to detect "confusion" or "stress."

[0977] 2. Sending Emotional Data

[0978] The device transmits the recognized emotion data to the server.

[0979] Feedback to parents

[0980] 1. Evaluation methods

[0981] The server analyzes the homework progress data and the recognized emotional data to assess the child's stress level and motivation.

[0982] 2. Means of generation and notification

[0983] The server generates a feedback message for the parents based on the evaluation results.

[0984] The feedback message includes specific ways to provide support, such as, "Your child seems to be having trouble. He or she may need help."

[0985] 3. Feedback display on parental devices

[0986] The device (parent's smartphone) receives the feedback message and displays it as a notification.

[0987] The user (parent) communicates with their child based on the displayed feedback.

[0988] Specific examples

[0989] Example 1: Homework progress tracking

[0990] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[0991] The server receives the progress data and stores it in a database.

[0992] The device also notifies parents of the progress, allowing them to check the progress.

[0993] Example 2: Questions and real-time support

[0994] The user (child) enters a question saying, "I don't know how to write a history report."

[0995] The server receives the question, and the generative AI generates a "sample report structure."

[0996] The device displays the answers, making it easier for children to write their reports.

[0997] Example 3: Parent feedback

[0998] The server analyzes the progress data and determines that the child's stress level is high.

[0999] The server generates a feedback message to inform the parent that their child is struggling and should be encouraged.

[1000] The device provides feedback to parents and suggests appropriate ways to encourage their child.

[1001] Example 4: Using the Emotion Engine

[1002] The user (child) shows an expression of frustration while solving a problem.

[1003] The device uses an emotion engine to recognize "confusion" and transmits the emotion data to the server.

[1004] The server generates feedback messages based on the recognized emotions and progress data.

[1005] The device notifies the parent, "Your child appears to be in trouble and may need help."

[1006] The user (parent) checks the notification and provides advice to the child.

[1007] In this way, the present invention is a system that can improve communication within the home by creating an environment in which the user can work on their homework while taking into consideration the user's emotions.

[1008] The processing flow will be explained below.

[1009] Step 1:

[1010] The teacher enters detailed information about the homework (such as the assignment content, deadline, and reference materials) into the school's online system.

[1011] Step 2:

[1012] The server collects homework information from the school system and stores it in a database.

[1013] Step 3:

[1014] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[1015] Step 4:

[1016] Your device will receive a notification and display the homework details on the screen.

[1017] The user (child) checks the displayed homework information.

[1018] Step 5:

[1019] The user (child) enters their homework progress through the app (e.g., "Math assignment 1 is 50% complete").

[1020] The terminal collects this progress data and sends it to the server.

[1021] Step 6:

[1022] The server stores the received progress data in a database.

[1023] The server also notifies the parent's device of the updated progress.

[1024] Step 7:

[1025] If the user (child) has a question while working on their homework, they can enter it in the question input field within the app (e.g., "I don't know how to solve problem 3").

[1026] The terminal sends a question to the server.

[1027] Step 8:

[1028] The server analyzes the questions it receives using generative AI and generates appropriate answers.

[1029] The server generates a response and sends it to the terminal.

[1030] Step 9:

[1031] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[1032] Step 10:

[1033] While the user (child) is working on their homework, the device uses an emotion engine to analyze the user's facial expressions, voice, or text input in real time and recognize their emotions.

[1034] For example, it can detect "confusion" and "stress" through the camera function.

[1035] Step 11:

[1036] The device transmits the recognized emotion data to the server.

[1037] Step 12:

[1038] The server analyzes homework progress data and emotional data to assess the child's stress level and motivation.

[1039] Based on the evaluation results, a feedback message for parents is generated.

[1040] Step 13:

[1041] The server sends a feedback message to the parent's device (e.g., "Your child seems to be in trouble. They may need help.").

[1042] Step 14:

[1043] The device (parent's smartphone) receives the feedback message and notifies the parent.

[1044] The user (parent) can check the notifications and use them to communicate with their child.

[1045] Step 15:

[1046] The user (parent) can give advice and words of encouragement to their child based on the displayed feedback.

[1047] For example, by encouraging children to "solve the problem together," we can strengthen learning support within the home.

[1048] As described above, through the processing steps of the present invention, a system is provided that utilizes an emotion engine to reduce the difficulties children face when doing their homework and allows parents to provide support at an appropriate time.

[1049] Example 2

[1050] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1051] In today's educational environment, it is important for teachers to manage students' homework and monitor their progress, but this requires a lot of time and effort. Furthermore, there are often no means to quickly resolve questions or difficulties students have when working on their homework. Furthermore, it is not possible to monitor students' emotions and stress levels and provide appropriate feedback to parents. As a result, students' learning efficiency declines and communication between families becomes insufficient.

[1052] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes an information input means of an educational institution for inputting detailed information about homework, a server means for collecting homework information from the information input means of the educational institution and storing it in a database, a notification means for notifying the homework information stored by the server means, a terminal means for displaying the homework information notified from the notification means, a progress input means for inputting the progress of homework using the terminal means, a server means for receiving data from the progress input means and storing it in a database, a question input means for inputting a question about homework using the terminal means, a server means for receiving a question from the question input means and generating an answer to the question using a generative AI means, and the server The system includes an answer display means for transmitting answers generated by the answer analysis means to a terminal means and displaying them, an emotion analysis means for the terminal means to recognize emotions by analyzing facial expressions, voice, or text input, a server means for receiving emotion data from the emotion analysis means and storing it in a database, an evaluation means for the server means to evaluate stress levels and motivation based on homework progress data and emotion data, a generation means for generating feedback messages for parents based on the evaluation results from the evaluation means, a notification means for transmitting the feedback message from the generation means to a parent terminal and notifying the parent, and a display means for displaying the feedback message on the parent terminal. This enables efficient homework management, rapid question resolution, monitoring of student emotions, and provision of appropriate feedback.

[1053] "Information input means for educational institutions" refers to the means by which teachers can input detailed information about homework (such as assignment content, submission deadlines, and reference materials) through the school's online system.

[1054] The "server means" is a means for storing homework information collected from the information input means of the educational institution in a database and for managing data communication with the notification means and the terminal means.

[1055] The "notification means" is a means for transmitting homework information, progress status, etc. stored by the server means to the user terminal as a push notification.

[1056] "Terminal means" refers to devices (smartphones, tablets, etc.) used by parents and children, and is a means of displaying homework information, progress, feedback messages, etc.

[1057] The "progress input means" is a means by which a child can input the progress of their homework through an application.

[1058] The "question input means" is a means by which a child inputs a question about homework through an application.

[1059] A "generative AI method" is a method that uses an AI model to create an answer to a question based on a generated prompt.

[1060] The "answer display means" is a means for transmitting the answer generated by the generative AI means to the terminal means and displaying it.

[1061] The "emotion analysis means" is a means by which the terminal means analyzes the user's facial expression, voice, or text input and recognizes emotions.

[1062] The "assessment tool" is a tool for assessing stress levels and motivation based on homework progress data and perceived emotional data.

[1063] The "generation means" is a means for generating a feedback message for parents based on the results of the evaluation means.

[1064] A "feedback message" is a message that tells parents what problems their child is facing or what state their child is in while studying.

[1065] The "display means" is a means for displaying a feedback message on the parent terminal.

[1066] The present invention is a system for helping children to efficiently complete their homework and facilitating communication between family members. This system is implemented using an educational institution, a server, and devices of parents and children, in combination with an emotion engine that recognizes the user's emotions.

[1067] Entering and collecting homework information

[1068] A teacher at an educational institution uses the school's online system (e.g., Google Classroom) to enter detailed information about the homework assignment (such as the assignment content, deadline, and reference materials).

[1069] The server periodically retrieves this information and stores it in an internal database (e.g., MySQL).

[1070] Homework information notification and display

[1071] The server generates push notifications to user devices (parents' and children's smartphones and tablets) based on the homework information it retrieves, and these notifications are sent using a service such as Firebase Cloud Messaging.

[1072] The device displays the received notification on the screen so that the user (child) can check detailed information about the homework.

[1073] Homework progress management

[1074] The user (child) enters their homework progress in the application's progress input field (e.g., "Math assignment 1 is 50% complete").

[1075] The device sends the entered progress data to the server, which stores the received progress data in a database and notifies the parent device of the progress status.

[1076] Asking questions and using the AI ​​assistant

[1077] The user (child) enters a question about their homework into the application's question input field (e.g., "I don't know how to solve problem 3").

[1078] The device sends a question to the server. The server receives the question data and generates a prompt that inputs the question into a generative AI model (e.g., OpenAI's GPT-4). The generative AI analyzes the prompt and generates an appropriate answer. The server sends the generated answer to the device, and the device displays the received answer, providing a specific solution or guide on how to solve it.

[1079] Emotion recognition by emotion engine

[1080] The device analyzes the user's (child's) facial expressions, voice, or text input in real time via a camera and microphone to recognize emotions. For example, it can detect "confusion" or "stress" using an emotion analysis engine such as Amazon Rekognition.

[1081] The device sends the recognized emotion data to a server, which then evaluates the stress level and motivation based on the homework progress data and emotion data.

[1082] Feedback to parents

[1083] The server generates a feedback message for the parents based on the evaluation results, including specific support methods such as "Your child seems to be having trouble. He or she may need help."

[1084] The server sends the feedback message to the parent's device, which then notifies the parent by displaying a notification, allowing the parent to communicate appropriately with their child based on this feedback.

[1085] Examples of concrete examples and prompts

[1086] Example 1: Homework progress management

[1087] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[1088] The server receives the progress data and stores it in a database.

[1089] The device also notifies parents of the progress, who can then check the progress.

[1090] Example prompt sentence:

[1091] "Design a system for children to report their progress on their language arts homework and notify their parents."

[1092] Example 2: Questions and real-time support

[1093] The user (child) enters a question such as, "I don't know how to write a history report."

[1094] The server receives the question, and the generative AI generates an example of a report structure.

[1095] The device displays the answers, making it easier for children to write their reports.

[1096] Example prompt sentence:

[1097] "Design a system that allows your child to ask questions and support them in writing their history report."

[1098] Example 3: Feedback to parents

[1099] The server analyzes the progress and emotional data and assesses that the child's stress level is high.

[1100] The server generates a feedback message to inform the parent that "your child is struggling and needs some encouragement."

[1101] The device receives the feedback and suggests the appropriate way to speak to the user.

[1102] Example prompt sentence:

[1103] "Design a system that analyzes children's stress levels and provides feedback to parents."

[1104] Example 4: Using an Emotion Engine

[1105] The user (child) shows signs of frustration while solving the problem.

[1106] The device uses an emotion engine to recognize "confusion" and transmits the emotion data to the server.

[1107] The server generates a feedback message based on the recognized emotion and progress data.

[1108] The device will notify the parent, "Your child seems to be in trouble and may need help," allowing the parent to offer advice to the child.

[1109] Example prompt sentence:

[1110] "Design a system that analyzes children's emotions and provides feedback to parents."

[1111] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1112] Understood. Below is a detailed explanation of the system program processing flow, broken down into steps.

[1113] Step 1:

[1114] Homework information entered by teachers at educational institutions

[1115] Input: The teacher logs into the school's online system (e.g., Google Classroom) and enters detailed information about the homework (such as the assignment content, deadline, and reference materials).

[1116] Action: A teacher fills in the required information in a web form and clicks the submit button.

[1117] Output: Homework information is saved in the online system database.

[1118] Step 2:

[1119] Collection of homework information by the server

[1120] Input: New homework information is added to the online system database.

[1121] How it works: The server periodically contacts the online system via the API to check for new homework information.

[1122] Output: The server retrieves the new homework information and stores it in its own database (e.g., MySQL).

[1123] Step 3:

[1124] Server-generated and sent notifications

[1125] Input: New homework information stored in the server's database.

[1126] How it works: The server generates the push notification content based on the homework information and sends it to the user's (child's and guardian's) device using services such as Firebase Cloud Messaging.

[1127] Output: A push notification is sent to the user device.

[1128] Step 4:

[1129] Receiving and displaying notifications on your device

[1130] Input: The push notification sent by the server.

[1131] What it does: Your device receives a notification and displays it in the notification area or within the app.

[1132] Output: The user (child) can check the detailed information of the homework.

[1133] Step 5:

[1134] Children input their homework progress

[1135] Input: The user (child) enters their homework progress into the app's input field (e.g., "Math assignment 1 is 50% complete").

[1136] What happens: A user enters text into a progress input field in the app and clicks the submit button.

[1137] Output: Progress information is saved to the device's temporary storage area.

[1138] Step 6:

[1139] Device sends progress data

[1140] Input: Progress information stored on the device.

[1141] Operation: The device sends progress information to the server via the API.

[1142] Output: Progress data is sent to the server and stored in the server's database.

[1143] Step 7:

[1144] Server-based progress data storage and parental notification

[1145] Input: Progress data sent to the server.

[1146] How it works: The server stores progress data in a database and also notifies the parent's device of this information.

[1147] Output: Progress is notified to the parent's device.

[1148] Step 8:

[1149] Children input questions

[1150] Input: The user (child) enters a question about their homework into the app's question input field (e.g., "I don't know how to solve problem 3").

[1151] How it works: A user enters text into the app's question input field and clicks the submit button.

[1152] Output: The question is saved in the device's temporary storage area.

[1153] Step 9:

[1154] Sending question data from the device

[1155] Input: Questions saved on your device.

[1156] How it works: The device sends the question to the server via the API.

[1157] Output: The query data is sent to the server and stored on the server.

[1158] Step 10:

[1159] Server analyzes questions and generates answers

[1160] Input: Question data stored on the server.

[1161] How it works: The server receives question data and generates a prompt that feeds the question into a generative AI model (e.g., OpenAI's GPT-4). The generative AI analyzes the prompt and generates an appropriate answer.

[1162] Output: The generated answer is retrieved by the server.

[1163] Step 11:

[1164] Server sends answer

[1165] Input: An answer generated by a generative AI model.

[1166] Action: The server generates a response and sends it to the device.

[1167] Output: The response data is sent to the terminal.

[1168] Step 12:

[1169] Displaying answers on the device

[1170] Input: The response data sent from the server.

[1171] What it does: The answer the device receives is displayed in the app.

[1172] Output: The user (child) can receive a concrete solution or guide.

[1173] Step 13:

[1174] Analysis of emotion data on the device

[1175] Input: User (child) facial expression, voice, or text input data.

[1176] How it works: The device collects data through the camera and microphone and analyzes emotions using an emotion analysis engine (e.g., Amazon Rekognition).

[1177] Output: The analyzed emotion data is generated and temporarily saved.

[1178] Step 14:

[1179] Sending emotional data by device

[1180] Input: Parsed emotion data.

[1181] Operation: The device sends emotion data to the server.

[1182] Output: The emotion data is sent to the server and stored in a database.

[1183] Step 15:

[1184] Server-generated ratings and feedback

[1185] Input: Progress and emotion data stored on the server.

[1186] How it works: The server evaluates the stress level and motivation based on the progress data and emotional data, and generates a feedback message for the parent.

[1187] Output: The generated feedback message is retrieved by the server.

[1188] Step 16:

[1189] Server sending feedback messages

[1190] Input: The generated feedback message.

[1191] Operation: The server sends a feedback message to the parent terminal.

[1192] Output: A feedback message is sent to the parent device.

[1193] Step 17:

[1194] Parental feedback display

[1195] Input: The feedback message sent by the server.

[1196] What it does: The parent device receives the feedback message and displays it in a notification or in the app.

[1197] Output: Parents can understand their child's situation and provide appropriate support.

[1198] (Application example 2)

[1199] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1200] In today's educational environment, it is important for children to complete their homework efficiently while maintaining smooth communication with their families. However, there is no centralized system that can manage homework progress, questions, or even grasp children's emotional state. Similar problems exist at brick-and-mortar learning events, which can potentially reduce the quality of children's learning experience. A comprehensive system to overcome these issues is needed.

[1201] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an educational institution's information input means for inputting detailed homework information, server means for collecting homework information from the educational institution's information input means and storing it in a database, notification means, terminal means, progress input means, question input means, generative AI means, answer display means, evaluation means, generation means, notification means, display means, emotion engine means for emotion recognition, means for transmitting emotion data acquired using the emotion engine means to the server means, and means for applying the emotion engine means to events and in-store activities. This enables children to efficiently complete their homework and learning activities and allows parents to provide appropriate support as needed, making similar support possible at learning events held in physical stores.

[1202] "Information input means of educational institutions" refers to systems or means for inputting detailed information about homework from educational institutions such as schools and cram schools.

[1203] "Server means" refers to means that performs the functions and roles of a server, such as collecting, storing, analyzing, and notifying homework information.

[1204] "Notification means" refers to means for notifying the user of collected homework information, progress, feedback messages, etc.

[1205] "Terminal means" refers to a device used by a user, such as a smartphone, tablet, or PC, which is capable of displaying and inputting information.

[1206] The "progress input means" is a means for the user to input the progress status of homework or tasks.

[1207] The "question input means" is a means for the user to input questions about homework or learning content.

[1208] "Generative AI methods" are artificial intelligence methods for generating appropriate answers to questions, and use technologies such as natural language processing.

[1209] The "answer display means" is a means for displaying the answer generated by the generative AI to the user.

[1210] The "evaluation means" is a means for evaluating the user's stress level and motivation based on homework progress data and emotional data.

[1211] The "generation means" is a means for generating a feedback message for parents based on the evaluation results obtained by the evaluation means.

[1212] The "emotion engine means" is a means for analyzing the user's facial expressions, voice, text, etc., and recognizing emotions.

[1213] "Means to be applied to activities in physical stores" refers to means that use emotion engine means to recognize and evaluate users' emotions during learning events and activities in physical stores and provide appropriate support.

[1214] The present invention is a comprehensive system for enabling children to efficiently complete their homework and for facilitating smooth communication within the family. Specific embodiments for realizing the present invention will be described in detail below.

[1215] Program processing

[1216] The system consists of multiple hardware and software components. The hardware includes smartphones, tablets, PCs, and servers, all of which require an internet connection. The software includes emotion recognition APIs (e.g., Microsoft Azure Emotion API), a notification system, a database (e.g., MySQL), and generative AI (e.g., GPT-3).

[1217] Server Roles

[1218] The server includes means for:

[1219] 1. Information input method for educational institutions: An online system where educational institutions input detailed information about homework (such as assignment content and submission deadlines).

[1220] 2. Database: Storage for homework information and progress data.

[1221] 3. Notification system: A system that notifies users of saved homework information, progress, feedback messages, etc.

[1222] 4. Generative AI: Artificial intelligence that generates appropriate answers to questions from users.

[1223] 5. Evaluation method: A system that evaluates the user's stress level and motivation based on homework progress data and emotional data.

[1224] Device Role

[1225] Terminals (smartphones, tablets, PCs) include means with the following functions:

[1226] 1. Information display method: The device displays notified homework information, progress, and AI-generated answers on the screen.

[1227] 2. Progress input means: A means for children to input their homework progress.

[1228] 3. Question input means: A means for children to input questions about their homework.

[1229] 4. Emotion engine means: A means for recognizing the user's emotions using a camera or microphone and sending that data to the server.

[1230] Managing connections

[1231] The server evaluates the user's stress level and motivation based on the homework progress data and questions, and generates a feedback message for parents based on the evaluation results, including specific instructions on the child's learning progress and the support needed.

[1232] Specific examples

[1233] Specific examples of progress management

[1234] For example, a scenario in which a child enters that their homework progress is 30% and a parent checks the progress. The device collects the progress data, the server evaluates it, and notifies the parent of the results.

[1235] Specific examples of emotion recognition

[1236] If a child shows a confused expression while working on their homework, the device's camera will capture the expression, and the emotion engine will recognize the expression as "confused" and send it to the server. The server will then analyze the emotion data and notify the parent or guardian, "Your child is confused. They may need help."

[1237] Prompt Sentence Examples

[1238] Examples of prompts for question input are as follows:

[1239] "My child says he can't solve problem 3 in his math homework. Do you have any solutions or hints?"

[1240] "Child A showed signs of confusion when doing his math homework, suggesting high stress levels. Please provide specific advice."

[1241] Thus, the present invention provides a means for improving the educational environment and enhancing communication among family members.

[1242] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1243] Step 1:

[1244] Using the educational institution's information input method, the teacher enters detailed information about the homework (such as the assignment content and submission deadline) into the online system.

[1245] Input: Homework details entered by the teacher.

[1246] Output: Homework information stored in the institution's system.

[1247] Step 2:

[1248] The server collects homework information from the institution's system and stores it in a database.

[1249] Input: Homework information obtained from the institution's system.

[1250] Output: Homework information stored in the server's database.

[1251] Step 3:

[1252] The server notifies the terminal of new homework information.

[1253] Input: Homework information stored in the database.

[1254] Output: Push notification to device.

[1255] Step 4:

[1256] Displays notifications received by the device on the screen.

[1257] Input: Homework information sent from the server.

[1258] Output: Homework information displayed on the terminal screen.

[1259] Step 5:

[1260] The user (child) uses the device to enter their homework progress.

[1261] Input: Homework progress input by the child.

[1262] Output: Progress data entered into the terminal.

[1263] Step 6:

[1264] The device sends the progress data to the server, which stores it in a database.

[1265] Input: Progress data sent from the device.

[1266] Output: Progress data stored in the server database.

[1267] Step 7:

[1268] The user (child) enters a homework question into the terminal.

[1269] Input: The question entered by the child.

[1270] Output: Question data entered into the terminal.

[1271] Step 8:

[1272] The terminal transmits the question data to the server.

[1273] Input: Question data sent from the terminal.

[1274] Output: The query data received by the server.

[1275] Step 9:

[1276] The server uses generative AI to generate answers to questions.

[1277] Input: The query data received by the server.

[1278] Output: Answer data generated by the generative AI.

[1279] Step 10:

[1280] The server sends the generated answer to the terminal, which displays the answer.

[1281] Input: Answer data generated by generative AI.

[1282] Output: The answer displayed on the terminal.

[1283] Step 11:

[1284] The device's camera is used to capture the child's facial expressions and analyze them using an emotion engine.

[1285] Input: Image data captured by the device's camera.

[1286] Output: Parsed emotion data.

[1287] Step 12:

[1288] The device sends the emotion data to the server, which stores it in a database.

[1289] Input: Emotion data sent from the device.

[1290] Output: Emotion data stored in the server database.

[1291] Step 13:

[1292] The server evaluates the homework based on progress data and emotional data.

[1293] Input: Progress data and emotion data.

[1294] Output: Evaluation results.

[1295] Step 14:

[1296] The server generates a feedback message based on the evaluation results and notifies the parents.

[1297] Input: Evaluation result.

[1298] Output: Feedback message to parent.

[1299] Step 15:

[1300] Parents check the feedback messages and provide appropriate support to their children.

[1301] Input: Feedback message.

[1302] Output: Parental supportive behavior.

[1303] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1304] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1305] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1306] [Third embodiment]

[1307] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1308] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1309] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1310] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1311] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1312] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1313] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1314] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1315] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1316] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1317] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1318] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1319] The present invention is a system for ensuring that children do their homework and for facilitating communication between family members. This system is implemented using an educational institution, a server, and terminals of parents and children. The details of the system's processing are explained below.

[1320] Entering and collecting homework information

[1321] 1. Means of inputting information for educational institutions

[1322] It begins with the teacher using the school's online system to enter detailed information about the homework (such as the assignment content, deadline, and reference materials).

[1323] 2. Information collection by the server

[1324] The server connects to the school's system and collects the entered homework information.

[1325] The collected homework information is stored in a database and prepared for notification to each household's device.

[1326] Homework information notification and display

[1327] 1. Means of notification

[1328] The server generates notifications based on homework information collected from educational institutions.

[1329] Send push notifications to devices (parents' and children's smartphones, tablets, etc.).

[1330] 2. Displaying information on a terminal

[1331] The terminal displays the notified homework information on the screen so that the user can check it.

[1332] Homework progress management

[1333] 1. Progress input method

[1334] The user (child) opens the app and enters their homework progress.

[1335] For example, enter specific progress information such as "Math assignment 1 50% complete."

[1336] 2. Data storage by server

[1337] The server receives the progress data and stores it in a database.

[1338] Asking questions and using the AI ​​assistant

[1339] 1. Question input method

[1340] Users (children) enter any questions they have about their homework into the app's question input field.

[1341] For example, enter "I don't know how to solve problem 3."

[1342] 2. Answer generation using generative AI

[1343] The server receives the question and uses generative AI to generate an appropriate answer.

[1344] The confirmed answer is sent to the terminal and displayed to the user.

[1345] Feedback to parents

[1346] 1. Evaluation methods

[1347] The server assesses the child's stress level and motivation based on homework progress data and questions.

[1348] 2. Means of generation and notification

[1349] The server generates a feedback message for parents based on the evaluation results.

[1350] The message includes specific support methods such as, "Your child's stress is increasing. Some encouraging words would be effective."

[1351] 3. Feedback display on parental devices

[1352] The device (parent's smartphone) receives the feedback message and displays it as a notification.

[1353] The user (parent) communicates with their child based on the displayed feedback.

[1354] Specific examples

[1355] Example 1: Homework progress tracking

[1356] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[1357] The server receives the progress data and stores it in a database.

[1358] The device also notifies parents of the progress, allowing them to check the progress.

[1359] Example 2: Questions and real-time support

[1360] The user (child) enters a question saying, "I don't know how to write a history report."

[1361] The server receives the question, and the generative AI generates a "sample report structure."

[1362] The device displays the answers, making it easier for children to write their reports.

[1363] Example 3: Parent feedback

[1364] The server analyzes the progress data and determines that the child's stress level is high.

[1365] The server generates a feedback message to inform the parent that their child is struggling and should be encouraged.

[1366] The device provides feedback to parents and suggests appropriate ways to encourage their child.

[1367] As a result, the present invention improves the efficiency with which children tackle their homework, facilitates communication within the family, and provides a beneficial environment for both children and parents.

[1368] The processing flow will be explained below.

[1369] Step 1:

[1370] The teacher enters detailed information about the homework (such as the assignment content, deadline, and reference materials) into the school's online system.

[1371] Step 2:

[1372] The server collects homework information from the school system and stores it in a database.

[1373] Step 3:

[1374] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[1375] Step 4:

[1376] Your device will receive a notification and display the homework details on the screen.

[1377] The user (child) checks the displayed homework information.

[1378] Step 5:

[1379] The user (child) enters their homework progress through the app (e.g., math assignment 1 is 50% complete).

[1380] The terminal collects this progress data and sends it to the server.

[1381] Step 6:

[1382] The server stores the received progress data in a database.

[1383] The server also notifies the parent's device of the updated progress.

[1384] Step 7:

[1385] If the user (child) has a question while working on their homework, they can enter it in the question input field within the app (e.g., "I don't know how to solve problem 3").

[1386] The terminal sends a question to the server.

[1387] Step 8:

[1388] The server analyzes the received question and generates an appropriate answer using generative AI.

[1389] The server sends the generated response to the terminal.

[1390] Step 9:

[1391] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[1392] Step 10:

[1393] The server analyzes homework progress data and question content to assess the child's stress level and motivation.

[1394] The server generates a feedback message for the parent based on the evaluation results.

[1395] Step 11:

[1396] The server sends a feedback message to the parent's device (e.g., "Your child is experiencing increased stress. Some encouraging words would be helpful").

[1397] Step 12:

[1398] The device (parent's smartphone) receives the feedback message and notifies the parent.

[1399] The user (parent) can check the notifications and use them to communicate with their child.

[1400] As described above, the present invention is a system that helps children to efficiently tackle their homework and allows parents to provide appropriate support through these processing steps.

[1401] Example 1

[1402] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1403] Ensuring that children do their homework reliably and maintaining smooth communication among family members are major challenges in modern families. To solve these problems, it is important to efficiently share homework information, manage children's homework progress, and provide appropriate support. However, doing these tasks manually requires a great deal of effort and time, making it difficult to achieve effective results. Therefore, a system that can solve these problems effectively and efficiently is needed.

[1404] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1405] In this invention, the server includes an input unit for inputting detailed information about homework from educational institutions, a unit for collecting homework information and storing it in a database, and a unit for notifying the user of the stored homework information. This allows for efficient collection of homework information from educational institutions and appropriate sharing within the home. Furthermore, the server unit uses a generative AI model to generate answers to children's questions, thereby supporting smooth communication between family members.

[1406] "Input means for educational institutions to input detailed information about homework" refers to a system or software that allows educational institutions (teachers) to input detailed information about homework (such as assignment content, submission deadline, reference materials, etc.).

[1407] "Server means for collecting homework information and storing it in a database" refers to a server that has the role of acquiring homework information input by educational institutions and storing it in a database.

[1408] "Means for notifying saved homework information" refers to the function of notifying parents and children's devices of homework information saved on the server.

[1409] "Device means for displaying homework information" refers to the function that displays notified homework information on devices such as smartphones and tablets used by parents and children.

[1410] "A means for inputting homework progress" refers to an application or interface that allows a child to input their homework progress.

[1411] "A means for inputting questions about homework" refers to an application or interface that allows a child to input questions about homework into the system.

[1412] "Server means for generating answers to questions using a generative AI model" refers to a server that generates answers to questions posed by children using a generative AI model (e.g., GPT-3).

[1413] "Answer display means for transmitting the generated answer to the terminal means and displaying it" refers to a function for transmitting the generated answer to the terminal of the parent or child and displaying it.

[1414] "Evaluation means for evaluating stress levels and motivation based on homework progress data" refers to a server that has the function of evaluating a child's stress levels and motivation based on homework progress data entered by the child.

[1415] The "means for generating a feedback message for parents" refers to a server function that generates a feedback message for parents based on the evaluation results obtained by the evaluation means.

[1416] The "notification means for sending a feedback message to a parent terminal and notifying the parent" refers to a function for sending a generated feedback message to a parent terminal and notifying the parent.

[1417] "Display means for displaying a feedback message" refers to a function for displaying the notified feedback message on the parent's terminal.

[1418] The present invention provides a system for ensuring that children do their homework and for facilitating communication between family members. This system is implemented using an educational institution, a server, and terminals of parents and children. The details of this system are described below.

[1419] Entering and collecting homework information

[1420] First, we will explain how educational institutions input detailed homework information. Teachers use the school's online system (e.g., Google Classroom or Microsoft Teams) to input detailed homework information (such as assignment content, submission deadline, and reference materials). This includes entering the assignment content as text, setting a calendar for the submission deadline, and adding linked reference materials.

[1421] Next, the server collects homework information. The server collects homework information entered by educational institutions via APIs such as Google Classroom. The collected data is temporarily stored in JSON format and then saved in a database such as MySQL or PostgreSQL. The saved data is sorted by household and prepared for push notifications.

[1422] Homework information notification and display

[1423] Next, we will explain how homework information is notified. The server generates a notification message based on the collected homework information. A template engine (for example, Handlebars.js) is used to generate the notification, creating a specific message such as "Japanese homework from Mr. / Ms. XX: Kanji practice, deadline is XX / XX."

[1424] Devices (parents' and children's smartphones and tablets) receive notifications using Firebase Cloud Messaging (FCM), which are then displayed as a pop-up in a dedicated app (e.g., HomeWork Tracker) where detailed information can be viewed.

[1425] Homework progress management

[1426] Next, we will explain how to manage homework progress. Users (children) use a dedicated app (HomeWork Tracker) to enter their homework progress. The input form has pull-down menus and sliders, making it easy to enter progress such as "Math assignment 1 progress: 50% complete."

[1427] The server receives the progress data entered by the user in real time and stores it in a database, strictly managing transactions (e.g., ACID characteristics) to maintain data consistency.

[1428] Asking questions and using the AI ​​assistant

[1429] If a user (child) has a question about their homework, they can write it down in the question input field of the dedicated app. For example, they can write, "I don't know the stroke order of the kanji."

[1430] The server receives the entered question and generates an appropriate answer using a generative AI model such as OpenAI's GPT-3. For example, it might generate an answer such as "The stroke order for kanji is as follows..." and send it to the user's device. When generating the answer, it uses an appropriate prompt. An example of a specific prompt would be "Please tell me the stroke order for kanji."

[1431] Feedback to parents

[1432] Finally, we will explain the feedback method. The server evaluates the child's stress level and motivation based on homework progress data and question content. This evaluation uses a machine learning model (e.g., regression analysis using scikit-learn). If the stress level is determined to be high, a feedback message such as "The child is struggling and needs encouragement" is generated.

[1433] The server sends the generated feedback message to the parent's device, where it is received through a dedicated app (HomeWork Tracker) and displayed as a notification. Based on this feedback message, parents can communicate appropriately with their children.

[1434] Specific examples

[1435] Specific examples are given below.

[1436] Example 1: Homework progress tracking

[1437] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[1438] The server receives the progress data and stores it in a database.

[1439] The device also notifies parents of the progress, who can then check the progress.

[1440] Example 2: Questions and real-time support

[1441] The user (child) enters a question such as, "I don't know how to write a history report."

[1442] The server receives the question, and the generative AI generates a "sample report structure."

[1443] The device displays the generated answers, making it easier for children to write their reports.

[1444] Example 3: Parent feedback

[1445] The server analyzes the progress data and assesses that the child's stress level is high.

[1446] The server generates a feedback message to inform the parent that "your child is struggling and needs some encouragement."

[1447] The device will then notify the parent of the feedback message and suggest appropriate ways to respond.

[1448] In this way, the present invention improves the efficiency with which children tackle their homework, facilitates communication within the family, and provides a beneficial environment for both children and parents.

[1449] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1450] Step 1:

[1451] The user (teacher) logs into an online system such as Google Classroom or Microsoft Teams and enters detailed information about the homework (such as the assignment content, deadline, and reference materials). The information entered is temporarily stored in the system's database, allowing the teacher to provide complete details of the homework assigned to the student.

[1452] Step 2:

[1453] The server collects homework information entered by educational institutions via APIs such as Google Classroom. The collected data is first temporarily saved in JSON format and then stored in a database such as MySQL or PostgreSQL. The saved data is sorted by household and prepared for push notifications. This ensures that homework information is accurately reflected in the database.

[1454] Step 3:

[1455] The server generates a notification message based on the collected homework information. A template engine (for example, Handlebars.js) is used to generate the notification, creating a specific message such as "Japanese homework from Teacher X: Kanji practice, deadline is X / X." The generated notification message is then ready to be sent to each household's device.

[1456] Step 4:

[1457] Devices (parents' and children's smartphones and tablets) receive notifications using Firebase Cloud Messaging (FCM). The received notification is displayed as a pop-up in a dedicated app (e.g., HomeWork Tracker) where detailed information can be checked. This information is cached on the device and can be accessed by the user at any time.

[1458] Step 5:

[1459] Users (children) use a dedicated app (HomeWork Tracker) to enter their homework progress. The input form has pull-down menus and sliders, making it easy to enter progress such as "Math assignment 1 progress: 50% complete." The entered information is immediately sent to the server.

[1460] Step 6:

[1461] The server receives the progress data entered by the user in real time and stores it in a database. At this time, transaction management (e.g., ACID characteristics) is strictly enforced to maintain data consistency. The received data is stored in an analysis table for subsequent processing.

[1462] Step 7:

[1463] If a user (child) has a question about their homework, they can write it down in the question input field of the dedicated app. For example, they can write "I don't know the stroke order of kanji." This input is immediately sent to the server.

[1464] Step 8:

[1465] The server receives the question and generates an appropriate answer using a generative AI model such as OpenAI's GPT-3. For example, an answer such as "The stroke order for kanji characters is as follows..." is generated. The generated answer is then sent to the user's device.

[1466] Step 9:

[1467] The device receives the answer from the server and displays it on the dedicated app screen. The user (child) can use this answer as a reference to proceed with their homework. The answer is cached on the device and can be reviewed later.

[1468] Step 10:

[1469] The server analyzes homework progress data and questions to assess children's stress levels and motivation. This assessment is performed using machine learning models (e.g., regression analysis using scikit-learn). The results are stored in a database and used to generate feedback for parents.

[1470] Step 11:

[1471] The server generates a feedback message for parents based on the evaluation results, including specific support methods such as, "Your child is experiencing increasing stress. Some encouraging words would be effective."

[1472] Step 12:

[1473] The server then sends the generated feedback message to the parent's device, which receives the message via a dedicated app and displays it as a notification.The parent can then communicate with their child based on this feedback.

[1474] (Application example 1)

[1475] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1476] Conventional home learning support systems were unable to provide sufficient support for children when they were doing their homework, and communication with parents was also limited. As a result, children's motivation and understanding when doing homework often decreased, making it difficult for parents to provide support. Furthermore, there was no system in place to effectively utilize educational support services and products in physical stores.

[1477] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1478] In this invention, the server includes an educational institution information input means for inputting detailed homework information, a server means for collecting homework information and storing it in a database, a notification means for notifying homework information, a terminal means for displaying the notified homework information on the terminal, a progress input means for inputting homework progress, a server means for receiving progress data and storing it in a database, a question input means for inputting homework-related questions, a generative AI means for generating answers to the questions, an answer display means for sending the generated answers to the terminal and displaying them, an evaluation means for evaluating stress levels and motivation based on homework progress data, a generation means for generating feedback messages for parents, a notification means for sending the feedback messages to the parent terminal and notifying them, a display means for displaying the feedback messages on the parent terminal, a prompt generation means for inputting prompts to the generative AI means for generating answers to homework questions, and a commercial terminal means for providing homework progress and AI assistant functions to sell educational support products and services in physical stores. This enables management of children's homework progress, prompt responses to questions, appropriate feedback to parents, and effective provision of educational support services in physical stores.

[1479] "Homework details" refers to information such as the content of assignments assigned to students by educational institutions, submission deadlines, and reference materials.

[1480] "Institutional information entry means" means an online system or device through which teachers enter homework details.

[1481] "Server Means" means a server for collecting, storing, processing and communicating homework information and subsequent progress and question data from an educational institution.

[1482] "Notification means" refers to a means that has the function of pushing homework information received from the server and generated feedback messages to the terminal.

[1483] "Terminal means" refers to a device that displays notified homework information and feedback messages, such as a smartphone, tablet, or computer.

[1484] "Homework progress" is information that indicates the progress and completion rate of a student's homework.

[1485] The "progress input means" is an interface that allows students to input their homework progress.

[1486] The "question input means" is an interface that allows students to input doubts or questions about their homework.

[1487] "Generative AI means" is an AI (artificial intelligence) system that uses natural language processing to automatically generate appropriate answers to students' questions.

[1488] "Answer display means" refers to a means for displaying the answer generated by the generative AI means on a terminal.

[1489] "Evaluation measures" are measures that analyze homework progress data and questions to assess students' stress levels and motivation.

[1490] The "generation means" is a means for generating a feedback message for parents based on the evaluation results obtained by the evaluation means.

[1491] "Prompt generation means" refers to a means for generating a prompt sentence to be input to the generative AI means.

[1492] "Commercial Terminal Means" means dedicated terminals or devices installed in a physical store to provide educational support products and services.

[1493] MODE FOR CARRYING OUT THE INVENTION

[1494] The present invention is a system for ensuring that children do their homework and for facilitating smooth communication within the family. Specific embodiments for carrying out the present invention are described below.

[1495] 1. Entering and collecting homework information

[1496] Educational institution information entry method

[1497] Teachers at educational institutions use online systems and devices to input homework details (such as assignment content, deadlines, and reference materials), which are then collected by the server and stored in its database.

[1498] Server information collection

[1499] The server receives homework information entered through the educational institution's information entry means, and stores this information in a database within the server for subsequent processing.

[1500] 2. Notification and display of homework information

[1501] Notification means

[1502] The server generates a notification message based on the homework information received from the educational institution, and sends the notification to the device (smartphone, tablet, etc.) as a push notification.

[1503] Displaying information via terminal means

[1504] The device displays the homework information received from the server on the screen, allowing the user to check detailed information about the homework.

[1505] 3. Homework progress management

[1506] Progress input method

[1507] The user (child) can use the device to input their homework progress, for example, by entering specific progress information such as "50% complete for Math Assignment 1."

[1508] Data storage by server

[1509] The server receives the progress data entered in this way and stores it in a database. This progress information is also sent to the parent's device.

[1510] 4. Asking questions and using AI assistants

[1511] Question input method

[1512] Users (children) can enter questions they have about their homework into the question input form on the device. For example, they can enter a question like, "I don't know how to solve problem 3."

[1513] Answer generation using generative AI methods

[1514] The server receives the user's question and generates an appropriate answer using a generative AI model, which uses natural language processing to generate an answer to the question.

[1515] Answer display means

[1516] The server-generated answer is sent to the terminal and immediately displayed to the user.

[1517] 5. Feedback to parents

[1518] Evaluation methods

[1519] The server assesses the child's stress level and motivation based on homework progress data and questions.

[1520] Generation and notification methods

[1521] Based on the evaluation results, the server generates a feedback message for the parent, including specific support methods such as "Your child's stress is increasing. Some words of encouragement would be effective." The generated message is then sent to the parent's device.

[1522] Feedback display on parental device

[1523] The parent device receives this feedback message and displays the feedback content, which parents can use as a reference when communicating with their children.

[1524] 6. Prompt Generation Methods

[1525] A prompt generator is used to input a prompt to the generator AI. This prompt is converted into an appropriate format depending on the specific question. The following is an example of a prompt:

[1526] Examples of prompts:

[1527] "I received a question from the home learning material 'Math Drills' saying 'I don't understand problem 3.' Please give me some hints on how to solve it."

[1528] 7. In-store use

[1529] Commercial terminal means can be installed in physical stores to provide homework progress and AI assistant functions, and this commercial terminal is intended to effectively provide educational support products and services.

[1530] With the above-described configuration, the present invention can improve the efficiency with which children do their homework, facilitate communication within the home, and create an environment that is beneficial to both parents and children.

[1531] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1532] Step 1: Institution Enters Homework Information

[1533] Using the institution's information entry means, the teacher enters the homework details (such as assignment content, deadline, reference materials, etc.) into the online system. This input information forms the basis for the data collected by the server in the next processing step.

[1534] Input: Homework details by educational institution

[1535] Output: Homework information entered into the online system

[1536] Step 2: Server collects homework information

[1537] The server collects homework information from the educational institution's information input means and stores the information in a database. Through this process, detailed homework information is centrally managed in the database.

[1538] Input: Homework information entered into the online system

[1539] Output: Homework information stored in the database

[1540] Step 3: Generate and send notifications

[1541] The server generates a notification message to be sent to the device based on the saved homework information, and pushes this message to the device using a notification means, allowing the user to receive the homework information promptly.

[1542] Input: Homework information in the database

[1543] Output: Homework information notification message to the terminal

[1544] Step 4: View homework information on your device

[1545] The terminal displays the homework information received from the server on the screen, allowing the user to check the content of the homework and the deadline for submission.

[1546] Input: Notification message from the server

[1547] Output: Homework information displayed on the terminal screen

[1548] Step 5: User enters homework progress

[1549] The user (child) inputs their homework progress via the device. For example, they input specific progress information such as "50% completion of math assignment 1."

[1550] Input: Homework progress information

[1551] Output: Homework progress information entered into the terminal

[1552] Step 6: Saving Progress Data on the Server

[1553] The server receives the homework progress information sent by the user, stores it in a database, and also notifies the parent / guardian of this progress information.

[1554] Input: Progress information from the user

[1555] Output: Progress information stored in a database and parental notification messages

[1556] Step 7: User enters question

[1557] The user (child) enters any questions about their homework into the question input form on the device. For example, they enter a question such as, "I don't know how to solve problem 3."

[1558] Input: User question

[1559] Output: Question input to terminal completed

[1560] Step 8: AI answer generation by the server

[1561] The server receives the user's question and generates an appropriate answer using a generative AI model, which inputs the prompt sentence generated by the prompt generation means and performs natural language processing.

[1562] Input: User question, prompt

[1563] Output: The generated answer

[1564] Step 9: Viewing Answers via Terminal

[1565] The server generates a response and sends it to the terminal, which receives it and displays it immediately to the user.

[1566] Input: Generated answer from the server

[1567] Output: Answer displayed on the terminal screen

[1568] Step 10: Server evaluation and feedback generation

[1569] The server evaluates the user's stress level and motivation based on the homework progress data and questions, and generates a feedback message for parents based on the evaluation results.

[1570] Input: Homework progress data, questions

[1571] Output: The generated feedback message

[1572] Step 11: Feedback notification and display on parent device

[1573] The server sends the generated feedback message to the parent's device, which receives it and displays the feedback content, allowing the parent to understand the detailed status of their child's homework and provide appropriate support.

[1574] Input: The generated feedback message

[1575] Output: Notification and feedback displayed on the parent's device

[1576] Step 12: Use prompt generators

[1577] A prompt generation means is used to input a prompt sentence into a generative AI means for generating answers to questions about homework. For example, a prompt sentence such as "I received a question from the homework textbook 'Math Drills' saying 'I don't understand problem 3.' Please give me a hint on how to solve it" is generated and input into the AI ​​model.

[1578] Input: User question

[1579] Output: The prompt generated by the prompt generator

[1580] Step 13: In-store use

[1581] Using commercial terminals installed in physical stores, homework progress and AI assistant functions are provided, allowing parents and children to easily use educational support products and services in physical stores.

[1582] Input: Progress information, AI assistant function

[1583] Output: Providing educational support services in physical stores

[1584] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1585] The present invention is a system for helping children to efficiently complete their homework and facilitating communication between family members. This system is implemented by combining an educational institution, a server, and devices of parents and children, with an emotion engine that recognizes the user's emotions.

[1586] Entering and collecting homework information

[1587] 1. Means of inputting information for educational institutions

[1588] The teacher uses the school's online system to enter detailed information about the homework (such as the assignment, deadline, and reference materials).

[1589] 2. Information collection by the server

[1590] The server collects homework information from the school system and stores it in a database.

[1591] Homework information notification and display

[1592] 1. Means of notification

[1593] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[1594] 2. Displaying information on a terminal

[1595] The device receives a notification and displays detailed homework information on the screen so that the user (child) can check it.

[1596] Homework progress management

[1597] 1. Progress input method

[1598] The user (child) enters their homework progress through the app (e.g., "Math assignment 1 is 50% complete").

[1599] The terminal collects this progress data and sends it to the server.

[1600] 2. Data storage by server

[1601] The server stores the received progress data in a database.

[1602] The server also notifies the parent's device of the updated progress.

[1603] Asking questions and using the AI ​​assistant

[1604] 1. Question input method

[1605] If the user (child) has any questions while working on their homework, they can enter their question in the question input field within the app (e.g., "I don't know how to solve problem 3").

[1606] The terminal sends a question to the server.

[1607] 2. Answer generation using generative AI

[1608] The server analyzes the received question and generates an appropriate answer using generative AI.

[1609] The server sends the generated response to the terminal.

[1610] 3. Answer display means

[1611] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[1612] Emotion recognition by emotion engine

[1613] 1. Emotional Engine Means

[1614] The device analyzes the user's facial expressions, voice, or text input in real time to recognize emotions.

[1615] For example, facial expressions can be analyzed through the camera function to detect "confusion" or "stress."

[1616] 2. Sending Emotional Data

[1617] The device transmits the recognized emotion data to the server.

[1618] Feedback to parents

[1619] 1. Evaluation methods

[1620] The server analyzes the homework progress data and the recognized emotional data to assess the child's stress level and motivation.

[1621] 2. Means of generation and notification

[1622] The server generates a feedback message for the parents based on the evaluation results.

[1623] The feedback message includes specific ways to provide support, such as, "Your child seems to be having trouble. He or she may need help."

[1624] 3. Feedback display on parental devices

[1625] The device (parent's smartphone) receives the feedback message and displays it as a notification.

[1626] The user (parent) communicates with their child based on the displayed feedback.

[1627] Specific examples

[1628] Example 1: Homework progress tracking

[1629] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[1630] The server receives the progress data and stores it in a database.

[1631] The device also notifies parents of the progress, allowing them to check the progress.

[1632] Example 2: Questions and real-time support

[1633] The user (child) enters a question saying, "I don't know how to write a history report."

[1634] The server receives the question, and the generative AI generates a "sample report structure."

[1635] The device displays the answers, making it easier for children to write their reports.

[1636] Example 3: Parent feedback

[1637] The server analyzes the progress data and determines that the child's stress level is high.

[1638] The server generates a feedback message to inform the parent that their child is struggling and should be encouraged.

[1639] The device provides feedback to parents and suggests appropriate ways to encourage their child.

[1640] Example 4: Using the Emotion Engine

[1641] The user (child) shows an expression of frustration while solving a problem.

[1642] The device uses an emotion engine to recognize "confusion" and transmits the emotion data to the server.

[1643] The server generates feedback messages based on the recognized emotions and progress data.

[1644] The device notifies the parent, "Your child appears to be in trouble and may need help."

[1645] The user (parent) checks the notification and provides advice to the child.

[1646] In this way, the present invention is a system that can improve communication within the home by creating an environment in which the user can work on their homework while taking into consideration the user's emotions.

[1647] The processing flow will be explained below.

[1648] Step 1:

[1649] The teacher enters detailed information about the homework (such as the assignment content, deadline, and reference materials) into the school's online system.

[1650] Step 2:

[1651] The server collects homework information from the school system and stores it in a database.

[1652] Step 3:

[1653] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[1654] Step 4:

[1655] Your device will receive a notification and display the homework details on the screen.

[1656] The user (child) checks the displayed homework information.

[1657] Step 5:

[1658] The user (child) enters their homework progress through the app (e.g., "Math assignment 1 is 50% complete").

[1659] The terminal collects this progress data and sends it to the server.

[1660] Step 6:

[1661] The server stores the received progress data in a database.

[1662] The server also notifies the parent's device of the updated progress.

[1663] Step 7:

[1664] If the user (child) has a question while working on their homework, they can enter it in the question input field within the app (e.g., "I don't know how to solve problem 3").

[1665] The terminal sends a question to the server.

[1666] Step 8:

[1667] The server analyzes the questions it receives using generative AI and generates appropriate answers.

[1668] The server generates a response and sends it to the terminal.

[1669] Step 9:

[1670] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[1671] Step 10:

[1672] While the user (child) is working on their homework, the device uses an emotion engine to analyze the user's facial expressions, voice, or text input in real time and recognize their emotions.

[1673] For example, it can detect "confusion" and "stress" through the camera function.

[1674] Step 11:

[1675] The device transmits the recognized emotion data to the server.

[1676] Step 12:

[1677] The server analyzes homework progress data and emotional data to assess the child's stress level and motivation.

[1678] Based on the evaluation results, a feedback message for parents is generated.

[1679] Step 13:

[1680] The server sends a feedback message to the parent's device (e.g., "Your child seems to be in trouble. They may need help.").

[1681] Step 14:

[1682] The device (parent's smartphone) receives the feedback message and notifies the parent.

[1683] The user (parent) can check the notifications and use them to communicate with their child.

[1684] Step 15:

[1685] The user (parent) can give advice and words of encouragement to their child based on the displayed feedback.

[1686] For example, by encouraging children to "solve the problem together," we can strengthen learning support within the home.

[1687] As described above, through the processing steps of the present invention, a system is provided that utilizes an emotion engine to reduce the difficulties children face when doing their homework and allows parents to provide support at an appropriate time.

[1688] Example 2

[1689] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1690] In today's educational environment, it is important for teachers to manage students' homework and monitor their progress, but this requires a lot of time and effort. Furthermore, there are often no means to quickly resolve questions or difficulties students have when working on their homework. Furthermore, it is not possible to monitor students' emotions and stress levels and provide appropriate feedback to parents. As a result, students' learning efficiency declines and communication between families becomes insufficient.

[1691] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes an information input means of an educational institution for inputting detailed information about homework, a server means for collecting homework information from the information input means of the educational institution and storing it in a database, a notification means for notifying the homework information stored by the server means, a terminal means for displaying the homework information notified from the notification means, a progress input means for inputting the progress of homework using the terminal means, a server means for receiving data from the progress input means and storing it in a database, a question input means for inputting a question about homework using the terminal means, a server means for receiving a question from the question input means and generating an answer to the question using a generative AI means, and the server The system includes an answer display means for transmitting answers generated by the answer analysis means to a terminal means and displaying them, an emotion analysis means for the terminal means to recognize emotions by analyzing facial expressions, voice, or text input, a server means for receiving emotion data from the emotion analysis means and storing it in a database, an evaluation means for the server means to evaluate stress levels and motivation based on homework progress data and emotion data, a generation means for generating feedback messages for parents based on the evaluation results from the evaluation means, a notification means for transmitting the feedback message from the generation means to a parent terminal and notifying the parent, and a display means for displaying the feedback message on the parent terminal. This enables efficient homework management, rapid question resolution, monitoring of student emotions, and provision of appropriate feedback.

[1692] "Information input means for educational institutions" refers to the means by which teachers can input detailed information about homework (such as assignment content, submission deadlines, and reference materials) through the school's online system.

[1693] The "server means" is a means for storing homework information collected from the information input means of the educational institution in a database and for managing data communication with the notification means and the terminal means.

[1694] The "notification means" is a means for transmitting homework information, progress status, etc. stored by the server means to the user terminal as a push notification.

[1695] "Terminal means" refers to devices (smartphones, tablets, etc.) used by parents and children, and is a means of displaying homework information, progress, feedback messages, etc.

[1696] The "progress input means" is a means by which a child can input the progress of their homework through an application.

[1697] The "question input means" is a means by which a child inputs a question about homework through an application.

[1698] A "generative AI method" is a method that uses an AI model to create an answer to a question based on a generated prompt.

[1699] The "answer display means" is a means for transmitting the answer generated by the generative AI means to the terminal means and displaying it.

[1700] The "emotion analysis means" is a means by which the terminal means analyzes the user's facial expression, voice, or text input and recognizes emotions.

[1701] The "assessment tool" is a tool for assessing stress levels and motivation based on homework progress data and perceived emotional data.

[1702] The "generation means" is a means for generating a feedback message for parents based on the results of the evaluation means.

[1703] A "feedback message" is a message that tells parents what problems their child is facing or what state their child is in while studying.

[1704] The "display means" is a means for displaying a feedback message on the parent terminal.

[1705] The present invention is a system for helping children to efficiently complete their homework and facilitating communication between family members. This system is implemented using an educational institution, a server, and devices of parents and children, in combination with an emotion engine that recognizes the user's emotions.

[1706] Entering and collecting homework information

[1707] A teacher at an educational institution uses the school's online system (e.g., Google Classroom) to enter detailed information about the homework assignment (such as the assignment content, deadline, and reference materials).

[1708] The server periodically retrieves this information and stores it in an internal database (e.g., MySQL).

[1709] Homework information notification and display

[1710] The server generates push notifications to user devices (parents' and children's smartphones and tablets) based on the homework information it retrieves, and these notifications are sent using a service such as Firebase Cloud Messaging.

[1711] The device displays the received notification on the screen so that the user (child) can check detailed information about the homework.

[1712] Homework progress management

[1713] The user (child) enters their homework progress in the application's progress input field (e.g., "Math assignment 1 is 50% complete").

[1714] The device sends the entered progress data to the server, which stores the received progress data in a database and notifies the parent device of the progress status.

[1715] Asking questions and using the AI ​​assistant

[1716] The user (child) enters a question about their homework into the application's question input field (e.g., "I don't know how to solve problem 3").

[1717] The device sends a question to the server. The server receives the question data and generates a prompt that inputs the question into a generative AI model (e.g., OpenAI's GPT-4). The generative AI analyzes the prompt and generates an appropriate answer. The server sends the generated answer to the device, and the device displays the received answer, providing a specific solution or guide on how to solve it.

[1718] Emotion recognition by emotion engine

[1719] The device analyzes the user's (child's) facial expressions, voice, or text input in real time via a camera and microphone to recognize emotions. For example, it can detect "confusion" or "stress" using an emotion analysis engine such as Amazon Rekognition.

[1720] The device sends the recognized emotion data to a server, which then evaluates the stress level and motivation based on the homework progress data and emotion data.

[1721] Feedback to parents

[1722] The server generates a feedback message for the parents based on the evaluation results, including specific support methods such as "Your child seems to be having trouble. He or she may need help."

[1723] The server sends the feedback message to the parent's device, which then notifies the parent by displaying a notification, allowing the parent to communicate appropriately with their child based on this feedback.

[1724] Examples of concrete examples and prompts

[1725] Example 1: Homework progress management

[1726] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[1727] The server receives the progress data and stores it in a database.

[1728] The device also notifies parents of the progress, who can then check the progress.

[1729] Example prompt sentence:

[1730] "Design a system for children to report their progress on their language arts homework and notify their parents."

[1731] Example 2: Questions and real-time support

[1732] The user (child) enters a question such as, "I don't know how to write a history report."

[1733] The server receives the question, and the generative AI generates an example of a report structure.

[1734] The device displays the answers, making it easier for children to write their reports.

[1735] Example prompt sentence:

[1736] "Design a system that allows your child to ask questions and support them in writing their history report."

[1737] Example 3: Feedback to parents

[1738] The server analyzes the progress and emotional data and assesses that the child's stress level is high.

[1739] The server generates a feedback message to inform the parent that "your child is struggling and needs some encouragement."

[1740] The device receives the feedback and suggests the appropriate way to speak to the user.

[1741] Example prompt sentence:

[1742] "Design a system that analyzes children's stress levels and provides feedback to parents."

[1743] Example 4: Using an Emotion Engine

[1744] The user (child) shows signs of frustration while solving the problem.

[1745] The device uses an emotion engine to recognize "confusion" and transmits the emotion data to the server.

[1746] The server generates a feedback message based on the recognized emotion and progress data.

[1747] The device will notify the parent, "Your child seems to be in trouble and may need help," allowing the parent to offer advice to the child.

[1748] Example prompt sentence:

[1749] "Design a system that analyzes children's emotions and provides feedback to parents."

[1750] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1751] Understood. Below is a detailed explanation of the system program processing flow, broken down into steps.

[1752] Step 1:

[1753] Homework information entered by teachers at educational institutions

[1754] Input: The teacher logs into the school's online system (e.g., Google Classroom) and enters detailed information about the homework (such as the assignment content, deadline, and reference materials).

[1755] Action: A teacher fills in the required information in a web form and clicks the submit button.

[1756] Output: Homework information is saved in the online system database.

[1757] Step 2:

[1758] Collection of homework information by the server

[1759] Input: New homework information is added to the online system database.

[1760] How it works: The server periodically contacts the online system via the API to check for new homework information.

[1761] Output: The server retrieves the new homework information and stores it in its own database (e.g., MySQL).

[1762] Step 3:

[1763] Server-generated and sent notifications

[1764] Input: New homework information stored in the server's database.

[1765] How it works: The server generates the push notification content based on the homework information and sends it to the user's (child's and guardian's) device using services such as Firebase Cloud Messaging.

[1766] Output: A push notification is sent to the user device.

[1767] Step 4:

[1768] Receiving and displaying notifications on your device

[1769] Input: The push notification sent by the server.

[1770] What it does: Your device receives a notification and displays it in the notification area or within the app.

[1771] Output: The user (child) can check the detailed information of the homework.

[1772] Step 5:

[1773] Children input their homework progress

[1774] Input: The user (child) enters their homework progress into the app's input field (e.g., "Math assignment 1 is 50% complete").

[1775] What happens: A user enters text into a progress input field in the app and clicks the submit button.

[1776] Output: Progress information is saved to the device's temporary storage area.

[1777] Step 6:

[1778] Device sends progress data

[1779] Input: Progress information stored on the device.

[1780] Operation: The device sends progress information to the server via the API.

[1781] Output: Progress data is sent to the server and stored in the server's database.

[1782] Step 7:

[1783] Server-based progress data storage and parental notification

[1784] Input: Progress data sent to the server.

[1785] How it works: The server stores progress data in a database and also notifies the parent's device of this information.

[1786] Output: Progress is notified to the parent's device.

[1787] Step 8:

[1788] Children input questions

[1789] Input: The user (child) enters a question about their homework into the app's question input field (e.g., "I don't know how to solve problem 3").

[1790] How it works: A user enters text into the app's question input field and clicks the submit button.

[1791] Output: The question is saved in the device's temporary storage area.

[1792] Step 9:

[1793] Sending question data from the device

[1794] Input: Questions saved on your device.

[1795] How it works: The device sends the question to the server via the API.

[1796] Output: The query data is sent to the server and stored on the server.

[1797] Step 10:

[1798] Server analyzes questions and generates answers

[1799] Input: Question data stored on the server.

[1800] How it works: The server receives question data and generates a prompt that feeds the question into a generative AI model (e.g., OpenAI's GPT-4). The generative AI analyzes the prompt and generates an appropriate answer.

[1801] Output: The generated answer is retrieved by the server.

[1802] Step 11:

[1803] Server sends answer

[1804] Input: An answer generated by a generative AI model.

[1805] Action: The server generates a response and sends it to the device.

[1806] Output: The response data is sent to the terminal.

[1807] Step 12:

[1808] Displaying answers on the device

[1809] Input: The response data sent from the server.

[1810] What it does: The answer the device receives is displayed in the app.

[1811] Output: The user (child) can receive a concrete solution or guide.

[1812] Step 13:

[1813] Analysis of emotion data on the device

[1814] Input: User (child) facial expression, voice, or text input data.

[1815] How it works: The device collects data through the camera and microphone and analyzes emotions using an emotion analysis engine (e.g., Amazon Rekognition).

[1816] Output: The analyzed emotion data is generated and temporarily saved.

[1817] Step 14:

[1818] Sending emotional data by device

[1819] Input: Parsed emotion data.

[1820] Operation: The device sends emotion data to the server.

[1821] Output: The emotion data is sent to the server and stored in a database.

[1822] Step 15:

[1823] Server-generated ratings and feedback

[1824] Input: Progress and emotion data stored on the server.

[1825] How it works: The server evaluates the stress level and motivation based on the progress data and emotional data, and generates a feedback message for the parent.

[1826] Output: The generated feedback message is retrieved by the server.

[1827] Step 16:

[1828] Server sending feedback messages

[1829] Input: The generated feedback message.

[1830] Operation: The server sends a feedback message to the parent terminal.

[1831] Output: A feedback message is sent to the parent device.

[1832] Step 17:

[1833] Parental feedback display

[1834] Input: The feedback message sent by the server.

[1835] What it does: The parent device receives the feedback message and displays it in a notification or in the app.

[1836] Output: Parents can understand their child's situation and provide appropriate support.

[1837] (Application example 2)

[1838] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1839] In today's educational environment, it is important for children to complete their homework efficiently while maintaining smooth communication with their families. However, there is no centralized system that can manage homework progress, questions, or even grasp children's emotional state. Similar problems exist at brick-and-mortar learning events, which can potentially reduce the quality of children's learning experience. A comprehensive system to overcome these issues is needed.

[1840] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes an educational institution's information input means for inputting detailed homework information, server means for collecting homework information from the educational institution's information input means and storing it in a database, notification means, terminal means, progress input means, question input means, generative AI means, answer display means, evaluation means, generation means, notification means, display means, emotion engine means for emotion recognition, means for transmitting emotion data acquired using the emotion engine means to the server means, and means for applying the emotion engine means to events and in-store activities. This enables children to efficiently complete their homework and learning activities and allows parents to provide appropriate support as needed, making similar support possible at learning events held in physical stores.

[1841] "Information input means of educational institutions" refers to systems or means for inputting detailed information about homework from educational institutions such as schools and cram schools.

[1842] "Server means" refers to means that performs the functions and roles of a server, such as collecting, storing, analyzing, and notifying homework information.

[1843] "Notification means" refers to means for notifying the user of collected homework information, progress, feedback messages, etc.

[1844] "Terminal means" refers to a device used by a user, such as a smartphone, tablet, or PC, which is capable of displaying and inputting information.

[1845] The "progress input means" is a means for the user to input the progress status of homework or tasks.

[1846] The "question input means" is a means for the user to input questions about homework or learning content.

[1847] "Generative AI methods" are artificial intelligence methods for generating appropriate answers to questions, and use technologies such as natural language processing.

[1848] The "answer display means" is a means for displaying the answer generated by the generative AI to the user.

[1849] The "evaluation means" is a means for evaluating the user's stress level and motivation based on homework progress data and emotional data.

[1850] The "generation means" is a means for generating a feedback message for parents based on the evaluation results obtained by the evaluation means.

[1851] The "emotion engine means" is a means for analyzing the user's facial expressions, voice, text, etc., and recognizing emotions.

[1852] "Means to be applied to activities in physical stores" refers to means that use emotion engine means to recognize and evaluate users' emotions during learning events and activities in physical stores and provide appropriate support.

[1853] The present invention is a comprehensive system for enabling children to efficiently complete their homework and for facilitating smooth communication within the family. Specific embodiments for realizing the present invention will be described in detail below.

[1854] Program processing

[1855] The system consists of multiple hardware and software components. The hardware includes smartphones, tablets, PCs, and servers, all of which require an internet connection. The software includes emotion recognition APIs (e.g., Microsoft Azure Emotion API), a notification system, a database (e.g., MySQL), and generative AI (e.g., GPT-3).

[1856] Server Roles

[1857] The server includes means for:

[1858] 1. Information input method for educational institutions: An online system where educational institutions input detailed information about homework (such as assignment content and submission deadlines).

[1859] 2. Database: Storage for homework information and progress data.

[1860] 3. Notification system: A system that notifies users of saved homework information, progress, feedback messages, etc.

[1861] 4. Generative AI: Artificial intelligence that generates appropriate answers to questions from users.

[1862] 5. Evaluation method: A system that evaluates the user's stress level and motivation based on homework progress data and emotional data.

[1863] Device Role

[1864] Terminals (smartphones, tablets, PCs) include means with the following functions:

[1865] 1. Information display method: The device displays notified homework information, progress, and AI-generated answers on the screen.

[1866] 2. Progress input means: A means for children to input their homework progress.

[1867] 3. Question input means: A means for children to input questions about their homework.

[1868] 4. Emotion engine means: A means for recognizing the user's emotions using a camera or microphone and sending that data to the server.

[1869] Managing connections

[1870] The server evaluates the user's stress level and motivation based on the homework progress data and questions, and generates a feedback message for parents based on the evaluation results, including specific instructions on the child's learning progress and the support needed.

[1871] Specific examples

[1872] Specific examples of progress management

[1873] For example, a scenario in which a child enters that their homework progress is 30% and a parent checks the progress. The device collects the progress data, the server evaluates it, and notifies the parent of the results.

[1874] Specific examples of emotion recognition

[1875] If a child shows a confused expression while working on their homework, the device's camera will capture the expression, and the emotion engine will recognize the expression as "confused" and send it to the server. The server will then analyze the emotion data and notify the parent or guardian, "Your child is confused. They may need help."

[1876] Prompt Sentence Examples

[1877] Examples of prompts for question input are as follows:

[1878] "My child says he can't solve problem 3 in his math homework. Do you have any solutions or hints?"

[1879] "Child A showed signs of confusion when doing his math homework, suggesting high stress levels. Please provide specific advice."

[1880] Thus, the present invention provides a means for improving the educational environment and enhancing communication among family members.

[1881] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1882] Step 1:

[1883] Using the educational institution's information input method, the teacher enters detailed information about the homework (such as the assignment content and submission deadline) into the online system.

[1884] Input: Homework details entered by the teacher.

[1885] Output: Homework information stored in the institution's system.

[1886] Step 2:

[1887] The server collects homework information from the institution's system and stores it in a database.

[1888] Input: Homework information obtained from the institution's system.

[1889] Output: Homework information stored in the server's database.

[1890] Step 3:

[1891] The server notifies the terminal of new homework information.

[1892] Input: Homework information stored in the database.

[1893] Output: Push notification to device.

[1894] Step 4:

[1895] Displays notifications received by the device on the screen.

[1896] Input: Homework information sent from the server.

[1897] Output: Homework information displayed on the terminal screen.

[1898] Step 5:

[1899] The user (child) uses the device to enter their homework progress.

[1900] Input: Homework progress input by the child.

[1901] Output: Progress data entered into the terminal.

[1902] Step 6:

[1903] The device sends the progress data to the server, which stores it in a database.

[1904] Input: Progress data sent from the device.

[1905] Output: Progress data stored in the server database.

[1906] Step 7:

[1907] The user (child) enters a homework question into the terminal.

[1908] Input: The question entered by the child.

[1909] Output: Question data entered into the terminal.

[1910] Step 8:

[1911] The terminal transmits the question data to the server.

[1912] Input: Question data sent from the terminal.

[1913] Output: The query data received by the server.

[1914] Step 9:

[1915] The server uses generative AI to generate answers to questions.

[1916] Input: The query data received by the server.

[1917] Output: Answer data generated by the generative AI.

[1918] Step 10:

[1919] The server sends the generated answer to the terminal, which displays the answer.

[1920] Input: Answer data generated by generative AI.

[1921] Output: The answer displayed on the terminal.

[1922] Step 11:

[1923] The device's camera is used to capture the child's facial expressions and analyze them using an emotion engine.

[1924] Input: Image data captured by the device's camera.

[1925] Output: Parsed emotion data.

[1926] Step 12:

[1927] The device sends the emotion data to the server, which stores it in a database.

[1928] Input: Emotion data sent from the device.

[1929] Output: Emotion data stored in the server database.

[1930] Step 13:

[1931] The server evaluates the homework based on progress data and emotional data.

[1932] Input: Progress data and emotion data.

[1933] Output: Evaluation results.

[1934] Step 14:

[1935] The server generates a feedback message based on the evaluation results and notifies the parents.

[1936] Input: Evaluation result.

[1937] Output: Feedback message to parent.

[1938] Step 15:

[1939] Parents check the feedback messages and provide appropriate support to their children.

[1940] Input: Feedback message.

[1941] Output: Parental supportive behavior.

[1942] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1943] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1944] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1945] [Fourth embodiment]

[1946] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1947] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1948] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1949] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1950] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1951] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1952] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1953] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1954] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1955] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1956] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1957] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1958] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1959] The present invention is a system for ensuring that children do their homework and for facilitating communication between family members. This system is implemented using an educational institution, a server, and terminals of parents and children. The details of the system's processing are explained below.

[1960] Entering and collecting homework information

[1961] 1. Means of inputting information for educational institutions

[1962] It begins with the teacher using the school's online system to enter detailed information about the homework (such as the assignment content, deadline, and reference materials).

[1963] 2. Information collection by the server

[1964] The server connects to the school's system and collects the entered homework information.

[1965] The collected homework information is stored in a database and prepared for notification to each household's device.

[1966] Homework information notification and display

[1967] 1. Means of notification

[1968] The server generates notifications based on homework information collected from educational institutions.

[1969] Send push notifications to devices (parents' and children's smartphones, tablets, etc.).

[1970] 2. Displaying information on a terminal

[1971] The terminal displays the notified homework information on the screen so that the user can check it.

[1972] Homework progress management

[1973] 1. Progress input method

[1974] The user (child) opens the app and enters their homework progress.

[1975] For example, enter specific progress information such as "Math assignment 1 50% complete."

[1976] 2. Data storage by server

[1977] The server receives the progress data and stores it in a database.

[1978] Asking questions and using the AI ​​assistant

[1979] 1. Question input method

[1980] Users (children) enter any questions they have about their homework into the app's question input field.

[1981] For example, enter "I don't know how to solve problem 3."

[1982] 2. Answer generation using generative AI

[1983] The server receives the question and uses generative AI to generate an appropriate answer.

[1984] The confirmed answer is sent to the terminal and displayed to the user.

[1985] Feedback to parents

[1986] 1. Evaluation methods

[1987] The server assesses the child's stress level and motivation based on homework progress data and questions.

[1988] 2. Means of generation and notification

[1989] The server generates a feedback message for parents based on the evaluation results.

[1990] The message includes specific support methods such as, "Your child's stress is increasing. Some encouraging words would be effective."

[1991] 3. Feedback display on parental devices

[1992] The device (parent's smartphone) receives the feedback message and displays it as a notification.

[1993] The user (parent) communicates with their child based on the displayed feedback.

[1994] Specific examples

[1995] Example 1: Homework progress tracking

[1996] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[1997] The server receives the progress data and stores it in a database.

[1998] The device also notifies parents of the progress, allowing them to check the progress.

[1999] Example 2: Questions and real-time support

[2000] The user (child) enters a question saying, "I don't know how to write a history report."

[2001] The server receives the question, and the generative AI generates a "sample report structure."

[2002] The device displays the answers, making it easier for children to write their reports.

[2003] Example 3: Parent feedback

[2004] The server analyzes the progress data and determines that the child's stress level is high.

[2005] The server generates a feedback message to inform the parent that their child is struggling and should be encouraged.

[2006] The device provides feedback to parents and suggests appropriate ways to encourage their child.

[2007] As a result, the present invention improves the efficiency with which children tackle their homework, facilitates communication within the family, and provides a beneficial environment for both children and parents.

[2008] The processing flow will be explained below.

[2009] Step 1:

[2010] The teacher enters detailed information about the homework (such as the assignment content, deadline, and reference materials) into the school's online system.

[2011] Step 2:

[2012] The server collects homework information from the school system and stores it in a database.

[2013] Step 3:

[2014] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[2015] Step 4:

[2016] Your device will receive a notification and display the homework details on the screen.

[2017] The user (child) checks the displayed homework information.

[2018] Step 5:

[2019] The user (child) enters their homework progress through the app (e.g., math assignment 1 is 50% complete).

[2020] The terminal collects this progress data and sends it to the server.

[2021] Step 6:

[2022] The server stores the received progress data in a database.

[2023] The server also notifies the parent's device of the updated progress.

[2024] Step 7:

[2025] If the user (child) has a question while working on their homework, they can enter it in the question input field within the app (e.g., "I don't know how to solve problem 3").

[2026] The terminal sends a question to the server.

[2027] Step 8:

[2028] The server analyzes the received question and generates an appropriate answer using generative AI.

[2029] The server sends the generated response to the terminal.

[2030] Step 9:

[2031] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[2032] Step 10:

[2033] The server analyzes homework progress data and question content to assess the child's stress level and motivation.

[2034] The server generates a feedback message for the parent based on the evaluation results.

[2035] Step 11:

[2036] The server sends a feedback message to the parent's device (e.g., "Your child is experiencing increased stress. Some encouraging words would be helpful").

[2037] Step 12:

[2038] The device (parent's smartphone) receives the feedback message and notifies the parent.

[2039] The user (parent) can check the notifications and use them to communicate with their child.

[2040] As described above, the present invention is a system that helps children to efficiently tackle their homework and allows parents to provide appropriate support through these processing steps.

[2041] Example 1

[2042] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2043] Ensuring that children do their homework reliably and maintaining smooth communication among family members are major challenges in modern families. To solve these problems, it is important to efficiently share homework information, manage children's homework progress, and provide appropriate support. However, doing these tasks manually requires a great deal of effort and time, making it difficult to achieve effective results. Therefore, a system that can solve these problems effectively and efficiently is needed.

[2044] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2045] In this invention, the server includes an input unit for inputting detailed information about homework from educational institutions, a unit for collecting homework information and storing it in a database, and a unit for notifying the user of the stored homework information. This allows for efficient collection of homework information from educational institutions and appropriate sharing within the home. Furthermore, the server unit uses a generative AI model to generate answers to children's questions, thereby supporting smooth communication between family members.

[2046] "Input means for educational institutions to input detailed information about homework" refers to a system or software that allows educational institutions (teachers) to input detailed information about homework (such as assignment content, submission deadline, reference materials, etc.).

[2047] "Server means for collecting homework information and storing it in a database" refers to a server that has the role of acquiring homework information input by educational institutions and storing it in a database.

[2048] "Means for notifying saved homework information" refers to the function of notifying parents and children's devices of homework information saved on the server.

[2049] "Device means for displaying homework information" refers to the function that displays notified homework information on devices such as smartphones and tablets used by parents and children.

[2050] "A means for inputting homework progress" refers to an application or interface that allows a child to input their homework progress.

[2051] "A means for inputting questions about homework" refers to an application or interface that allows a child to input questions about homework into the system.

[2052] "Server means for generating answers to questions using a generative AI model" refers to a server that generates answers to questions posed by children using a generative AI model (e.g., GPT-3).

[2053] "Answer display means for transmitting the generated answer to the terminal means and displaying it" refers to a function for transmitting the generated answer to the terminal of the parent or child and displaying it.

[2054] "Evaluation means for evaluating stress levels and motivation based on homework progress data" refers to a server that has the function of evaluating a child's stress levels and motivation based on homework progress data entered by the child.

[2055] The "means for generating a feedback message for parents" refers to a server function that generates a feedback message for parents based on the evaluation results obtained by the evaluation means.

[2056] The "notification means for sending a feedback message to a parent terminal and notifying the parent" refers to a function for sending a generated feedback message to a parent terminal and notifying the parent.

[2057] "Display means for displaying a feedback message" refers to a function for displaying the notified feedback message on the parent's terminal.

[2058] The present invention provides a system for ensuring that children do their homework and for facilitating communication between family members. This system is implemented using an educational institution, a server, and terminals of parents and children. The details of this system are described below.

[2059] Entering and collecting homework information

[2060] First, we will explain how educational institutions input detailed homework information. Teachers use the school's online system (e.g., Google Classroom or Microsoft Teams) to input detailed homework information (such as assignment content, submission deadline, and reference materials). This includes entering the assignment content as text, setting a calendar for the submission deadline, and adding linked reference materials.

[2061] Next, the server collects homework information. The server collects homework information entered by educational institutions via APIs such as Google Classroom. The collected data is temporarily stored in JSON format and then saved in a database such as MySQL or PostgreSQL. The saved data is sorted by household and prepared for push notifications.

[2062] Homework information notification and display

[2063] Next, we will explain how homework information is notified. The server generates a notification message based on the collected homework information. A template engine (for example, Handlebars.js) is used to generate the notification, creating a specific message such as "Japanese homework from Mr. / Ms. XX: Kanji practice, deadline is XX / XX."

[2064] Devices (parents' and children's smartphones and tablets) receive notifications using Firebase Cloud Messaging (FCM), which are then displayed as a pop-up in a dedicated app (e.g., HomeWork Tracker) where detailed information can be viewed.

[2065] Homework progress management

[2066] Next, we will explain how to manage homework progress. Users (children) use a dedicated app (HomeWork Tracker) to enter their homework progress. The input form has pull-down menus and sliders, making it easy to enter progress such as "Math assignment 1 progress: 50% complete."

[2067] The server receives the progress data entered by the user in real time and stores it in a database, strictly managing transactions (e.g., ACID characteristics) to maintain data consistency.

[2068] Asking questions and using the AI ​​assistant

[2069] If a user (child) has a question about their homework, they can write it down in the question input field of the dedicated app. For example, they can write, "I don't know the stroke order of the kanji."

[2070] The server receives the entered question and generates an appropriate answer using a generative AI model such as OpenAI's GPT-3. For example, it might generate an answer such as "The stroke order for kanji is as follows..." and send it to the user's device. When generating the answer, it uses an appropriate prompt. An example of a specific prompt would be "Please tell me the stroke order for kanji."

[2071] Feedback to parents

[2072] Finally, we will explain the feedback method. The server evaluates the child's stress level and motivation based on homework progress data and question content. This evaluation uses a machine learning model (e.g., regression analysis using scikit-learn). If the stress level is determined to be high, a feedback message such as "The child is struggling and needs encouragement" is generated.

[2073] The server sends the generated feedback message to the parent's device, where it is received through a dedicated app (HomeWork Tracker) and displayed as a notification. Based on this feedback message, parents can communicate appropriately with their children.

[2074] Specific examples

[2075] Specific examples are given below.

[2076] Example 1: Homework progress tracking

[2077] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[2078] The server receives the progress data and stores it in a database.

[2079] The device also notifies parents of the progress, who can then check the progress.

[2080] Example 2: Questions and real-time support

[2081] The user (child) enters a question such as, "I don't know how to write a history report."

[2082] The server receives the question, and the generative AI generates a "sample report structure."

[2083] The device displays the generated answers, making it easier for children to write their reports.

[2084] Example 3: Parent feedback

[2085] The server analyzes the progress data and assesses that the child's stress level is high.

[2086] The server generates a feedback message to inform the parent that "your child is struggling and needs some encouragement."

[2087] The device will then notify the parent of the feedback message and suggest appropriate ways to respond.

[2088] In this way, the present invention improves the efficiency with which children tackle their homework, facilitates communication within the family, and provides a beneficial environment for both children and parents.

[2089] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2090] Step 1:

[2091] The user (teacher) logs into an online system such as Google Classroom or Microsoft Teams and enters detailed information about the homework (such as the assignment content, deadline, and reference materials). The information entered is temporarily stored in the system's database, allowing the teacher to provide complete details of the homework assigned to the student.

[2092] Step 2:

[2093] The server collects homework information entered by educational institutions via APIs such as Google Classroom. The collected data is first temporarily saved in JSON format and then stored in a database such as MySQL or PostgreSQL. The saved data is sorted by household and prepared for push notifications. This ensures that homework information is accurately reflected in the database.

[2094] Step 3:

[2095] The server generates a notification message based on the collected homework information. A template engine (for example, Handlebars.js) is used to generate the notification, creating a specific message such as "Japanese homework from Teacher X: Kanji practice, deadline is X / X." The generated notification message is then ready to be sent to each household's device.

[2096] Step 4:

[2097] Devices (parents' and children's smartphones and tablets) receive notifications using Firebase Cloud Messaging (FCM). The received notification is displayed as a pop-up in a dedicated app (e.g., HomeWork Tracker) where detailed information can be checked. This information is cached on the device and can be accessed by the user at any time.

[2098] Step 5:

[2099] Users (children) use a dedicated app (HomeWork Tracker) to enter their homework progress. The input form has pull-down menus and sliders, making it easy to enter progress such as "Math assignment 1 progress: 50% complete." The entered information is immediately sent to the server.

[2100] Step 6:

[2101] The server receives the progress data entered by the user in real time and stores it in a database. At this time, transaction management (e.g., ACID characteristics) is strictly enforced to maintain data consistency. The received data is stored in an analysis table for subsequent processing.

[2102] Step 7:

[2103] If a user (child) has a question about their homework, they can write it down in the question input field of the dedicated app. For example, they can write "I don't know the stroke order of kanji." This input is immediately sent to the server.

[2104] Step 8:

[2105] The server receives the question and generates an appropriate answer using a generative AI model such as OpenAI's GPT-3. For example, an answer such as "The stroke order for kanji characters is as follows..." is generated. The generated answer is then sent to the user's device.

[2106] Step 9:

[2107] The device receives the answer from the server and displays it on the dedicated app screen. The user (child) can use this answer as a reference to proceed with their homework. The answer is cached on the device and can be reviewed later.

[2108] Step 10:

[2109] The server analyzes homework progress data and questions to assess children's stress levels and motivation. This assessment is performed using machine learning models (e.g., regression analysis using scikit-learn). The results are stored in a database and used to generate feedback for parents.

[2110] Step 11:

[2111] The server generates a feedback message for parents based on the evaluation results, including specific support methods such as, "Your child is experiencing increasing stress. Some encouraging words would be effective."

[2112] Step 12:

[2113] The server then sends the generated feedback message to the parent's device, which receives the message via a dedicated app and displays it as a notification.The parent can then communicate with their child based on this feedback.

[2114] (Application example 1)

[2115] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2116] Conventional home learning support systems were unable to provide sufficient support for children when they were doing their homework, and communication with parents was also limited. As a result, children's motivation and understanding when doing homework often decreased, making it difficult for parents to provide support. Furthermore, there was no system in place to effectively utilize educational support services and products in physical stores.

[2117] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2118] In this invention, the server includes an educational institution information input means for inputting detailed homework information, a server means for collecting homework information and storing it in a database, a notification means for notifying homework information, a terminal means for displaying the notified homework information on the terminal, a progress input means for inputting homework progress, a server means for receiving progress data and storing it in a database, a question input means for inputting homework-related questions, a generative AI means for generating answers to the questions, an answer display means for sending the generated answers to the terminal and displaying them, an evaluation means for evaluating stress levels and motivation based on homework progress data, a generation means for generating feedback messages for parents, a notification means for sending the feedback messages to the parent terminal and notifying them, a display means for displaying the feedback messages on the parent terminal, a prompt generation means for inputting prompts to the generative AI means for generating answers to homework questions, and a commercial terminal means for providing homework progress and AI assistant functions to sell educational support products and services in physical stores. This enables management of children's homework progress, prompt responses to questions, appropriate feedback to parents, and effective provision of educational support services in physical stores.

[2119] "Homework details" refers to information such as the content of assignments assigned to students by educational institutions, submission deadlines, and reference materials.

[2120] "Institutional information entry means" means an online system or device through which teachers enter homework details.

[2121] "Server Means" means a server for collecting, storing, processing and communicating homework information and subsequent progress and question data from an educational institution.

[2122] "Notification means" refers to a means that has the function of pushing homework information received from the server and generated feedback messages to the terminal.

[2123] "Terminal means" refers to a device that displays notified homework information and feedback messages, such as a smartphone, tablet, or computer.

[2124] "Homework progress" is information that indicates the progress and completion rate of a student's homework.

[2125] The "progress input means" is an interface that allows students to input their homework progress.

[2126] The "question input means" is an interface that allows students to input doubts or questions about their homework.

[2127] "Generative AI means" is an AI (artificial intelligence) system that uses natural language processing to automatically generate appropriate answers to students' questions.

[2128] "Answer display means" refers to a means for displaying the answer generated by the generative AI means on a terminal.

[2129] "Evaluation measures" are measures that analyze homework progress data and questions to assess students' stress levels and motivation.

[2130] The "generation means" is a means for generating a feedback message for parents based on the evaluation results obtained by the evaluation means.

[2131] "Prompt generation means" refers to a means for generating a prompt sentence to be input to the generative AI means.

[2132] "Commercial Terminal Means" means dedicated terminals or devices installed in a physical store to provide educational support products and services.

[2133] MODE FOR CARRYING OUT THE INVENTION

[2134] The present invention is a system for ensuring that children do their homework and for facilitating smooth communication within the family. Specific embodiments for carrying out the present invention are described below.

[2135] 1. Entering and collecting homework information

[2136] Educational institution information entry method

[2137] Teachers at educational institutions use online systems and devices to input homework details (such as assignment content, deadlines, and reference materials), which are then collected by the server and stored in its database.

[2138] Server information collection

[2139] The server receives homework information entered through the educational institution's information entry means, and stores this information in a database within the server for subsequent processing.

[2140] 2. Notification and display of homework information

[2141] Notification means

[2142] The server generates a notification message based on the homework information received from the educational institution, and sends the notification to the device (smartphone, tablet, etc.) as a push notification.

[2143] Displaying information via terminal means

[2144] The device displays the homework information received from the server on the screen, allowing the user to check detailed information about the homework.

[2145] 3. Homework progress management

[2146] Progress input method

[2147] The user (child) can use the device to input their homework progress, for example, by entering specific progress information such as "50% complete for Math Assignment 1."

[2148] Data storage by server

[2149] The server receives the progress data entered in this way and stores it in a database. This progress information is also sent to the parent's device.

[2150] 4. Asking questions and using AI assistants

[2151] Question input method

[2152] Users (children) can enter questions they have about their homework into the question input form on the device. For example, they can enter a question like, "I don't know how to solve problem 3."

[2153] Answer generation using generative AI methods

[2154] The server receives the user's question and generates an appropriate answer using a generative AI model, which uses natural language processing to generate an answer to the question.

[2155] Answer display means

[2156] The server-generated answer is sent to the terminal and immediately displayed to the user.

[2157] 5. Feedback to parents

[2158] Evaluation methods

[2159] The server assesses the child's stress level and motivation based on homework progress data and questions.

[2160] Generation and notification methods

[2161] Based on the evaluation results, the server generates a feedback message for the parent, including specific support methods such as "Your child's stress is increasing. Some words of encouragement would be effective." The generated message is then sent to the parent's device.

[2162] Feedback display on parental device

[2163] The parent device receives this feedback message and displays the feedback content, which parents can use as a reference when communicating with their children.

[2164] 6. Prompt Generation Methods

[2165] A prompt generator is used to input a prompt to the generator AI. This prompt is converted into an appropriate format depending on the specific question. The following is an example of a prompt:

[2166] Examples of prompts:

[2167] "I received a question from the home learning material 'Math Drills' saying 'I don't understand problem 3.' Please give me some hints on how to solve it."

[2168] 7. In-store use

[2169] Commercial terminal means can be installed in physical stores to provide homework progress and AI assistant functions, and this commercial terminal is intended to effectively provide educational support products and services.

[2170] With the above-described configuration, the present invention can improve the efficiency with which children do their homework, facilitate communication within the home, and create an environment that is beneficial to both parents and children.

[2171] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2172] Step 1: Institution Enters Homework Information

[2173] Using the institution's information entry means, the teacher enters the homework details (such as assignment content, deadline, reference materials, etc.) into the online system. This input information forms the basis for the data collected by the server in the next processing step.

[2174] Input: Homework details by educational institution

[2175] Output: Homework information entered into the online system

[2176] Step 2: Server collects homework information

[2177] The server collects homework information from the educational institution's information input means and stores the information in a database. Through this process, detailed homework information is centrally managed in the database.

[2178] Input: Homework information entered into the online system

[2179] Output: Homework information stored in the database

[2180] Step 3: Generate and send notifications

[2181] The server generates a notification message to be sent to the device based on the saved homework information, and pushes this message to the device using a notification means, allowing the user to receive the homework information promptly.

[2182] Input: Homework information in the database

[2183] Output: Homework information notification message to the terminal

[2184] Step 4: View homework information on your device

[2185] The terminal displays the homework information received from the server on the screen, allowing the user to check the content of the homework and the deadline for submission.

[2186] Input: Notification message from the server

[2187] Output: Homework information displayed on the terminal screen

[2188] Step 5: User enters homework progress

[2189] The user (child) inputs their homework progress via the device. For example, they input specific progress information such as "50% completion of math assignment 1."

[2190] Input: Homework progress information

[2191] Output: Homework progress information entered into the terminal

[2192] Step 6: Saving Progress Data on the Server

[2193] The server receives the homework progress information sent by the user, stores it in a database, and also notifies the parent / guardian of this progress information.

[2194] Input: Progress information from the user

[2195] Output: Progress information stored in a database and parental notification messages

[2196] Step 7: User enters question

[2197] The user (child) enters any questions about their homework into the question input form on the device. For example, they enter a question such as, "I don't know how to solve problem 3."

[2198] Input: User question

[2199] Output: Question input to terminal completed

[2200] Step 8: AI answer generation by the server

[2201] The server receives the user's question and generates an appropriate answer using a generative AI model, which inputs the prompt sentence generated by the prompt generation means and performs natural language processing.

[2202] Input: User question, prompt

[2203] Output: The generated answer

[2204] Step 9: Viewing Answers via Terminal

[2205] The server generates a response and sends it to the terminal, which receives it and displays it immediately to the user.

[2206] Input: Generated answer from the server

[2207] Output: Answer displayed on the terminal screen

[2208] Step 10: Server evaluation and feedback generation

[2209] The server evaluates the user's stress level and motivation based on the homework progress data and questions, and generates a feedback message for parents based on the evaluation results.

[2210] Input: Homework progress data, questions

[2211] Output: The generated feedback message

[2212] Step 11: Feedback notification and display on parent device

[2213] The server sends the generated feedback message to the parent's device, which receives it and displays the feedback content, allowing the parent to understand the detailed status of their child's homework and provide appropriate support.

[2214] Input: The generated feedback message

[2215] Output: Notification and feedback displayed on the parent's device

[2216] Step 12: Use prompt generators

[2217] A prompt generation means is used to input a prompt sentence into a generative AI means for generating answers to questions about homework. For example, a prompt sentence such as "I received a question from the homework textbook 'Math Drills' saying 'I don't understand problem 3.' Please give me a hint on how to solve it" is generated and input into the AI ​​model.

[2218] Input: User question

[2219] Output: The prompt generated by the prompt generator

[2220] Step 13: In-store use

[2221] Using commercial terminals installed in physical stores, homework progress and AI assistant functions are provided, allowing parents and children to easily use educational support products and services in physical stores.

[2222] Input: Progress information, AI assistant function

[2223] Output: Providing educational support services in physical stores

[2224] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2225] The present invention is a system for helping children to efficiently complete their homework and facilitating communication between family members. This system is implemented by combining an educational institution, a server, and devices of parents and children, with an emotion engine that recognizes the user's emotions.

[2226] Entering and collecting homework information

[2227] 1. Means of inputting information for educational institutions

[2228] The teacher uses the school's online system to enter detailed information about the homework (such as the assignment, deadline, and reference materials).

[2229] 2. Information collection by the server

[2230] The server collects homework information from the school system and stores it in a database.

[2231] Homework information notification and display

[2232] 1. Means of notification

[2233] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[2234] 2. Displaying information on a terminal

[2235] The device receives a notification and displays detailed homework information on the screen so that the user (child) can check it.

[2236] Homework progress management

[2237] 1. Progress input method

[2238] The user (child) enters their homework progress through the app (e.g., "Math assignment 1 is 50% complete").

[2239] The terminal collects this progress data and sends it to the server.

[2240] 2. Data storage by server

[2241] The server stores the received progress data in a database.

[2242] The server also notifies the parent's device of the updated progress.

[2243] Asking questions and using the AI ​​assistant

[2244] 1. Question input method

[2245] If the user (child) has any questions while working on their homework, they can enter their question in the question input field within the app (e.g., "I don't know how to solve problem 3").

[2246] The terminal sends a question to the server.

[2247] 2. Answer generation using generative AI

[2248] The server analyzes the received question and generates an appropriate answer using generative AI.

[2249] The server sends the generated response to the terminal.

[2250] 3. Answer display means

[2251] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[2252] Emotion recognition by emotion engine

[2253] 1. Emotional Engine Means

[2254] The device analyzes the user's facial expressions, voice, or text input in real time to recognize emotions.

[2255] For example, facial expressions can be analyzed through the camera function to detect "confusion" or "stress."

[2256] 2. Sending Emotional Data

[2257] The device transmits the recognized emotion data to the server.

[2258] Feedback to parents

[2259] 1. Evaluation methods

[2260] The server analyzes the homework progress data and the recognized emotional data to assess the child's stress level and motivation.

[2261] 2. Means of generation and notification

[2262] The server generates a feedback message for the parents based on the evaluation results.

[2263] The feedback message includes specific ways to provide support, such as, "Your child seems to be having trouble. He or she may need help."

[2264] 3. Feedback display on parental devices

[2265] The device (parent's smartphone) receives the feedback message and displays it as a notification.

[2266] The user (parent) communicates with their child based on the displayed feedback.

[2267] Specific examples

[2268] Example 1: Homework progress tracking

[2269] The user (child) enters their progress into the app, saying, "I'm halfway done with today's Japanese homework."

[2270] The server receives the progress data and stores it in a database.

[2271] The device also notifies parents of the progress, allowing them to check the progress.

[2272] Example 2: Questions and real-time support

[2273] The user (child) enters a question saying, "I don't know how to write a history report."

[2274] The server receives the question, and the generative AI generates a "sample report structure."

[2275] The device displays the answers, making it easier for children to write their reports.

[2276] Example 3: Parent feedback

[2277] The server analyzes the progress data and determines that the child's stress level is high.

[2278] The server generates a feedback message to inform the parent that their child is struggling and should be encouraged.

[2279] The device provides feedback to parents and suggests appropriate ways to encourage their child.

[2280] Example 4: Using the Emotion Engine

[2281] The user (child) shows an expression of frustration while solving a problem.

[2282] The device uses an emotion engine to recognize "confusion" and transmits the emotion data to the server.

[2283] The server generates feedback messages based on the recognized emotions and progress data.

[2284] The device notifies the parent, "Your child appears to be in trouble and may need help."

[2285] The user (parent) checks the notification and provides advice to the child.

[2286] In this way, the present invention is a system that can improve communication within the home by creating an environment in which the user can work on their homework while taking into consideration the user's emotions.

[2287] The processing flow will be explained below.

[2288] Step 1:

[2289] The teacher enters detailed information about the homework (such as the assignment content, deadline, and reference materials) into the school's online system.

[2290] Step 2:

[2291] The server collects homework information from the school system and stores it in a database.

[2292] Step 3:

[2293] The server generates a notification based on the homework information and sends a push notification to the device (parent's and child's smartphone, tablet, etc.).

[2294] Step 4:

[2295] Your device will receive a notification and display the homework details on the screen.

[2296] The user (child) checks the displayed homework information.

[2297] Step 5:

[2298] The user (child) enters their homework progress through the app (e.g., "Math assignment 1 is 50% complete").

[2299] The terminal collects this progress data and sends it to the server.

[2300] Step 6:

[2301] The server stores the received progress data in a database.

[2302] The server also notifies the parent's device of the updated progress.

[2303] Step 7:

[2304] If the user (child) has a question while working on their homework, they can enter it in the question input field within the app (e.g., "I don't know how to solve problem 3").

[2305] The terminal sends a question to the server.

[2306] Step 8:

[2307] The server analyzes the questions it receives using generative AI and generates appropriate answers.

[2308] The server generates a response and sends it to the terminal.

[2309] Step 9:

[2310] The device displays the received answer to the user (child) and provides specific solutions and guidance on how to solve the problem.

[2311] Step 10:

[2312] While the user (child) is working on their homework, the device uses an emotion engine to analyze the user's facial expressions, voice, or text input in real time and recognize their emotions.

[2313] For example, it can detect "confusion" and "stress" through the camera function.

[2314] Step 11:

[2315] The device transmits the recognized emotion data to the server.

[2316] Step 12:

[2317] The server analyzes homework progress data and emotional data to assess the child's stress level and motivation.

[2318] Based on the evaluation results, a feedback message for parents is generated.

[2319] Step 13:

[2320] The server sends a feedback message to the parent's device (e.g., "Your child seems to be in trouble. They may need help.").

[2321] Step 14:

[2322] The device (parent's smartphone) receives the feedback message and notifies the parent.

[2323] The user (parent) can check the notifications and use them to communicate with their child.

[2324] Step 15:

[2325] The user (parent) can give advice and words of encouragement to their child based on the displayed feedback.

[2326] For example, by encouraging children to "solve the problem together," we can strengthen learning support within the home.

[2327] As described above, through the processing steps of the present invention, a system is provided that utilizes an emotion engine to reduce the difficulties children face when doing their homework and allows parents to provide support at an appropriate time.

[2328] Example 2

[2329] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2330] In today's educational environment, it is important for teachers to manage students' homework and monitor their progress, but this requires a lot of time and effort. Furthermore, there are often no means to quickly resolve questions or difficulties students have when working on their homework. Furthermore, it is not possible to monitor students' emotions and stress levels and provide appropriate feedback to parents. As a result, students' learning efficiency declines and communication between families becomes insufficient.

[2331] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes an information input means of an educational institution for inputting detailed information about homework, a server means for collecting homework information from the information input means of the educational institution and storing it in a database, a notification means for notifying the homework information stored by the server means, a terminal means for displaying the homework information notified from the notification means, a progress input means for inputting the progress of homework using the terminal means, a server means for receiving data from the progress input means and storing it in a database, a question input means for inputting a question about homework using the terminal means, a server means for receiving a question from the question input means and generating an answer to the question using a generative AI means, and the server The system includes an answer display means for transmitting answers generated by the answer analysis means to a terminal means and displaying them, an emotion analysis means for the terminal means to recognize emotions by analyzing facial expressions, voice, or text input, a server means for receiving emotion data from the emotion analysis means and storing it in a database, an evaluation means for the server means to evaluate stress levels and motivation based on homework progress data and emotion data, a generation means for generating feedback messages for parents based on the evaluation results from the evaluation means, a notification means for transmitting the feedback message from the generation means to a parent terminal and notifying the parent, and a display means for displaying the feedback message on the parent terminal. This enables efficient homework management, rapid question resolution, monitoring of student emotions, and provision of appropriate feedback.

[2332] "Information input means for educational institutions" refers to the means by which teachers can input detailed information about homework (such as assignment content, submission deadlines, and reference materials) through the school's online system.

[2333] The "server means" is a means for storing homework information collected from the information input means of the educational institution in a database and for managing data communication with the notification means and the terminal means.

[2334] The "notification means" is a means for transmitting homework information, progress status, etc. stored by the server means to the user terminal as a push notification.

[2335] "Terminal means" refers to devices (smartphones, tablets, etc.) used by parents and children, and is a means of displaying homework information, progress, feedback messages, etc.

[2336] The "progress input means" is a means by which a child can input the progress of their homework through an application.

[2337] The "question input means" is a means by which a child inputs a question about homework through an application.

[2338] A "generative AI method" is a method that uses an AI model to create an answer to a question based on a generated prompt.

[2339] The "answer display means" is a means for transmitting the answer generated by the generative AI means to the terminal means and displaying it.

[2340] The "emotion analysis means" is a means by which the terminal means analyzes the user's facial expression, voice, or text input and recognizes emotions.

[2341] The "assessment tool" is a tool for assessing stress levels and motivation based on homework progress data and perceived emotional data.

[2342] The "generation means" is a means for generating a feedback message for parents based on the results of the evaluation means.

[2343] A "feedback message" is a message that tells parents what problems their child is facing or what state their child is in while studying.

[2344] The "display means" is a means for displaying a feedback message on the par...

Claims

1. an information input means for the educational institution for inputting detailed information about the homework; a server means for collecting homework information from the information input means of the educational institution and storing the information in a database; notification means for notifying the homework information stored by the server means; a terminal means for displaying the homework information notified by the notifying means; a progress input means for inputting the progress of homework using the terminal means; a server means for receiving data from the progress input means and storing the data in a database; a question input means for inputting a question about homework using the terminal means; a server means for receiving a question from the question input means and generating an answer to the question using a generative AI means; an answer display means for transmitting the generated answer from the server means to a terminal means and displaying the answer; evaluation means for evaluating a stress level and motivation based on homework progress data; a generating means for generating a feedback message for parents based on the evaluation result from the evaluating means; a notification means for transmitting the feedback message from the generation means to a parent terminal and notifying the parent terminal; a display means for displaying a feedback message on the parent terminal; A system including:

2. 2. The system according to claim 1, wherein the generative AI means generates answers to questions using natural language processing.

3. 2. The system according to claim 1, wherein said evaluation means evaluates stress levels and motivation based on an analysis of homework progress data and question content.

Images