system

Abstract

A system is provided.SOLUTION: A schedule management system for children includes input means for a teacher to input information such as homework and belongings, server means for storing and analyzing the input information, notification means for generating and notifying a reminder based on the stored information, voice processing means for a user to perform voice input and acquire target information, reply means for replying to the user with the acquired information, GPS means for acquiring GPS information from a terminal carried by a child and transmitting the GPS information to a server, and position information display means for a parent to check position information of the child through an application.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Today, children have a wide range of tasks and schedules, including cram schools, extracurricular activities, homework, and checking for forgotten items. This makes managing these tasks extremely complicated, even for parents and teachers. It is particularly difficult for children to develop self-management skills, and parents often have to constantly nag them. Furthermore, missed communications from teachers and inadequate communication between parents and children can lead to children forgetting things or not turning in homework. Parents also need to be able to accurately track their children's location at all times to ensure their safety. There is a need for a system that can solve these issues and enable children to live comfortable and efficient lives. [Means for solving the problem]

[0005] The present invention provides a schedule management system for children, which includes the following means. First, an input means is provided for teachers to input information such as homework and belongings. This allows teachers to easily register necessary information within the system. Next, a server means is provided for saving and analyzing the input information, allowing for centralized management and analysis of information. The system also includes a notification means for generating reminders based on the saved information and sending notifications. This allows children to receive the necessary information at a specified time. Furthermore, a voice processing means for voice input and a response means for responding to the acquired information to the user are provided, allowing children to easily obtain the necessary information. Furthermore, the system includes a GPS means for acquiring GPS information from the child's device and sending it to a server, and a location information display means for parents to check the child's location through an app. By combining these means, a system is provided that reduces the burden on parents and teachers and makes children's schedule management more efficient.

[0006] A "schedule management system for children" is a system that allows children to manage their schedules for cram schools, school, extracurricular activities, etc., and has the function of working in cooperation with parents and teachers to efficiently manage children's tasks and plans.

[0007] "Input means" refers to an interface or device that allows teachers or parents to input information such as homework, belongings, and events into an application or system.

[0008] "Server means" refers to a computer server or cloud server that stores and analyzes input information and provides data to other system components as needed.

[0009] "Notification means" refers to the mechanisms and functions for generating reminders and alerts and sending notifications to the user's device.

[0010] "Speech processing means" refers to speech recognition technology and interfaces that allow a user to input speech, analyze it, and convert it into text.

[0011] "Response means" refers to a function or interface for returning an appropriate response to the user based on the information obtained by the voice processing means.

[0012] "GPS means" refers to technology or devices that have the ability to periodically obtain location information from a child's device and send it to a server.

[0013] "Location information display means" refers to a display function or interface that allows parents to check their child's location information in real time through an application. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9]1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] This invention provides a schedule management system for children, with the aim of enabling parents, children, and teachers to work together to efficiently manage schedules and tasks. This system realizes information sharing and management between parents, children, and teachers through the following components: input means, server means, notification means, voice processing means, response means, GPS means, and location information display means.

[0036] 1. System Overview

[0037] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts, and can enter and check information through the application.

[0038] 2. Input Method

[0039] Users (teachers) enter information about homework, belongings, and events into an input form within the app, and this information is sent to the cloud server in real time.

[0040] Example: Teacher types, "Tomorrow's homework is math worksheets, and students should bring a compass and ruler."

[0041] 3. Server Means

[0042] The server receives the information entered by teachers and parents, stores it in a database, and then analyzes it to generate reminders and notifications as needed.

[0043] Example: A server stores homework and belongings information sent by teachers and sets reminders.

[0044] 4. Means of notification

[0045] The server generates reminders based on the stored information and sends notifications to the device when the reminder time arrives.

[0046] Example: Your device receives a notification that says, "You will need a compass and ruler for class tomorrow."

[0047] 5. Audio Processing Means

[0048] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server, allowing the child to easily obtain information.

[0049] Example: Child says, "What should I bring tomorrow?"

[0050] 6. Response methods

[0051] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and returns the response to the device. The response is then conveyed to the child as voice.

[0052] Example: The device responds by saying, "Tomorrow, bring a compass and a ruler."

[0053] 7. GPS means

[0054] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time.

[0055] Example: Location information is sent when a child is on their way to cram school.

[0056] 8. Location information display means

[0057] Users (parents) can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[0058] Example: A parent uses an app to check where their child is.

[0059] Specific examples

[0060] Scenario 1: Check your belongings

[0061] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[0062] 2. The server stores the information and sets the reminder.

[0063] 3. At night, your child asks via voice command, "What should I bring to math class tomorrow?"

[0064] 4. The device converts the speech to text and sends the query to the server.

[0065] 5. The server obtains the information about "compass and ruler" and returns it to the device.

[0066] 6. The device will respond with a voice saying, "Tomorrow, bring a compass and a ruler."

[0067] Scenario 2: Location Check

[0068] 1. GPS information is sent periodically as the child leaves home and heads to cram school.

[0069] 2. Parents can check their child's location in real time on their device.

[0070] 3. Parents can check through the app whether their children are in a safe place.

[0071] As described above, this system streamlines information sharing and management between parents, children, and teachers, reducing the burden on families. This allows children to manage their many schedules and tasks without stress, and parents can watch over their children's growth with peace of mind.

[0072] The processing flow will be explained below.

[0073] Program processing of belongings check scenario

[0074] Step 1:

[0075] The user (teacher) enters "Bring a compass and ruler to tomorrow's math class" into the app's input form.

[0076] Step 2:

[0077] The device converts this input into JSON format data and sends it to the server as an API request.

[0078] Step 3:

[0079] The server receives the API request and parses the input data into the required fields.

[0080] Step 4:

[0081] The server stores the parsed data in a database and returns a success message to the terminal.

[0082] Step 5:

[0083] In the evening, the user (child) asks via voice input, "What should I bring to math class tomorrow?"

[0084] Step 6:

[0085] The device converts the voice input into text using a speech recognition engine and sends this text to the server as a query.

[0086] Step 7:

[0087] The server parses the received query and retrieves the relevant information ("compass and ruler") from the database.

[0088] Step 8:

[0089] The server sends the acquired information to the terminal as a JSON format response.

[0090] Step 9:

[0091] The device receives the response and replies in voice, "Tomorrow, bring a compass and a ruler."

[0092] Step 10:

[0093] The next morning, the device will send a notification to the user based on the set reminder time, saying, "You will need a compass and ruler for tomorrow's class."

[0094] Location verification scenario program processing

[0095] Step 1:

[0096] The user (child) leaves home and activates the GPS function on the device on the way to cram school.

[0097] Step 2:

[0098] The device periodically acquires GPS information (latitude, longitude), converts it into JSON format data, and sends it to the server.

[0099] Step 3:

[0100] The server analyzes the received GPS information and stores it in a database.

[0101] Step 4:

[0102] The server continuously monitors the latest GPS information and provides it immediately when a parent requests it.

[0103] Step 5:

[0104] The user (parent) makes a request in the app saying, "I want to check where my child is right now."

[0105] Step 6:

[0106] The device sends this request to the server.

[0107] Step 7:

[0108] The server retrieves the latest GPS information from the database and sends it to the device as JSON format data.

[0109] Step 8:

[0110] The device displays the received GPS information in map format, showing parents the child's location.

[0111] Step 9:

[0112] The user (parent) looks at the map on the app to check their child's current location and the route they have taken.

[0113] Through the above processing steps, the user can efficiently manage their child's schedule, homework, and belongings, and can keep track of their child's location information in real time.

[0114] Example 1

[0115] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0116] In modern families, managing children's schedules and learning tasks is important, but the burden falls on parents and teachers. In particular, there is a need for systems that can monitor children's learning and behavior in real time and provide appropriate support. However, conventional systems lack the ability to share information in real time or easily obtain information via voice, making it difficult to effectively manage children's learning while reducing the burden on parents and teachers and encouraging their independence. In addition, there are challenges in obtaining and displaying location information in real time and with accuracy.

[0117] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0118] In this invention, the server includes an input means for teachers to input information such as homework and belongings, a server means for saving and analyzing the input information, a notification means for generating and notifying reminders based on the saved information, a voice processing means for converting voice input by the user into text, a response means for retrieving target information from the server based on the converted text data and responding to the user in voice, a GPS means for acquiring location data from the child's device and transmitting it to the server, and a location information display means for parents to check their child's location information through the app. This allows parents, teachers, and children to share information in real time, enabling quick and intuitive schedule management, task management, and location information confirmation. Furthermore, obtaining information via voice makes the system easy for children to use and independently check their schedules.

[0119] "Input means" refers to a device or mechanism that allows teachers to input information such as homework and belongings.

[0120] "Server means" refers to a computer and its program for storing and analyzing input information.

[0121] A "notification means" is a mechanism or device that generates a reminder based on the stored information and sends a notification to the terminal.

[0122] A "speech processing means" is a device or software for converting a user's speech input into text.

[0123] The "response means" is a mechanism or device that obtains the target information from the server based on the converted text data and responds to the user in the form of voice.

[0124] "GPS means" refers to technology or devices that acquire location data from a child's device and transmit it to a server.

[0125] "Location information display means" refers to a mechanism or device that allows parents to check their child's location information through an app.

[0126] "User account authentication" refers to the technology and methods used to verify the user accounts of parents, teachers, and children and to authenticate that they are legitimate users.

[0127] "Schedule management" refers to the mechanism or means for saving and managing schedule information entered by the user.

[0128] "Task management" refers to the mechanisms and means for saving and managing task information entered by users.

[0129] This invention provides a schedule management system for children, with the aim of enabling parents, children, and teachers to work together to efficiently manage schedules and tasks. This system realizes information sharing and management between parents, children, and teachers through the following components: input means, server means, notification means, voice processing means, response means, GPS means, and location information display means.

[0130] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts, and can enter and check information through the application.

[0131] Input Method

[0132] The user (teacher) enters homework, belongings, and event information into an input form within the app. This information is sent to the cloud server in real time. Specifically, the teacher launches the smartphone app, goes to the schedule tab, and enters the homework as "math worksheets" and the belongings as "compass and ruler."

[0133] Server Means

[0134] The server receives the information sent from the device and stores it in a database (for example, MySQL or MongoDB). It then analyzes this information and generates reminders and notifications as needed. The server's API endpoint receives the data and stores it in the database. The server also runs scheduled jobs (such as Cron jobs) to check what items students need to bring to class the next day and set reminders.

[0135] Notification means

[0136] The server generates a reminder based on the saved information and sends a notification to the device when the reminder time arrives. This process uses FCM (Firebase Cloud Messaging) and other services. The device receives the push notification and displays the message "You will need a compass and ruler for tomorrow's class."

[0137] Voice processing and response means

[0138] When the user (child) asks a question by voice, the device converts the voice into text using the Google Cloud Speech-to-Text API or similar and sends the query to the server. The server receives the query obtained by the voice processing means, retrieves the relevant information from a database, and responds to the device. The response is communicated to the child as voice. The device uses the Google Cloud Text-to-Speech API to play back the message, "Tomorrow's belongings are a compass and a ruler."

[0139] GPS and location information display methods

[0140] The device (child) periodically sends GPS information to the server, allowing parents to track their child's location in real time. The GPS data is sent using the device's native API (e.g., Android's LocationManager). Parents can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format using the Google Maps API or similar.

[0141] Specific examples

[0142] Scenario 1: Check your belongings

[0143] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[0144] 2. The server stores the information and sets the reminder.

[0145] 3. At night, the child asks aloud, "What should I bring to math class tomorrow?"

[0146] 4. The device converts the voice data into text and sends the query to the server.

[0147] 5. The server retrieves the necessary information from the database and generates a response.

[0148] 6. The device receives the response and plays back the following: "Tomorrow, bring a compass and a ruler."

[0149] Scenario 2: Location Check

[0150] 1. While a child is on their way to cram school, their GPS information is periodically sent to a server.

[0151] 2. The server stores the acquired GPS information.

[0152] 3. The parent launches the app and checks their child's location.

[0153] 4. The child's current location is displayed on a map in real time on the parent's device.

[0154] As described above, this system streamlines information sharing and management between parents, children, and teachers, reducing the burden on families. This allows children to manage their many schedules and tasks without stress, and parents can watch over their children's growth with peace of mind.

[0155] Prompt Sentence Examples

[0156] - "Please explain how the schedule information entered by the teacher is sent to the server, saved, and notified."

[0157] - "When your child asks a verbal question, please explain in detail the process of how you verbally respond to that question."

[0158] - "Please explain how parents can check their children's location in real time."

[0159] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0160] Step 1:

[0161] The user (teacher) launches the smartphone app, moves to the schedule tab, and enters homework and belongings information. The entered data is in text format: "Homework: Math worksheets, Items: Compass and ruler." After entering the data, the user confirms it and presses the send button. The device generates an HTTP POST request with the entered data and sends it to the server's API endpoint.

[0162] Step 2:

[0163] The server receives the HTTP POST request and extracts the data in the request body. It then saves the information entered by the teacher ("Homework: Math worksheet, Items to bring: Compass and ruler") in a database such as MySQL or MongoDB. After saving the information in the database, it returns a successful save response to the device.

[0164] Step 3:

[0165] The server runs a scheduled job (Cron job) to analyze the saved data, check the schedule for the next day, and generate a reminder such as "You will need a compass and ruler for tomorrow's class." Based on the reminder time, the server prepares to push this reminder information to the device.

[0166] Step 4:

[0167] The server uses Firebase Cloud Messaging (FCM) to send a reminder to the user's device. Specifically, it generates a push notification message stating, "You will need a compass and ruler for tomorrow's class," and sends it to the child's device via the FCM server.

[0168] Step 5:

[0169] The device receives the push notification and displays a message to the user saying, "You will need a compass and ruler for tomorrow's class." Specifically, the app updates the notification icon and displays the reminder details as a pop-up message.

[0170] Step 6:

[0171] The user (child) asks a question by voice input. Specifically, they activate the voice assistant function in the app and say, "What should I bring tomorrow?" This voice data is collected by the device.

[0172] Step 7:

[0173] The device converts the collected voice data into text data using the Google Cloud Speech-to-Text API. The converted text, "What will you bring tomorrow?", is generated. Based on this text data, an HTTP request is generated and sent to send a query to the server.

[0174] Step 8:

[0175] The server receives the HTTP request and analyzes the text data query, "What should I bring tomorrow?". It searches the database for the relevant information and retrieves the "math worksheet, compass, and ruler" information. It then stores the retrieved information as text data and generates a response.

[0176] Step 9:

[0177] The server generates a response and sends it to the device. For example, the response may contain text data such as "Tomorrow's items are a compass and a ruler." After receiving the response, the device prepares to respond by voice.

[0178] Step 10:

[0179] The device converts the received text data into audio data using the Google Cloud Text-to-Speech API. This audio data is then played back and the user (child) is told, "Tomorrow's items are a compass and a ruler." Specifically, the audio is played back through the device's speaker.

[0180] Step 11:

[0181] The device (child) periodically obtains GPS information and sends it to the server. Specifically, it obtains the current location data using LocationManager and sends it to the server's API endpoint via an HTTP POST request.

[0182] Step 12:

[0183] The server receives the GPS information and stores it in a database, where it can be provided to the parent's device in real time upon request.

[0184] Step 13:

[0185] Parents can send a request to check their child's location through the app. Specifically, they open the map display function in the app and press a button to request their child's current location. This request is sent to the server.

[0186] Step 14:

[0187] The server receives the parent's request, retrieves the latest GPS information from the database, formats the location information into data for display on a map using the Google Maps API, and sends it to the parent's device.

[0188] Step 15:

[0189] The parent's device uses the Google Maps API to display the received location information on a map. Specifically, the child's current location is displayed in real time on the map display area within the app.

[0190] Based on the above process, this system enables smooth information sharing and management, reducing the burden on the household and allowing children to manage their numerous schedules and tasks without stress. It also allows parents to watch their children grow with peace of mind.

[0191] (Application example 1)

[0192] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0193] Current child schedule management systems require a lot of time and effort to input and check information, placing a heavy burden on parents and teachers. Furthermore, they lack the ability to track children's location, making it difficult to respond quickly in emergencies. This makes it difficult for parents to effectively monitor their children.

[0194] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0195] In this invention, the server includes: an input unit for teachers to input information such as homework and belongings; a server unit for saving and analyzing the input information; a notification unit for generating and notifying reminders based on the saved information; a voice processing unit for users to input voice information and acquire the target information; a response unit for responding to the acquired information to the user; a GPS unit for acquiring GPS information from the child's device and sending it to the server; a location information display unit for parents to check the child's location information through an app; a voice assistant unit for users to ask questions about belongings and schedules by voice and for the server to respond to those questions; an emergency notification unit for displaying real-time location information on the parent's device and sending alerts in the event of an emergency; and a unit for parents to track the child's location using smart glasses or a head-mounted display. This reduces the burden on parents and teachers while enabling a quick response in emergencies.

[0196] "Input means" refers to the means by which teachers input information such as homework and belongings.

[0197] "Server means" refers to means for storing and analyzing input information.

[0198] The "notification means" is a means for generating and notifying reminders based on the stored information.

[0199] The "voice processing means" is a means for a user to input voice and obtain target information.

[0200] The "response means" is a means for responding to the user with the acquired information.

[0201] "GPS means" refers to the means for obtaining GPS information from the device held by the child and sending it to the server.

[0202] "Location information display means" is a means for parents to check their child's location information through the app.

[0203] A "voice assistant" is a means by which a user can ask questions about their belongings or schedule by voice, and a server can respond to those questions.

[0204] The "emergency notification means" is a means for displaying real-time location information on the parent's device and sending an alert in the event of an emergency.

[0205] "Smart glasses or head-mounted displays" are devices that allow parents to track their children's locations.

[0206] The present invention relates to a schedule management system for children, and aims to enable parents, children, and teachers to work together to efficiently manage schedules and tasks. This system is realized by combining several important means.

[0207] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts and can enter and check information through the application.

[0208] Generating a Program

[0209] The system is realized with the following program structure:

[0210] 1. Input method: Teachers enter information such as homework, belongings, and school events into an input form within the app. This information is sent to the cloud server in real time.

[0211] 2. Server means: The server receives the information entered by teachers, parents, and children, stores it in a database, and performs analysis based on this information to generate reminders and notifications as needed.

[0212] 3. Notification method: The server generates a reminder based on the stored information and sends a notification to the device when the reminder time arrives.

[0213] 4. Voice processing means: When a child asks a question by voice, the device converts the voice into text and sends the query to the server, allowing the child to easily obtain information.

[0214] 5. Response means: The server receives the query obtained by the voice processing means, retrieves the relevant information from the database, and responds to the device. The response is conveyed to the child as voice.

[0215] 6. GPS: The child's device will periodically send GPS information to the server, allowing parents to track their child's location in real time.

[0216] 7. Location information display: Parents can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[0217] 8. Voice assistant: When a child asks about their belongings or schedule by voice, the server responds with the relevant information.

[0218] 9. Emergency notification: Displays real-time location information on the parent's device and sends alerts in the event of an emergency.

[0219] 10. Smart glasses or head-mounted displays: These devices allow parents to track their children's location in real time and ensure their safety.

[0220] About program processing

[0221] Hardware and software used:

[0222] Server: Flask (a Python web framework)

[0223] Database: SQL or NoSQL database

[0224] Devices: smartphones, smart glasses, head-mounted displays

[0225] Speech processing: Speech recognition API (e.g. Google Speech-to-Text)

[0226] Location information processing: GPS module and map API (e.g. Google Maps API)

[0227] Data processing and calculation:

[0228] Adding schedule information: The server receives the information entered by the teacher and stores it in the database.

[0229] Obtaining schedule information: The server analyzes the information asked by the child via voice and responds with the relevant schedule.

[0230] Location information update: The server receives and stores GPS information sent from the child's device.

[0231] Emergency notification generation: When the set reference time is exceeded, the server automatically generates a notification and sends it to the parent device.

[0232] Specific examples

[0233] 1. Examples of belongings checks:

[0234] A child asks via voice command, "What should I bring to math class tomorrow?"

[0235] The server retrieves the information "compass and ruler" from the database and returns it to the terminal.

[0236] The device will respond aloud, "Tomorrow's items to bring are a compass and a ruler."

[0237] 2. Examples of location verification:

[0238] GPS information is sent periodically from the time the child leaves home to the time they are on their way to cram school.

[0239] Parents can check their children's location in real time through smart glasses and ensure their safety.

[0240] 3. Example prompt:

[0241] In your Kids Safeguard app,

[0242] 1. Easily manage your child's schedule and belongings.

[0243] 2. When you ask the voice assistant, "What should I bring tomorrow?", the app will automatically provide an answer from its database.

[0244] 3. Parents can check their children's current location in real time through smart glasses to ensure their safety.

[0245] Based on this, consider how your AI might respond to the following specific scenarios:

[0246] "If a child takes a detour on the way home from school, the parent can use the app to pinpoint their location and direct them back to a safe route."

[0247] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0248] Step 1:

[0249] User (teacher) enters information

[0250] Input: The teacher enters information such as homework and belongings into the input format.

[0251] Specific operation: The teacher enters homework, belongings, event information, etc. in text format into the application's input form.

[0252] Data processing: The server receives the entered information and stores it in a database.

[0253] Output: The entered information is saved in the database.

[0254] Step 2:

[0255] The server analyzes the information and sets reminders

[0256] Input: Information stored in a database.

[0257] What it does: The server periodically scans the stored information and analyzes it for information that requires reminders.

[0258] Data processing: Based on the stored information, a reminder is generated and a notification is sent at the set time.

[0259] Output: A reminder is generated and ready to be notified.

[0260] Step 3:

[0261] Your device will receive a reminder and notify you

[0262] Input: Reminders sent from the server.

[0263] Specific operation: When the reminder time arrives, the server sends a reminder to the user's terminal.

[0264] Data processing: The device displays the reminder as a notification, which includes the reminder content.

[0265] Output: A notification will be displayed on the terminal to inform the user.

[0266] Step 4:

[0267] Children can ask questions by voice input

[0268] Input: The child types in a question by voice.

[0269] Specific actions: The child asks a question to the device verbally, such as "What should I bring tomorrow?"

[0270] Data processing: The terminal's speech processing means converts the speech into text and sends the query to the server.

[0271] Output: The speech is converted to text and the query is sent to the server.

[0272] Step 5:

[0273] The server analyzes the query and generates a response

[0274] Input: Text questions submitted by the child.

[0275] Specific operation: The server receives the query and queries the database to obtain the relevant information.

[0276] Data processing: Converting the acquired information into a format for response.

[0277] Output: The server sends a response to the device.

[0278] Step 6:

[0279] The device will speak the response

[0280] Input: The response sent by the server.

[0281] What happens: The device converts the text response into speech and reads it to the user.

[0282] Data processing: Text to speech conversion.

[0283] Output: The response is spoken to the user.

[0284] Step 7:

[0285] GPS information collection and transmission

[0286] Input: GPS information from the child's device.

[0287] Specific operation: The device collects GPS information at specified intervals and sends it to the server.

[0288] Data processing: GPS data is received on the server side and stored in a database.

[0289] Output: The latest location information is saved on the server.

[0290] Step 8:

[0291] Parents check location information

[0292] Input: Child's location.

[0293] Specific actions: Parent opens the app and checks their child's location.

[0294] Data processing: Obtain location information from the server and display it on the app's map.

[0295] Output: The child's location is displayed on the parent's device in map format.

[0296] Step 9:

[0297] Use as a voice assistant

[0298] Input: Child's spoken question.

[0299] Specific action: The child asks aloud questions about belongings and schedules.

[0300] Data processing: The speech processing means converts the speech into text, and the server generates a response.

[0301] Output: The device will speak the response.

[0302] Step 10:

[0303] Use of emergency notification methods

[0304] Input: Emergency alert conditions.

[0305] Specific operation: When the set conditions are met, the server sends an alert to the parent device.

[0306] Data Processing: Alert generation and sending.

[0307] Output: An emergency notification will be displayed on the parent's device.

[0308] Step 11:

[0309] Location tracking with smart glasses or head-mounted displays

[0310] Input: Child's latest location.

[0311] How it works: Parents wear smart glasses or a head-mounted display that displays their child's location in real time.

[0312] Data processing: Real-time display of location information.

[0313] Output: Parent visually confirms child's location.

[0314] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0315] This invention combines an emotion engine with a schedule management system for children to provide additional support based on user emotion recognition. This system includes input means, server means, notification means, voice processing means, response means, GPS means, location information display means, and the emotion engine. This enables the system to respond adaptively to the user's emotional state in addition to conventional schedule management functions.

[0316] 1. System Overview

[0317] The entire system consists of a cloud-based server, a user terminal application, and an emotion engine. Users (parents, children, and teachers) each have their own separate accounts and can input and check information through the application. The system also recognizes the user's emotional state from voice input and behavioral patterns and provides appropriate notifications and feedback.

[0318] 2. Input Method

[0319] Users (teachers) enter information about homework, belongings, and events into an input form within the app, and this information is sent to the cloud server in real time.

[0320] Example: Teacher types, "Tomorrow's homework is math worksheets, and students should bring a compass and ruler."

[0321] 3. Server Means

[0322] The server receives the information entered by teachers and parents, stores it in a database, and then analyzes it to generate reminders and notifications as needed.

[0323] Example: A server stores homework and belongings information sent by teachers and sets reminders.

[0324] 4. Means of notification

[0325] The server generates reminders based on the saved information and sends notifications to the device when the reminder time arrives. The emotion engine can also change the content and tone of the notifications.

[0326] Example: Your device receives a notification that says, "You will need a compass and ruler for class tomorrow."

[0327] 5. Audio Processing Means

[0328] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server, through which the emotion engine performs emotion analysis.

[0329] Example: Child says, "What should I bring tomorrow?"

[0330] 6. Response methods

[0331] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and generates a response based on the emotional state analyzed by the emotion engine. The response is then conveyed to the child as voice.

[0332] Example: The device responds with a voice message saying, "Tomorrow, bring a compass and a ruler. You did a great job today!"

[0333] 7. GPS means

[0334] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time.

[0335] Example: Location information is sent when a child is on their way to cram school.

[0336] 8. Location information display means

[0337] Users (parents) can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[0338] Example: A parent uses an app to check where their child is.

[0339] 9. Emotion Engine

[0340] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of this emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses.

[0341] Example: If the emotion engine analyzes the emotions from a child's voice input and determines that the child is under stress, it will notify the child with a message such as "Take time to relax."

[0342] Specific examples

[0343] Scenario 1: Inventory Check and Emotional Feedback

[0344] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[0345] 2. The server stores the information and sets the reminder.

[0346] 3. At night, your child asks via voice command, "What should I bring to math class tomorrow?"

[0347] 4. The device converts the speech to text and sends the query to the server.

[0348] 5. The server obtains the information about the "compass and ruler," and the emotion engine generates a message that reflects the emotion, such as "You worked hard today!"

[0349] 6. The device will respond with a voice message saying, "Tomorrow, bring a compass and a ruler. You did a great job today!"

[0350] Scenario 2: Location and emotional support

[0351] 1. The child leaves home and activates the GPS function on the device on the way to cram school.

[0352] 2. The device periodically acquires GPS information and sends it to the server.

[0353] 3. The server continues to monitor the latest GPS information.

[0354] 4. The parent makes a request in the app to check where their child is.

[0355] 5. The server sends the latest GPS information to the device and displays it in map format.

[0356] 6. Furthermore, if the emotion engine detects that a child may be feeling stressed based on their behavioral patterns, it will notify the parents, saying, "Let's play together after cram school."

[0357] This system allows parents and teachers to communicate better with their children, allowing them to study and carry out daily activities without stress. Feedback from the emotion engine also contributes to maintaining children's mental health.

[0358] The processing flow will be explained below.

[0359] Program processing of inventory check and emotional feedback scenarios

[0360] Step 1:

[0361] The user (teacher) enters "Bring a compass and ruler to tomorrow's math class" into the app's input form.

[0362] Step 2:

[0363] The device converts this input into JSON format data and sends it to the server as an API request.

[0364] Step 3:

[0365] The server receives the API request and parses the input data into the required fields.

[0366] Step 4:

[0367] The server stores the parsed data in a database and returns a success message to the terminal.

[0368] Step 5:

[0369] In the evening, the user (child) asks via voice input, "What should I bring to math class tomorrow?"

[0370] Step 6:

[0371] The device converts the voice input into text using a speech recognition engine and sends this text to the server as a query.

[0372] Step 7:

[0373] The server parses the received query and retrieves the relevant information ("compass and ruler") from the database.

[0374] Step 8:

[0375] The server sends the acquired information to an emotion engine, which analyzes the child's emotions based on the user's past voice input and behavioral patterns.

[0376] Step 9:

[0377] The emotion engine generates appropriate feedback messages based on the analysis results.

[0378] Step 10:

[0379] The server sends a feedback message ("Tomorrow you will bring a compass and a ruler. You did well today!") to the device.

[0380] Step 11:

[0381] The device responds to the message it receives with a voice message saying, "Tomorrow, bring a compass and a ruler. You did well today!"

[0382] Programmatic processing of location-checking and emotional support scenarios

[0383] Step 1:

[0384] The user (child) leaves home and activates the GPS function on the device on the way to cram school.

[0385] Step 2:

[0386] The device periodically acquires GPS information (latitude, longitude), converts it into JSON format data, and sends it to the server.

[0387] Step 3:

[0388] The server analyzes the received GPS information and stores it in a database.

[0389] Step 4:

[0390] The server continuously monitors the latest GPS information and provides it immediately when a parent requests it.

[0391] Step 5:

[0392] The user (parent) makes a request in the app saying, "I want to check where my child is right now."

[0393] Step 6:

[0394] The device sends this request to the server.

[0395] Step 7:

[0396] The server retrieves the latest GPS information from the database and sends it to the device as JSON format data.

[0397] Step 8:

[0398] The device displays the received GPS information in map format, showing parents the child's location.

[0399] Step 9:

[0400] The server sends past behavioral patterns and current GPS data to an emotion engine to analyze the child's current emotions.

[0401] Step 10:

[0402] If the emotion engine determines based on the analysis results that a child is under stress, it generates a message to the parent such as, "Let's play together after cram school."

[0403] Step 11:

[0404] The server notifies the parent terminal of the generated message.

[0405] Step 12:

[0406] The device will notify the parent with a message saying, "Let's play together after cram school."

[0407] Through the above processing steps, users can efficiently manage their children's schedules, homework, and belongings, track their child's location in real time, and receive support based on their emotional state.

[0408] Example 2

[0409] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0410] Conventional schedule management systems process schedules and notifications uniformly without considering the user's emotional state, which can cause children to feel stressed or unable to properly understand the information. Another issue is that it is difficult for parents and teachers to grasp their children's current state. To support children's mental health and achieve more effective communication, a system incorporating emotion analysis is needed.

[0411] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0412] In this invention, the server includes means for saving and analyzing input information, means for generating and notifying reminders based on the saved information, emotion engine means for analyzing the user's emotions based on voice input and behavioral patterns, and means for customizing the content of notifications and reminders based on the analyzed emotional state. This enables schedule management and notifications adapted to the user's emotional state, reducing stress for children and enabling better communication with parents and teachers.

[0413] "Input means" refers to the means by which teachers input information such as homework and belongings.

[0414] "Server means" refers to means for storing and analyzing input information.

[0415] The "notification means" is a means for generating and notifying reminders based on the stored information.

[0416] The "voice processing means" is a means for a user to input voice and obtain target information.

[0417] The "response means" is a means for responding to the user with the acquired information.

[0418] "GPS means" refers to the means for obtaining GPS information from the device held by the child and sending it to the server.

[0419] "Location information display means" is a means for parents to check their child's location information through the app.

[0420] The "emotion engine means" is a means for analyzing the user's emotions based on voice input and behavioral patterns.

[0421] "Customization means" refers to means for customizing the content of notifications and reminders based on the analyzed emotional state.

[0422] This invention is a schedule management system for children that consists of a cloud-based server, a user terminal application, and an emotion engine. In addition to conventional schedule management functions, this system also enables responses that adapt to the user's emotional state.

[0423] System configuration

[0424] First, let's take a look at an overview of the system: Parents, children, and teachers each have their own individual accounts, and can enter and check information through an application that works with a cloud-based server.

[0425] Input Method

[0426] Users (teachers) enter homework, belongings, and event information into an input form within the app. This information is sent to a cloud server in real time. The hardware used is the teacher's PC or smartphone, and the software is a dedicated application.

[0427] example:

[0428] Type, "Tomorrow's homework is math worksheets, and bring a compass and ruler."

[0429] Server Means

[0430] The server receives information entered by users (teachers and parents) and stores it in a database. It then analyzes the information and generates reminders and notifications as needed. Specifically, it uses database software and analytical algorithms.

[0431] example:

[0432] The server stores homework and belongings information sent by teachers and sets reminders.

[0433] Notification means

[0434] The server generates a reminder based on the saved information when the specified time arrives and sends a notification to the device. The emotion engine can also change the content and tone of the notification. This is done using a cloud notification service and emotion analysis algorithm.

[0435] example:

[0436] Your device receives a notification that says, "You will need a compass and ruler for tomorrow's class."

[0437] Audio Processing Means

[0438] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server. The hardware used is the child's smartphone or tablet, and the software is a voice recognition application. The emotion engine performs emotion analysis based on this query.

[0439] example:

[0440] The child voice-inputs, "What should I bring tomorrow?"

[0441] Response methods

[0442] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and generates a response based on the emotional state analyzed by the emotion engine, which is then conveyed to the child as voice.

[0443] example:

[0444] The device will respond aloud, saying, "Tomorrow, bring a compass and a ruler. You did well today!"

[0445] GPS means

[0446] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time. The hardware used is the child's smartphone or GPS device, and the software is a location tracking application.

[0447] example:

[0448] Location information is sent on the child's way to cram school.

[0449] Location information display means

[0450] Users (parents) can check their child's location information through the app. The latest GPS information obtained from the server is displayed in map format. The hardware used is the parent's PC or smartphone, and the software is a location information display application.

[0451] example:

[0452] Parents can check where their children are using the app.

[0453] Emotion Engine Means

[0454] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of the emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses.

[0455] example:

[0456] The emotion engine analyzes the child's voice input and, if it determines that the child is under stress, it will notify the child with a message such as, "Take some time to relax."

[0457] Prompt Sentence Examples

[0458] "Please let me know so I can check what I need to bring tomorrow."

[0459] "Please tell me where your child is currently."

[0460] This system allows parents and teachers to communicate better with their children, allowing them to study and carry out daily activities without stress. Feedback from the emotion engine also contributes to maintaining children's mental health.

[0461] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0462] Step 1:

[0463] User (teacher) input

[0464] The user (teacher) enters homework, belongings, and event information into the application's input form. This information is sent to the cloud server in real time. Specifically, the teacher opens the app, enters the homework details and belongings list, and presses the "Send" button. Input: Homework and belongings information entered by the teacher. Output: Data sent to the cloud server.

[0465] Step 2:

[0466] Data storage and analysis by server

[0467] The server stores the received information in a database and performs analysis based on the stored information. This analysis includes generating reminders and notifications as needed. Specifically, the server uses database software to store the received information. It then generates notifications based on the reminder setting logic. Input: Data sent to the cloud server. Output: Information stored in the database and reminder settings.

[0468] Step 3:

[0469] Notification method operation

[0470] The server generates a reminder based on the stored information and sends a notification to the device when the reminder time arrives. The emotion engine can change the content and tone of the notification. Specifically, the server uses the notification API to create a reminder and send it to the child's device. Input: Reminder settings and emotion analysis results. Output: Notification sent to the child's device.

[0471] Step 4:

[0472] User (child) voice input and query transmission to the server

[0473] When the user (child) asks a question by voice, the device converts the voice into text and sends a query to the server. The emotion engine performs emotion analysis based on this query. Specifically, the child uses the voice input function to ask a question. The device converts the voice into text and sends it to the server. Input: Child's voice input. Output: Text query sent to the server.

[0474] Step 5:

[0475] Server response generation and notification

[0476] The server receives the query obtained by the voice processing means and retrieves the relevant information from the database. It generates an appropriate response based on the emotional state analyzed by the emotion engine and sends a voice notification to the device. Specifically, the server processes the query, extracts data, determines the emotional state using an emotion analysis algorithm, and generates an appropriate message to send to the device. Input: Text query sent to the server. Output: Response message sent to the child's device.

[0477] Step 6:

[0478] Acquiring GPS information and sending it to the server

[0479] GPS information is periodically sent from the device (child) to the server. Parents can track their child's location in real time. Specifically, the device obtains location information from the GPS sensor and periodically sends it to the server. Input: GPS information from the device. Output: GPS data sent to the server.

[0480] Step 7:

[0481] Parent location check

[0482] The user (parent) can check their child's location information through the app. The latest GPS information obtained from the server is displayed in map format. Specifically, the parent opens the app and sends a request to check their child's location information. The latest GPS information is obtained from the server and displayed in map format. Input: Parent's request to check location information. Output: Location information displayed in map format in the app.

[0483] Step 8:

[0484] Customize notifications with the emotion engine

[0485] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of this emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses. Specifically, the emotion engine analyzes text and voice data, determines the user's emotional state, and adjusts the tone and content of notifications. Input: Voice input, behavioral patterns, and past data. Output: Notifications and reminders customized based on emotions.

[0486] (Application example 2)

[0487] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0488] While conventional child schedule management systems could record schedules and provide reminders, they did not provide support that took into account the user's emotional state. As a result, children often felt stressed in their studies and daily lives, making it difficult to effectively manage their studies and lives. Furthermore, there were insufficient ways for parents to grasp their children's situations in real time, making it difficult to communicate appropriately with their children and with teachers.

[0489] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an input means for the teacher to input information such as homework and belongings; a server means for saving and analyzing the input information; a notification means for generating and notifying reminders based on the saved information; a voice processing means for the user to input voice information and acquire the target information; a response means for responding to the acquired information to the user; a GPS means for acquiring GPS information from the child's device and sending it to the server; a location information display means for the parent to check the child's location information through an app; an emotion analysis means for analyzing the user's emotions from the voice input and behavioral patterns using an emotion engine and generating individually customized feedback based on the analysis results; and a voice generation means for providing customized notifications and feedback by voice. This enables appropriate support that takes into account the child's emotional state, effectively managing learning and daily activities while reducing stress. Furthermore, parents can grasp their child's location information and situation in real time, promoting appropriate communication between parents and children.

[0490] "Input means" refers to a device or program that allows teachers to input information such as homework and belongings.

[0491] The "server means" is a device or program that receives and stores information sent from the input means, and further analyzes the information.

[0492] The "notification means" is a device or program that generates a reminder based on the information stored in the server means and notifies the user of the reminder on the terminal.

[0493] The "voice processing means" is a device or program that converts voice input by a user into text and analyzes the text.

[0494] The "response means" is a device or program that responds to the user based on the acquired information.

[0495] A "GPS means" is a device or program that transmits GPS information obtained from a device held by a child to a server.

[0496] "Location information display means" refers to a device or program that allows parents to check their child's location information through the app.

[0497] The "emotion analysis means" is a device or program that uses an emotion engine to analyze the user's emotions from voice input and behavioral patterns, and generates individually customized feedback based on the results.

[0498] A "voice generating means" is a device or program that provides customized notifications or feedback by voice.

[0499] This invention is a schedule management system for children, which includes a cloud-based server, a user terminal application, and an emotion engine. Specifically, teachers, parents, and children each have their own individual accounts, and input and confirm information through the application. The emotion engine also provides support based on the user's emotional state.

[0500] 1. System Overview

[0501] The overall system mainly consists of the following components:

[0502] Server means: Stores and analyzes information entered by teaching staff and parents.

[0503] Input Method: A device or program that allows teachers and parents to input homework and event information.

[0504] Notification method: Generates reminders based on saved information and notifies the device.

[0505] Voice processing means: When a child asks a question by voice input, the voice is analyzed.

[0506] Response method: A voice response will be provided based on the analyzed information.

[0507] GPS method: Location information is obtained from the child's device and sent to the server.

[0508] Location display method: Parents can check their child's location through the app.

[0509] Emotion analysis means: Analyzes user emotions from voice input, movement patterns, etc.

[0510] Voice generation means: Provides customized notifications and feedback via voice based on the results of sentiment analysis.

[0511] 2. Hardware and Software Used

[0512] Hardware: Using devices such as smartphones, tablets, and smart glasses.

[0513] software:

[0514] Web application framework: Flask

[0515] Cloud Service: Google Cloud TextToSpeech API

[0516] Speech Recognition Library: SpeechRecognition

[0517] 3. Processing Flow

[0518] Server Means

[0519] The server receives information entered by teachers and parents, stores this information in a database, and generates appropriate reminders and notifications based on the stored information.

[0520] Input Method

[0521] Users (teachers and parents) use smartphones or tablets to enter homework and event information, which is then sent to the server via the application.

[0522] Voice processing and response means

[0523] When a child asks a question by voice input, the voice processing means converts the voice into text and sends it to the server. The server retrieves the relevant information from the database and performs emotion analysis to generate appropriate feedback. The generated feedback is then returned to the child as a voice response.

[0524] GPS and location information display methods

[0525] GPS information is periodically sent from the child's device to a server, and parents can check their child's location in real time through the app.

[0526] Emotion analysis and speech generation

[0527] The server performs emotion analysis based on data such as voice input and behavioral patterns, and reflects the results in feedback and notifications. Customized feedback is provided by voice using a voice generation means.

[0528] 4. Examples of concrete examples and prompts

[0529] Specific Scenario 1

[0530] Teacher: Using the app, type "Bring your trigonometry textbook and notebook for tomorrow's math class."

[0531] Child: At night, ask using voice command, "What should I bring tomorrow?"

[0532] Device: Provides verbal feedback such as, "Tomorrow, bring your textbook and notebook. You worked hard today!"

[0533] Prompt Sentence Examples

[0534] Voice prompts for questions

[0535] "What do you need to bring to math class tomorrow?"

[0536] "What's the homework for tomorrow?"

[0537] Feedback prompts based on sentiment analysis

[0538] "It seems like you've been stressful today. Let's take some time to relax."

[0539] "Great work today! Great job!"

[0540] In this way, appropriate support can be provided based on a child's emotional state, enabling them to effectively manage their studies and daily activities while reducing stress. In addition, parents can track their child's location and situation in real time, promoting appropriate communication between parents and children.

[0541] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0542] Step 1:

[0543] Users (teachers and parents) use a smartphone or tablet to enter homework and event information and send it through the application's input means. The entered information is sent to the server and saved. The input to the input means is text-based homework content and belongings information. The output is information saved in the server's database.

[0544] Step 2:

[0545] The server analyzes the input information and generates a reminder based on the saved data. This reminder is automatically set based on the date and time of the event. Specifically, the server analyzes the input text information, extracts the date, time, and content of the event, and generates the reminder setting information. The output is the set reminder information.

[0546] Step 3:

[0547] A notification is sent to the user's device based on the information of the reminder for which the notification method has been set. The content of the notification is sent in the format of "XX is required for tomorrow's class" according to the reminder's set time. The output is a notification message that is displayed on the user's device.

[0548] Step 4:

[0549] A child asks a question using voice input. A voice processing means converts this voice input into text and sends the text data to a server. Specifically, a voice recognition library (e.g., SpeechRecognition) is used to convert the voice data into text data. The input is the voice data of the question as voice input, and the output is the text data sent to the server.

[0550] Step 5:

[0551] The server executes a query based on the text data obtained from the voice input and retrieves the required information from the database. The retrieved information is passed to an emotion analysis means, which analyzes the user's emotional state. This analysis uses the tone of the voice and past behavioral patterns. The output is the result of the emotion analysis and the information retrieved from the database.

[0552] Step 6:

[0553] The emotion analysis means generates individually customized feedback based on the analysis results and passes the feedback to the voice generation means. The voice generation means converts the text of the feedback into voice and sends it to the user's device. Specifically, the Google Cloud TextToSpeech API is used. The input is the analyzed emotional state and text data, and the output is voice data.

[0554] Step 7:

[0555] GPS information is periodically acquired from the child's device and sent to a server. The server monitors this GPS information in real time and stores it in a database. The input is the periodically transmitted GPS data, and the output is the location information data stored on the server.

[0556] Step 8:

[0557] Parents request their child's location information through the app and view it in real time on a map using the location information display means. The server obtains the latest GPS information and displays it as map data on the parent's device. The input is the parent's request and the GPS information stored on the server, and the output is the location information displayed in map format.

[0558] These processing steps enable the system to provide appropriate support that takes into account the user's emotional state, effectively managing learning and daily activities while reducing stress. Furthermore, parents can track their child's location and situation in real time, promoting appropriate communication between them.

[0559] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0560] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0561] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0562] [Second embodiment]

[0563] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0564] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0565] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0566] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0567] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0568] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0569] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0570] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0571] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0572] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0573] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0574] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0575] This invention provides a schedule management system for children, with the aim of enabling parents, children, and teachers to work together to efficiently manage schedules and tasks. This system realizes information sharing and management between parents, children, and teachers through the following components: input means, server means, notification means, voice processing means, response means, GPS means, and location information display means.

[0576] 1. System Overview

[0577] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts, and can enter and check information through the application.

[0578] 2. Input Method

[0579] Users (teachers) enter information about homework, belongings, and events into an input form within the app, and this information is sent to the cloud server in real time.

[0580] Example: Teacher types, "Tomorrow's homework is math worksheets, and students should bring a compass and ruler."

[0581] 3. Server Means

[0582] The server receives the information entered by teachers and parents, stores it in a database, and then analyzes it to generate reminders and notifications as needed.

[0583] Example: A server stores homework and belongings information sent by teachers and sets reminders.

[0584] 4. Means of notification

[0585] The server generates reminders based on the stored information and sends notifications to the device when the reminder time arrives.

[0586] Example: Your device receives a notification that says, "You will need a compass and ruler for class tomorrow."

[0587] 5. Audio Processing Means

[0588] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server, allowing the child to easily obtain information.

[0589] Example: Child says, "What should I bring tomorrow?"

[0590] 6. Response methods

[0591] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and returns the response to the device. The response is then conveyed to the child as voice.

[0592] Example: The device responds by saying, "Tomorrow, bring a compass and a ruler."

[0593] 7. GPS means

[0594] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time.

[0595] Example: Location information is sent when a child is on their way to cram school.

[0596] 8. Location information display means

[0597] Users (parents) can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[0598] Example: A parent uses an app to check where their child is.

[0599] Specific examples

[0600] Scenario 1: Check your belongings

[0601] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[0602] 2. The server stores the information and sets the reminder.

[0603] 3. At night, your child asks via voice command, "What should I bring to math class tomorrow?"

[0604] 4. The device converts the speech to text and sends the query to the server.

[0605] 5. The server obtains the information about "compass and ruler" and returns it to the device.

[0606] 6. The device will respond with a voice saying, "Tomorrow, bring a compass and a ruler."

[0607] Scenario 2: Location Check

[0608] 1. GPS information is sent periodically as the child leaves home and heads to cram school.

[0609] 2. Parents can check their child's location in real time on their device.

[0610] 3. Parents can check through the app whether their children are in a safe place.

[0611] As described above, this system streamlines information sharing and management between parents, children, and teachers, reducing the burden on families. This allows children to manage their many schedules and tasks without stress, and parents can watch over their children's growth with peace of mind.

[0612] The processing flow will be explained below.

[0613] Program processing of belongings check scenario

[0614] Step 1:

[0615] The user (teacher) enters "Bring a compass and ruler to tomorrow's math class" into the app's input form.

[0616] Step 2:

[0617] The device converts this input into JSON format data and sends it to the server as an API request.

[0618] Step 3:

[0619] The server receives the API request and parses the input data into the required fields.

[0620] Step 4:

[0621] The server stores the parsed data in a database and returns a success message to the terminal.

[0622] Step 5:

[0623] In the evening, the user (child) asks via voice input, "What should I bring to math class tomorrow?"

[0624] Step 6:

[0625] The device converts the voice input into text using a speech recognition engine and sends this text to the server as a query.

[0626] Step 7:

[0627] The server parses the received query and retrieves the relevant information ("compass and ruler") from the database.

[0628] Step 8:

[0629] The server sends the acquired information to the terminal as a JSON format response.

[0630] Step 9:

[0631] The device receives the response and replies in voice, "Tomorrow, bring a compass and a ruler."

[0632] Step 10:

[0633] The next morning, the device will send a notification to the user based on the set reminder time, saying, "You will need a compass and ruler for tomorrow's class."

[0634] Location verification scenario program processing

[0635] Step 1:

[0636] The user (child) leaves home and activates the GPS function on the device on the way to cram school.

[0637] Step 2:

[0638] The device periodically acquires GPS information (latitude, longitude), converts it into JSON format data, and sends it to the server.

[0639] Step 3:

[0640] The server analyzes the received GPS information and stores it in a database.

[0641] Step 4:

[0642] The server continuously monitors the latest GPS information and provides it immediately when a parent requests it.

[0643] Step 5:

[0644] The user (parent) makes a request in the app saying, "I want to check where my child is right now."

[0645] Step 6:

[0646] The device sends this request to the server.

[0647] Step 7:

[0648] The server retrieves the latest GPS information from the database and sends it to the device as JSON format data.

[0649] Step 8:

[0650] The device displays the received GPS information in map format, showing parents the child's location.

[0651] Step 9:

[0652] The user (parent) looks at the map on the app to check their child's current location and the route they have taken.

[0653] Through the above processing steps, the user can efficiently manage their child's schedule, homework, and belongings, and can keep track of their child's location information in real time.

[0654] Example 1

[0655] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0656] In modern families, managing children's schedules and learning tasks is important, but the burden falls on parents and teachers. In particular, there is a need for systems that can monitor children's learning and behavior in real time and provide appropriate support. However, conventional systems lack the ability to share information in real time or easily obtain information via voice, making it difficult to effectively manage children's learning while reducing the burden on parents and teachers and encouraging their independence. In addition, there are challenges in obtaining and displaying location information in real time and with accuracy.

[0657] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0658] In this invention, the server includes an input means for teachers to input information such as homework and belongings, a server means for saving and analyzing the input information, a notification means for generating and notifying reminders based on the saved information, a voice processing means for converting voice input by the user into text, a response means for retrieving target information from the server based on the converted text data and responding to the user in voice, a GPS means for acquiring location data from the child's device and transmitting it to the server, and a location information display means for parents to check their child's location information through the app. This allows parents, teachers, and children to share information in real time, enabling quick and intuitive schedule management, task management, and location information confirmation. Furthermore, obtaining information via voice makes the system easy for children to use and independently check their schedules.

[0659] "Input means" refers to a device or mechanism that allows teachers to input information such as homework and belongings.

[0660] "Server means" refers to a computer and its program for storing and analyzing input information.

[0661] A "notification means" is a mechanism or device that generates a reminder based on the stored information and sends a notification to the terminal.

[0662] A "speech processing means" is a device or software for converting a user's speech input into text.

[0663] The "response means" is a mechanism or device that obtains the target information from the server based on the converted text data and responds to the user in the form of voice.

[0664] "GPS means" refers to technology or devices that acquire location data from a child's device and transmit it to a server.

[0665] "Location information display means" refers to a mechanism or device that allows parents to check their child's location information through an app.

[0666] "User account authentication" refers to the technology and methods used to verify the user accounts of parents, teachers, and children and to authenticate that they are legitimate users.

[0667] "Schedule management" refers to the mechanism or means for saving and managing schedule information entered by the user.

[0668] "Task management" refers to the mechanisms and means for saving and managing task information entered by users.

[0669] This invention provides a schedule management system for children, with the aim of enabling parents, children, and teachers to work together to efficiently manage schedules and tasks. This system realizes information sharing and management between parents, children, and teachers through the following components: input means, server means, notification means, voice processing means, response means, GPS means, and location information display means.

[0670] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts, and can enter and check information through the application.

[0671] Input Method

[0672] The user (teacher) enters homework, belongings, and event information into an input form within the app. This information is sent to the cloud server in real time. Specifically, the teacher launches the smartphone app, goes to the schedule tab, and enters the homework as "math worksheets" and the belongings as "compass and ruler."

[0673] Server Means

[0674] The server receives the information sent from the device and stores it in a database (for example, MySQL or MongoDB). It then analyzes this information and generates reminders and notifications as needed. The server's API endpoint receives the data and stores it in the database. The server also runs scheduled jobs (such as Cron jobs) to check what items students need to bring to class the next day and set reminders.

[0675] Notification means

[0676] The server generates a reminder based on the saved information and sends a notification to the device when the reminder time arrives. This process uses FCM (Firebase Cloud Messaging) and other services. The device receives the push notification and displays the message "You will need a compass and ruler for tomorrow's class."

[0677] Voice processing and response means

[0678] When the user (child) asks a question by voice, the device converts the voice into text using the Google Cloud Speech-to-Text API or similar and sends the query to the server. The server receives the query obtained by the voice processing means, retrieves the relevant information from a database, and responds to the device. The response is communicated to the child as voice. The device uses the Google Cloud Text-to-Speech API to play back the message, "Tomorrow's belongings are a compass and a ruler."

[0679] GPS and location information display methods

[0680] The device (child) periodically sends GPS information to the server, allowing parents to track their child's location in real time. The GPS data is sent using the device's native API (e.g., Android's LocationManager). Parents can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format using the Google Maps API or similar.

[0681] Specific examples

[0682] Scenario 1: Check your belongings

[0683] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[0684] 2. The server stores the information and sets the reminder.

[0685] 3. At night, the child asks aloud, "What should I bring to math class tomorrow?"

[0686] 4. The device converts the voice data into text and sends the query to the server.

[0687] 5. The server retrieves the necessary information from the database and generates a response.

[0688] 6. The device receives the response and plays back the following: "Tomorrow, bring a compass and a ruler."

[0689] Scenario 2: Location Check

[0690] 1. While a child is on their way to cram school, their GPS information is periodically sent to a server.

[0691] 2. The server stores the acquired GPS information.

[0692] 3. The parent launches the app and checks their child's location.

[0693] 4. The child's current location is displayed on a map in real time on the parent's device.

[0694] As described above, this system streamlines information sharing and management between parents, children, and teachers, reducing the burden on families. This allows children to manage their many schedules and tasks without stress, and parents can watch over their children's growth with peace of mind.

[0695] Prompt Sentence Examples

[0696] - "Please explain how the schedule information entered by the teacher is sent to the server, saved, and notified."

[0697] - "When your child asks a verbal question, please explain in detail the process of how you verbally respond to that question."

[0698] - "Please explain how parents can check their children's location in real time."

[0699] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0700] Step 1:

[0701] The user (teacher) launches the smartphone app, moves to the schedule tab, and enters homework and belongings information. The entered data is in text format: "Homework: Math worksheets, Items: Compass and ruler." After entering the data, the user confirms it and presses the send button. The device generates an HTTP POST request with the entered data and sends it to the server's API endpoint.

[0702] Step 2:

[0703] The server receives the HTTP POST request and extracts the data in the request body. It then saves the information entered by the teacher ("Homework: Math worksheet, Items to bring: Compass and ruler") in a database such as MySQL or MongoDB. After saving the information in the database, it returns a successful save response to the device.

[0704] Step 3:

[0705] The server runs a scheduled job (Cron job) to analyze the saved data, check the schedule for the next day, and generate a reminder such as "You will need a compass and ruler for tomorrow's class." Based on the reminder time, the server prepares to push this reminder information to the device.

[0706] Step 4:

[0707] The server uses Firebase Cloud Messaging (FCM) to send a reminder to the user's device. Specifically, it generates a push notification message stating, "You will need a compass and ruler for tomorrow's class," and sends it to the child's device via the FCM server.

[0708] Step 5:

[0709] The device receives the push notification and displays a message to the user saying, "You will need a compass and ruler for tomorrow's class." Specifically, the app updates the notification icon and displays the reminder details as a pop-up message.

[0710] Step 6:

[0711] The user (child) asks a question by voice input. Specifically, they activate the voice assistant function in the app and say, "What should I bring tomorrow?" This voice data is collected by the device.

[0712] Step 7:

[0713] The device converts the collected voice data into text data using the Google Cloud Speech-to-Text API. The converted text, "What will you bring tomorrow?", is generated. Based on this text data, an HTTP request is generated and sent to send a query to the server.

[0714] Step 8:

[0715] The server receives the HTTP request and analyzes the text data query, "What should I bring tomorrow?". It searches the database for the relevant information and retrieves the "math worksheet, compass, and ruler" information. It then stores the retrieved information as text data and generates a response.

[0716] Step 9:

[0717] The server generates a response and sends it to the device. For example, the response may contain text data such as "Tomorrow's items are a compass and a ruler." After receiving the response, the device prepares to respond by voice.

[0718] Step 10:

[0719] The device converts the received text data into audio data using the Google Cloud Text-to-Speech API. This audio data is then played back and the user (child) is told, "Tomorrow's items are a compass and a ruler." Specifically, the audio is played back through the device's speaker.

[0720] Step 11:

[0721] The device (child) periodically obtains GPS information and sends it to the server. Specifically, it obtains the current location data using LocationManager and sends it to the server's API endpoint via an HTTP POST request.

[0722] Step 12:

[0723] The server receives the GPS information and stores it in a database, where it can be provided to the parent's device in real time upon request.

[0724] Step 13:

[0725] Parents can send a request to check their child's location through the app. Specifically, they open the map display function in the app and press a button to request their child's current location. This request is sent to the server.

[0726] Step 14:

[0727] The server receives the parent's request, retrieves the latest GPS information from the database, formats the location information into data for display on a map using the Google Maps API, and sends it to the parent's device.

[0728] Step 15:

[0729] The parent's device uses the Google Maps API to display the received location information on a map. Specifically, the child's current location is displayed in real time on the map display area within the app.

[0730] Based on the above process, this system enables smooth information sharing and management, reducing the burden on the household and allowing children to manage their numerous schedules and tasks without stress. It also allows parents to watch their children grow with peace of mind.

[0731] (Application example 1)

[0732] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0733] Current child schedule management systems require a lot of time and effort to input and check information, placing a heavy burden on parents and teachers. Furthermore, they lack the ability to track children's location, making it difficult to respond quickly in emergencies. This makes it difficult for parents to effectively monitor their children.

[0734] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0735] In this invention, the server includes: an input unit for teachers to input information such as homework and belongings; a server unit for saving and analyzing the input information; a notification unit for generating and notifying reminders based on the saved information; a voice processing unit for users to input voice information and acquire the target information; a response unit for responding to the acquired information to the user; a GPS unit for acquiring GPS information from the child's device and sending it to the server; a location information display unit for parents to check the child's location information through an app; a voice assistant unit for users to ask questions about belongings and schedules by voice and for the server to respond to those questions; an emergency notification unit for displaying real-time location information on the parent's device and sending alerts in the event of an emergency; and a unit for parents to track the child's location using smart glasses or a head-mounted display. This reduces the burden on parents and teachers while enabling a quick response in emergencies.

[0736] "Input means" refers to the means by which teachers input information such as homework and belongings.

[0737] "Server means" refers to means for storing and analyzing input information.

[0738] The "notification means" is a means for generating and notifying reminders based on the stored information.

[0739] The "voice processing means" is a means for a user to input voice and obtain target information.

[0740] The "response means" is a means for responding to the user with the acquired information.

[0741] "GPS means" refers to the means for obtaining GPS information from the device held by the child and sending it to the server.

[0742] "Location information display means" is a means for parents to check their child's location information through the app.

[0743] A "voice assistant" is a means by which a user can ask questions about their belongings or schedule by voice, and a server can respond to those questions.

[0744] The "emergency notification means" is a means for displaying real-time location information on the parent's device and sending an alert in the event of an emergency.

[0745] "Smart glasses or head-mounted displays" are devices that allow parents to track their children's locations.

[0746] The present invention relates to a schedule management system for children, and aims to enable parents, children, and teachers to work together to efficiently manage schedules and tasks. This system is realized by combining several important means.

[0747] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts and can enter and check information through the application.

[0748] Generating a Program

[0749] The system is realized with the following program structure:

[0750] 1. Input method: Teachers enter information such as homework, belongings, and school events into an input form within the app. This information is sent to the cloud server in real time.

[0751] 2. Server means: The server receives the information entered by teachers, parents, and children, stores it in a database, and performs analysis based on this information to generate reminders and notifications as needed.

[0752] 3. Notification method: The server generates a reminder based on the stored information and sends a notification to the device when the reminder time arrives.

[0753] 4. Voice processing means: When a child asks a question by voice, the device converts the voice into text and sends the query to the server, allowing the child to easily obtain information.

[0754] 5. Response means: The server receives the query obtained by the voice processing means, retrieves the relevant information from the database, and responds to the device. The response is conveyed to the child as voice.

[0755] 6. GPS: The child's device will periodically send GPS information to the server, allowing parents to track their child's location in real time.

[0756] 7. Location information display: Parents can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[0757] 8. Voice assistant: When a child asks about their belongings or schedule by voice, the server responds with the relevant information.

[0758] 9. Emergency notification: Displays real-time location information on the parent's device and sends alerts in the event of an emergency.

[0759] 10. Smart glasses or head-mounted displays: These devices allow parents to track their children's location in real time and ensure their safety.

[0760] About program processing

[0761] Hardware and software used:

[0762] Server: Flask (a Python web framework)

[0763] Database: SQL or NoSQL database

[0764] Devices: smartphones, smart glasses, head-mounted displays

[0765] Speech processing: Speech recognition API (e.g. Google Speech-to-Text)

[0766] Location information processing: GPS module and map API (e.g. Google Maps API)

[0767] Data processing and calculation:

[0768] Adding schedule information: The server receives the information entered by the teacher and stores it in the database.

[0769] Obtaining schedule information: The server analyzes the information asked by the child via voice and responds with the relevant schedule.

[0770] Location information update: The server receives and stores GPS information sent from the child's device.

[0771] Emergency notification generation: When the set reference time is exceeded, the server automatically generates a notification and sends it to the parent device.

[0772] Specific examples

[0773] 1. Examples of belongings checks:

[0774] A child asks via voice command, "What should I bring to math class tomorrow?"

[0775] The server retrieves the information "compass and ruler" from the database and returns it to the terminal.

[0776] The device will respond aloud, "Tomorrow's items to bring are a compass and a ruler."

[0777] 2. Examples of location verification:

[0778] GPS information is sent periodically from the time the child leaves home to the time they are on their way to cram school.

[0779] Parents can check their children's location in real time through smart glasses and ensure their safety.

[0780] 3. Example prompt:

[0781] In your Kids Safeguard app,

[0782] 1. Easily manage your child's schedule and belongings.

[0783] 2. When you ask the voice assistant, "What should I bring tomorrow?", the app will automatically provide an answer from its database.

[0784] 3. Parents can check their children's current location in real time through smart glasses to ensure their safety.

[0785] Based on this, consider how your AI might respond to the following specific scenarios:

[0786] "If a child takes a detour on the way home from school, the parent can use the app to pinpoint their location and direct them back to a safe route."

[0787] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0788] Step 1:

[0789] User (teacher) enters information

[0790] Input: The teacher enters information such as homework and belongings into the input format.

[0791] Specific operation: The teacher enters homework, belongings, event information, etc. in text format into the application's input form.

[0792] Data processing: The server receives the entered information and stores it in a database.

[0793] Output: The entered information is saved in the database.

[0794] Step 2:

[0795] The server analyzes the information and sets reminders

[0796] Input: Information stored in a database.

[0797] What it does: The server periodically scans the stored information and analyzes it for information that requires reminders.

[0798] Data processing: Based on the stored information, a reminder is generated and a notification is sent at the set time.

[0799] Output: A reminder is generated and ready to be notified.

[0800] Step 3:

[0801] Your device will receive a reminder and notify you

[0802] Input: Reminders sent from the server.

[0803] Specific operation: When the reminder time arrives, the server sends a reminder to the user's terminal.

[0804] Data processing: The device displays the reminder as a notification, which includes the reminder content.

[0805] Output: A notification will be displayed on the terminal to inform the user.

[0806] Step 4:

[0807] Children can ask questions by voice input

[0808] Input: The child types in a question by voice.

[0809] Specific actions: The child asks a question to the device verbally, such as "What should I bring tomorrow?"

[0810] Data processing: The terminal's speech processing means converts the speech into text and sends the query to the server.

[0811] Output: The speech is converted to text and the query is sent to the server.

[0812] Step 5:

[0813] The server analyzes the query and generates a response

[0814] Input: Text questions submitted by the child.

[0815] Specific operation: The server receives the query and queries the database to obtain the relevant information.

[0816] Data processing: Converting the acquired information into a format for response.

[0817] Output: The server sends a response to the device.

[0818] Step 6:

[0819] The device will speak the response

[0820] Input: The response sent by the server.

[0821] What happens: The device converts the text response into speech and reads it to the user.

[0822] Data processing: Text to speech conversion.

[0823] Output: The response is spoken to the user.

[0824] Step 7:

[0825] GPS information collection and transmission

[0826] Input: GPS information from the child's device.

[0827] Specific operation: The device collects GPS information at specified intervals and sends it to the server.

[0828] Data processing: GPS data is received on the server side and stored in a database.

[0829] Output: The latest location information is saved on the server.

[0830] Step 8:

[0831] Parents check location information

[0832] Input: Child's location.

[0833] Specific actions: Parent opens the app and checks their child's location.

[0834] Data processing: Obtain location information from the server and display it on the app's map.

[0835] Output: The child's location is displayed on the parent's device in map format.

[0836] Step 9:

[0837] Use as a voice assistant

[0838] Input: Child's spoken question.

[0839] Specific action: The child asks aloud questions about belongings and schedules.

[0840] Data processing: The speech processing means converts the speech into text, and the server generates a response.

[0841] Output: The device will speak the response.

[0842] Step 10:

[0843] Use of emergency notification methods

[0844] Input: Emergency alert conditions.

[0845] Specific operation: When the set conditions are met, the server sends an alert to the parent device.

[0846] Data Processing: Alert generation and sending.

[0847] Output: An emergency notification will be displayed on the parent's device.

[0848] Step 11:

[0849] Location tracking with smart glasses or head-mounted displays

[0850] Input: Child's latest location.

[0851] How it works: Parents wear smart glasses or a head-mounted display that displays their child's location in real time.

[0852] Data processing: Real-time display of location information.

[0853] Output: Parent visually confirms child's location.

[0854] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0855] This invention combines an emotion engine with a schedule management system for children to provide additional support based on user emotion recognition. This system includes input means, server means, notification means, voice processing means, response means, GPS means, location information display means, and the emotion engine. This enables the system to respond adaptively to the user's emotional state in addition to conventional schedule management functions.

[0856] 1. System Overview

[0857] The entire system consists of a cloud-based server, a user terminal application, and an emotion engine. Users (parents, children, and teachers) each have their own separate accounts and can input and check information through the application. The system also recognizes the user's emotional state from voice input and behavioral patterns and provides appropriate notifications and feedback.

[0858] 2. Input Method

[0859] Users (teachers) enter information about homework, belongings, and events into an input form within the app, and this information is sent to the cloud server in real time.

[0860] Example: Teacher types, "Tomorrow's homework is math worksheets, and students should bring a compass and ruler."

[0861] 3. Server Means

[0862] The server receives the information entered by teachers and parents, stores it in a database, and then analyzes it to generate reminders and notifications as needed.

[0863] Example: A server stores homework and belongings information sent by teachers and sets reminders.

[0864] 4. Means of notification

[0865] The server generates reminders based on the saved information and sends notifications to the device when the reminder time arrives. The emotion engine can also change the content and tone of the notifications.

[0866] Example: Your device receives a notification that says, "You will need a compass and ruler for class tomorrow."

[0867] 5. Audio Processing Means

[0868] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server, through which the emotion engine performs emotion analysis.

[0869] Example: Child says, "What should I bring tomorrow?"

[0870] 6. Response methods

[0871] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and generates a response based on the emotional state analyzed by the emotion engine. The response is then conveyed to the child as voice.

[0872] Example: The device responds with a voice message saying, "Tomorrow, bring a compass and a ruler. You did a great job today!"

[0873] 7. GPS means

[0874] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time.

[0875] Example: Location information is sent when a child is on their way to cram school.

[0876] 8. Location information display means

[0877] Users (parents) can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[0878] Example: A parent uses an app to check where their child is.

[0879] 9. Emotion Engine

[0880] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of this emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses.

[0881] Example: If the emotion engine analyzes the emotions from a child's voice input and determines that the child is under stress, it will notify the child with a message such as "Take time to relax."

[0882] Specific examples

[0883] Scenario 1: Inventory Check and Emotional Feedback

[0884] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[0885] 2. The server stores the information and sets the reminder.

[0886] 3. At night, your child asks via voice command, "What should I bring to math class tomorrow?"

[0887] 4. The device converts the speech to text and sends the query to the server.

[0888] 5. The server obtains the information about the "compass and ruler," and the emotion engine generates a message that reflects the emotion, such as "You worked hard today!"

[0889] 6. The device will respond with a voice message saying, "Tomorrow, bring a compass and a ruler. You did a great job today!"

[0890] Scenario 2: Location and emotional support

[0891] 1. The child leaves home and activates the GPS function on the device on the way to cram school.

[0892] 2. The device periodically acquires GPS information and sends it to the server.

[0893] 3. The server continues to monitor the latest GPS information.

[0894] 4. The parent makes a request in the app to check where their child is.

[0895] 5. The server sends the latest GPS information to the device and displays it in map format.

[0896] 6. Furthermore, if the emotion engine detects that a child may be feeling stressed based on their behavioral patterns, it will notify the parents, saying, "Let's play together after cram school."

[0897] This system allows parents and teachers to communicate better with their children, allowing them to study and carry out daily activities without stress. Feedback from the emotion engine also contributes to maintaining children's mental health.

[0898] The processing flow will be explained below.

[0899] Program processing of inventory check and emotional feedback scenarios

[0900] Step 1:

[0901] The user (teacher) enters "Bring a compass and ruler to tomorrow's math class" into the app's input form.

[0902] Step 2:

[0903] The device converts this input into JSON format data and sends it to the server as an API request.

[0904] Step 3:

[0905] The server receives the API request and parses the input data into the required fields.

[0906] Step 4:

[0907] The server stores the parsed data in a database and returns a success message to the terminal.

[0908] Step 5:

[0909] In the evening, the user (child) asks via voice input, "What should I bring to math class tomorrow?"

[0910] Step 6:

[0911] The device converts the voice input into text using a speech recognition engine and sends this text to the server as a query.

[0912] Step 7:

[0913] The server parses the received query and retrieves the relevant information ("compass and ruler") from the database.

[0914] Step 8:

[0915] The server sends the acquired information to an emotion engine, which analyzes the child's emotions based on the user's past voice input and behavioral patterns.

[0916] Step 9:

[0917] The emotion engine generates appropriate feedback messages based on the analysis results.

[0918] Step 10:

[0919] The server sends a feedback message ("Tomorrow you will bring a compass and a ruler. You did well today!") to the device.

[0920] Step 11:

[0921] The device responds to the message it receives with a voice message saying, "Tomorrow, bring a compass and a ruler. You did well today!"

[0922] Programmatic processing of location-checking and emotional support scenarios

[0923] Step 1:

[0924] The user (child) leaves home and activates the GPS function on the device on the way to cram school.

[0925] Step 2:

[0926] The device periodically acquires GPS information (latitude, longitude), converts it into JSON format data, and sends it to the server.

[0927] Step 3:

[0928] The server analyzes the received GPS information and stores it in a database.

[0929] Step 4:

[0930] The server continuously monitors the latest GPS information and provides it immediately when a parent requests it.

[0931] Step 5:

[0932] The user (parent) makes a request in the app saying, "I want to check where my child is right now."

[0933] Step 6:

[0934] The device sends this request to the server.

[0935] Step 7:

[0936] The server retrieves the latest GPS information from the database and sends it to the device as JSON format data.

[0937] Step 8:

[0938] The device displays the received GPS information in map format, showing parents the child's location.

[0939] Step 9:

[0940] The server sends past behavioral patterns and current GPS data to an emotion engine to analyze the child's current emotions.

[0941] Step 10:

[0942] If the emotion engine determines based on the analysis results that a child is under stress, it generates a message to the parent such as, "Let's play together after cram school."

[0943] Step 11:

[0944] The server notifies the parent terminal of the generated message.

[0945] Step 12:

[0946] The device will notify the parent with a message saying, "Let's play together after cram school."

[0947] Through the above processing steps, users can efficiently manage their children's schedules, homework, and belongings, track their child's location in real time, and receive support based on their emotional state.

[0948] Example 2

[0949] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0950] Conventional schedule management systems process schedules and notifications uniformly without considering the user's emotional state, which can cause children to feel stressed or unable to properly understand the information. Another issue is that it is difficult for parents and teachers to grasp their children's current state. To support children's mental health and achieve more effective communication, a system incorporating emotion analysis is needed.

[0951] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0952] In this invention, the server includes means for saving and analyzing input information, means for generating and notifying reminders based on the saved information, emotion engine means for analyzing the user's emotions based on voice input and behavioral patterns, and means for customizing the content of notifications and reminders based on the analyzed emotional state. This enables schedule management and notifications adapted to the user's emotional state, reducing stress for children and enabling better communication with parents and teachers.

[0953] "Input means" refers to the means by which teachers input information such as homework and belongings.

[0954] "Server means" refers to means for storing and analyzing input information.

[0955] The "notification means" is a means for generating and notifying reminders based on the stored information.

[0956] The "voice processing means" is a means for a user to input voice and obtain target information.

[0957] The "response means" is a means for responding to the user with the acquired information.

[0958] "GPS means" refers to the means for obtaining GPS information from the device held by the child and sending it to the server.

[0959] "Location information display means" is a means for parents to check their child's location information through the app.

[0960] The "emotion engine means" is a means for analyzing the user's emotions based on voice input and behavioral patterns.

[0961] "Customization means" refers to means for customizing the content of notifications and reminders based on the analyzed emotional state.

[0962] This invention is a schedule management system for children that consists of a cloud-based server, a user terminal application, and an emotion engine. In addition to conventional schedule management functions, this system also enables responses that adapt to the user's emotional state.

[0963] System configuration

[0964] First, let's take a look at an overview of the system: Parents, children, and teachers each have their own individual accounts, and can enter and check information through an application that works with a cloud-based server.

[0965] Input Method

[0966] Users (teachers) enter homework, belongings, and event information into an input form within the app. This information is sent to a cloud server in real time. The hardware used is the teacher's PC or smartphone, and the software is a dedicated application.

[0967] example:

[0968] Type, "Tomorrow's homework is math worksheets, and bring a compass and ruler."

[0969] Server Means

[0970] The server receives information entered by users (teachers and parents) and stores it in a database. It then analyzes the information and generates reminders and notifications as needed. Specifically, it uses database software and analytical algorithms.

[0971] example:

[0972] The server stores homework and belongings information sent by teachers and sets reminders.

[0973] Notification means

[0974] The server generates a reminder based on the saved information when the specified time arrives and sends a notification to the device. The emotion engine can also change the content and tone of the notification. This is done using a cloud notification service and emotion analysis algorithm.

[0975] example:

[0976] Your device receives a notification that says, "You will need a compass and ruler for tomorrow's class."

[0977] Audio Processing Means

[0978] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server. The hardware used is the child's smartphone or tablet, and the software is a voice recognition application. The emotion engine performs emotion analysis based on this query.

[0979] example:

[0980] The child voice-inputs, "What should I bring tomorrow?"

[0981] Response methods

[0982] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and generates a response based on the emotional state analyzed by the emotion engine, which is then conveyed to the child as voice.

[0983] example:

[0984] The device will respond aloud, saying, "Tomorrow, bring a compass and a ruler. You did well today!"

[0985] GPS means

[0986] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time. The hardware used is the child's smartphone or GPS device, and the software is a location tracking application.

[0987] example:

[0988] Location information is sent on the child's way to cram school.

[0989] Location information display means

[0990] Users (parents) can check their child's location information through the app. The latest GPS information obtained from the server is displayed in map format. The hardware used is the parent's PC or smartphone, and the software is a location information display application.

[0991] example:

[0992] Parents can check where their children are using the app.

[0993] Emotion Engine Means

[0994] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of the emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses.

[0995] example:

[0996] The emotion engine analyzes the child's voice input and, if it determines that the child is under stress, it will notify the child with a message such as, "Take some time to relax."

[0997] Prompt Sentence Examples

[0998] "Please let me know so I can check what I need to bring tomorrow."

[0999] "Please tell me where your child is currently."

[1000] This system allows parents and teachers to communicate better with their children, allowing them to study and carry out daily activities without stress. Feedback from the emotion engine also contributes to maintaining children's mental health.

[1001] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1002] Step 1:

[1003] User (teacher) input

[1004] The user (teacher) enters homework, belongings, and event information into the application's input form. This information is sent to the cloud server in real time. Specifically, the teacher opens the app, enters the homework details and belongings list, and presses the "Send" button. Input: Homework and belongings information entered by the teacher. Output: Data sent to the cloud server.

[1005] Step 2:

[1006] Data storage and analysis by server

[1007] The server stores the received information in a database and performs analysis based on the stored information. This analysis includes generating reminders and notifications as needed. Specifically, the server uses database software to store the received information. It then generates notifications based on the reminder setting logic. Input: Data sent to the cloud server. Output: Information stored in the database and reminder settings.

[1008] Step 3:

[1009] Notification method operation

[1010] The server generates a reminder based on the stored information and sends a notification to the device when the reminder time arrives. The emotion engine can change the content and tone of the notification. Specifically, the server uses the notification API to create a reminder and send it to the child's device. Input: Reminder settings and emotion analysis results. Output: Notification sent to the child's device.

[1011] Step 4:

[1012] User (child) voice input and query transmission to the server

[1013] When the user (child) asks a question by voice, the device converts the voice into text and sends a query to the server. The emotion engine performs emotion analysis based on this query. Specifically, the child uses the voice input function to ask a question. The device converts the voice into text and sends it to the server. Input: Child's voice input. Output: Text query sent to the server.

[1014] Step 5:

[1015] Server response generation and notification

[1016] The server receives the query obtained by the voice processing means and retrieves the relevant information from the database. It generates an appropriate response based on the emotional state analyzed by the emotion engine and sends a voice notification to the device. Specifically, the server processes the query, extracts data, determines the emotional state using an emotion analysis algorithm, and generates an appropriate message to send to the device. Input: Text query sent to the server. Output: Response message sent to the child's device.

[1017] Step 6:

[1018] Acquiring GPS information and sending it to the server

[1019] GPS information is periodically sent from the device (child) to the server. Parents can track their child's location in real time. Specifically, the device obtains location information from the GPS sensor and periodically sends it to the server. Input: GPS information from the device. Output: GPS data sent to the server.

[1020] Step 7:

[1021] Parent location check

[1022] The user (parent) can check their child's location information through the app. The latest GPS information obtained from the server is displayed in map format. Specifically, the parent opens the app and sends a request to check their child's location information. The latest GPS information is obtained from the server and displayed in map format. Input: Parent's request to check location information. Output: Location information displayed in map format in the app.

[1023] Step 8:

[1024] Customize notifications with the emotion engine

[1025] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of this emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses. Specifically, the emotion engine analyzes text and voice data, determines the user's emotional state, and adjusts the tone and content of notifications. Input: Voice input, behavioral patterns, and past data. Output: Notifications and reminders customized based on emotions.

[1026] (Application example 2)

[1027] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1028] While conventional child schedule management systems could record schedules and provide reminders, they did not provide support that took into account the user's emotional state. As a result, children often felt stressed in their studies and daily lives, making it difficult to effectively manage their studies and lives. Furthermore, there were insufficient ways for parents to grasp their children's situations in real time, making it difficult to communicate appropriately with their children and with teachers.

[1029] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an input means for the teacher to input information such as homework and belongings; a server means for saving and analyzing the input information; a notification means for generating and notifying reminders based on the saved information; a voice processing means for the user to input voice information and acquire the target information; a response means for responding to the acquired information to the user; a GPS means for acquiring GPS information from the child's device and sending it to the server; a location information display means for the parent to check the child's location information through an app; an emotion analysis means for analyzing the user's emotions from the voice input and behavioral patterns using an emotion engine and generating individually customized feedback based on the analysis results; and a voice generation means for providing customized notifications and feedback by voice. This enables appropriate support that takes into account the child's emotional state, effectively managing learning and daily activities while reducing stress. Furthermore, parents can grasp their child's location information and situation in real time, promoting appropriate communication between parents and children.

[1030] "Input means" refers to a device or program that allows teachers to input information such as homework and belongings.

[1031] The "server means" is a device or program that receives and stores information sent from the input means, and further analyzes the information.

[1032] The "notification means" is a device or program that generates a reminder based on the information stored in the server means and notifies the user of the reminder on the terminal.

[1033] The "voice processing means" is a device or program that converts voice input by a user into text and analyzes the text.

[1034] The "response means" is a device or program that responds to the user based on the acquired information.

[1035] A "GPS means" is a device or program that transmits GPS information obtained from a device held by a child to a server.

[1036] "Location information display means" refers to a device or program that allows parents to check their child's location information through the app.

[1037] The "emotion analysis means" is a device or program that uses an emotion engine to analyze the user's emotions from voice input and behavioral patterns, and generates individually customized feedback based on the results.

[1038] A "voice generating means" is a device or program that provides customized notifications or feedback by voice.

[1039] This invention is a schedule management system for children, which includes a cloud-based server, a user terminal application, and an emotion engine. Specifically, teachers, parents, and children each have their own individual accounts, and input and confirm information through the application. The emotion engine also provides support based on the user's emotional state.

[1040] 1. System Overview

[1041] The overall system mainly consists of the following components:

[1042] Server means: Stores and analyzes information entered by teaching staff and parents.

[1043] Input Method: A device or program that allows teachers and parents to input homework and event information.

[1044] Notification method: Generates reminders based on saved information and notifies the device.

[1045] Voice processing means: When a child asks a question by voice input, the voice is analyzed.

[1046] Response method: A voice response will be provided based on the analyzed information.

[1047] GPS method: Location information is obtained from the child's device and sent to the server.

[1048] Location display method: Parents can check their child's location through the app.

[1049] Emotion analysis means: Analyzes user emotions from voice input, movement patterns, etc.

[1050] Voice generation means: Provides customized notifications and feedback via voice based on the results of sentiment analysis.

[1051] 2. Hardware and Software Used

[1052] Hardware: Using devices such as smartphones, tablets, and smart glasses.

[1053] software:

[1054] Web application framework: Flask

[1055] Cloud Service: Google Cloud TextToSpeech API

[1056] Speech Recognition Library: SpeechRecognition

[1057] 3. Processing Flow

[1058] Server Means

[1059] The server receives information entered by teachers and parents, stores this information in a database, and generates appropriate reminders and notifications based on the stored information.

[1060] Input Method

[1061] Users (teachers and parents) use smartphones or tablets to enter homework and event information, which is then sent to the server via the application.

[1062] Voice processing and response means

[1063] When a child asks a question by voice input, the voice processing means converts the voice into text and sends it to the server. The server retrieves the relevant information from the database and performs emotion analysis to generate appropriate feedback. The generated feedback is then returned to the child as a voice response.

[1064] GPS and location information display methods

[1065] GPS information is periodically sent from the child's device to a server, and parents can check their child's location in real time through the app.

[1066] Emotion analysis and speech generation

[1067] The server performs emotion analysis based on data such as voice input and behavioral patterns, and reflects the results in feedback and notifications. Customized feedback is provided by voice using a voice generation means.

[1068] 4. Examples of concrete examples and prompts

[1069] Specific Scenario 1

[1070] Teacher: Using the app, type "Bring your trigonometry textbook and notebook for tomorrow's math class."

[1071] Child: At night, ask using voice command, "What should I bring tomorrow?"

[1072] Device: Provides verbal feedback such as, "Tomorrow, bring your textbook and notebook. You worked hard today!"

[1073] Prompt Sentence Examples

[1074] Voice prompts for questions

[1075] "What do you need to bring to math class tomorrow?"

[1076] "What's the homework for tomorrow?"

[1077] Feedback prompts based on sentiment analysis

[1078] "It seems like you've been stressful today. Let's take some time to relax."

[1079] "Great work today! Great job!"

[1080] In this way, appropriate support can be provided based on a child's emotional state, enabling them to effectively manage their studies and daily activities while reducing stress. In addition, parents can track their child's location and situation in real time, promoting appropriate communication between parents and children.

[1081] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1082] Step 1:

[1083] Users (teachers and parents) use a smartphone or tablet to enter homework and event information and send it through the application's input means. The entered information is sent to the server and saved. The input to the input means is text-based homework content and belongings information. The output is information saved in the server's database.

[1084] Step 2:

[1085] The server analyzes the input information and generates a reminder based on the saved data. This reminder is automatically set based on the date and time of the event. Specifically, the server analyzes the input text information, extracts the date, time, and content of the event, and generates the reminder setting information. The output is the set reminder information.

[1086] Step 3:

[1087] A notification is sent to the user's device based on the information of the reminder for which the notification method has been set. The content of the notification is sent in the format of "XX is required for tomorrow's class" according to the reminder's set time. The output is a notification message that is displayed on the user's device.

[1088] Step 4:

[1089] A child asks a question using voice input. A voice processing means converts this voice input into text and sends the text data to a server. Specifically, a voice recognition library (e.g., SpeechRecognition) is used to convert the voice data into text data. The input is the voice data of the question as voice input, and the output is the text data sent to the server.

[1090] Step 5:

[1091] The server executes a query based on the text data obtained from the voice input and retrieves the required information from the database. The retrieved information is passed to an emotion analysis means, which analyzes the user's emotional state. This analysis uses the tone of the voice and past behavioral patterns. The output is the result of the emotion analysis and the information retrieved from the database.

[1092] Step 6:

[1093] The emotion analysis means generates individually customized feedback based on the analysis results and passes the feedback to the voice generation means. The voice generation means converts the text of the feedback into voice and sends it to the user's device. Specifically, the Google Cloud TextToSpeech API is used. The input is the analyzed emotional state and text data, and the output is voice data.

[1094] Step 7:

[1095] GPS information is periodically acquired from the child's device and sent to a server. The server monitors this GPS information in real time and stores it in a database. The input is the periodically transmitted GPS data, and the output is the location information data stored on the server.

[1096] Step 8:

[1097] Parents request their child's location information through the app and view it in real time on a map using the location information display means. The server obtains the latest GPS information and displays it as map data on the parent's device. The input is the parent's request and the GPS information stored on the server, and the output is the location information displayed in map format.

[1098] These processing steps enable the system to provide appropriate support that takes into account the user's emotional state, effectively managing learning and daily activities while reducing stress. Furthermore, parents can track their child's location and situation in real time, promoting appropriate communication between them.

[1099] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1100] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1101] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1102] [Third embodiment]

[1103] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1104] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1105] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1106] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1107] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1108] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1109] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1110] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1111] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1112] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1113] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1114] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1115] This invention provides a schedule management system for children, with the aim of enabling parents, children, and teachers to work together to efficiently manage schedules and tasks. This system realizes information sharing and management between parents, children, and teachers through the following components: input means, server means, notification means, voice processing means, response means, GPS means, and location information display means.

[1116] 1. System Overview

[1117] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts, and can enter and check information through the application.

[1118] 2. Input Method

[1119] Users (teachers) enter information about homework, belongings, and events into an input form within the app, and this information is sent to the cloud server in real time.

[1120] Example: Teacher types, "Tomorrow's homework is math worksheets, and students should bring a compass and ruler."

[1121] 3. Server Means

[1122] The server receives the information entered by teachers and parents, stores it in a database, and then analyzes it to generate reminders and notifications as needed.

[1123] Example: A server stores homework and belongings information sent by teachers and sets reminders.

[1124] 4. Means of notification

[1125] The server generates reminders based on the stored information and sends notifications to the device when the reminder time arrives.

[1126] Example: Your device receives a notification that says, "You will need a compass and ruler for class tomorrow."

[1127] 5. Audio Processing Means

[1128] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server, allowing the child to easily obtain information.

[1129] Example: Child says, "What should I bring tomorrow?"

[1130] 6. Response methods

[1131] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and returns the response to the device. The response is then conveyed to the child as voice.

[1132] Example: The device responds by saying, "Tomorrow, bring a compass and a ruler."

[1133] 7. GPS means

[1134] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time.

[1135] Example: Location information is sent when a child is on their way to cram school.

[1136] 8. Location information display means

[1137] Users (parents) can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[1138] Example: A parent uses an app to check where their child is.

[1139] Specific examples

[1140] Scenario 1: Check your belongings

[1141] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[1142] 2. The server stores the information and sets the reminder.

[1143] 3. At night, your child asks via voice command, "What should I bring to math class tomorrow?"

[1144] 4. The device converts the speech to text and sends the query to the server.

[1145] 5. The server obtains the information about "compass and ruler" and returns it to the device.

[1146] 6. The device will respond with a voice saying, "Tomorrow, bring a compass and a ruler."

[1147] Scenario 2: Location Check

[1148] 1. GPS information is sent periodically as the child leaves home and heads to cram school.

[1149] 2. Parents can check their child's location in real time on their device.

[1150] 3. Parents can check through the app whether their children are in a safe place.

[1151] As described above, this system streamlines information sharing and management between parents, children, and teachers, reducing the burden on families. This allows children to manage their many schedules and tasks without stress, and parents can watch over their children's growth with peace of mind.

[1152] The processing flow will be explained below.

[1153] Program processing of belongings check scenario

[1154] Step 1:

[1155] The user (teacher) enters "Bring a compass and ruler to tomorrow's math class" into the app's input form.

[1156] Step 2:

[1157] The device converts this input into JSON format data and sends it to the server as an API request.

[1158] Step 3:

[1159] The server receives the API request and parses the input data into the required fields.

[1160] Step 4:

[1161] The server stores the parsed data in a database and returns a success message to the terminal.

[1162] Step 5:

[1163] In the evening, the user (child) asks via voice input, "What should I bring to math class tomorrow?"

[1164] Step 6:

[1165] The device converts the voice input into text using a speech recognition engine and sends this text to the server as a query.

[1166] Step 7:

[1167] The server parses the received query and retrieves the relevant information ("compass and ruler") from the database.

[1168] Step 8:

[1169] The server sends the acquired information to the terminal as a JSON format response.

[1170] Step 9:

[1171] The device receives the response and replies in voice, "Tomorrow, bring a compass and a ruler."

[1172] Step 10:

[1173] The next morning, the device will send a notification to the user based on the set reminder time, saying, "You will need a compass and ruler for tomorrow's class."

[1174] Location verification scenario program processing

[1175] Step 1:

[1176] The user (child) leaves home and activates the GPS function on the device on the way to cram school.

[1177] Step 2:

[1178] The device periodically acquires GPS information (latitude, longitude), converts it into JSON format data, and sends it to the server.

[1179] Step 3:

[1180] The server analyzes the received GPS information and stores it in a database.

[1181] Step 4:

[1182] The server continuously monitors the latest GPS information and provides it immediately when a parent requests it.

[1183] Step 5:

[1184] The user (parent) makes a request in the app saying, "I want to check where my child is right now."

[1185] Step 6:

[1186] The device sends this request to the server.

[1187] Step 7:

[1188] The server retrieves the latest GPS information from the database and sends it to the device as JSON format data.

[1189] Step 8:

[1190] The device displays the received GPS information in map format, showing parents the child's location.

[1191] Step 9:

[1192] The user (parent) looks at the map on the app to check their child's current location and the route they have taken.

[1193] Through the above processing steps, the user can efficiently manage their child's schedule, homework, and belongings, and can keep track of their child's location information in real time.

[1194] Example 1

[1195] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1196] In modern families, managing children's schedules and learning tasks is important, but the burden falls on parents and teachers. In particular, there is a need for systems that can monitor children's learning and behavior in real time and provide appropriate support. However, conventional systems lack the ability to share information in real time or easily obtain information via voice, making it difficult to effectively manage children's learning while reducing the burden on parents and teachers and encouraging their independence. In addition, there are challenges in obtaining and displaying location information in real time and with accuracy.

[1197] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1198] In this invention, the server includes an input means for teachers to input information such as homework and belongings, a server means for saving and analyzing the input information, a notification means for generating and notifying reminders based on the saved information, a voice processing means for converting voice input by the user into text, a response means for retrieving target information from the server based on the converted text data and responding to the user in voice, a GPS means for acquiring location data from the child's device and transmitting it to the server, and a location information display means for parents to check their child's location information through the app. This allows parents, teachers, and children to share information in real time, enabling quick and intuitive schedule management, task management, and location information confirmation. Furthermore, obtaining information via voice makes the system easy for children to use and independently check their schedules.

[1199] "Input means" refers to a device or mechanism that allows teachers to input information such as homework and belongings.

[1200] "Server means" refers to a computer and its program for storing and analyzing input information.

[1201] A "notification means" is a mechanism or device that generates a reminder based on the stored information and sends a notification to the terminal.

[1202] A "speech processing means" is a device or software for converting a user's speech input into text.

[1203] The "response means" is a mechanism or device that obtains the target information from the server based on the converted text data and responds to the user in the form of voice.

[1204] "GPS means" refers to technology or devices that acquire location data from a child's device and transmit it to a server.

[1205] "Location information display means" refers to a mechanism or device that allows parents to check their child's location information through an app.

[1206] "User account authentication" refers to the technology and methods used to verify the user accounts of parents, teachers, and children and to authenticate that they are legitimate users.

[1207] "Schedule management" refers to the mechanism or means for saving and managing schedule information entered by the user.

[1208] "Task management" refers to the mechanisms and means for saving and managing task information entered by users.

[1209] This invention provides a schedule management system for children, with the aim of enabling parents, children, and teachers to work together to efficiently manage schedules and tasks. This system realizes information sharing and management between parents, children, and teachers through the following components: input means, server means, notification means, voice processing means, response means, GPS means, and location information display means.

[1210] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts, and can enter and check information through the application.

[1211] Input Method

[1212] The user (teacher) enters homework, belongings, and event information into an input form within the app. This information is sent to the cloud server in real time. Specifically, the teacher launches the smartphone app, goes to the schedule tab, and enters the homework as "math worksheets" and the belongings as "compass and ruler."

[1213] Server Means

[1214] The server receives the information sent from the device and stores it in a database (for example, MySQL or MongoDB). It then analyzes this information and generates reminders and notifications as needed. The server's API endpoint receives the data and stores it in the database. The server also runs scheduled jobs (such as Cron jobs) to check what items students need to bring to class the next day and set reminders.

[1215] Notification means

[1216] The server generates a reminder based on the saved information and sends a notification to the device when the reminder time arrives. This process uses FCM (Firebase Cloud Messaging) and other services. The device receives the push notification and displays the message "You will need a compass and ruler for tomorrow's class."

[1217] Voice processing and response means

[1218] When the user (child) asks a question by voice, the device converts the voice into text using the Google Cloud Speech-to-Text API or similar and sends the query to the server. The server receives the query obtained by the voice processing means, retrieves the relevant information from a database, and responds to the device. The response is communicated to the child as voice. The device uses the Google Cloud Text-to-Speech API to play back the message, "Tomorrow's belongings are a compass and a ruler."

[1219] GPS and location information display methods

[1220] The device (child) periodically sends GPS information to the server, allowing parents to track their child's location in real time. The GPS data is sent using the device's native API (e.g., Android's LocationManager). Parents can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format using the Google Maps API or similar.

[1221] Specific examples

[1222] Scenario 1: Check your belongings

[1223] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[1224] 2. The server stores the information and sets the reminder.

[1225] 3. At night, the child asks aloud, "What should I bring to math class tomorrow?"

[1226] 4. The device converts the voice data into text and sends the query to the server.

[1227] 5. The server retrieves the necessary information from the database and generates a response.

[1228] 6. The device receives the response and plays back the following: "Tomorrow, bring a compass and a ruler."

[1229] Scenario 2: Location Check

[1230] 1. While a child is on their way to cram school, their GPS information is periodically sent to a server.

[1231] 2. The server stores the acquired GPS information.

[1232] 3. The parent launches the app and checks their child's location.

[1233] 4. The child's current location is displayed on a map in real time on the parent's device.

[1234] As described above, this system streamlines information sharing and management between parents, children, and teachers, reducing the burden on families. This allows children to manage their many schedules and tasks without stress, and parents can watch over their children's growth with peace of mind.

[1235] Prompt Sentence Examples

[1236] - "Please explain how the schedule information entered by the teacher is sent to the server, saved, and notified."

[1237] - "When your child asks a verbal question, please explain in detail the process of how you verbally respond to that question."

[1238] - "Please explain how parents can check their children's location in real time."

[1239] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1240] Step 1:

[1241] The user (teacher) launches the smartphone app, moves to the schedule tab, and enters homework and belongings information. The entered data is in text format: "Homework: Math worksheets, Items: Compass and ruler." After entering the data, the user confirms it and presses the send button. The device generates an HTTP POST request with the entered data and sends it to the server's API endpoint.

[1242] Step 2:

[1243] The server receives the HTTP POST request and extracts the data in the request body. It then saves the information entered by the teacher ("Homework: Math worksheet, Items to bring: Compass and ruler") in a database such as MySQL or MongoDB. After saving the information in the database, it returns a successful save response to the device.

[1244] Step 3:

[1245] The server runs a scheduled job (Cron job) to analyze the saved data, check the schedule for the next day, and generate a reminder such as "You will need a compass and ruler for tomorrow's class." Based on the reminder time, the server prepares to push this reminder information to the device.

[1246] Step 4:

[1247] The server uses Firebase Cloud Messaging (FCM) to send a reminder to the user's device. Specifically, it generates a push notification message stating, "You will need a compass and ruler for tomorrow's class," and sends it to the child's device via the FCM server.

[1248] Step 5:

[1249] The device receives the push notification and displays a message to the user saying, "You will need a compass and ruler for tomorrow's class." Specifically, the app updates the notification icon and displays the reminder details as a pop-up message.

[1250] Step 6:

[1251] The user (child) asks a question by voice input. Specifically, they activate the voice assistant function in the app and say, "What should I bring tomorrow?" This voice data is collected by the device.

[1252] Step 7:

[1253] The device converts the collected voice data into text data using the Google Cloud Speech-to-Text API. The converted text, "What will you bring tomorrow?", is generated. Based on this text data, an HTTP request is generated and sent to send a query to the server.

[1254] Step 8:

[1255] The server receives the HTTP request and analyzes the text data query, "What should I bring tomorrow?". It searches the database for the relevant information and retrieves the "math worksheet, compass, and ruler" information. It then stores the retrieved information as text data and generates a response.

[1256] Step 9:

[1257] The server generates a response and sends it to the device. For example, the response may contain text data such as "Tomorrow's items are a compass and a ruler." After receiving the response, the device prepares to respond by voice.

[1258] Step 10:

[1259] The device converts the received text data into audio data using the Google Cloud Text-to-Speech API. This audio data is then played back and the user (child) is told, "Tomorrow's items are a compass and a ruler." Specifically, the audio is played back through the device's speaker.

[1260] Step 11:

[1261] The device (child) periodically obtains GPS information and sends it to the server. Specifically, it obtains the current location data using LocationManager and sends it to the server's API endpoint via an HTTP POST request.

[1262] Step 12:

[1263] The server receives the GPS information and stores it in a database, where it can be provided to the parent's device in real time upon request.

[1264] Step 13:

[1265] Parents can send a request to check their child's location through the app. Specifically, they open the map display function in the app and press a button to request their child's current location. This request is sent to the server.

[1266] Step 14:

[1267] The server receives the parent's request, retrieves the latest GPS information from the database, formats the location information into data for display on a map using the Google Maps API, and sends it to the parent's device.

[1268] Step 15:

[1269] The parent's device uses the Google Maps API to display the received location information on a map. Specifically, the child's current location is displayed in real time on the map display area within the app.

[1270] Based on the above process, this system enables smooth information sharing and management, reducing the burden on the household and allowing children to manage their numerous schedules and tasks without stress. It also allows parents to watch their children grow with peace of mind.

[1271] (Application example 1)

[1272] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1273] Current child schedule management systems require a lot of time and effort to input and check information, placing a heavy burden on parents and teachers. Furthermore, they lack the ability to track children's location, making it difficult to respond quickly in emergencies. This makes it difficult for parents to effectively monitor their children.

[1274] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1275] In this invention, the server includes: an input unit for teachers to input information such as homework and belongings; a server unit for saving and analyzing the input information; a notification unit for generating and notifying reminders based on the saved information; a voice processing unit for users to input voice information and acquire the target information; a response unit for responding to the acquired information to the user; a GPS unit for acquiring GPS information from the child's device and sending it to the server; a location information display unit for parents to check the child's location information through an app; a voice assistant unit for users to ask questions about belongings and schedules by voice and for the server to respond to those questions; an emergency notification unit for displaying real-time location information on the parent's device and sending alerts in the event of an emergency; and a unit for parents to track the child's location using smart glasses or a head-mounted display. This reduces the burden on parents and teachers while enabling a quick response in emergencies.

[1276] "Input means" refers to the means by which teachers input information such as homework and belongings.

[1277] "Server means" refers to means for storing and analyzing input information.

[1278] The "notification means" is a means for generating and notifying reminders based on the stored information.

[1279] The "voice processing means" is a means for a user to input voice and obtain target information.

[1280] The "response means" is a means for responding to the user with the acquired information.

[1281] "GPS means" refers to the means for obtaining GPS information from the device held by the child and sending it to the server.

[1282] "Location information display means" is a means for parents to check their child's location information through the app.

[1283] A "voice assistant" is a means by which a user can ask questions about their belongings or schedule by voice, and a server can respond to those questions.

[1284] The "emergency notification means" is a means for displaying real-time location information on the parent's device and sending an alert in the event of an emergency.

[1285] "Smart glasses or head-mounted displays" are devices that allow parents to track their children's locations.

[1286] The present invention relates to a schedule management system for children, and aims to enable parents, children, and teachers to work together to efficiently manage schedules and tasks. This system is realized by combining several important means.

[1287] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts and can enter and check information through the application.

[1288] Generating a Program

[1289] The system is realized with the following program structure:

[1290] 1. Input method: Teachers enter information such as homework, belongings, and school events into an input form within the app. This information is sent to the cloud server in real time.

[1291] 2. Server means: The server receives the information entered by teachers, parents, and children, stores it in a database, and performs analysis based on this information to generate reminders and notifications as needed.

[1292] 3. Notification method: The server generates a reminder based on the stored information and sends a notification to the device when the reminder time arrives.

[1293] 4. Voice processing means: When a child asks a question by voice, the device converts the voice into text and sends the query to the server, allowing the child to easily obtain information.

[1294] 5. Response means: The server receives the query obtained by the voice processing means, retrieves the relevant information from the database, and responds to the device. The response is conveyed to the child as voice.

[1295] 6. GPS: The child's device will periodically send GPS information to the server, allowing parents to track their child's location in real time.

[1296] 7. Location information display: Parents can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[1297] 8. Voice assistant: When a child asks about their belongings or schedule by voice, the server responds with the relevant information.

[1298] 9. Emergency notification: Displays real-time location information on the parent's device and sends alerts in the event of an emergency.

[1299] 10. Smart glasses or head-mounted displays: These devices allow parents to track their children's location in real time and ensure their safety.

[1300] About program processing

[1301] Hardware and software used:

[1302] Server: Flask (a Python web framework)

[1303] Database: SQL or NoSQL database

[1304] Devices: smartphones, smart glasses, head-mounted displays

[1305] Speech processing: Speech recognition API (e.g. Google Speech-to-Text)

[1306] Location information processing: GPS module and map API (e.g. Google Maps API)

[1307] Data processing and calculation:

[1308] Adding schedule information: The server receives the information entered by the teacher and stores it in the database.

[1309] Obtaining schedule information: The server analyzes the information asked by the child via voice and responds with the relevant schedule.

[1310] Location information update: The server receives and stores GPS information sent from the child's device.

[1311] Emergency notification generation: When the set reference time is exceeded, the server automatically generates a notification and sends it to the parent device.

[1312] Specific examples

[1313] 1. Examples of belongings checks:

[1314] A child asks via voice command, "What should I bring to math class tomorrow?"

[1315] The server retrieves the information "compass and ruler" from the database and returns it to the terminal.

[1316] The device will respond aloud, "Tomorrow's items to bring are a compass and a ruler."

[1317] 2. Examples of location verification:

[1318] GPS information is sent periodically from the time the child leaves home to the time they are on their way to cram school.

[1319] Parents can check their children's location in real time through smart glasses and ensure their safety.

[1320] 3. Example prompt:

[1321] In your Kids Safeguard app,

[1322] 1. Easily manage your child's schedule and belongings.

[1323] 2. When you ask the voice assistant, "What should I bring tomorrow?", the app will automatically provide an answer from its database.

[1324] 3. Parents can check their children's current location in real time through smart glasses to ensure their safety.

[1325] Based on this, consider how your AI might respond to the following specific scenarios:

[1326] "If a child takes a detour on the way home from school, the parent can use the app to pinpoint their location and direct them back to a safe route."

[1327] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1328] Step 1:

[1329] User (teacher) enters information

[1330] Input: The teacher enters information such as homework and belongings into the input format.

[1331] Specific operation: The teacher enters homework, belongings, event information, etc. in text format into the application's input form.

[1332] Data processing: The server receives the entered information and stores it in a database.

[1333] Output: The entered information is saved in the database.

[1334] Step 2:

[1335] The server analyzes the information and sets reminders

[1336] Input: Information stored in a database.

[1337] What it does: The server periodically scans the stored information and analyzes it for information that requires reminders.

[1338] Data processing: Based on the stored information, a reminder is generated and a notification is sent at the set time.

[1339] Output: A reminder is generated and ready to be notified.

[1340] Step 3:

[1341] Your device will receive a reminder and notify you

[1342] Input: Reminders sent from the server.

[1343] Specific operation: When the reminder time arrives, the server sends a reminder to the user's terminal.

[1344] Data processing: The device displays the reminder as a notification, which includes the reminder content.

[1345] Output: A notification will be displayed on the terminal to inform the user.

[1346] Step 4:

[1347] Children can ask questions by voice input

[1348] Input: The child types in a question by voice.

[1349] Specific actions: The child asks a question to the device verbally, such as "What should I bring tomorrow?"

[1350] Data processing: The terminal's speech processing means converts the speech into text and sends the query to the server.

[1351] Output: The speech is converted to text and the query is sent to the server.

[1352] Step 5:

[1353] The server analyzes the query and generates a response

[1354] Input: Text questions submitted by the child.

[1355] Specific operation: The server receives the query and queries the database to obtain the relevant information.

[1356] Data processing: Converting the acquired information into a format for response.

[1357] Output: The server sends a response to the device.

[1358] Step 6:

[1359] The device will speak the response

[1360] Input: The response sent by the server.

[1361] What happens: The device converts the text response into speech and reads it to the user.

[1362] Data processing: Text to speech conversion.

[1363] Output: The response is spoken to the user.

[1364] Step 7:

[1365] GPS information collection and transmission

[1366] Input: GPS information from the child's device.

[1367] Specific operation: The device collects GPS information at specified intervals and sends it to the server.

[1368] Data processing: GPS data is received on the server side and stored in a database.

[1369] Output: The latest location information is saved on the server.

[1370] Step 8:

[1371] Parents check location information

[1372] Input: Child's location.

[1373] Specific actions: Parent opens the app and checks their child's location.

[1374] Data processing: Obtain location information from the server and display it on the app's map.

[1375] Output: The child's location is displayed on the parent's device in map format.

[1376] Step 9:

[1377] Use as a voice assistant

[1378] Input: Child's spoken question.

[1379] Specific action: The child asks aloud questions about belongings and schedules.

[1380] Data processing: The speech processing means converts the speech into text, and the server generates a response.

[1381] Output: The device will speak the response.

[1382] Step 10:

[1383] Use of emergency notification methods

[1384] Input: Emergency alert conditions.

[1385] Specific operation: When the set conditions are met, the server sends an alert to the parent device.

[1386] Data Processing: Alert generation and sending.

[1387] Output: An emergency notification will be displayed on the parent's device.

[1388] Step 11:

[1389] Location tracking with smart glasses or head-mounted displays

[1390] Input: Child's latest location.

[1391] How it works: Parents wear smart glasses or a head-mounted display that displays their child's location in real time.

[1392] Data processing: Real-time display of location information.

[1393] Output: Parent visually confirms child's location.

[1394] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1395] This invention combines an emotion engine with a schedule management system for children to provide additional support based on user emotion recognition. This system includes input means, server means, notification means, voice processing means, response means, GPS means, location information display means, and the emotion engine. This enables the system to respond adaptively to the user's emotional state in addition to conventional schedule management functions.

[1396] 1. System Overview

[1397] The entire system consists of a cloud-based server, a user terminal application, and an emotion engine. Users (parents, children, and teachers) each have their own separate accounts and can input and check information through the application. The system also recognizes the user's emotional state from voice input and behavioral patterns and provides appropriate notifications and feedback.

[1398] 2. Input Method

[1399] Users (teachers) enter information about homework, belongings, and events into an input form within the app, and this information is sent to the cloud server in real time.

[1400] Example: Teacher types, "Tomorrow's homework is math worksheets, and students should bring a compass and ruler."

[1401] 3. Server Means

[1402] The server receives the information entered by teachers and parents, stores it in a database, and then analyzes it to generate reminders and notifications as needed.

[1403] Example: A server stores homework and belongings information sent by teachers and sets reminders.

[1404] 4. Means of notification

[1405] The server generates reminders based on the saved information and sends notifications to the device when the reminder time arrives. The emotion engine can also change the content and tone of the notifications.

[1406] Example: Your device receives a notification that says, "You will need a compass and ruler for class tomorrow."

[1407] 5. Audio Processing Means

[1408] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server, through which the emotion engine performs emotion analysis.

[1409] Example: Child says, "What should I bring tomorrow?"

[1410] 6. Response methods

[1411] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and generates a response based on the emotional state analyzed by the emotion engine. The response is then conveyed to the child as voice.

[1412] Example: The device responds with a voice message saying, "Tomorrow, bring a compass and a ruler. You did a great job today!"

[1413] 7. GPS means

[1414] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time.

[1415] Example: Location information is sent when a child is on their way to cram school.

[1416] 8. Location information display means

[1417] Users (parents) can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[1418] Example: A parent uses an app to check where their child is.

[1419] 9. Emotion Engine

[1420] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of this emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses.

[1421] Example: If the emotion engine analyzes the emotions from a child's voice input and determines that the child is under stress, it will notify the child with a message such as "Take time to relax."

[1422] Specific examples

[1423] Scenario 1: Inventory Check and Emotional Feedback

[1424] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[1425] 2. The server stores the information and sets the reminder.

[1426] 3. At night, your child asks via voice command, "What should I bring to math class tomorrow?"

[1427] 4. The device converts the speech to text and sends the query to the server.

[1428] 5. The server obtains the information about the "compass and ruler," and the emotion engine generates a message that reflects the emotion, such as "You worked hard today!"

[1429] 6. The device will respond with a voice message saying, "Tomorrow, bring a compass and a ruler. You did a great job today!"

[1430] Scenario 2: Location and emotional support

[1431] 1. The child leaves home and activates the GPS function on the device on the way to cram school.

[1432] 2. The device periodically acquires GPS information and sends it to the server.

[1433] 3. The server continues to monitor the latest GPS information.

[1434] 4. The parent makes a request in the app to check where their child is.

[1435] 5. The server sends the latest GPS information to the device and displays it in map format.

[1436] 6. Furthermore, if the emotion engine detects that a child may be feeling stressed based on their behavioral patterns, it will notify the parents, saying, "Let's play together after cram school."

[1437] This system allows parents and teachers to communicate better with their children, allowing them to study and carry out daily activities without stress. Feedback from the emotion engine also contributes to maintaining children's mental health.

[1438] The processing flow will be explained below.

[1439] Program processing of inventory check and emotional feedback scenarios

[1440] Step 1:

[1441] The user (teacher) enters "Bring a compass and ruler to tomorrow's math class" into the app's input form.

[1442] Step 2:

[1443] The device converts this input into JSON format data and sends it to the server as an API request.

[1444] Step 3:

[1445] The server receives the API request and parses the input data into the required fields.

[1446] Step 4:

[1447] The server stores the parsed data in a database and returns a success message to the terminal.

[1448] Step 5:

[1449] In the evening, the user (child) asks via voice input, "What should I bring to math class tomorrow?"

[1450] Step 6:

[1451] The device converts the voice input into text using a speech recognition engine and sends this text to the server as a query.

[1452] Step 7:

[1453] The server parses the received query and retrieves the relevant information ("compass and ruler") from the database.

[1454] Step 8:

[1455] The server sends the acquired information to an emotion engine, which analyzes the child's emotions based on the user's past voice input and behavioral patterns.

[1456] Step 9:

[1457] The emotion engine generates appropriate feedback messages based on the analysis results.

[1458] Step 10:

[1459] The server sends a feedback message ("Tomorrow you will bring a compass and a ruler. You did well today!") to the device.

[1460] Step 11:

[1461] The device responds to the message it receives with a voice message saying, "Tomorrow, bring a compass and a ruler. You did well today!"

[1462] Programmatic processing of location-checking and emotional support scenarios

[1463] Step 1:

[1464] The user (child) leaves home and activates the GPS function on the device on the way to cram school.

[1465] Step 2:

[1466] The device periodically acquires GPS information (latitude, longitude), converts it into JSON format data, and sends it to the server.

[1467] Step 3:

[1468] The server analyzes the received GPS information and stores it in a database.

[1469] Step 4:

[1470] The server continuously monitors the latest GPS information and provides it immediately when a parent requests it.

[1471] Step 5:

[1472] The user (parent) makes a request in the app saying, "I want to check where my child is right now."

[1473] Step 6:

[1474] The device sends this request to the server.

[1475] Step 7:

[1476] The server retrieves the latest GPS information from the database and sends it to the device as JSON format data.

[1477] Step 8:

[1478] The device displays the received GPS information in map format, showing parents the child's location.

[1479] Step 9:

[1480] The server sends past behavioral patterns and current GPS data to an emotion engine to analyze the child's current emotions.

[1481] Step 10:

[1482] If the emotion engine determines based on the analysis results that a child is under stress, it generates a message to the parent such as, "Let's play together after cram school."

[1483] Step 11:

[1484] The server notifies the parent terminal of the generated message.

[1485] Step 12:

[1486] The device will notify the parent with a message saying, "Let's play together after cram school."

[1487] Through the above processing steps, users can efficiently manage their children's schedules, homework, and belongings, track their child's location in real time, and receive support based on their emotional state.

[1488] Example 2

[1489] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1490] Conventional schedule management systems process schedules and notifications uniformly without considering the user's emotional state, which can cause children to feel stressed or unable to properly understand the information. Another issue is that it is difficult for parents and teachers to grasp their children's current state. To support children's mental health and achieve more effective communication, a system incorporating emotion analysis is needed.

[1491] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1492] In this invention, the server includes means for saving and analyzing input information, means for generating and notifying reminders based on the saved information, emotion engine means for analyzing the user's emotions based on voice input and behavioral patterns, and means for customizing the content of notifications and reminders based on the analyzed emotional state. This enables schedule management and notifications adapted to the user's emotional state, reducing stress for children and enabling better communication with parents and teachers.

[1493] "Input means" refers to the means by which teachers input information such as homework and belongings.

[1494] "Server means" refers to means for storing and analyzing input information.

[1495] The "notification means" is a means for generating and notifying reminders based on the stored information.

[1496] The "voice processing means" is a means for a user to input voice and obtain target information.

[1497] The "response means" is a means for responding to the user with the acquired information.

[1498] "GPS means" refers to the means for obtaining GPS information from the device held by the child and sending it to the server.

[1499] "Location information display means" is a means for parents to check their child's location information through the app.

[1500] The "emotion engine means" is a means for analyzing the user's emotions based on voice input and behavioral patterns.

[1501] "Customization means" refers to means for customizing the content of notifications and reminders based on the analyzed emotional state.

[1502] This invention is a schedule management system for children that consists of a cloud-based server, a user terminal application, and an emotion engine. In addition to conventional schedule management functions, this system also enables responses that adapt to the user's emotional state.

[1503] System configuration

[1504] First, let's take a look at an overview of the system: Parents, children, and teachers each have their own individual accounts, and can enter and check information through an application that works with a cloud-based server.

[1505] Input Method

[1506] Users (teachers) enter homework, belongings, and event information into an input form within the app. This information is sent to a cloud server in real time. The hardware used is the teacher's PC or smartphone, and the software is a dedicated application.

[1507] example:

[1508] Type, "Tomorrow's homework is math worksheets, and bring a compass and ruler."

[1509] Server Means

[1510] The server receives information entered by users (teachers and parents) and stores it in a database. It then analyzes the information and generates reminders and notifications as needed. Specifically, it uses database software and analytical algorithms.

[1511] example:

[1512] The server stores homework and belongings information sent by teachers and sets reminders.

[1513] Notification means

[1514] The server generates a reminder based on the saved information when the specified time arrives and sends a notification to the device. The emotion engine can also change the content and tone of the notification. This is done using a cloud notification service and emotion analysis algorithm.

[1515] example:

[1516] Your device receives a notification that says, "You will need a compass and ruler for tomorrow's class."

[1517] Audio Processing Means

[1518] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server. The hardware used is the child's smartphone or tablet, and the software is a voice recognition application. The emotion engine performs emotion analysis based on this query.

[1519] example:

[1520] The child voice-inputs, "What should I bring tomorrow?"

[1521] Response methods

[1522] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and generates a response based on the emotional state analyzed by the emotion engine, which is then conveyed to the child as voice.

[1523] example:

[1524] The device will respond aloud, saying, "Tomorrow, bring a compass and a ruler. You did well today!"

[1525] GPS means

[1526] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time. The hardware used is the child's smartphone or GPS device, and the software is a location tracking application.

[1527] example:

[1528] Location information is sent on the child's way to cram school.

[1529] Location information display means

[1530] Users (parents) can check their child's location information through the app. The latest GPS information obtained from the server is displayed in map format. The hardware used is the parent's PC or smartphone, and the software is a location information display application.

[1531] example:

[1532] Parents can check where their children are using the app.

[1533] Emotion Engine Means

[1534] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of the emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses.

[1535] example:

[1536] The emotion engine analyzes the child's voice input and, if it determines that the child is under stress, it will notify the child with a message such as, "Take some time to relax."

[1537] Prompt Sentence Examples

[1538] "Please let me know so I can check what I need to bring tomorrow."

[1539] "Please tell me where your child is currently."

[1540] This system allows parents and teachers to communicate better with their children, allowing them to study and carry out daily activities without stress. Feedback from the emotion engine also contributes to maintaining children's mental health.

[1541] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1542] Step 1:

[1543] User (teacher) input

[1544] The user (teacher) enters homework, belongings, and event information into the application's input form. This information is sent to the cloud server in real time. Specifically, the teacher opens the app, enters the homework details and belongings list, and presses the "Send" button. Input: Homework and belongings information entered by the teacher. Output: Data sent to the cloud server.

[1545] Step 2:

[1546] Data storage and analysis by server

[1547] The server stores the received information in a database and performs analysis based on the stored information. This analysis includes generating reminders and notifications as needed. Specifically, the server uses database software to store the received information. It then generates notifications based on the reminder setting logic. Input: Data sent to the cloud server. Output: Information stored in the database and reminder settings.

[1548] Step 3:

[1549] Notification method operation

[1550] The server generates a reminder based on the stored information and sends a notification to the device when the reminder time arrives. The emotion engine can change the content and tone of the notification. Specifically, the server uses the notification API to create a reminder and send it to the child's device. Input: Reminder settings and emotion analysis results. Output: Notification sent to the child's device.

[1551] Step 4:

[1552] User (child) voice input and query transmission to the server

[1553] When the user (child) asks a question by voice, the device converts the voice into text and sends a query to the server. The emotion engine performs emotion analysis based on this query. Specifically, the child uses the voice input function to ask a question. The device converts the voice into text and sends it to the server. Input: Child's voice input. Output: Text query sent to the server.

[1554] Step 5:

[1555] Server response generation and notification

[1556] The server receives the query obtained by the voice processing means and retrieves the relevant information from the database. It generates an appropriate response based on the emotional state analyzed by the emotion engine and sends a voice notification to the device. Specifically, the server processes the query, extracts data, determines the emotional state using an emotion analysis algorithm, and generates an appropriate message to send to the device. Input: Text query sent to the server. Output: Response message sent to the child's device.

[1557] Step 6:

[1558] Acquiring GPS information and sending it to the server

[1559] GPS information is periodically sent from the device (child) to the server. Parents can track their child's location in real time. Specifically, the device obtains location information from the GPS sensor and periodically sends it to the server. Input: GPS information from the device. Output: GPS data sent to the server.

[1560] Step 7:

[1561] Parent location check

[1562] The user (parent) can check their child's location information through the app. The latest GPS information obtained from the server is displayed in map format. Specifically, the parent opens the app and sends a request to check their child's location information. The latest GPS information is obtained from the server and displayed in map format. Input: Parent's request to check location information. Output: Location information displayed in map format in the app.

[1563] Step 8:

[1564] Customize notifications with the emotion engine

[1565] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of this emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses. Specifically, the emotion engine analyzes text and voice data, determines the user's emotional state, and adjusts the tone and content of notifications. Input: Voice input, behavioral patterns, and past data. Output: Notifications and reminders customized based on emotions.

[1566] (Application example 2)

[1567] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1568] While conventional child schedule management systems could record schedules and provide reminders, they did not provide support that took into account the user's emotional state. As a result, children often felt stressed in their studies and daily lives, making it difficult to effectively manage their studies and lives. Furthermore, there were insufficient ways for parents to grasp their children's situations in real time, making it difficult to communicate appropriately with their children and with teachers.

[1569] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an input means for the teacher to input information such as homework and belongings; a server means for saving and analyzing the input information; a notification means for generating and notifying reminders based on the saved information; a voice processing means for the user to input voice information and acquire the target information; a response means for responding to the acquired information to the user; a GPS means for acquiring GPS information from the child's device and sending it to the server; a location information display means for the parent to check the child's location information through an app; an emotion analysis means for analyzing the user's emotions from the voice input and behavioral patterns using an emotion engine and generating individually customized feedback based on the analysis results; and a voice generation means for providing customized notifications and feedback by voice. This enables appropriate support that takes into account the child's emotional state, effectively managing learning and daily activities while reducing stress. Furthermore, parents can grasp their child's location information and situation in real time, promoting appropriate communication between parents and children.

[1570] "Input means" refers to a device or program that allows teachers to input information such as homework and belongings.

[1571] The "server means" is a device or program that receives and stores information sent from the input means, and further analyzes the information.

[1572] The "notification means" is a device or program that generates a reminder based on the information stored in the server means and notifies the user of the reminder on the terminal.

[1573] The "voice processing means" is a device or program that converts voice input by a user into text and analyzes the text.

[1574] The "response means" is a device or program that responds to the user based on the acquired information.

[1575] A "GPS means" is a device or program that transmits GPS information obtained from a device held by a child to a server.

[1576] "Location information display means" refers to a device or program that allows parents to check their child's location information through the app.

[1577] The "emotion analysis means" is a device or program that uses an emotion engine to analyze the user's emotions from voice input and behavioral patterns, and generates individually customized feedback based on the results.

[1578] A "voice generating means" is a device or program that provides customized notifications or feedback by voice.

[1579] This invention is a schedule management system for children, which includes a cloud-based server, a user terminal application, and an emotion engine. Specifically, teachers, parents, and children each have their own individual accounts, and input and confirm information through the application. The emotion engine also provides support based on the user's emotional state.

[1580] 1. System Overview

[1581] The overall system mainly consists of the following components:

[1582] Server means: Stores and analyzes information entered by teaching staff and parents.

[1583] Input Method: A device or program that allows teachers and parents to input homework and event information.

[1584] Notification method: Generates reminders based on saved information and notifies the device.

[1585] Voice processing means: When a child asks a question by voice input, the voice is analyzed.

[1586] Response method: A voice response will be provided based on the analyzed information.

[1587] GPS method: Location information is obtained from the child's device and sent to the server.

[1588] Location display method: Parents can check their child's location through the app.

[1589] Emotion analysis means: Analyzes user emotions from voice input, movement patterns, etc.

[1590] Voice generation means: Provides customized notifications and feedback via voice based on the results of sentiment analysis.

[1591] 2. Hardware and Software Used

[1592] Hardware: Using devices such as smartphones, tablets, and smart glasses.

[1593] software:

[1594] Web application framework: Flask

[1595] Cloud Service: Google Cloud TextToSpeech API

[1596] Speech Recognition Library: SpeechRecognition

[1597] 3. Processing Flow

[1598] Server Means

[1599] The server receives information entered by teachers and parents, stores this information in a database, and generates appropriate reminders and notifications based on the stored information.

[1600] Input Method

[1601] Users (teachers and parents) use smartphones or tablets to enter homework and event information, which is then sent to the server via the application.

[1602] Voice processing and response means

[1603] When a child asks a question by voice input, the voice processing means converts the voice into text and sends it to the server. The server retrieves the relevant information from the database and performs emotion analysis to generate appropriate feedback. The generated feedback is then returned to the child as a voice response.

[1604] GPS and location information display methods

[1605] GPS information is periodically sent from the child's device to a server, and parents can check their child's location in real time through the app.

[1606] Emotion analysis and speech generation

[1607] The server performs emotion analysis based on data such as voice input and behavioral patterns, and reflects the results in feedback and notifications. Customized feedback is provided by voice using a voice generation means.

[1608] 4. Examples of concrete examples and prompts

[1609] Specific Scenario 1

[1610] Teacher: Using the app, type "Bring your trigonometry textbook and notebook for tomorrow's math class."

[1611] Child: At night, ask using voice command, "What should I bring tomorrow?"

[1612] Device: Provides verbal feedback such as, "Tomorrow, bring your textbook and notebook. You worked hard today!"

[1613] Prompt Sentence Examples

[1614] Voice prompts for questions

[1615] "What do you need to bring to math class tomorrow?"

[1616] "What's the homework for tomorrow?"

[1617] Feedback prompts based on sentiment analysis

[1618] "It seems like you've been stressful today. Let's take some time to relax."

[1619] "Great work today! Great job!"

[1620] In this way, appropriate support can be provided based on a child's emotional state, enabling them to effectively manage their studies and daily activities while reducing stress. In addition, parents can track their child's location and situation in real time, promoting appropriate communication between parents and children.

[1621] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1622] Step 1:

[1623] Users (teachers and parents) use a smartphone or tablet to enter homework and event information and send it through the application's input means. The entered information is sent to the server and saved. The input to the input means is text-based homework content and belongings information. The output is information saved in the server's database.

[1624] Step 2:

[1625] The server analyzes the input information and generates a reminder based on the saved data. This reminder is automatically set based on the date and time of the event. Specifically, the server analyzes the input text information, extracts the date, time, and content of the event, and generates the reminder setting information. The output is the set reminder information.

[1626] Step 3:

[1627] A notification is sent to the user's device based on the information of the reminder for which the notification method has been set. The content of the notification is sent in the format of "XX is required for tomorrow's class" according to the reminder's set time. The output is a notification message that is displayed on the user's device.

[1628] Step 4:

[1629] A child asks a question using voice input. A voice processing means converts this voice input into text and sends the text data to a server. Specifically, a voice recognition library (e.g., SpeechRecognition) is used to convert the voice data into text data. The input is the voice data of the question as voice input, and the output is the text data sent to the server.

[1630] Step 5:

[1631] The server executes a query based on the text data obtained from the voice input and retrieves the required information from the database. The retrieved information is passed to an emotion analysis means, which analyzes the user's emotional state. This analysis uses the tone of the voice and past behavioral patterns. The output is the result of the emotion analysis and the information retrieved from the database.

[1632] Step 6:

[1633] The emotion analysis means generates individually customized feedback based on the analysis results and passes the feedback to the voice generation means. The voice generation means converts the text of the feedback into voice and sends it to the user's device. Specifically, the Google Cloud TextToSpeech API is used. The input is the analyzed emotional state and text data, and the output is voice data.

[1634] Step 7:

[1635] GPS information is periodically acquired from the child's device and sent to a server. The server monitors this GPS information in real time and stores it in a database. The input is the periodically transmitted GPS data, and the output is the location information data stored on the server.

[1636] Step 8:

[1637] Parents request their child's location information through the app and view it in real time on a map using the location information display means. The server obtains the latest GPS information and displays it as map data on the parent's device. The input is the parent's request and the GPS information stored on the server, and the output is the location information displayed in map format.

[1638] These processing steps enable the system to provide appropriate support that takes into account the user's emotional state, effectively managing learning and daily activities while reducing stress. Furthermore, parents can track their child's location and situation in real time, promoting appropriate communication between them.

[1639] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1640] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1641] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1642] [Fourth embodiment]

[1643] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1644] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1645] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1646] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1647] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1648] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1649] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1650] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1651] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1652] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1653] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1654] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1655] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1656] This invention provides a schedule management system for children, with the aim of enabling parents, children, and teachers to work together to efficiently manage schedules and tasks. This system realizes information sharing and management between parents, children, and teachers through the following components: input means, server means, notification means, voice processing means, response means, GPS means, and location information display means.

[1657] 1. System Overview

[1658] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts, and can enter and check information through the application.

[1659] 2. Input Method

[1660] Users (teachers) enter information about homework, belongings, and events into an input form within the app, and this information is sent to the cloud server in real time.

[1661] Example: Teacher types, "Tomorrow's homework is math worksheets, and students should bring a compass and ruler."

[1662] 3. Server Means

[1663] The server receives the information entered by teachers and parents, stores it in a database, and then analyzes it to generate reminders and notifications as needed.

[1664] Example: A server stores homework and belongings information sent by teachers and sets reminders.

[1665] 4. Means of notification

[1666] The server generates reminders based on the stored information and sends notifications to the device when the reminder time arrives.

[1667] Example: Your device receives a notification that says, "You will need a compass and ruler for class tomorrow."

[1668] 5. Audio Processing Means

[1669] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server, allowing the child to easily obtain information.

[1670] Example: Child says, "What should I bring tomorrow?"

[1671] 6. Response methods

[1672] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and returns the response to the device. The response is then conveyed to the child as voice.

[1673] Example: The device responds by saying, "Tomorrow, bring a compass and a ruler."

[1674] 7. GPS means

[1675] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time.

[1676] Example: Location information is sent when a child is on their way to cram school.

[1677] 8. Location information display means

[1678] Users (parents) can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[1679] Example: A parent uses an app to check where their child is.

[1680] Specific examples

[1681] Scenario 1: Check your belongings

[1682] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[1683] 2. The server stores the information and sets the reminder.

[1684] 3. At night, your child asks via voice command, "What should I bring to math class tomorrow?"

[1685] 4. The device converts the speech to text and sends the query to the server.

[1686] 5. The server obtains the information about "compass and ruler" and returns it to the device.

[1687] 6. The device will respond with a voice saying, "Tomorrow, bring a compass and a ruler."

[1688] Scenario 2: Location Check

[1689] 1. GPS information is sent periodically as the child leaves home and heads to cram school.

[1690] 2. Parents can check their child's location in real time on their device.

[1691] 3. Parents can check through the app whether their children are in a safe place.

[1692] As described above, this system streamlines information sharing and management between parents, children, and teachers, reducing the burden on families. This allows children to manage their many schedules and tasks without stress, and parents can watch over their children's growth with peace of mind.

[1693] The processing flow will be explained below.

[1694] Program processing of belongings check scenario

[1695] Step 1:

[1696] The user (teacher) enters "Bring a compass and ruler to tomorrow's math class" into the app's input form.

[1697] Step 2:

[1698] The device converts this input into JSON format data and sends it to the server as an API request.

[1699] Step 3:

[1700] The server receives the API request and parses the input data into the required fields.

[1701] Step 4:

[1702] The server stores the parsed data in a database and returns a success message to the terminal.

[1703] Step 5:

[1704] In the evening, the user (child) asks via voice input, "What should I bring to math class tomorrow?"

[1705] Step 6:

[1706] The device converts the voice input into text using a speech recognition engine and sends this text to the server as a query.

[1707] Step 7:

[1708] The server parses the received query and retrieves the relevant information ("compass and ruler") from the database.

[1709] Step 8:

[1710] The server sends the acquired information to the terminal as a JSON format response.

[1711] Step 9:

[1712] The device receives the response and replies in voice, "Tomorrow, bring a compass and a ruler."

[1713] Step 10:

[1714] The next morning, the device will send a notification to the user based on the set reminder time, saying, "You will need a compass and ruler for tomorrow's class."

[1715] Location verification scenario program processing

[1716] Step 1:

[1717] The user (child) leaves home and activates the GPS function on the device on the way to cram school.

[1718] Step 2:

[1719] The device periodically acquires GPS information (latitude, longitude), converts it into JSON format data, and sends it to the server.

[1720] Step 3:

[1721] The server analyzes the received GPS information and stores it in a database.

[1722] Step 4:

[1723] The server continuously monitors the latest GPS information and provides it immediately when a parent requests it.

[1724] Step 5:

[1725] The user (parent) makes a request in the app saying, "I want to check where my child is right now."

[1726] Step 6:

[1727] The device sends this request to the server.

[1728] Step 7:

[1729] The server retrieves the latest GPS information from the database and sends it to the device as JSON format data.

[1730] Step 8:

[1731] The device displays the received GPS information in map format, showing parents the child's location.

[1732] Step 9:

[1733] The user (parent) looks at the map on the app to check their child's current location and the route they have taken.

[1734] Through the above processing steps, the user can efficiently manage their child's schedule, homework, and belongings, and can keep track of their child's location information in real time.

[1735] Example 1

[1736] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1737] In modern families, managing children's schedules and learning tasks is important, but the burden falls on parents and teachers. In particular, there is a need for systems that can monitor children's learning and behavior in real time and provide appropriate support. However, conventional systems lack the ability to share information in real time or easily obtain information via voice, making it difficult to effectively manage children's learning while reducing the burden on parents and teachers and encouraging their independence. In addition, there are challenges in obtaining and displaying location information in real time and with accuracy.

[1738] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1739] In this invention, the server includes an input means for teachers to input information such as homework and belongings, a server means for saving and analyzing the input information, a notification means for generating and notifying reminders based on the saved information, a voice processing means for converting voice input by the user into text, a response means for retrieving target information from the server based on the converted text data and responding to the user in voice, a GPS means for acquiring location data from the child's device and transmitting it to the server, and a location information display means for parents to check their child's location information through the app. This allows parents, teachers, and children to share information in real time, enabling quick and intuitive schedule management, task management, and location information confirmation. Furthermore, obtaining information via voice makes the system easy for children to use and independently check their schedules.

[1740] "Input means" refers to a device or mechanism that allows teachers to input information such as homework and belongings.

[1741] "Server means" refers to a computer and its program for storing and analyzing input information.

[1742] A "notification means" is a mechanism or device that generates a reminder based on the stored information and sends a notification to the terminal.

[1743] A "speech processing means" is a device or software for converting a user's speech input into text.

[1744] The "response means" is a mechanism or device that obtains the target information from the server based on the converted text data and responds to the user in the form of voice.

[1745] "GPS means" refers to technology or devices that acquire location data from a child's device and transmit it to a server.

[1746] "Location information display means" refers to a mechanism or device that allows parents to check their child's location information through an app.

[1747] "User account authentication" refers to the technology and methods used to verify the user accounts of parents, teachers, and children and to authenticate that they are legitimate users.

[1748] "Schedule management" refers to the mechanism or means for saving and managing schedule information entered by the user.

[1749] "Task management" refers to the mechanisms and means for saving and managing task information entered by users.

[1750] This invention provides a schedule management system for children, with the aim of enabling parents, children, and teachers to work together to efficiently manage schedules and tasks. This system realizes information sharing and management between parents, children, and teachers through the following components: input means, server means, notification means, voice processing means, response means, GPS means, and location information display means.

[1751] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts, and can enter and check information through the application.

[1752] Input Method

[1753] The user (teacher) enters homework, belongings, and event information into an input form within the app. This information is sent to the cloud server in real time. Specifically, the teacher launches the smartphone app, goes to the schedule tab, and enters the homework as "math worksheets" and the belongings as "compass and ruler."

[1754] Server Means

[1755] The server receives the information sent from the device and stores it in a database (for example, MySQL or MongoDB). It then analyzes this information and generates reminders and notifications as needed. The server's API endpoint receives the data and stores it in the database. The server also runs scheduled jobs (such as Cron jobs) to check what items students need to bring to class the next day and set reminders.

[1756] Notification means

[1757] The server generates a reminder based on the saved information and sends a notification to the device when the reminder time arrives. This process uses FCM (Firebase Cloud Messaging) and other services. The device receives the push notification and displays the message "You will need a compass and ruler for tomorrow's class."

[1758] Voice processing and response means

[1759] When the user (child) asks a question by voice, the device converts the voice into text using the Google Cloud Speech-to-Text API or similar and sends the query to the server. The server receives the query obtained by the voice processing means, retrieves the relevant information from a database, and responds to the device. The response is communicated to the child as voice. The device uses the Google Cloud Text-to-Speech API to play back the message, "Tomorrow's belongings are a compass and a ruler."

[1760] GPS and location information display methods

[1761] The device (child) periodically sends GPS information to the server, allowing parents to track their child's location in real time. The GPS data is sent using the device's native API (e.g., Android's LocationManager). Parents can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format using the Google Maps API or similar.

[1762] Specific examples

[1763] Scenario 1: Check your belongings

[1764] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[1765] 2. The server stores the information and sets the reminder.

[1766] 3. At night, the child asks aloud, "What should I bring to math class tomorrow?"

[1767] 4. The device converts the voice data into text and sends the query to the server.

[1768] 5. The server retrieves the necessary information from the database and generates a response.

[1769] 6. The device receives the response and plays back the following: "Tomorrow, bring a compass and a ruler."

[1770] Scenario 2: Location Check

[1771] 1. While a child is on their way to cram school, their GPS information is periodically sent to a server.

[1772] 2. The server stores the acquired GPS information.

[1773] 3. The parent launches the app and checks their child's location.

[1774] 4. The child's current location is displayed on a map in real time on the parent's device.

[1775] As described above, this system streamlines information sharing and management between parents, children, and teachers, reducing the burden on families. This allows children to manage their many schedules and tasks without stress, and parents can watch over their children's growth with peace of mind.

[1776] Prompt Sentence Examples

[1777] - "Please explain how the schedule information entered by the teacher is sent to the server, saved, and notified."

[1778] - "When your child asks a verbal question, please explain in detail the process of how you verbally respond to that question."

[1779] - "Please explain how parents can check their children's location in real time."

[1780] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1781] Step 1:

[1782] The user (teacher) launches the smartphone app, moves to the schedule tab, and enters homework and belongings information. The entered data is in text format: "Homework: Math worksheets, Items: Compass and ruler." After entering the data, the user confirms it and presses the send button. The device generates an HTTP POST request with the entered data and sends it to the server's API endpoint.

[1783] Step 2:

[1784] The server receives the HTTP POST request and extracts the data in the request body. It then saves the information entered by the teacher ("Homework: Math worksheet, Items to bring: Compass and ruler") in a database such as MySQL or MongoDB. After saving the information in the database, it returns a successful save response to the device.

[1785] Step 3:

[1786] The server runs a scheduled job (Cron job) to analyze the saved data, check the schedule for the next day, and generate a reminder such as "You will need a compass and ruler for tomorrow's class." Based on the reminder time, the server prepares to push this reminder information to the device.

[1787] Step 4:

[1788] The server uses Firebase Cloud Messaging (FCM) to send a reminder to the user's device. Specifically, it generates a push notification message stating, "You will need a compass and ruler for tomorrow's class," and sends it to the child's device via the FCM server.

[1789] Step 5:

[1790] The device receives the push notification and displays a message to the user saying, "You will need a compass and ruler for tomorrow's class." Specifically, the app updates the notification icon and displays the reminder details as a pop-up message.

[1791] Step 6:

[1792] The user (child) asks a question by voice input. Specifically, they activate the voice assistant function in the app and say, "What should I bring tomorrow?" This voice data is collected by the device.

[1793] Step 7:

[1794] The device converts the collected voice data into text data using the Google Cloud Speech-to-Text API. The converted text, "What will you bring tomorrow?", is generated. Based on this text data, an HTTP request is generated and sent to send a query to the server.

[1795] Step 8:

[1796] The server receives the HTTP request and analyzes the text data query, "What should I bring tomorrow?". It searches the database for the relevant information and retrieves the "math worksheet, compass, and ruler" information. It then stores the retrieved information as text data and generates a response.

[1797] Step 9:

[1798] The server generates a response and sends it to the device. For example, the response may contain text data such as "Tomorrow's items are a compass and a ruler." After receiving the response, the device prepares to respond by voice.

[1799] Step 10:

[1800] The device converts the received text data into audio data using the Google Cloud Text-to-Speech API. This audio data is then played back and the user (child) is told, "Tomorrow's items are a compass and a ruler." Specifically, the audio is played back through the device's speaker.

[1801] Step 11:

[1802] The device (child) periodically obtains GPS information and sends it to the server. Specifically, it obtains the current location data using LocationManager and sends it to the server's API endpoint via an HTTP POST request.

[1803] Step 12:

[1804] The server receives the GPS information and stores it in a database, where it can be provided to the parent's device in real time upon request.

[1805] Step 13:

[1806] Parents can send a request to check their child's location through the app. Specifically, they open the map display function in the app and press a button to request their child's current location. This request is sent to the server.

[1807] Step 14:

[1808] The server receives the parent's request, retrieves the latest GPS information from the database, formats the location information into data for display on a map using the Google Maps API, and sends it to the parent's device.

[1809] Step 15:

[1810] The parent's device uses the Google Maps API to display the received location information on a map. Specifically, the child's current location is displayed in real time on the map display area within the app.

[1811] Based on the above process, this system enables smooth information sharing and management, reducing the burden on the household and allowing children to manage their numerous schedules and tasks without stress. It also allows parents to watch their children grow with peace of mind.

[1812] (Application example 1)

[1813] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1814] Current child schedule management systems require a lot of time and effort to input and check information, placing a heavy burden on parents and teachers. Furthermore, they lack the ability to track children's location, making it difficult to respond quickly in emergencies. This makes it difficult for parents to effectively monitor their children.

[1815] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1816] In this invention, the server includes: an input unit for teachers to input information such as homework and belongings; a server unit for saving and analyzing the input information; a notification unit for generating and notifying reminders based on the saved information; a voice processing unit for users to input voice information and acquire the target information; a response unit for responding to the acquired information to the user; a GPS unit for acquiring GPS information from the child's device and sending it to the server; a location information display unit for parents to check the child's location information through an app; a voice assistant unit for users to ask questions about belongings and schedules by voice and for the server to respond to those questions; an emergency notification unit for displaying real-time location information on the parent's device and sending alerts in the event of an emergency; and a unit for parents to track the child's location using smart glasses or a head-mounted display. This reduces the burden on parents and teachers while enabling a quick response in emergencies.

[1817] "Input means" refers to the means by which teachers input information such as homework and belongings.

[1818] "Server means" refers to means for storing and analyzing input information.

[1819] The "notification means" is a means for generating and notifying reminders based on the stored information.

[1820] The "voice processing means" is a means for a user to input voice and obtain target information.

[1821] The "response means" is a means for responding to the user with the acquired information.

[1822] "GPS means" refers to the means for obtaining GPS information from the device held by the child and sending it to the server.

[1823] "Location information display means" is a means for parents to check their child's location information through the app.

[1824] A "voice assistant" is a means by which a user can ask questions about their belongings or schedule by voice, and a server can respond to those questions.

[1825] The "emergency notification means" is a means for displaying real-time location information on the parent's device and sending an alert in the event of an emergency.

[1826] "Smart glasses or head-mounted displays" are devices that allow parents to track their children's locations.

[1827] The present invention relates to a schedule management system for children, and aims to enable parents, children, and teachers to work together to efficiently manage schedules and tasks. This system is realized by combining several important means.

[1828] The entire system consists of a cloud-based server and a user terminal application. Parents, children, and teachers each have their own individual accounts and can enter and check information through the application.

[1829] Generating a Program

[1830] The system is realized with the following program structure:

[1831] 1. Input method: Teachers enter information such as homework, belongings, and school events into an input form within the app. This information is sent to the cloud server in real time.

[1832] 2. Server means: The server receives the information entered by teachers, parents, and children, stores it in a database, and performs analysis based on this information to generate reminders and notifications as needed.

[1833] 3. Notification method: The server generates a reminder based on the stored information and sends a notification to the device when the reminder time arrives.

[1834] 4. Voice processing means: When a child asks a question by voice, the device converts the voice into text and sends the query to the server, allowing the child to easily obtain information.

[1835] 5. Response means: The server receives the query obtained by the voice processing means, retrieves the relevant information from the database, and responds to the device. The response is conveyed to the child as voice.

[1836] 6. GPS: The child's device will periodically send GPS information to the server, allowing parents to track their child's location in real time.

[1837] 7. Location information display: Parents can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[1838] 8. Voice assistant: When a child asks about their belongings or schedule by voice, the server responds with the relevant information.

[1839] 9. Emergency notification: Displays real-time location information on the parent's device and sends alerts in the event of an emergency.

[1840] 10. Smart glasses or head-mounted displays: These devices allow parents to track their children's location in real time and ensure their safety.

[1841] About program processing

[1842] Hardware and software used:

[1843] Server: Flask (a Python web framework)

[1844] Database: SQL or NoSQL database

[1845] Devices: smartphones, smart glasses, head-mounted displays

[1846] Speech processing: Speech recognition API (e.g. Google Speech-to-Text)

[1847] Location information processing: GPS module and map API (e.g. Google Maps API)

[1848] Data processing and calculation:

[1849] Adding schedule information: The server receives the information entered by the teacher and stores it in the database.

[1850] Obtaining schedule information: The server analyzes the information asked by the child via voice and responds with the relevant schedule.

[1851] Location information update: The server receives and stores GPS information sent from the child's device.

[1852] Emergency notification generation: When the set reference time is exceeded, the server automatically generates a notification and sends it to the parent device.

[1853] Specific examples

[1854] 1. Examples of belongings checks:

[1855] A child asks via voice command, "What should I bring to math class tomorrow?"

[1856] The server retrieves the information "compass and ruler" from the database and returns it to the terminal.

[1857] The device will respond aloud, "Tomorrow's items to bring are a compass and a ruler."

[1858] 2. Examples of location verification:

[1859] GPS information is sent periodically from the time the child leaves home to the time they are on their way to cram school.

[1860] Parents can check their children's location in real time through smart glasses and ensure their safety.

[1861] 3. Example prompt:

[1862] In your Kids Safeguard app,

[1863] 1. Easily manage your child's schedule and belongings.

[1864] 2. When you ask the voice assistant, "What should I bring tomorrow?", the app will automatically provide an answer from its database.

[1865] 3. Parents can check their children's current location in real time through smart glasses to ensure their safety.

[1866] Based on this, consider how your AI might respond to the following specific scenarios:

[1867] "If a child takes a detour on the way home from school, the parent can use the app to pinpoint their location and direct them back to a safe route."

[1868] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1869] Step 1:

[1870] User (teacher) enters information

[1871] Input: The teacher enters information such as homework and belongings into the input format.

[1872] Specific operation: The teacher enters homework, belongings, event information, etc. in text format into the application's input form.

[1873] Data processing: The server receives the entered information and stores it in a database.

[1874] Output: The entered information is saved in the database.

[1875] Step 2:

[1876] The server analyzes the information and sets reminders

[1877] Input: Information stored in a database.

[1878] What it does: The server periodically scans the stored information and analyzes it for information that requires reminders.

[1879] Data processing: Based on the stored information, a reminder is generated and a notification is sent at the set time.

[1880] Output: A reminder is generated and ready to be notified.

[1881] Step 3:

[1882] Your device will receive a reminder and notify you

[1883] Input: Reminders sent from the server.

[1884] Specific operation: When the reminder time arrives, the server sends a reminder to the user's terminal.

[1885] Data processing: The device displays the reminder as a notification, which includes the reminder content.

[1886] Output: A notification will be displayed on the terminal to inform the user.

[1887] Step 4:

[1888] Children can ask questions by voice input

[1889] Input: The child types in a question by voice.

[1890] Specific actions: The child asks a question to the device verbally, such as "What should I bring tomorrow?"

[1891] Data processing: The terminal's speech processing means converts the speech into text and sends the query to the server.

[1892] Output: The speech is converted to text and the query is sent to the server.

[1893] Step 5:

[1894] The server analyzes the query and generates a response

[1895] Input: Text questions submitted by the child.

[1896] Specific operation: The server receives the query and queries the database to obtain the relevant information.

[1897] Data processing: Converting the acquired information into a format for response.

[1898] Output: The server sends a response to the device.

[1899] Step 6:

[1900] The device will speak the response

[1901] Input: The response sent by the server.

[1902] What happens: The device converts the text response into speech and reads it to the user.

[1903] Data processing: Text to speech conversion.

[1904] Output: The response is spoken to the user.

[1905] Step 7:

[1906] GPS information collection and transmission

[1907] Input: GPS information from the child's device.

[1908] Specific operation: The device collects GPS information at specified intervals and sends it to the server.

[1909] Data processing: GPS data is received on the server side and stored in a database.

[1910] Output: The latest location information is saved on the server.

[1911] Step 8:

[1912] Parents check location information

[1913] Input: Child's location.

[1914] Specific actions: Parent opens the app and checks their child's location.

[1915] Data processing: Obtain location information from the server and display it on the app's map.

[1916] Output: The child's location is displayed on the parent's device in map format.

[1917] Step 9:

[1918] Use as a voice assistant

[1919] Input: Child's spoken question.

[1920] Specific action: The child asks aloud questions about belongings and schedules.

[1921] Data processing: The speech processing means converts the speech into text, and the server generates a response.

[1922] Output: The device will speak the response.

[1923] Step 10:

[1924] Use of emergency notification methods

[1925] Input: Emergency alert conditions.

[1926] Specific operation: When the set conditions are met, the server sends an alert to the parent device.

[1927] Data Processing: Alert generation and sending.

[1928] Output: An emergency notification will be displayed on the parent's device.

[1929] Step 11:

[1930] Location tracking with smart glasses or head-mounted displays

[1931] Input: Child's latest location.

[1932] How it works: Parents wear smart glasses or a head-mounted display that displays their child's location in real time.

[1933] Data processing: Real-time display of location information.

[1934] Output: Parent visually confirms child's location.

[1935] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1936] This invention combines an emotion engine with a schedule management system for children to provide additional support based on user emotion recognition. This system includes input means, server means, notification means, voice processing means, response means, GPS means, location information display means, and the emotion engine. This enables the system to respond adaptively to the user's emotional state in addition to conventional schedule management functions.

[1937] 1. System Overview

[1938] The entire system consists of a cloud-based server, a user terminal application, and an emotion engine. Users (parents, children, and teachers) each have their own separate accounts and can input and check information through the application. The system also recognizes the user's emotional state from voice input and behavioral patterns and provides appropriate notifications and feedback.

[1939] 2. Input Method

[1940] Users (teachers) enter information about homework, belongings, and events into an input form within the app, and this information is sent to the cloud server in real time.

[1941] Example: Teacher types, "Tomorrow's homework is math worksheets, and students should bring a compass and ruler."

[1942] 3. Server Means

[1943] The server receives the information entered by teachers and parents, stores it in a database, and then analyzes it to generate reminders and notifications as needed.

[1944] Example: A server stores homework and belongings information sent by teachers and sets reminders.

[1945] 4. Means of notification

[1946] The server generates reminders based on the saved information and sends notifications to the device when the reminder time arrives. The emotion engine can also change the content and tone of the notifications.

[1947] Example: Your device receives a notification that says, "You will need a compass and ruler for class tomorrow."

[1948] 5. Audio Processing Means

[1949] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server, through which the emotion engine performs emotion analysis.

[1950] Example: Child says, "What should I bring tomorrow?"

[1951] 6. Response methods

[1952] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and generates a response based on the emotional state analyzed by the emotion engine. The response is then conveyed to the child as voice.

[1953] Example: The device responds with a voice message saying, "Tomorrow, bring a compass and a ruler. You did a great job today!"

[1954] 7. GPS means

[1955] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time.

[1956] Example: Location information is sent when a child is on their way to cram school.

[1957] 8. Location information display means

[1958] Users (parents) can check their child's location through the app. The latest GPS information obtained from the server is displayed in map format.

[1959] Example: A parent uses an app to check where their child is.

[1960] 9. Emotion Engine

[1961] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of this emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses.

[1962] Example: If the emotion engine analyzes the emotions from a child's voice input and determines that the child is under stress, it will notify the child with a message such as "Take time to relax."

[1963] Specific examples

[1964] Scenario 1: Inventory Check and Emotional Feedback

[1965] 1. The teacher enters into the app, "Bring a compass and ruler to math class tomorrow."

[1966] 2. The server stores the information and sets the reminder.

[1967] 3. At night, your child asks via voice command, "What should I bring to math class tomorrow?"

[1968] 4. The device converts the speech to text and sends the query to the server.

[1969] 5. The server obtains the information about the "compass and ruler," and the emotion engine generates a message that reflects the emotion, such as "You worked hard today!"

[1970] 6. The device will respond with a voice message saying, "Tomorrow, bring a compass and a ruler. You did a great job today!"

[1971] Scenario 2: Location and emotional support

[1972] 1. The child leaves home and activates the GPS function on the device on the way to cram school.

[1973] 2. The device periodically acquires GPS information and sends it to the server.

[1974] 3. The server continues to monitor the latest GPS information.

[1975] 4. The parent makes a request in the app to check where their child is.

[1976] 5. The server sends the latest GPS information to the device and displays it in map format.

[1977] 6. Furthermore, if the emotion engine detects that a child may be feeling stressed based on their behavioral patterns, it will notify the parents, saying, "Let's play together after cram school."

[1978] This system allows parents and teachers to communicate better with their children, allowing them to study and carry out daily activities without stress. Feedback from the emotion engine also contributes to maintaining children's mental health.

[1979] The processing flow will be explained below.

[1980] Program processing of inventory check and emotional feedback scenarios

[1981] Step 1:

[1982] The user (teacher) enters "Bring a compass and ruler to tomorrow's math class" into the app's input form.

[1983] Step 2:

[1984] The device converts this input into JSON format data and sends it to the server as an API request.

[1985] Step 3:

[1986] The server receives the API request and parses the input data into the required fields.

[1987] Step 4:

[1988] The server stores the parsed data in a database and returns a success message to the terminal.

[1989] Step 5:

[1990] In the evening, the user (child) asks via voice input, "What should I bring to math class tomorrow?"

[1991] Step 6:

[1992] The device converts the voice input into text using a speech recognition engine and sends this text to the server as a query.

[1993] Step 7:

[1994] The server parses the received query and retrieves the relevant information ("compass and ruler") from the database.

[1995] Step 8:

[1996] The server sends the acquired information to an emotion engine, which analyzes the child's emotions based on the user's past voice input and behavioral patterns.

[1997] Step 9:

[1998] The emotion engine generates appropriate feedback messages based on the analysis results.

[1999] Step 10:

[2000] The server sends a feedback message ("Tomorrow you will bring a compass and a ruler. You did well today!") to the device.

[2001] Step 11:

[2002] The device responds to the message it receives with a voice message saying, "Tomorrow, bring a compass and a ruler. You did well today!"

[2003] Programmatic processing of location-checking and emotional support scenarios

[2004] Step 1:

[2005] The user (child) leaves home and activates the GPS function on the device on the way to cram school.

[2006] Step 2:

[2007] The device periodically acquires GPS information (latitude, longitude), converts it into JSON format data, and sends it to the server.

[2008] Step 3:

[2009] The server analyzes the received GPS information and stores it in a database.

[2010] Step 4:

[2011] The server continuously monitors the latest GPS information and provides it immediately when a parent requests it.

[2012] Step 5:

[2013] The user (parent) makes a request in the app saying, "I want to check where my child is right now."

[2014] Step 6:

[2015] The device sends this request to the server.

[2016] Step 7:

[2017] The server retrieves the latest GPS information from the database and sends it to the device as JSON format data.

[2018] Step 8:

[2019] The device displays the received GPS information in map format, showing parents the child's location.

[2020] Step 9:

[2021] The server sends past behavioral patterns and current GPS data to an emotion engine to analyze the child's current emotions.

[2022] Step 10:

[2023] If the emotion engine determines based on the analysis results that a child is under stress, it generates a message to the parent such as, "Let's play together after cram school."

[2024] Step 11:

[2025] The server notifies the parent terminal of the generated message.

[2026] Step 12:

[2027] The device will notify the parent with a message saying, "Let's play together after cram school."

[2028] Through the above processing steps, users can efficiently manage their children's schedules, homework, and belongings, track their child's location in real time, and receive support based on their emotional state.

[2029] Example 2

[2030] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2031] Conventional schedule management systems process schedules and notifications uniformly without considering the user's emotional state, which can cause children to feel stressed or unable to properly understand the information. Another issue is that it is difficult for parents and teachers to grasp their children's current state. To support children's mental health and achieve more effective communication, a system incorporating emotion analysis is needed.

[2032] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2033] In this invention, the server includes means for saving and analyzing input information, means for generating and notifying reminders based on the saved information, emotion engine means for analyzing the user's emotions based on voice input and behavioral patterns, and means for customizing the content of notifications and reminders based on the analyzed emotional state. This enables schedule management and notifications adapted to the user's emotional state, reducing stress for children and enabling better communication with parents and teachers.

[2034] "Input means" refers to the means by which teachers input information such as homework and belongings.

[2035] "Server means" refers to means for storing and analyzing input information.

[2036] The "notification means" is a means for generating and notifying reminders based on the stored information.

[2037] The "voice processing means" is a means for a user to input voice and obtain target information.

[2038] The "response means" is a means for responding to the user with the acquired information.

[2039] "GPS means" refers to the means for obtaining GPS information from the device held by the child and sending it to the server.

[2040] "Location information display means" is a means for parents to check their child's location information through the app.

[2041] The "emotion engine means" is a means for analyzing the user's emotions based on voice input and behavioral patterns.

[2042] "Customization means" refers to means for customizing the content of notifications and reminders based on the analyzed emotional state.

[2043] This invention is a schedule management system for children that consists of a cloud-based server, a user terminal application, and an emotion engine. In addition to conventional schedule management functions, this system also enables responses that adapt to the user's emotional state.

[2044] System configuration

[2045] First, let's take a look at an overview of the system: Parents, children, and teachers each have their own individual accounts, and can enter and check information through an application that works with a cloud-based server.

[2046] Input Method

[2047] Users (teachers) enter homework, belongings, and event information into an input form within the app. This information is sent to a cloud server in real time. The hardware used is the teacher's PC or smartphone, and the software is a dedicated application.

[2048] example:

[2049] Type, "Tomorrow's homework is math worksheets, and bring a compass and ruler."

[2050] Server Means

[2051] The server receives information entered by users (teachers and parents) and stores it in a database. It then analyzes the information and generates reminders and notifications as needed. Specifically, it uses database software and analytical algorithms.

[2052] example:

[2053] The server stores homework and belongings information sent by teachers and sets reminders.

[2054] Notification means

[2055] The server generates a reminder based on the saved information when the specified time arrives and sends a notification to the device. The emotion engine can also change the content and tone of the notification. This is done using a cloud notification service and emotion analysis algorithm.

[2056] example:

[2057] Your device receives a notification that says, "You will need a compass and ruler for tomorrow's class."

[2058] Audio Processing Means

[2059] When a user (child) asks a question by voice, the device converts the voice into text and sends the query to the server. The hardware used is the child's smartphone or tablet, and the software is a voice recognition application. The emotion engine performs emotion analysis based on this query.

[2060] example:

[2061] The child voice-inputs, "What should I bring tomorrow?"

[2062] Response methods

[2063] The server receives the query generated by the voice processing means, retrieves the relevant information from the database, and generates a response based on the emotional state analyzed by the emotion engine, which is then conveyed to the child as voice.

[2064] example:

[2065] The device will respond aloud, saying, "Tomorrow, bring a compass and a ruler. You did well today!"

[2066] GPS means

[2067] GPS information is periodically sent from the device (child) to the server, allowing parents to track their child's location in real time. The hardware used is the child's smartphone or GPS device, and the software is a location tracking application.

[2068] example:

[2069] Location information is sent on the child's way to cram school.

[2070] Location information display means

[2071] Users (parents) can check their child's location information through the app. The latest GPS information obtained from the server is displayed in map format. The hardware used is the parent's PC or smartphone, and the software is a location information display application.

[2072] example:

[2073] Parents can check where their children are using the app.

[2074] Emotion Engine Means

[2075] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of the emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses.

[2076] example:

[2077] The emotion engine analyzes the child's voice input and, if it determines that the child is under stress, it will notify the child with a message such as, "Take some time to relax."

[2078] Prompt Sentence Examples

[2079] "Please let me know so I can check what I need to bring tomorrow."

[2080] "Please tell me where your child is currently."

[2081] This system allows parents and teachers to communicate better with their children, allowing them to study and carry out daily activities without stress. Feedback from the emotion engine also contributes to maintaining children's mental health.

[2082] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2083] Step 1:

[2084] User (teacher) input

[2085] The user (teacher) enters homework, belongings, and event information into the application's input form. This information is sent to the cloud server in real time. Specifically, the teacher opens the app, enters the homework details and belongings list, and presses the "Send" button. Input: Homework and belongings information entered by the teacher. Output: Data sent to the cloud server.

[2086] Step 2:

[2087] Data storage and analysis by server

[2088] The server stores the received information in a database and performs analysis based on the stored information. This analysis includes generating reminders and notifications as needed. Specifically, the server uses database software to store the received information. It then generates notifications based on the reminder setting logic. Input: Data sent to the cloud server. Output: Information stored in the database and reminder settings.

[2089] Step 3:

[2090] Notification method operation

[2091] The server generates a reminder based on the stored information and sends a notification to the device when the reminder time arrives. The emotion engine can change the content and tone of the notification. Specifically, the server uses the notification API to create a reminder and send it to the child's device. Input: Reminder settings and emotion analysis results. Output: Notification sent to the child's device.

[2092] Step 4:

[2093] User (child) voice input and query transmission to the server

[2094] When the user (child) asks a question by voice, the device converts the voice into text and sends a query to the server. The emotion engine performs emotion analysis based on this query. Specifically, the child uses the voice input function to ask a question. The device converts the voice into text and sends it to the server. Input: Child's voice input. Output: Text query sent to the server.

[2095] Step 5:

[2096] Server response generation and notification

[2097] The server receives the query obtained by the voice processing means and retrieves the relevant information from the database. It generates an appropriate response based on the emotional state analyzed by the emotion engine and sends a voice notification to the device. Specifically, the server processes the query, extracts data, determines the emotional state using an emotion analysis algorithm, and generates an appropriate message to send to the device. Input: Text query sent to the server. Output: Response message sent to the child's device.

[2098] Step 6:

[2099] Acquiring GPS information and sending it to the server

[2100] GPS information is periodically sent from the device (child) to the server. Parents can track their child's location in real time. Specifically, the device obtains location information from the GPS sensor and periodically sends it to the server. Input: GPS information from the device. Output: GPS data sent to the server.

[2101] Step 7:

[2102] Parent location check

[2103] The user (parent) can check their child's location information through the app. The latest GPS information obtained from the server is displayed in map format. Specifically, the parent opens the app and sends a request to check their child's location information. The latest GPS information is obtained from the server and displayed in map format. Input: Parent's request to check location information. Output: Location information displayed in map format in the app.

[2104] Step 8:

[2105] Customize notifications with the emotion engine

[2106] The server uses an emotion engine to analyze the user's emotions based on voice input, behavioral patterns, and past data. The results of this emotion analysis are reflected in the content and tone of notifications and reminders, enabling individually customized responses. Specifically, the emotion engine analyzes text and voice data, determines the user's emotional state, and adjusts the tone and content of notifications. Input: Voice input, behavioral patterns, and past data. Output: Notifications and reminders customized based on emotions.

[2107] (Application example 2)

[2108] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2109] While conventional child schedule management systems could record schedules and provide reminders, they did not provide support that took into account the user's emotional state. As a result, children often felt stressed in their studies and daily lives, making it difficult to effectively manage their studies and lives. Furthermore, there were insufficient ways for parents to grasp their children's situations in real time, making it difficult to communicate appropriately with their children and with teachers.

[2110] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an input means for the teacher to input information such as homework and belongings; a server means for saving and analyzing the input information; a notification means for generating and notifying reminders based on the saved information; a voice processing means for the user to input voice information and acquire the target information; a response means for responding to the acquired information to the user; a GPS means for acquiring GPS information from the child's device and sending it to the server; a location information display means for the parent to check the child's location information through an app; an emotion analysis means for analyzing the user's emotions from the voice input and behavioral patterns using an emotion engine and generating individually customized feedback based on the analysis results; and a voice generation means for providing customized notifications and feedback by voice. This enables appropriate support that takes into account the child's emotional state, effectively managing learning and daily activities while reducing stress. Furthermore, parents can grasp their child's location information and situation in real time, promoting appropriate communication between parents and children.

[2111] "Input means" refers to a device or program that allows teachers to input information such as homework and belongings.

[2112] The "server means" is a device or program that receives and stores information sent from the input means, and further analyzes the information.

[2113] The "notification means" is a device or program that generates a reminder based on the information stored in the server means and notifies the user of the reminder on the terminal.

[2114] The "voice processing means" is a device or program that converts voice input by a user into text and analyzes the text.

[2115] The "response means" is a device or program that responds to the user based on the acquired information.

[2116] A "GPS means" is a device or program that transmits GPS information obtained from a device held by a child to a server.

[2117] "Location information display means" refers to a device or program that allows parents to check their child's location information through the app.

[2118] The "emotion analysis means" is a device or program that uses an emotion engine to analyze the user's emotions from voice input and behavioral patterns, and generates individually customized feedback based on the results.

[2119] A "voice generating means" is a device or program that provides customized notifications or feedback by voice.

[2120] This invention is a schedule management system for children, which includes a cloud-based server, a user terminal application, and an emotion engine. Specifically, teachers, parents, and children each have their own individual accounts, and input and confirm information through the application. The emotion engine also provides support based on the user's emotional state.

[2121] 1. System Overview

[2122] The overall system mainly consists of the following components:

[2123] Server means: Stores and analyzes information entered by teaching staff and parents.

[2124] Input Method: A device or program that allows teachers and parents to input homework and event information.

[2125] Notification method: Generates reminders based on saved information and notifies the device.

[2126] Voice processing means: When a child asks a question by voice input, the voice is analyzed.

[2127] Response method: A voice response will be provided based on the analyzed information.

[2128] GPS method: Location information is obtained from the child's device and sent to the server.

[2129] Location display method: Parents can check their child's location through the app.

[2130] Emotion analysis means: Analyzes user emotions from voice input, movement patterns, etc.

[2131] Voice generation means: Provides customized notifications and feedback via voice based on the results of sentiment analysis.

[2132] 2. Hardware and Software Used

[2133] Hardware: Using devices such as smartphones, tablets, and smart glasses.

[2134] software:

[2135] Web application framework: Flask

[2136] Cloud Service: Google Cloud TextToSpeech API

[2137] Speech Recognition Library: SpeechRecognition

[2138] 3. Processing Flow

[2139] Server Means

[2140] The server receives information entered by teachers and parents, stores this information in a database, and generates appropriate reminders and notifications based on the stored information.

[2141] Input Method

[2142] Users (teachers and parents) use smartphones or tablets to enter homework and event information, which is then sent to the server via the application.

[2143] Voice processing and response means

[2144] When a child asks a question by voice input, the voice processing means converts the voice into text and sends it to the server. The server retrieves the relevant information from the database and performs emotion analysis to generate appropriate feedback. The generated feedback is then returned to the child as a voice response.

[2145] GPS and location information display methods

[2146] GPS information is periodically sent from the child's device to a server, and parents can check their child's location in real time through the app.

[2147] Emotion analysis and speech generation

[2148] The server performs emotion analysis based on data such as voice input and behavioral patterns, and reflects the results in feedback and notifications. Customized feedback is provided by voice using a voice generation means.

[2149] 4. Examples of concrete examples and prompts

[2150] Specific Scenario 1

[2151] Teacher: Using the app, type "Bring your trigonometry textbook and notebook for tomorrow's math class."

[2152] Child: At night, ask using voice command, "What should I bring tomorrow?"

[2153] Device: Provides verbal feedback such as, "Tomorrow, bring your textbook and notebook. You worked hard today!"

[2154] Prompt Sentence Examples

[2155] Voice prompts for questions

[2156] "What do you need to bring to math class tomorrow?"

[2157] "What's the homework for tomorrow?"

[2158] Feedback prompts based on sentiment analysis

[2159] "It seems like you've been stressful today. Let's take some time to relax."

[2160] "Great work today! Great job!"

[2161] In this way, appropriate support can be provided based on a child's emotional state, enabling them to effectively manage their studies and daily activities while reducing stress. In addition, parents can track their child's location and situation in real time, promoting appropriate communication between parents and children.

[2162] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2163] Step 1:

[2164] Users (teachers and parents) use a smartphone or tablet to enter homework and event information and send it through the application's input means. The entered information is sent to the server and saved. The input to the input means is text-based homework content and belongings information. The output is information saved in the server's database.

[2165] Step 2:

[2166] The server analyzes the input information and generates a reminder based on the saved data. This reminder is automatically set based on the date and time of the event. Specifically, the server analyzes the input text information, extracts the date, time, and content of the event, and generates the reminder setting information. The output is the set reminder information.

[2167] Step 3:

[2168] A notification is sent to the user's device based on the information of the reminder for which the notification method has been set. The content of the notification is sent in the format of "XX is required for tomorrow's class" according to the reminder's set time. The output is a notification message that is displayed on the user's device.

[2169] Step 4:

[2170] A child asks a question using voice input. A voice processing means converts this voice input into text and sends the text data to a server. Specifically, a voice recognition library (e.g., SpeechRecognition) is used to convert the voice data into text data. The input is the voice data of the question as voice input, and the output is the text data sent to the server.

[2171] Step 5:

[2172] The server executes a query based on the text data obtained from the voice input and retrieves the required information from the database. The retrieved information is passed to an emotion analysis means, which analyzes the user's emotional state. This analysis uses the tone of the voice and past behavioral patterns. The output is the result of the emotion analysis and the information retrieved from the database.

[2173] Step 6:

[2174] The emotion analysis means generates individually customized feedback based on the analysis results and passes the feedback to the voice generation means. The voice generation means converts the text of the feedback into voice and sends it to the user's device. Specifically, the Google Cloud TextToSpeech API is used. The input is the analyzed emotional state and text data, and the output is voice data.

[2175] Step 7:

[2176] GPS information is periodically acquired from the child's device and sent to a server. The server monitors this GPS information in real time and stores it in a database. The input is the periodically transmitted GPS data, and the output is the location information data stored on the server.

[2177] Step 8:

[2178] Parents request their child's location information through the app and view it in real time on a map using the location information display means. The server obtains the latest GPS information and displays it as map data on the parent's device. The input is the parent's request and the GPS information stored on the server, and the output is the location information displayed in map format.

[2179] These processing steps enable the system to provide appropriate support that takes into account the user's emotional state, effectively managing learning and daily activities while reducing stress. Furthermore, parents can track their child's location and situation in real time, promoting appropriate communication between them.

[2180] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2181] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2182] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2183] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2184] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising ...

Claims

1. A schedule management system for children, An input means for teachers to input information such as homework and belongings; server means for storing and analyzing input information; A notification means for generating and notifying a reminder based on the stored information; a voice processing means for allowing a user to input voice and obtain target information; replying means for replying to the user about the acquired information; A GPS means for acquiring GPS information from the device held by the child and sending it to a server; A location information display means for parents to check their child's location information through the app; A system including:

2. The system of claim 1 further comprising means for authenticating parent, teacher and child user accounts and coordinating schedule, appointment and task information.

3. 10. The system of claim 1, further comprising means for dynamically querying information stored in a database based on information entered by a user and returning results in real time.

Images