system

Abstract

Provide a system. [Solution] A way for children to input what they want to see, means for transmitting the input data to a server; means for analyzing the received data at the server and generating feedback and rewards based on the analysis results; The system includes a means for notifying a parent device of the generated feedback and reward.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, it has become increasingly common for parents to be too busy to respond to their children's requests to "look at me." In such situations, children may not be recognized for their efforts or achievements, and the lack of communication can lead to emotional instability. Therefore, there is a need for a system that can listen to children's thoughts and provide appropriate feedback even when parents are busy. [Means for solving the problem]

[0005] To solve the above-mentioned problems, the present invention provides the following means: a system including means for a child to input content they want to see, means for sending the input data to a server, means for analyzing the data received by the server and generating feedback and rewards based on the analysis results, and means for notifying the parent of the generated feedback and rewards. This system makes it possible to automatically generate appropriate feedback and rewards based on the data input by the child and notify the parent, allowing the parent to communicate appropriately with their child even when they are busy.

[0006] "Child" means a student, pupil, or minor.

[0007] "What you want to see" refers to the results and actions, such as drawings, crafts, essays, photos, and videos, that children want to show their parents.

[0008] "Means of input" refers to interfaces such as keyboards, touchscreens, and voice input systems that allow children to input what they want to see into digital devices.

[0009] "Means for sending" refers to a program or protocol with Internet communication capabilities for sending input data to a server.

[0010] "Server" refers to a computer system for receiving, storing, and analyzing data.

[0011] "Means of analysis" refers to artificial intelligence (AI) or algorithms used to assess a child's interests and behavioral patterns based on the data received.

[0012] "Feedback" refers to the evaluations and comments that children receive that are generated based on the analysis results.

[0013] "Rewards" refer to incentives such as digital badges, drawing sheets, and in-game items given to children in recognition of their efforts and achievements.

[0014] "Means of notification" refers to a push notification service or messaging system that notifies the parent's device of the generated feedback and reward.

[0015] "Parent Device" means a smartphone, tablet, or other mobile device. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] This invention is a system for supporting communication between parents and children, and aims to realize a series of processes in which children input the content they want to see, the data is sent to a server, the server analyzes it, generates feedback and rewards, and notifies the parent's terminal.

[0038] System configuration

[0039] The system includes the following components:

[0040] 1. Children's devices

[0041] A means (interface) for children to input what they want to see

[0042] A means of sending input data to the server (communication function)

[0043] 2. Server

[0044] How data is received and stored

[0045] A means of analyzing the received data (AI or algorithms)

[0046] A means of generating feedback and rewards based on the analysis results

[0047] 3. Parent's device

[0048] A way to receive and communicate feedback and rewards

[0049] Program processing

[0050] User (child):

[0051] The child uses the device's input means to input the content they want their parent to see, saying "Look, look." The input content can be text, photos, videos, etc., and this data is sent to a server via the Internet.

[0052] Device (child's device):

[0053] The system receives the information entered by the child, formats it as data to be sent, and sends a POST request to the server, which then stores the data in the cloud and prepares it for analysis.

[0054] server:

[0055] The server receives the POST request and securely stores the data. The stored data is analyzed by an AI feedback engine, which evaluates the child's interests and behavioral patterns. For example, when evaluating a child's drawing, the engine analyzes the use of color, composition, and theme.

[0056] server:

[0057] Based on the analysis results, feedback and appropriate rewards are generated. The generated feedback is in text format and includes specific evaluations and words of encouragement for the child. Rewards are provided in the form of digital badges, drawing sheets, in-game items, etc., and serve to continue to pique the child's interest.

[0058] Device (parent device):

[0059] A push notification is sent to the parent's device, displaying feedback and a reward. When the parent taps the notification, the "Misete-chan" app opens, where they can check detailed feedback and information about the outcome the child wanted to show.

[0060] Specific examples

[0061] Example 1: When a child wants to show a picture

[0062] 1. User (child):

[0063] Children enter text into the app saying, "I want to show my mom the picture I drew," and then upload and send a photo of the drawing.

[0064] 2. Device (child's device):

[0065] It receives the input data (text and picture) and sends it to the server.

[0066] 3. Server:

[0067] The server receives the data and analyzes the photo of the painting using an AI feedback engine. As a result of the analysis, the painting may be evaluated as having excellent color usage, for example.

[0068] 4. Server:

[0069] Based on the analysis results, feedback such as "XX-chan drew a wonderful picture" is generated, and a digital badge "Creative Kids" is generated as a reward.

[0070] 5. Device (parent device):

[0071] A notification will be sent to the parent's device saying, "○○-chan has drawn a wonderful picture. A digital badge has been sent."

[0072] 6. User (Parent):

[0073] Parents can check the notification and view detailed feedback in the app. When they have time, they can give their child specific praise for what they think is great about their drawing.

[0074] In this way, this system allows parents to communicate smoothly with their children even when they are busy, and children can be properly recognized for their efforts and achievements.

[0075] The processing flow will be explained below.

[0076] Step 1:

[0077] User (child)

[0078] The child opens the "Misete-chan" app and accesses the input form within the app to enter "what they want to see."

[0079] Step 2:

[0080] User (child)

[0081] A child enters text, photos, videos, etc. into the input form. For example, a child can enter a photo of a drawing they have made and the text, "I want to show this to my mom."

[0082] Step 3:

[0083] Device (child's device)

[0084] It receives the input data, converts it into a transfer format such as JSON, and then sends a POST request to the server via the Internet.

[0085] Step 4:

[0086] server

[0087] The POST request is received and stored in a database. The stored data includes the child's ID, input, photo, and timestamp.

[0088] Step 5:

[0089] server

[0090] The stored data is analyzed using an AI feedback engine, which evaluates, for example, the use of color and composition in photos, and the content of text.

[0091] Step 6:

[0092] server

[0093] Feedback is generated based on the analysis results. For example, if the evaluation is "Excellent use of color," the system generates feedback such as "XX-chan drew a wonderful picture."

[0094] Step 7:

[0095] server

[0096] Use the reward generation engine to generate appropriate rewards, such as a digital badge for "creative kids."

[0097] Step 8:

[0098] server

[0099] Notification data is generated to notify the parent's terminal of the generated feedback and reward.

[0100] Step 9:

[0101] Device (parent device)

[0102] A push notification will be received and displayed in the notification center. When a parent taps the notification, the "Misete-chan" app will open and display the feedback details.

[0103] Step 10:

[0104] User (Parent)

[0105] Parents can review the app's feedback and give their child specific praise, such as, "This is what's great about your drawing."

[0106] This series of steps allows parents to quickly and appropriately communicate what their children want to see, and allows parents to maintain regular communication with their children even when they are busy.

[0107] Example 1

[0108] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0109] In today's parent-child relationships, parents need a way to communicate smoothly with their children even when they are busy. In particular, there are many situations where parents are unable to respond immediately when their children want to show their parents the artwork or results they have created as they grow. In such situations, children's efforts may not be properly evaluated, which can result in a decline in their motivation. Therefore, a system is needed that allows parents to properly evaluate the work their children want to show and, through that feedback, further motivate them.

[0110] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0111] In this invention, the server includes a means for receiving and storing data on the server, a means for analyzing the stored data with an AI feedback engine, and a means for generating feedback and a digital reward based on the analysis results. This allows parents to appropriately evaluate the results that their children want to show and notify the parents of the feedback and digital reward on their device, thereby motivating the children and facilitating communication between parents and children.

[0112] "Child" means a minor who is raised by his or her parents within the family home.

[0113] "Input means" refers to the interface that a user uses to provide data, such as text, photos, or videos, to the system.

[0114] "Transmission means" refers to a function for transmitting input data to a server using a communication protocol.

[0115] "Server" refers to a powerful computer system for receiving, storing, analyzing, and managing data.

[0116] "Receiving means" refers to the function by which the server receives data sent from the child's device.

[0117] "Storage means" refers to a memory or database that securely stores received data.

[0118] An "AI feedback engine" refers to a software component that uses artificial intelligence to analyze data and generate evaluations and feedback based on the results.

[0119] "Analysis means" refers to the function of using an AI feedback engine to perform detailed analysis of the received data.

[0120] "Feedback" refers to messages of evaluation and encouragement that are generated for children based on the analysis results.

[0121] "Digital rewards" refers to rewards for children, such as digital badges, points, and in-software items.

[0122] "Notification means" refers to a function that notifies the parent's device of feedback and digital reward information in real time.

[0123] "Parent's device" refers to electronic devices such as smartphones and tablets used by parents.

[0124] "Verification" refers to the ability for parents to view feedback and digital reward details on the device.

[0125] This invention is a system to support communication between parents and children. It implements a series of processes: a child inputs the content they want to see, the data is sent to a server, the server analyzes it, generates feedback and rewards, and notifies the parent's device.

[0126] System configuration

[0127] The system includes the following components:

[0128] 1. Children's devices

[0129] Input method: An interface for children to input what they want to see (e.g., a smartphone app)

[0130] Transmission method: Communication function for sending input data to the server (e.g., Wi-Fi, 4G communication)

[0131] 2. Server

[0132] Receiving means: A means for receiving and storing data (e.g., HTTP server, database)

[0133] Analysis tools: Tools for analyzing stored data with an AI feedback engine (e.g., machine learning models)

[0134] Generator: A generator (e.g., a natural language generation algorithm) for generating feedback and digital rewards based on the analysis results.

[0135] 3. Parent's device

[0136] Notification method: A method for notifying the parent of the generated feedback and digital rewards (e.g., push notification service)

[0137] Confirmation: An interface (e.g., a smartphone app) for parents to review feedback and digital rewards.

[0138] Program processing

[0139] User (child):

[0140] The child uses the device's interface to input what they want their parent to see, such as "Look, look." For example, they could type in the text "I want to show my mom the picture I drew," and then upload a photo of the drawing.

[0141] Device (child's device):

[0142] It receives the information entered by the child, converts it into an appropriate format, and sends it to the server as a POST request. Specifically, it converts the text data and photo data into JSON format and sends it to the server.

[0143] server:

[0144] The received data is securely stored. The stored data is then analyzed using an AI feedback engine. For example, if the target of analysis is a photo of a child's drawing, the machine learning model will analyze the color usage, composition, theme, etc.

[0145] server:

[0146] Based on the analysis results, feedback and digital rewards are generated. For example, feedback such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated.

[0147] server:

[0148] Set up push notifications to send generated feedback and digital reward information to the parent's device. For example, send a notification saying, "X-chan drew a great picture. We've sent you a digital badge."

[0149] Device (parent device):

[0150] A push notification is sent to the parent's device, and when the parent taps the notification, the corresponding app opens, displaying detailed feedback and information about the child's work.

[0151] Specific examples

[0152] Example 1: When a child wants to show a picture

[0153] 1. User (child):

[0154] Children enter text in the app saying, "I want you to see this picture," then upload and send a photo of the drawing.

[0155] 2. Device (child's device):

[0156] It receives the input data (text and picture) and sends it to the server.

[0157] 3. Server:

[0158] The data is received and a photo of the painting is analyzed. The color usage and composition are evaluated using a machine learning model. As a result of the analysis, feedback such as "the color usage is excellent" is received.

[0159] 4. Server:

[0160] Based on the analysis results, feedback such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated.

[0161] 5. Server:

[0162] A push notification will be sent to the parent's device saying, "○○-chan drew a wonderful picture. A digital badge has been sent."

[0163] 6. Device (parent device):

[0164] Parents can view the notification and open the corresponding app to view detailed feedback, allowing them to give specific praise to their child.

[0165] Prompt Sentence Examples

[0166] "Now that my daughter has uploaded her drawing, please generate a rating and feedback. Analyze it to assess color, composition, and theme, then choose words of encouragement and an appropriate digital reward."

[0167] This system allows for real-time recognition of a child's efforts and achievements, facilitating smooth communication between parents and children.

[0168] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0169] Step 1:

[0170] User (child):

[0171] A child opens the app and taps the "Look, look" button. They then enter data such as text, photos, and videos into the input interface. For example, they might enter the text "I want to show my mom the picture I drew," take a photo of the drawing, and upload it. The input in this case is text data and image data.

[0172] Step 2:

[0173] Device (child's device):

[0174] It takes the user's input (text and photo) and converts it to the appropriate format. Specifically, it converts the input data to JSON and prepares it as a POST request. For example, it generates the following JSON data:

[0175] json

[0176] {

[0177] "message": "I want to show my mom the picture I drew",

[0178] "image_data": "<base64_encoded_image_data> "

[0179] }

[0180] This is sent to a server via the Internet.

[0181] Step 3:

[0182] server:

[0183] Receives a POST request sent from the device. The received data is first validated and then securely stored in a database. For example, image data is stored in cloud storage (e.g., AWS (registered trademark) S3), and its reference URL is stored in the database. The received data is then imported into "message" and "image_data".

[0184] Step 4:

[0185] server:

[0186] The saved data is input into an AI feedback engine for analysis. A machine learning model is used to evaluate the color usage, composition, theme, and other aspects of the pictures uploaded by children. For example, the image analysis engine evaluates the variety of colors and balance of the composition, and generates a rating such as "excellent color usage" as the analysis result. The output is text data of the analysis results.

[0187] Step 5:

[0188] server:

[0189] Based on the analysis results, a feedback message and digital reward are generated. For example, based on the text data of the analysis results, a feedback message such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated. The generated feedback and reward are stored in a database. The output is the feedback message and digital reward data.

[0190] Step 6:

[0191] server:

[0192] The generated feedback and digital reward information is sent to the parent's device via push notification. Specifically, a push notification service (e.g., Firebase Cloud Messaging) is used to notify the parent's device. For example, a notification message saying, "X-chan drew a great picture. We've sent you a digital badge." The input in this case is the feedback message and digital reward data, and the output is the sending of a push notification.

[0193] Step 7:

[0194] Device (parent device):

[0195] A push notification is sent to the parent's device, and when the parent taps the notification, the corresponding app opens. A detailed feedback message and information about the child's work are displayed in the app. For example, the feedback message "Your drawing is so colorful and wonderful!" and the digital badge "Creative Kids" are displayed. The parent can review this and give specific praise to their child. The output is the feedback message and a digital reward.

[0196] (Application example 1)

[0197] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0198] Robots used in factories are required to accurately detect abnormalities and areas requiring maintenance during operation and notify managers and workers in real time, enabling prompt and appropriate responses and improving work safety and efficiency. However, current systems have issues with the accuracy of abnormality detection and the speed of notification. In addition, they do not provide sufficient feedback on appropriate countermeasures or rewards, which creates challenges in maintaining motivation and improving work efficiency.

[0199] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0200] In this invention, the server includes a means for inputting the content that the worker wants to see, a means for transmitting the input data to the server, a means for analyzing the data received by the server and generating feedback and rewards based on the analysis results, and a means for notifying the generated feedback and rewards to the manager's terminal. This enables accurate detection and prompt notification of abnormalities and areas requiring maintenance, provides appropriate feedback for countermeasures and rewards to maintain motivation, and improves the safety and efficiency of work.

[0201] "Worker" means an employee who performs work within a factory.

[0202] An "administrator" is a person in charge of managing work within a factory and the operation of robots.

[0203] "Server" refers to a computer system for receiving, analyzing, storing data, and generating feedback.

[0204] "Input means" refers to the interface or device that allows the worker to input the information they want to see.

[0205] "Transmission means" refers to the communication functions and protocols used to transmit input data to the server.

[0206] "Means of analysis" refers to algorithms and AI engines that process the data received by the server and detect anomalies or identify areas requiring maintenance.

[0207] "Feedback" refers to evaluations and instructions provided to workers and managers based on the analysis results.

[0208] "Rewards" are digital badges or other rewards given to workers for taking corrective action.

[0209] "Means of notification" refers to communication methods and push notification functions for conveying generated feedback and rewards to managers and workers.

[0210] An "abnormality" refers to an operation or state that differs from normal in machines or systems within a factory.

[0211] "Maintenance required areas" are areas or parts that require preventative maintenance or repair.

[0212] "Digital Badge" means an electronic reward provided to recognize a worker's achievements.

[0213] A "safety badge" is an electronic certificate of knowledge provided to workers as recognition of safe work practices.

[0214] This invention is a system that supports communication between managers and workers to improve the safety and efficiency of robots used in factories. The system aims to realize a series of processes in which workers input what they want to see, send the data to a server, analyze it, generate feedback and rewards, and notify the manager's terminal.

[0215] System configuration

[0216] The system includes the following components:

[0217] 1. Worker's terminal

[0218] A means (interface) for workers to input what they want to see

[0219] A means of sending input data to the server (communication function)

[0220] 2. Server

[0221] How data is received and stored

[0222] A means of analyzing the received data (AI or algorithms)

[0223] A means of generating feedback and rewards based on the analysis results

[0224] 3. Administrator's terminal

[0225] A way to receive and communicate feedback and rewards

[0226] Program processing (natural language explanation)

[0227] Worker (user):

[0228] The worker uses the input means of the terminal to input what he or she wants the manager to see. The input content can be text, photos, videos, etc., and this data is sent to the server via the Internet.

[0229] Terminal (Worker's terminal):

[0230] The system receives the information entered by the worker, formats it as transmission data, and sends a POST request to the server, which saves the data in the cloud and prepares it for analysis.

[0231] server:

[0232] The server receives the POST request and securely stores the data. The stored data is analyzed by an AI feedback engine to track work progress and identify abnormalities. For example, when evaluating abnormal machine sounds, the characteristics and frequency of the sound are analyzed.

[0233] server:

[0234] Based on the analysis results, feedback and appropriate rewards are generated. The generated feedback is in text format and includes specific evaluations and measures for the worker. Rewards are provided in the form of digital badges, safety badges, etc., and serve to continuously motivate workers.

[0235] Terminal (Administrator's terminal):

[0236] A push notification is sent to the manager's device, informing them of the feedback and reward. When the manager taps the notification, the app opens and they can view detailed feedback and the information about the deliverables that the worker wanted to see.

[0237] Specific examples

[0238] Example 1: When the robot detects an abnormal sound

[0239] 1. Worker (user):

[0240] The worker enters text into the app saying, "There is an abnormal noise coming from the machine," and then uploads and sends the recording of the abnormal noise.

[0241] 2. Terminal (Worker's terminal):

[0242] Receives input data (text and audio data) and sends it to the server.

[0243] 3. Server:

[0244] The server receives the data and analyzes the recorded data using an AI feedback engine. As a result of the analysis, it may conclude that the cause is, for example, "wear on the bearings."

[0245] 4. Server:

[0246] Based on the analysis results, feedback is generated such as "Machine A's bearings are worn and require inspection," and a digital badge "Safety Awareness" is generated as a reward.

[0247] 5. Terminal (Administrator's terminal):

[0248] A notification is sent to the administrator's terminal stating, "An abnormality has been detected in Machine A. Inspection is required."

[0249] 6. Operator / Administrator:

[0250] The administrator checks the notification, views detailed feedback in the app, and issues instructions on the necessary response, which the worker then implements to resolve the abnormality.

[0251] Prompt Sentence Examples

[0252] Data from a machine where an abnormality was detected has been sent and analyzed. The abnormality detected is bearing wear. Generate feedback to notify managers and workers: "There is wear in the bearings of machine A. Inspection recommended." and assign a related digital badge.

[0253] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0254] Step 1:

[0255] The user (worker) uses the terminal to input the information they want to see (abnormal sounds or problems). The input method is text, photos, or video. The input data is saved in the terminal once and is ready to be sent.

[0256] Input: What the worker inputs (text, photos, videos)

[0257] Output: Input data ready to be sent

[0258] Step 2:

[0259] The terminal sends the formatted data to the server using the HTTP POST request as the communication protocol.

[0260] Input: Input data ready to be sent

[0261] Output: Data sent to the server

[0262] Step 3:

[0263] The server receives the data sent from the terminal and stores it securely in a database (e.g., MySQL (registered trademark)).

[0264] Input: Data sent from the terminal

[0265] Output: Data stored in the database

[0266] Step 4:

[0267] The AI ​​feedback engine on the server analyzes the stored data, specifically using a sound analysis algorithm (e.g., SpaCy or TENSORFLOW®) to analyze abnormal sounds.

[0268] Input: Saved data

[0269] Output: Analysis results (e.g. abnormal noise is caused by bearing wear)

[0270] Step 5:

[0271] The server generates feedback based on the analysis results, including specific measures and evaluations, and generates appropriate rewards (e.g., digital badges).

[0272] Input: Analysis results

[0273] Output: Feedback and reward (e.g., bearing wear is the cause. Inspection recommended. Digital badge "Safety Awareness")

[0274] Step 6:

[0275] The generated feedback and reward will be sent to the administrator's device via a push notification, which will include information about the feedback and reward.

[0276] Input: Feedback and Rewards

[0277] Output: Push notification sent to the administrator's device

[0278] Step 7:

[0279] The manager checks the notification on the terminal and views the detailed feedback content, and if necessary, issues instructions to the worker to resolve the problem.

[0280] Input: Push notification sent to the administrator's device

[0281] Output: Feedback viewed by the administrator and instructions to respond

[0282] Specific behavior:

[0283] 1. User enters text, photo, or video and presses the save button

[0284] 2. The device formats the data and sends it to the server

[0285] 3. The server receives the data and stores it in the database

[0286] 4. The AI ​​engine on the server analyzes the data

[0287] 5. The server generates feedback and rewards based on the analysis results.

[0288] 6. The server notifies the administrator of the generated feedback and rewards.

[0289] 7. The administrator checks the notification, reads the feedback, and takes any necessary action.

[0290] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0291] This invention relates to a system that supports communication between parents and children by allowing children to input what they want to see, sending the data to a server, which then analyzes the data to generate feedback and rewards, and notifying the parent's device of the generated feedback and rewards. Furthermore, this system incorporates an emotion engine that recognizes the child's emotions.

[0292] System configuration

[0293] The system includes the following components:

[0294] 1. Children's devices

[0295] A means (interface) for children to input what they want to see

[0296] A means of sending input data to the server (communication function)

[0297] 2. Server

[0298] How data is received and stored

[0299] A means of analyzing the received data (AI or algorithms)

[0300] Emotion recognition using an emotion engine

[0301] A means of generating feedback and rewards based on the analysis results

[0302] 3. Parent's device

[0303] A way to receive and communicate feedback and rewards

[0304] Program processing

[0305] User (child):

[0306] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[0307] Device (child's device):

[0308] The data entered by children is converted into JSON format or similar and sent to a server via the Internet.

[0309] server:

[0310] The server receives the POST request and stores it in a database. The stored data includes the child's ID, input content, photo, and timestamp. The emotion engine recognizes the child's emotions from the input text and image. This emotion data is also used for analysis.

[0311] server:

[0312] The received data is analyzed using an AI feedback engine. For example, the system evaluates the color usage and composition of the drawing, and provides analysis results that take the child's emotions into consideration.

[0313] server:

[0314] Based on the analysis results, feedback and rewards are generated. For example, if a child is pleased with the evaluation that "your use of color is excellent," the system generates feedback such as "Your drawing is very colorful and beautiful!" and provides the digital badge "Creative Kids" as a reward.

[0315] Device (parent device):

[0316] The generated feedback and reward notifications are sent to the parent's device. When a push notification is received, a new message appears in the notification center. When the parent taps the notification, they can view the child's request and the corresponding feedback within the app.

[0317] Specific examples

[0318] Example 1: When a child wants to show a picture

[0319] 1. User (child):

[0320] A child can type in text in the app saying, "I want to show my mom the picture I drew," upload a photo of the drawing, and send it. The emotion engine recognizes that the child is "happy."

[0321] 2. Device (child's device):

[0322] The entered data (text and picture) is sent to the server in JSON format.

[0323] 3. Server:

[0324] Receive and store data. The emotion engine recognizes when a child is happy.

[0325] 4. Server:

[0326] The AI ​​feedback engine analyzes the data and evaluates it as "great use of color." Taking into account the results of the emotion engine, the feedback is determined as "X-Chan drew a wonderful picture."

[0327] 5. Server:

[0328] A reward generation engine generates digital badges for "creative kids."

[0329] 6. Device (parent device):

[0330] A notification will be sent to the parent's device saying, "○○-chan has drawn a wonderful picture. A digital badge has been sent."

[0331] 7. User (Parent):

[0332] Parents can view the notification and detailed feedback within the app, giving specific praise such as, "Your drawing is so colorful and beautiful!"

[0333] In this way, this system allows parents to communicate smoothly with their children even when they are busy, and children can be properly recognized for their efforts and achievements. Furthermore, the emotion engine allows feedback that takes into account the child's emotions, resulting in greater understanding and consideration.

[0334] The processing flow will be explained below.

[0335] Step 1:

[0336] User (child)

[0337] Open the "Misete-chan" app. Access the input form within the app and enter the "content you want to see."

[0338] Step 2:

[0339] User (child)

[0340] Enter text, photos, videos, etc. into the input form. For example, take a photo of a drawing you've made and enter the text "I want my mom to see this."

[0341] Step 3:

[0342] Device (child's device)

[0343] It receives the input data, converts it to JSON format, and then sends a POST request to the server via the Internet.

[0344] Step 4:

[0345] server

[0346] It receives a POST request and stores it in a database. The data stored includes the child's ID, input, photo, and timestamp.

[0347] Step 5:

[0348] server

[0349] The data is passed to an AI feedback engine for analysis of text data and photos. At the same time, an emotion engine recognizes the child's emotions from the text and photos. For example, if the text is "I want my mom to see this," the emotion engine recognizes positive emotions (joy).

[0350] Step 6:

[0351] server

[0352] An AI feedback engine analyzes the data and evaluates the child's input and photos. For example, it analyzes a photo of a drawing and evaluates it as "great use of color."

[0353] Step 7:

[0354] server

[0355] The emotions recognized by the emotion engine are combined with the evaluation results of the AI ​​feedback engine to generate feedback. For example, specific feedback such as "Your drawing is very colorful and beautiful! You must be happy to show it to your mother" can be set.

[0356] Step 8:

[0357] server

[0358] The reward generation engine uses the analysis results and emotional data to generate appropriate rewards, such as creating a digital badge for "creative kids."

[0359] Step 9:

[0360] server

[0361] The system generates data to notify the parent's device of the generated feedback and reward. The notification includes a summary of the feedback and the reward.

[0362] Step 10:

[0363] Device (parent device)

[0364] A push notification will be received and displayed in the notification center. When a parent taps the notification, the "Misete-chan" app will open and display detailed feedback and reward information.

[0365] Step 11:

[0366] User (Parent)

[0367] Parents can check the feedback within the app and give their child specific praise, for example, "Your drawing is so colorful and beautiful!"

[0368] This series of steps allows children to quickly and appropriately communicate what they want to see to their parents, and allows parents to communicate with their children regularly even when they are busy. Furthermore, providing feedback and rewards that take children's emotions into consideration makes communication even more effective.

[0369] Example 2

[0370] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0371] Conventional parent-child communication systems lack a means for children to properly communicate what they want to see to their parents, or a means for providing feedback that understands the child's emotions. Furthermore, there is a lack of a way to generate rewards that take the child's emotions into account and notify the parent. This creates a challenge in that it is difficult to ensure smooth communication even when parents are busy.

[0372] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0373] In this invention, the server includes an emotion recognition means for recognizing the child's emotion, a means for notifying the parent of appropriate feedback based on the analysis, and a means for generating a reward such as a digital badge, a drawing sheet, or an in-game item, thereby making it possible to provide appropriate feedback and rewards while taking the child's emotion into consideration.

[0374] "Means for inputting content that children want to see" refers to devices or interfaces that allow children to input content that they want to see, and includes software such as applications that run on smartphones and tablets.

[0375] "Means for transmitting input data to a server" refers to a function for transmitting data input by a child to a server via a communication means such as the Internet.

[0376] "Means of analyzing data received by the server and generating feedback and rewards based on the analysis results" refers to a system that analyzes received data using AI or algorithms and automatically generates feedback messages and rewards based on the results.

[0377] "Means for notifying the parent's terminal of the generated feedback and reward" refers to a function for sending and notifying the parent's terminal of the generated feedback message and reward information.

[0378] "Emotion recognition means for recognizing children's emotions" refers to engines or algorithms that analyze and recognize the emotional state of children from text, images, etc. entered by them.

[0379] "Means for communicating data in JSON format" refers to a means for converting the content entered by the child into JSON (JavaScript (registered trademark) Object Notation) format and sending it to a server in accordance with a communication protocol.

[0380] "Means for using emotional data for analysis" refers to the ability to use a child's emotional state as part of data analysis to generate more appropriate feedback and rewards.

[0381] "Digital badges" refer to electronic awards or certificates given to children based on their behavior and achievements.

[0382] A "drawing sheet" refers to a digital or physical sheet generated based on a child's drawing and related information.

[0383] "In-game items" refer to benefits and rewards that can be used within the game a child is playing.

[0384] MODE FOR CARRYING OUT THE INVENTION

[0385] This invention relates to a system that supports communication between parents and children by allowing children to input what they want to see, sending the data to a server, which then analyzes the data to generate feedback and rewards, and notifying the parent's device of the generated feedback and rewards. Furthermore, this system incorporates an emotion engine that recognizes the child's emotions.

[0386] System configuration

[0387] The system includes the following components:

[0388] 1. Children's devices

[0389] Input method: An interface for children to input what they want to see. For example, a smartphone application.

[0390] Transmission means: A communication function for transmitting input data to a server.

[0391] 2. Server

[0392] Receiving means: A function that receives and stores data (e.g., a database system).

[0393] Analysis means: A function that analyzes the received data (e.g., AI feedback engine, emotion recognition engine).

[0394] Generation means: A function that generates feedback and rewards based on the analysis results.

[0395] Notification: A function that notifies the parent's device of the generated feedback and rewards.

[0396] 3. Parent's device

[0397] Receiving means: A function for receiving and notifying feedback and rewards (e.g., a smartphone application).

[0398] Program processing

[0399] User (child):

[0400] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[0401] Device (child's device):

[0402] The data entered by the child is converted into JSON format and sent to a server via the internet. The entered data includes the child's ID, input content, photo, timestamp, etc.

[0403] server:

[0404] The server receives the POST request and stores it in a database. This data contains all the information necessary for analysis, such as the child's ID, input content, photo, and timestamp. Next, an emotion recognition engine is used to recognize the child's emotions from the input text and images. Specifically, it identifies emotions such as "happy" from the child's text message and image.

[0405] server:

[0406] The received data, including emotional data, is analyzed by an AI feedback engine. For example, a drawing is evaluated for its color usage and composition. Emotional data is also taken into account in the analysis to generate more appropriate feedback.

[0407] server:

[0408] A feedback message and reward are generated based on the analysis results. For example, if the analysis result is "great use of color" and the child is pleased, the system generates feedback such as "Your drawing is very colorful and wonderful!" and provides a "Creative Kids" digital badge as a reward.

[0409] Device (parent device):

[0410] The generated feedback message and reward information are sent to the parent's device. The parent's device receives a push notification, and a new message appears in the notification center. When the parent taps the notification, they can view the child's request and the corresponding feedback within the "Misete-chan" app.

[0411] Specific examples

[0412] Example 1: When a child wants to show a picture

[0413] User (child):

[0414] A child uses the "Misete-chan" app to type, "I want to show my mom the picture I drew," and uploads a photo of the drawing. The emotion engine recognizes that the child is "happy."

[0415] Device (child's device):

[0416] The entered data (text and picture) is sent to the server in JSON format.

[0417] server:

[0418] Receive and store data. The emotion engine recognizes when a child is happy.

[0419] server:

[0420] The AI ​​feedback engine analyzes the data and evaluates it as "great use of color." Taking into account the results of the emotion engine, the feedback is determined as "X-Chan drew a wonderful picture."

[0421] server:

[0422] A reward generation engine generates digital badges for "creative kids."

[0423] Device (parent device):

[0424] A notification will be sent to the parent's device saying, "X-chan drew a wonderful picture. We've sent you a digital badge." The parent will then check the notification and view detailed feedback within the app. They can then give specific praise, such as, "Your drawing is so colorful and beautiful!"

[0425] Prompt Sentence Examples

[0426] Below are some example prompts to input to the generative AI model:

[0427] A child requests in the app, "Mommy, please show me your dinosaur drawing." Feedback: Great colors, this dinosaur looks so realistic. Emotion: Delighted. Generated feedback: "Great colors! This dinosaur looks so realistic!" Generated badge: "Creative Kids."

[0428] In this way, this system allows parents to communicate smoothly with their children even when they are busy. Children can be properly recognized for their efforts and achievements, and the emotion engine allows for feedback that takes children's emotions into consideration.

[0429] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0430] Step 1:

[0431] User (child):

[0432] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[0433] Input: Text message (e.g., "I want my mom to see this") and image data (e.g., a photo of a drawing).

[0434] Output: JSON formatted data.

[0435] Specific operation: Using the camera function within the app, an interface will appear where you can take a photo of the painting and enter a message.

[0436] Step 2:

[0437] Device (child's device):

[0438] The entered data is converted into JSON format and sent to the server via the Internet.

[0439] Input: Text messages and photos sent by users.

[0440] Output: A POST request to the server.

[0441] What happens: The app internally encodes the data into JSON format and sends a POST request to the server endpoint.

[0442] Step 3:

[0443] server:

[0444] The server receives the POST request and stores it in a database, which stores the child's ID, input, photo, timestamp, etc.

[0445] Input: JSON formatted data.

[0446] Output: Records stored in the database.

[0447] What happens: The server parses the POST request and creates a new record in the database.

[0448] Step 4:

[0449] server:

[0450] Using an emotion recognition engine, the system recognizes a child's emotions from input text and images. For example, it identifies emotions such as "happy" from a child's message.

[0451] Input: Text message and image data.

[0452] Output: Emotion data (e.g., "happy").

[0453] Specific operation: The emotion recognition engine performs text analysis and image analysis to estimate emotions.

[0454] Step 5:

[0455] server:

[0456] The AI ​​feedback engine analyzes the received data and emotional data, for example evaluating the color usage and composition of the picture and determining feedback taking the child's emotions into account.

[0457] Input: Stored database data and emotion data.

[0458] Output: Feedback content.

[0459] Specific operation: The AI ​​feedback engine analyzes the data and makes an evaluation.

[0460] Step 6:

[0461] server:

[0462] Based on the analysis results, feedback messages and rewards are generated. For example, based on the result that "children are delighted with the wonderful use of color," feedback such as "Your drawing is very colorful and wonderful!" and a digital badge of "Creative Kids" are generated.

[0463] Input: Analysis results and emotion data.

[0464] Output: Feedback message and digital badge.

[0465] What happens: The server constructs a feedback message and generates a digital badge.

[0466] Step 7:

[0467] server:

[0468] The generated feedback message and reward information are sent to the parent's device.

[0469] Input: Feedback message and digital badge.

[0470] Output: Notification to parent device.

[0471] Specific operation: The server sends a push notification to the parent device.

[0472] Step 8:

[0473] Device (parent device):

[0474] When parents tap the notification, they can view their child's request and feedback within the "Misete-chan" app.

[0475] Input: Notification from the server.

[0476] Output: Display of feedback message.

[0477] What it does: Parents receive a notification on their smartphone and receive detailed feedback within the app.

[0478] These steps allow the system to take into account the child's input and emotions, and provide appropriate feedback and rewards to the parent.

[0479] (Application example 2)

[0480] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0481] In modern society, busy parents tend to neglect communication with their children. This reduces opportunities for children to have their efforts and achievements seen, making it difficult for them to feel confident or happy. It is also often difficult to properly understand a child's emotions and provide them with feedback. This invention aims to solve these problems by providing a system that accurately understands the content and emotions entered by a child and provides appropriate feedback to parents in real time.

[0482] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for inputting content that the child wants to see, a means for transmitting the input data to the server, a means for analyzing the data received by the server and generating feedback and a reward based on the analysis results, a means for notifying the parent's device of the generated feedback and reward, a means for analyzing the child's emotions using an emotion recognition engine, a means for notifying the parent's device of the generated feedback and reward in real time, and a means for generating optimal feedback based on the analysis results using a generative AI model. This makes it possible to accurately understand the content and emotions input by the child and notify the parent of appropriate feedback and reward in real time.

[0483] Key Word Definitions

[0484] "Means for inputting what children want their parents to see" refers to an interface that allows children to input what they want their parents to see in the form of text, images, audio, etc.

[0485] "Means for transmitting input data to a server" refers to a communication function that transmits data input by a child to a server via the Internet.

[0486] "Means for analyzing data received by the server and generating feedback and rewards based on the analysis results" refers to a function that analyzes data received by the server and automatically generates feedback for the parent and rewards for the child based on the analysis results.

[0487] The "means for notifying the parent's terminal of the generated feedback and reward" is a communication function for transmitting the feedback and reward generated by the server to the parent's terminal in real time.

[0488] "Means for analyzing children's emotions using an emotion recognition engine" is an AI technology that analyzes emotions from text, voice, images, etc. entered by the child and identifies the child's current emotions.

[0489] "Means for notifying the parent's device of the generated feedback and reward in real time" is a function for instantly sending the generated feedback and reward to the parent's device, thereby quickly conveying the information to the parent.

[0490] "Means for generating optimal feedback based on analysis results using a generative AI model" refers to a function that uses an AI model to evaluate analysis results and generate optimal feedback for children.

[0491] A "digital certification badge" is a badge that digitally recognizes a child's efforts and achievements and is used to enhance a child's sense of accomplishment.

[0492] "Creative sheets" are digital tools that allow children to engage in creative activities, and examples include drawing sheets.

[0493] "Digital entertainment items" are digital items provided to increase children's enjoyment, including, for example, in-game bonuses and items.

[0494] MODE FOR CARRYING OUT THE INVENTION

[0495] This invention relates to a system for promoting communication between parents and children. A child inputs the content they want to see and sends the data to a server, which analyzes it, generates feedback and rewards, and notifies the parent's device. The system also uses an emotion recognition engine to analyze the child's emotions and generates optimal feedback accordingly.

[0496] System configuration

[0497] 1. Children's devices:

[0498] Input medium: The interface that a child uses to input content such as text, images, or audio.

[0499] Communication method: A communication function that sends the data entered by the child to a server via the Internet.

[0500] 2. Server:

[0501] Data storage means: The server has the function of storing the received data in a database.

[0502] Data analysis method: The server analyzes the received data using AI algorithms, including an emotion recognition engine.

[0503] Feedback generation method: The system has the ability to generate feedback and rewards based on the recorded data and analysis results. Using a generative AI model, it suggests optimal feedback based on the child's emotions.

[0504] Notification: The generated feedback and rewards are sent to the parent's device in real time.

[0505] 3. Parent device:

[0506] Receiving means: The parent's device receives feedback and reward notifications from the server.

[0507] Display: The reported feedback and rewards are displayed within the app for easy parental review.

[0508] Processing flow

[0509] User (child)

[0510] Using an application installed on the child's device, the child can input "what they want to show their mother" in the form of text, image, voice, etc. For example, the child can take a photo of a drawing they have made and attach a text message saying "I want to show this to my mother." The emotion recognition engine analyzes the child's emotions and sends this data to the server.

[0511] Device (child's device)

[0512] The data entered by children is converted into JSON format or similar and sent to a server via the Internet.

[0513] server

[0514] The server stores the received data in a database and analyzes it using an AI algorithm, which uses tools such as TensorFlow and PyTorch. The data also includes the results of an emotion recognition engine analyzing the child's emotions. Feedback and rewards are generated based on the analysis results. Generative AI models (such as GPT-3 (registered trademark) and BERT) are used to automatically generate optimal feedback that matches the child's emotions and content.

[0515] server

[0516] The generated feedback and rewards are pushed from the server to the parent's device in real time using a notification service such as Firebase Cloud Messaging (FCM).

[0517] Device (parent device)

[0518] The parent's device receives a push notification from the server and displays the new message in the notification center. When the parent taps the notification, they can view the child's request and receive feedback within the app.

[0519] Specific examples

[0520] Example 1: When a child wants to show a picture

[0521] A child enters text into the app saying, "I want to show my mom the picture I drew," and uploads and sends a photo of the drawing. The emotion recognition engine recognizes the child's emotion as "happy." The server receives the data, and the AI ​​feedback engine evaluates it as "great use of color," generating feedback such as "X-chan drew a wonderful picture." As a reward, the child is given a "Creative Kids" digital badge. A notification is sent to the parent's device stating, "X-chan drew a wonderful picture. A digital badge has been sent."

[0522] Example prompts for generative AI models

[0523] "A child says, 'I want to show my mom the picture I drew.' He / she is very happy. Consider this situation and generate feedback and give him / her a 'Creative Kids' digital badge."

[0524] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0525] Program processing steps

[0526] Step 1:

[0527] Input: The text, images, audio, and other content that your child types.

[0528] The child uses the device's application to input the content they want to show (for example, a picture they have drawn and a message). At this time, an emotion recognition engine is activated to recognize the child's emotions. This organizes the child's input data into the form of text, images, and emotion data.

[0529] Output: Organized input data (text, images, emotion data).

[0530] Step 2:

[0531] Input: Organized input data (text, images, sentiment data).

[0532] The child's device converts the organized input data into JSON format and sends it to the server, which requires a secure communication method to send the data over the Internet.

[0533] Output: JSON formatted data sent to the server.

[0534] Step 3:

[0535] Input: JSON formatted data sent to the server.

[0536] The server stores the received data in a database. The stored data includes the child's ID, input content, image, emotion data, and timestamp. The data is managed using database software (e.g., MySQL, PostgreSQL).

[0537] Output: Data stored in a database.

[0538] Step 4:

[0539] Input: Data stored in a database.

[0540] The server analyzes the data using AI algorithms and emotion recognition engines (e.g., TensorFlow, PyTorch), evaluates the content and emotional data of the received child input data, and generates an analysis result based on the child's emotions.

[0541] Output: Analysis results (evaluation based on the child's feelings).

[0542] Step 5:

[0543] Input: Analysis results.

[0544] The server uses a generative AI model (e.g., GPT-3 or BERT) to generate feedback and rewards based on the analysis results. In this case, the feedback correctly evaluates the child's input and creates appropriate messages based on their emotions. Rewards such as digital certification badges, creation sheets, and digital entertainment items are also generated.

[0545] Output: Generated feedback and rewards (e.g., feedback messages, digital badges).

[0546] Step 6:

[0547] Input: Generated feedback and rewards.

[0548] The server notifies the parent device of the generated feedback and reward in real time using a notification service such as Firebase Cloud Messaging (FCM) to instantly send a push notification to the parent device.

[0549] Output: Notifications sent to the parent device (feedback messages, digital badges).

[0550] Step 7:

[0551] Input: Notifications sent by the server (feedback messages, digital badges).

[0552] The parent's device will receive a notification, which will be displayed as a push notification. When the parent taps the notification, they can view the child's request and the feedback provided within the app, allowing parents to communicate more effectively with their children.

[0553] Output: Feedback and reward displayed in the app.

[0554] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0555] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0556] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0557] [Second embodiment]

[0558] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0559] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0560] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0561] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0562] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0563] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0564] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0565] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0566] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0567] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0568] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0569] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0570] This invention is a system for supporting communication between parents and children, and aims to realize a series of processes in which children input the content they want to see, the data is sent to a server, the server analyzes it, generates feedback and rewards, and notifies the parent's terminal.

[0571] System configuration

[0572] The system includes the following components:

[0573] 1. Children's devices

[0574] A means (interface) for children to input what they want to see

[0575] A means of sending input data to the server (communication function)

[0576] 2. Server

[0577] How data is received and stored

[0578] A means of analyzing the received data (AI or algorithms)

[0579] A means of generating feedback and rewards based on the analysis results

[0580] 3. Parent's device

[0581] A way to receive and communicate feedback and rewards

[0582] Program processing

[0583] User (child):

[0584] The child uses the device's input means to input the content they want their parent to see, saying "Look, look." The input content can be text, photos, videos, etc., and this data is sent to a server via the Internet.

[0585] Device (child's device):

[0586] The system receives the information entered by the child, formats it as data to be sent, and sends a POST request to the server, which then stores the data in the cloud and prepares it for analysis.

[0587] server:

[0588] The server receives the POST request and securely stores the data. The stored data is analyzed by an AI feedback engine, which evaluates the child's interests and behavioral patterns. For example, when evaluating a child's drawing, the engine analyzes the use of color, composition, and theme.

[0589] server:

[0590] Based on the analysis results, feedback and appropriate rewards are generated. The generated feedback is in text format and includes specific evaluations and words of encouragement for the child. Rewards are provided in the form of digital badges, drawing sheets, in-game items, etc., and serve to continue to pique the child's interest.

[0591] Device (parent device):

[0592] A push notification is sent to the parent's device, displaying feedback and a reward. When the parent taps the notification, the "Misete-chan" app opens, where they can check detailed feedback and information about the outcome the child wanted to show.

[0593] Specific examples

[0594] Example 1: When a child wants to show a picture

[0595] 1. User (child):

[0596] Children enter text into the app saying, "I want to show my mom the picture I drew," and then upload and send a photo of the drawing.

[0597] 2. Device (child's device):

[0598] It receives the input data (text and picture) and sends it to the server.

[0599] 3. Server:

[0600] The server receives the data and analyzes the photo of the painting using an AI feedback engine. As a result of the analysis, the painting may be evaluated as having excellent color usage, for example.

[0601] 4. Server:

[0602] Based on the analysis results, feedback such as "XX-chan drew a wonderful picture" is generated, and a digital badge "Creative Kids" is generated as a reward.

[0603] 5. Device (parent device):

[0604] A notification will be sent to the parent's device saying, "○○-chan has drawn a wonderful picture. A digital badge has been sent."

[0605] 6. User (Parent):

[0606] Parents can check the notification and view detailed feedback in the app. When they have time, they can give their child specific praise for what they think is great about their drawing.

[0607] In this way, this system allows parents to communicate smoothly with their children even when they are busy, and children can be properly recognized for their efforts and achievements.

[0608] The processing flow will be explained below.

[0609] Step 1:

[0610] User (child)

[0611] The child opens the "Misete-chan" app and accesses the input form within the app to enter "what they want to see."

[0612] Step 2:

[0613] User (child)

[0614] A child enters text, photos, videos, etc. into the input form. For example, a child can enter a photo of a drawing they have made and the text, "I want to show this to my mom."

[0615] Step 3:

[0616] Device (child's device)

[0617] It receives the input data, converts it into a transfer format such as JSON, and then sends a POST request to the server via the Internet.

[0618] Step 4:

[0619] server

[0620] The POST request is received and stored in a database. The stored data includes the child's ID, input, photo, and timestamp.

[0621] Step 5:

[0622] server

[0623] The stored data is analyzed using an AI feedback engine, which evaluates, for example, the use of color and composition in photos, and the content of text.

[0624] Step 6:

[0625] server

[0626] Feedback is generated based on the analysis results. For example, if the evaluation is "Excellent use of color," the system generates feedback such as "XX-chan drew a wonderful picture."

[0627] Step 7:

[0628] server

[0629] Use the reward generation engine to generate appropriate rewards, such as a digital badge for "creative kids."

[0630] Step 8:

[0631] server

[0632] Notification data is generated to notify the parent's terminal of the generated feedback and reward.

[0633] Step 9:

[0634] Device (parent device)

[0635] A push notification will be received and displayed in the notification center. When a parent taps the notification, the "Misete-chan" app will open and display the feedback details.

[0636] Step 10:

[0637] User (Parent)

[0638] Parents can review the app's feedback and give their child specific praise, such as, "This is what's great about your drawing."

[0639] This series of steps allows parents to quickly and appropriately communicate what their children want to see, and allows parents to maintain regular communication with their children even when they are busy.

[0640] Example 1

[0641] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0642] In today's parent-child relationships, parents need a way to communicate smoothly with their children even when they are busy. In particular, there are many situations where parents are unable to respond immediately when their children want to show their parents the artwork or results they have created as they grow. In such situations, children's efforts may not be properly evaluated, which can result in a decline in their motivation. Therefore, a system is needed that allows parents to properly evaluate the work their children want to show and, through that feedback, further motivate them.

[0643] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0644] In this invention, the server includes a means for receiving and storing data on the server, a means for analyzing the stored data with an AI feedback engine, and a means for generating feedback and a digital reward based on the analysis results. This allows parents to appropriately evaluate the results that their children want to show and notify the parents of the feedback and digital reward on their device, thereby motivating the children and facilitating communication between parents and children.

[0645] "Child" means a minor who is raised by his or her parents within the family home.

[0646] "Input means" refers to the interface that a user uses to provide data, such as text, photos, or videos, to the system.

[0647] "Transmission means" refers to a function for transmitting input data to a server using a communication protocol.

[0648] "Server" refers to a powerful computer system for receiving, storing, analyzing, and managing data.

[0649] "Receiving means" refers to the function by which the server receives data sent from the child's device.

[0650] "Storage means" refers to a memory or database that securely stores received data.

[0651] An "AI feedback engine" refers to a software component that uses artificial intelligence to analyze data and generate evaluations and feedback based on the results.

[0652] "Analysis means" refers to the function of using an AI feedback engine to perform detailed analysis of the received data.

[0653] "Feedback" refers to messages of evaluation and encouragement that are generated for children based on the analysis results.

[0654] "Digital rewards" refers to rewards for children, such as digital badges, points, and in-software items.

[0655] "Notification means" refers to a function that notifies the parent's device of feedback and digital reward information in real time.

[0656] "Parent's device" refers to electronic devices such as smartphones and tablets used by parents.

[0657] "Verification" refers to the ability for parents to view feedback and digital reward details on the device.

[0658] This invention is a system to support communication between parents and children. It implements a series of processes: a child inputs the content they want to see, the data is sent to a server, the server analyzes it, generates feedback and rewards, and notifies the parent's device.

[0659] System configuration

[0660] The system includes the following components:

[0661] 1. Children's devices

[0662] Input method: An interface for children to input what they want to see (e.g., a smartphone app)

[0663] Transmission method: Communication function for sending input data to the server (e.g., Wi-Fi, 4G communication)

[0664] 2. Server

[0665] Receiving means: A means for receiving and storing data (e.g., HTTP server, database)

[0666] Analysis tools: Tools for analyzing stored data with an AI feedback engine (e.g., machine learning models)

[0667] Generator: A generator (e.g., a natural language generation algorithm) for generating feedback and digital rewards based on the analysis results.

[0668] 3. Parent's device

[0669] Notification method: A method for notifying the parent of the generated feedback and digital rewards (e.g., push notification service)

[0670] Confirmation: An interface (e.g., a smartphone app) for parents to review feedback and digital rewards.

[0671] Program processing

[0672] User (child):

[0673] The child uses the device's interface to input what they want their parent to see, such as "Look, look." For example, they could type in the text "I want to show my mom the picture I drew," and then upload a photo of the drawing.

[0674] Device (child's device):

[0675] It receives the information entered by the child, converts it into an appropriate format, and sends it to the server as a POST request. Specifically, it converts the text data and photo data into JSON format and sends it to the server.

[0676] server:

[0677] The received data is securely stored. The stored data is then analyzed using an AI feedback engine. For example, if the target of analysis is a photo of a child's drawing, the machine learning model will analyze the color usage, composition, theme, etc.

[0678] server:

[0679] Based on the analysis results, feedback and digital rewards are generated. For example, feedback such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated.

[0680] server:

[0681] Set up push notifications to send generated feedback and digital reward information to the parent's device. For example, send a notification saying, "X-chan drew a great picture. We've sent you a digital badge."

[0682] Device (parent device):

[0683] A push notification is sent to the parent's device, and when the parent taps the notification, the corresponding app opens, displaying detailed feedback and information about the child's work.

[0684] Specific examples

[0685] Example 1: When a child wants to show a picture

[0686] 1. User (child):

[0687] Children enter text in the app saying, "I want you to see this picture," then upload and send a photo of the drawing.

[0688] 2. Device (child's device):

[0689] It receives the input data (text and picture) and sends it to the server.

[0690] 3. Server:

[0691] The data is received and a photo of the painting is analyzed. The color usage and composition are evaluated using a machine learning model. As a result of the analysis, feedback such as "the color usage is excellent" is received.

[0692] 4. Server:

[0693] Based on the analysis results, feedback such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated.

[0694] 5. Server:

[0695] A push notification will be sent to the parent's device saying, "○○-chan drew a wonderful picture. A digital badge has been sent."

[0696] 6. Device (parent device):

[0697] Parents can view the notification and open the corresponding app to view detailed feedback, allowing them to give specific praise to their child.

[0698] Prompt Sentence Examples

[0699] "Now that my daughter has uploaded her drawing, please generate a rating and feedback. Analyze it to assess color, composition, and theme, then choose words of encouragement and an appropriate digital reward."

[0700] This system allows for real-time recognition of a child's efforts and achievements, facilitating smooth communication between parents and children.

[0701] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0702] Step 1:

[0703] User (child):

[0704] A child opens the app and taps the "Look, look" button. They then enter data such as text, photos, and videos into the input interface. For example, they might enter the text "I want to show my mom the picture I drew," take a photo of the drawing, and upload it. The input in this case is text data and image data.

[0705] Step 2:

[0706] Device (child's device):

[0707] It takes the user's input (text and photo) and converts it to the appropriate format. Specifically, it converts the input data to JSON and prepares it as a POST request. For example, it generates the following JSON data:

[0708] json

[0709] {

[0710] "message": "I want to show my mom the picture I drew",

[0711] "image_data": "<base64_encoded_image_data> "

[0712] }

[0713] This is sent to a server via the Internet.

[0714] Step 3:

[0715] server:

[0716] Receives a POST request sent from the device. The received data is first validated and then securely stored in a database. For example, image data is stored in cloud storage (e.g., AWS S3), and its reference URL is stored in the database. The received data is then imported into "message" and "image_data".

[0717] Step 4:

[0718] server:

[0719] The saved data is input into an AI feedback engine for analysis. A machine learning model is used to evaluate the color usage, composition, theme, and other aspects of the pictures uploaded by children. For example, the image analysis engine evaluates the variety of colors and balance of the composition, and generates a rating such as "excellent color usage" as the analysis result. The output is text data of the analysis results.

[0720] Step 5:

[0721] server:

[0722] Based on the analysis results, a feedback message and digital reward are generated. For example, based on the text data of the analysis results, a feedback message such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated. The generated feedback and reward are stored in a database. The output is the feedback message and digital reward data.

[0723] Step 6:

[0724] server:

[0725] The generated feedback and digital reward information is sent to the parent's device via push notification. Specifically, a push notification service (e.g., Firebase Cloud Messaging) is used to notify the parent's device. For example, a notification message saying, "X-chan drew a great picture. We've sent you a digital badge." The input in this case is the feedback message and digital reward data, and the output is the sending of a push notification.

[0726] Step 7:

[0727] Device (parent device):

[0728] A push notification is sent to the parent's device, and when the parent taps the notification, the corresponding app opens. A detailed feedback message and information about the child's work are displayed in the app. For example, the feedback message "Your drawing is so colorful and wonderful!" and the digital badge "Creative Kids" are displayed. The parent can review this and give specific praise to their child. The output is the feedback message and a digital reward.

[0729] (Application example 1)

[0730] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0731] Robots used in factories are required to accurately detect abnormalities and areas requiring maintenance during operation and notify managers and workers in real time, enabling prompt and appropriate responses and improving work safety and efficiency. However, current systems have issues with the accuracy of abnormality detection and the speed of notification. In addition, they do not provide sufficient feedback on appropriate countermeasures or rewards, which creates challenges in maintaining motivation and improving work efficiency.

[0732] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0733] In this invention, the server includes a means for inputting the content that the worker wants to see, a means for transmitting the input data to the server, a means for analyzing the data received by the server and generating feedback and rewards based on the analysis results, and a means for notifying the generated feedback and rewards to the manager's terminal. This enables accurate detection and prompt notification of abnormalities and areas requiring maintenance, provides appropriate feedback for countermeasures and rewards to maintain motivation, and improves the safety and efficiency of work.

[0734] "Worker" means an employee who performs work within a factory.

[0735] An "administrator" is a person in charge of managing work within a factory and the operation of robots.

[0736] "Server" refers to a computer system for receiving, analyzing, storing data, and generating feedback.

[0737] "Input means" refers to the interface or device that allows the worker to input the information they want to see.

[0738] "Transmission means" refers to the communication functions and protocols used to transmit input data to the server.

[0739] "Means of analysis" refers to algorithms and AI engines that process the data received by the server and detect anomalies or identify areas requiring maintenance.

[0740] "Feedback" refers to evaluations and instructions provided to workers and managers based on the analysis results.

[0741] "Rewards" are digital badges or other rewards given to workers for taking corrective action.

[0742] "Means of notification" refers to communication methods and push notification functions for conveying generated feedback and rewards to managers and workers.

[0743] An "abnormality" refers to an operation or state that differs from normal in machines or systems within a factory.

[0744] "Maintenance required areas" are areas or parts that require preventative maintenance or repair.

[0745] "Digital Badge" means an electronic reward provided to recognize a worker's achievements.

[0746] A "safety badge" is an electronic certificate of knowledge provided to workers as recognition of safe work practices.

[0747] This invention is a system that supports communication between managers and workers to improve the safety and efficiency of robots used in factories. The system aims to realize a series of processes in which workers input what they want to see, send the data to a server, analyze it, generate feedback and rewards, and notify the manager's terminal.

[0748] System configuration

[0749] The system includes the following components:

[0750] 1. Worker's terminal

[0751] A means (interface) for workers to input what they want to see

[0752] A means of sending input data to the server (communication function)

[0753] 2. Server

[0754] How data is received and stored

[0755] A means of analyzing the received data (AI or algorithms)

[0756] A means of generating feedback and rewards based on the analysis results

[0757] 3. Administrator's terminal

[0758] A way to receive and communicate feedback and rewards

[0759] Program processing (natural language explanation)

[0760] Worker (user):

[0761] The worker uses the input means of the terminal to input what he or she wants the manager to see. The input content can be text, photos, videos, etc., and this data is sent to the server via the Internet.

[0762] Terminal (Worker's terminal):

[0763] The system receives the information entered by the worker, formats it as transmission data, and sends a POST request to the server, which saves the data in the cloud and prepares it for analysis.

[0764] server:

[0765] The server receives the POST request and securely stores the data. The stored data is analyzed by an AI feedback engine to track work progress and identify abnormalities. For example, when evaluating abnormal machine sounds, the characteristics and frequency of the sound are analyzed.

[0766] server:

[0767] Based on the analysis results, feedback and appropriate rewards are generated. The generated feedback is in text format and includes specific evaluations and measures for the worker. Rewards are provided in the form of digital badges, safety badges, etc., and serve to continuously motivate workers.

[0768] Terminal (Administrator's terminal):

[0769] A push notification is sent to the manager's device, informing them of the feedback and reward. When the manager taps the notification, the app opens and they can view detailed feedback and the information about the deliverables that the worker wanted to see.

[0770] Specific examples

[0771] Example 1: When the robot detects an abnormal sound

[0772] 1. Worker (user):

[0773] The worker enters text into the app saying, "There is an abnormal noise coming from the machine," and then uploads and sends the recording of the abnormal noise.

[0774] 2. Terminal (Worker's terminal):

[0775] Receives input data (text and audio data) and sends it to the server.

[0776] 3. Server:

[0777] The server receives the data and analyzes the recorded data using an AI feedback engine. As a result of the analysis, it may conclude that the cause is, for example, "wear on the bearings."

[0778] 4. Server:

[0779] Based on the analysis results, feedback is generated such as "Machine A's bearings are worn and require inspection," and a digital badge "Safety Awareness" is generated as a reward.

[0780] 5. Terminal (Administrator's terminal):

[0781] A notification is sent to the administrator's terminal stating, "An abnormality has been detected in Machine A. Inspection is required."

[0782] 6. Operator / Administrator:

[0783] The administrator checks the notification, views detailed feedback in the app, and issues instructions on the necessary response, which the worker then implements to resolve the abnormality.

[0784] Prompt Sentence Examples

[0785] Data from a machine where an abnormality was detected has been sent and analyzed. The abnormality detected is bearing wear. Generate feedback to notify managers and workers: "There is wear in the bearings of machine A. Inspection recommended." and assign a related digital badge.

[0786] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0787] Step 1:

[0788] The user (worker) uses the terminal to input the information they want to see (abnormal sounds or problems). The input method is text, photos, or video. The input data is saved in the terminal once and is ready to be sent.

[0789] Input: What the worker inputs (text, photos, videos)

[0790] Output: Input data ready to be sent

[0791] Step 2:

[0792] The terminal sends the formatted data to the server using the HTTP POST request as the communication protocol.

[0793] Input: Input data ready to be sent

[0794] Output: Data sent to the server

[0795] Step 3:

[0796] The server receives the data sent from the device and stores it securely in a database (e.g., MySQL).

[0797] Input: Data sent from the terminal

[0798] Output: Data stored in the database

[0799] Step 4:

[0800] The AI ​​feedback engine on the server analyzes the stored data, specifically using a sound analysis algorithm (e.g., SpaCy or TensorFlow) to analyze abnormal sounds.

[0801] Input: Saved data

[0802] Output: Analysis results (e.g. abnormal noise is caused by bearing wear)

[0803] Step 5:

[0804] The server generates feedback based on the analysis results, including specific measures and evaluations, and generates appropriate rewards (e.g., digital badges).

[0805] Input: Analysis results

[0806] Output: Feedback and reward (e.g., bearing wear is the cause. Inspection recommended. Digital badge "Safety Awareness")

[0807] Step 6:

[0808] The generated feedback and reward will be sent to the administrator's device via a push notification, which will include information about the feedback and reward.

[0809] Input: Feedback and Rewards

[0810] Output: Push notification sent to the administrator's device

[0811] Step 7:

[0812] The manager checks the notification on the terminal and views the detailed feedback content, and if necessary, issues instructions to the worker to resolve the problem.

[0813] Input: Push notification sent to the administrator's device

[0814] Output: Feedback viewed by the administrator and instructions to respond

[0815] Specific behavior:

[0816] 1. User enters text, photo, or video and presses the save button

[0817] 2. The device formats the data and sends it to the server

[0818] 3. The server receives the data and stores it in the database

[0819] 4. The AI ​​engine on the server analyzes the data

[0820] 5. The server generates feedback and rewards based on the analysis results.

[0821] 6. The server notifies the administrator of the generated feedback and rewards.

[0822] 7. The administrator checks the notification, reads the feedback, and takes any necessary action.

[0823] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0824] This invention relates to a system that supports communication between parents and children by allowing children to input what they want to see, sending the data to a server, which then analyzes the data to generate feedback and rewards, and notifying the parent's device of the generated feedback and rewards. Furthermore, this system incorporates an emotion engine that recognizes the child's emotions.

[0825] System configuration

[0826] The system includes the following components:

[0827] 1. Children's devices

[0828] A means (interface) for children to input what they want to see

[0829] A means of sending input data to the server (communication function)

[0830] 2. Server

[0831] How data is received and stored

[0832] A means of analyzing the received data (AI or algorithms)

[0833] Emotion recognition using an emotion engine

[0834] A means of generating feedback and rewards based on the analysis results

[0835] 3. Parent's device

[0836] A way to receive and communicate feedback and rewards

[0837] Program processing

[0838] User (child):

[0839] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[0840] Device (child's device):

[0841] The data entered by children is converted into JSON format or similar and sent to a server via the Internet.

[0842] server:

[0843] The server receives the POST request and stores it in a database. The stored data includes the child's ID, input content, photo, and timestamp. The emotion engine recognizes the child's emotions from the input text and image. This emotion data is also used for analysis.

[0844] server:

[0845] The received data is analyzed using an AI feedback engine. For example, the system evaluates the color usage and composition of the drawing, and provides analysis results that take the child's emotions into consideration.

[0846] server:

[0847] Based on the analysis results, feedback and rewards are generated. For example, if a child is pleased with the evaluation that "your use of color is excellent," the system generates feedback such as "Your drawing is very colorful and beautiful!" and provides the digital badge "Creative Kids" as a reward.

[0848] Device (parent device):

[0849] The generated feedback and reward notifications are sent to the parent's device. When a push notification is received, a new message appears in the notification center. When the parent taps the notification, they can view the child's request and the corresponding feedback within the app.

[0850] Specific examples

[0851] Example 1: When a child wants to show a picture

[0852] 1. User (child):

[0853] A child can type in text in the app saying, "I want to show my mom the picture I drew," upload a photo of the drawing, and send it. The emotion engine recognizes that the child is "happy."

[0854] 2. Device (child's device):

[0855] The entered data (text and picture) is sent to the server in JSON format.

[0856] 3. Server:

[0857] Receive and store data. The emotion engine recognizes when a child is happy.

[0858] 4. Server:

[0859] The AI ​​feedback engine analyzes the data and evaluates it as "great use of color." Taking into account the results of the emotion engine, the feedback is determined as "X-Chan drew a wonderful picture."

[0860] 5. Server:

[0861] A reward generation engine generates digital badges for "creative kids."

[0862] 6. Device (parent device):

[0863] A notification will be sent to the parent's device saying, "○○-chan has drawn a wonderful picture. A digital badge has been sent."

[0864] 7. User (Parent):

[0865] Parents can view the notification and detailed feedback within the app, giving specific praise such as, "Your drawing is so colorful and beautiful!"

[0866] In this way, this system allows parents to communicate smoothly with their children even when they are busy, and children can be properly recognized for their efforts and achievements. Furthermore, the emotion engine allows feedback that takes into account the child's emotions, resulting in greater understanding and consideration.

[0867] The processing flow will be explained below.

[0868] Step 1:

[0869] User (child)

[0870] Open the "Misete-chan" app. Access the input form within the app and enter the "content you want to see."

[0871] Step 2:

[0872] User (child)

[0873] Enter text, photos, videos, etc. into the input form. For example, take a photo of a drawing you've made and enter the text "I want my mom to see this."

[0874] Step 3:

[0875] Device (child's device)

[0876] It receives the input data, converts it to JSON format, and then sends a POST request to the server via the Internet.

[0877] Step 4:

[0878] server

[0879] It receives a POST request and stores it in a database. The data stored includes the child's ID, input, photo, and timestamp.

[0880] Step 5:

[0881] server

[0882] The data is passed to an AI feedback engine for analysis of text data and photos. At the same time, an emotion engine recognizes the child's emotions from the text and photos. For example, if the text is "I want my mom to see this," the emotion engine recognizes positive emotions (joy).

[0883] Step 6:

[0884] server

[0885] An AI feedback engine analyzes the data and evaluates the child's input and photos. For example, it analyzes a photo of a drawing and evaluates it as "great use of color."

[0886] Step 7:

[0887] server

[0888] The emotions recognized by the emotion engine are combined with the evaluation results of the AI ​​feedback engine to generate feedback. For example, specific feedback such as "Your drawing is very colorful and beautiful! You must be happy to show it to your mother" can be set.

[0889] Step 8:

[0890] server

[0891] The reward generation engine uses the analysis results and emotional data to generate appropriate rewards, such as creating a digital badge for "creative kids."

[0892] Step 9:

[0893] server

[0894] The system generates data to notify the parent's device of the generated feedback and reward. The notification includes a summary of the feedback and the reward.

[0895] Step 10:

[0896] Device (parent device)

[0897] A push notification will be received and displayed in the notification center. When a parent taps the notification, the "Misete-chan" app will open and display detailed feedback and reward information.

[0898] Step 11:

[0899] User (Parent)

[0900] Parents can check the feedback within the app and give their child specific praise, for example, "Your drawing is so colorful and beautiful!"

[0901] This series of steps allows children to quickly and appropriately communicate what they want to see to their parents, and allows parents to communicate with their children regularly even when they are busy. Furthermore, providing feedback and rewards that take children's emotions into consideration makes communication even more effective.

[0902] Example 2

[0903] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0904] Conventional parent-child communication systems lack a means for children to properly communicate what they want to see to their parents, or a means for providing feedback that understands the child's emotions. Furthermore, there is a lack of a way to generate rewards that take the child's emotions into account and notify the parent. This creates a challenge in that it is difficult to ensure smooth communication even when parents are busy.

[0905] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0906] In this invention, the server includes an emotion recognition means for recognizing the child's emotion, a means for notifying the parent of appropriate feedback based on the analysis, and a means for generating a reward such as a digital badge, a drawing sheet, or an in-game item, thereby making it possible to provide appropriate feedback and rewards while taking the child's emotion into consideration.

[0907] "Means for inputting content that children want to see" refers to devices or interfaces that allow children to input content that they want to see, and includes software such as applications that run on smartphones and tablets.

[0908] "Means for transmitting input data to a server" refers to a function for transmitting data input by a child to a server via a communication means such as the Internet.

[0909] "Means of analyzing data received by the server and generating feedback and rewards based on the analysis results" refers to a system that analyzes received data using AI or algorithms and automatically generates feedback messages and rewards based on the results.

[0910] "Means for notifying the parent's terminal of the generated feedback and reward" refers to a function for sending and notifying the parent's terminal of the generated feedback message and reward information.

[0911] "Emotion recognition means for recognizing children's emotions" refers to engines or algorithms that analyze and recognize the emotional state of children from text, images, etc. entered by them.

[0912] "Means for communicating data in JSON format" refers to the means for converting the content entered by the child into JSON (JavaScript Object Notation) format and sending it to the server according to the communication protocol.

[0913] "Means for using emotional data for analysis" refers to the ability to use a child's emotional state as part of data analysis to generate more appropriate feedback and rewards.

[0914] "Digital badges" refer to electronic awards or certificates given to children based on their behavior and achievements.

[0915] A "drawing sheet" refers to a digital or physical sheet generated based on a child's drawing and related information.

[0916] "In-game items" refer to benefits and rewards that can be used within the game a child is playing.

[0917] MODE FOR CARRYING OUT THE INVENTION

[0918] This invention relates to a system that supports communication between parents and children by allowing children to input what they want to see, sending the data to a server, which then analyzes the data to generate feedback and rewards, and notifying the parent's device of the generated feedback and rewards. Furthermore, this system incorporates an emotion engine that recognizes the child's emotions.

[0919] System configuration

[0920] The system includes the following components:

[0921] 1. Children's devices

[0922] Input method: An interface for children to input what they want to see. For example, a smartphone application.

[0923] Transmission means: A communication function for transmitting input data to a server.

[0924] 2. Server

[0925] Receiving means: A function that receives and stores data (e.g., a database system).

[0926] Analysis means: A function that analyzes the received data (e.g., AI feedback engine, emotion recognition engine).

[0927] Generation means: A function that generates feedback and rewards based on the analysis results.

[0928] Notification: A function that notifies the parent's device of the generated feedback and rewards.

[0929] 3. Parent's device

[0930] Receiving means: A function for receiving and notifying feedback and rewards (e.g., a smartphone application).

[0931] Program processing

[0932] User (child):

[0933] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[0934] Device (child's device):

[0935] The data entered by the child is converted into JSON format and sent to a server via the internet. The entered data includes the child's ID, input content, photo, timestamp, etc.

[0936] server:

[0937] The server receives the POST request and stores it in a database. This data contains all the information necessary for analysis, such as the child's ID, input content, photo, and timestamp. Next, an emotion recognition engine is used to recognize the child's emotions from the input text and images. Specifically, it identifies emotions such as "happy" from the child's text message and image.

[0938] server:

[0939] The received data, including emotional data, is analyzed by an AI feedback engine. For example, a drawing is evaluated for its color usage and composition. Emotional data is also taken into account in the analysis to generate more appropriate feedback.

[0940] server:

[0941] A feedback message and reward are generated based on the analysis results. For example, if the analysis result is "great use of color" and the child is pleased, the system generates feedback such as "Your drawing is very colorful and wonderful!" and provides a "Creative Kids" digital badge as a reward.

[0942] Device (parent device):

[0943] The generated feedback message and reward information are sent to the parent's device. The parent's device receives a push notification, and a new message appears in the notification center. When the parent taps the notification, they can view the child's request and the corresponding feedback within the "Misete-chan" app.

[0944] Specific examples

[0945] Example 1: When a child wants to show a picture

[0946] User (child):

[0947] A child uses the "Misete-chan" app to type, "I want to show my mom the picture I drew," and uploads a photo of the drawing. The emotion engine recognizes that the child is "happy."

[0948] Device (child's device):

[0949] The entered data (text and picture) is sent to the server in JSON format.

[0950] server:

[0951] Receive and store data. The emotion engine recognizes when a child is happy.

[0952] server:

[0953] The AI ​​feedback engine analyzes the data and evaluates it as "great use of color." Taking into account the results of the emotion engine, the feedback is determined as "X-Chan drew a wonderful picture."

[0954] server:

[0955] A reward generation engine generates digital badges for "creative kids."

[0956] Device (parent device):

[0957] A notification will be sent to the parent's device saying, "X-chan drew a wonderful picture. We've sent you a digital badge." The parent will then check the notification and view detailed feedback within the app. They can then give specific praise, such as, "Your drawing is so colorful and beautiful!"

[0958] Prompt Sentence Examples

[0959] Below are some example prompts to input to the generative AI model:

[0960] A child requests in the app, "Mommy, please show me your dinosaur drawing." Feedback: Great colors, this dinosaur looks so realistic. Emotion: Delighted. Generated feedback: "Great colors! This dinosaur looks so realistic!" Generated badge: "Creative Kids."

[0961] In this way, this system allows parents to communicate smoothly with their children even when they are busy. Children can be properly recognized for their efforts and achievements, and the emotion engine allows for feedback that takes children's emotions into consideration.

[0962] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0963] Step 1:

[0964] User (child):

[0965] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[0966] Input: Text message (e.g., "I want my mom to see this") and image data (e.g., a photo of a drawing).

[0967] Output: JSON formatted data.

[0968] Specific operation: Using the camera function within the app, an interface will appear where you can take a photo of the painting and enter a message.

[0969] Step 2:

[0970] Device (child's device):

[0971] The entered data is converted into JSON format and sent to the server via the Internet.

[0972] Input: Text messages and photos sent by users.

[0973] Output: A POST request to the server.

[0974] What happens: The app internally encodes the data into JSON format and sends a POST request to the server endpoint.

[0975] Step 3:

[0976] server:

[0977] The server receives the POST request and stores it in a database, which stores the child's ID, input, photo, timestamp, etc.

[0978] Input: JSON formatted data.

[0979] Output: Records stored in the database.

[0980] What happens: The server parses the POST request and creates a new record in the database.

[0981] Step 4:

[0982] server:

[0983] Using an emotion recognition engine, the system recognizes a child's emotions from input text and images. For example, it identifies emotions such as "happy" from a child's message.

[0984] Input: Text message and image data.

[0985] Output: Emotion data (e.g., "happy").

[0986] Specific operation: The emotion recognition engine performs text analysis and image analysis to estimate emotions.

[0987] Step 5:

[0988] server:

[0989] The AI ​​feedback engine analyzes the received data and emotional data, for example evaluating the color usage and composition of the picture and determining feedback taking the child's emotions into account.

[0990] Input: Stored database data and emotion data.

[0991] Output: Feedback content.

[0992] Specific operation: The AI ​​feedback engine analyzes the data and makes an evaluation.

[0993] Step 6:

[0994] server:

[0995] Based on the analysis results, feedback messages and rewards are generated. For example, based on the result that "children are delighted with the wonderful use of color," feedback such as "Your drawing is very colorful and wonderful!" and a digital badge of "Creative Kids" are generated.

[0996] Input: Analysis results and emotion data.

[0997] Output: Feedback message and digital badge.

[0998] What happens: The server constructs a feedback message and generates a digital badge.

[0999] Step 7:

[1000] server:

[1001] The generated feedback message and reward information are sent to the parent's device.

[1002] Input: Feedback message and digital badge.

[1003] Output: Notification to parent device.

[1004] Specific operation: The server sends a push notification to the parent device.

[1005] Step 8:

[1006] Device (parent device):

[1007] When parents tap the notification, they can view their child's request and feedback within the "Misete-chan" app.

[1008] Input: Notification from the server.

[1009] Output: Display of feedback message.

[1010] What it does: Parents receive a notification on their smartphone and receive detailed feedback within the app.

[1011] These steps allow the system to take into account the child's input and emotions, and provide appropriate feedback and rewards to the parent.

[1012] (Application example 2)

[1013] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1014] In modern society, busy parents tend to neglect communication with their children. This reduces opportunities for children to have their efforts and achievements seen, making it difficult for them to feel confident or happy. It is also often difficult to properly understand a child's emotions and provide them with feedback. This invention aims to solve these problems by providing a system that accurately understands the content and emotions entered by a child and provides appropriate feedback to parents in real time.

[1015] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for inputting content that the child wants to see, a means for transmitting the input data to the server, a means for analyzing the data received by the server and generating feedback and a reward based on the analysis results, a means for notifying the parent's device of the generated feedback and reward, a means for analyzing the child's emotions using an emotion recognition engine, a means for notifying the parent's device of the generated feedback and reward in real time, and a means for generating optimal feedback based on the analysis results using a generative AI model. This makes it possible to accurately understand the content and emotions input by the child and notify the parent of appropriate feedback and reward in real time.

[1016] Key Word Definitions

[1017] "Means for inputting what children want their parents to see" refers to an interface that allows children to input what they want their parents to see in the form of text, images, audio, etc.

[1018] "Means for transmitting input data to a server" refers to a communication function that transmits data input by a child to a server via the Internet.

[1019] "Means for analyzing data received by the server and generating feedback and rewards based on the analysis results" refers to a function that analyzes data received by the server and automatically generates feedback for the parent and rewards for the child based on the analysis results.

[1020] The "means for notifying the parent's terminal of the generated feedback and reward" is a communication function for transmitting the feedback and reward generated by the server to the parent's terminal in real time.

[1021] "Means for analyzing children's emotions using an emotion recognition engine" is an AI technology that analyzes emotions from text, voice, images, etc. entered by the child and identifies the child's current emotions.

[1022] "Means for notifying the parent's device of the generated feedback and reward in real time" is a function for instantly sending the generated feedback and reward to the parent's device, thereby quickly conveying the information to the parent.

[1023] "Means for generating optimal feedback based on analysis results using a generative AI model" refers to a function that uses an AI model to evaluate analysis results and generate optimal feedback for children.

[1024] A "digital certification badge" is a badge that digitally recognizes a child's efforts and achievements and is used to enhance a child's sense of accomplishment.

[1025] "Creative sheets" are digital tools that allow children to engage in creative activities, and examples include drawing sheets.

[1026] "Digital entertainment items" are digital items provided to increase children's enjoyment, including, for example, in-game bonuses and items.

[1027] MODE FOR CARRYING OUT THE INVENTION

[1028] This invention relates to a system for promoting communication between parents and children. A child inputs the content they want to see and sends the data to a server, which analyzes it, generates feedback and rewards, and notifies the parent's device. The system also uses an emotion recognition engine to analyze the child's emotions and generates optimal feedback accordingly.

[1029] System configuration

[1030] 1. Children's devices:

[1031] Input medium: The interface that a child uses to input content such as text, images, or audio.

[1032] Communication method: A communication function that sends the data entered by the child to a server via the Internet.

[1033] 2. Server:

[1034] Data storage means: The server has the function of storing the received data in a database.

[1035] Data analysis method: The server analyzes the received data using AI algorithms, including an emotion recognition engine.

[1036] Feedback generation method: The system has the ability to generate feedback and rewards based on the recorded data and analysis results. Using a generative AI model, it suggests optimal feedback based on the child's emotions.

[1037] Notification: The generated feedback and rewards are sent to the parent's device in real time.

[1038] 3. Parent device:

[1039] Receiving means: The parent's device receives feedback and reward notifications from the server.

[1040] Display: The reported feedback and rewards are displayed within the app for easy parental review.

[1041] Processing flow

[1042] User (child)

[1043] Using an application installed on the child's device, the child can input "what they want to show their mother" in the form of text, image, voice, etc. For example, the child can take a photo of a drawing they have made and attach a text message saying "I want to show this to my mother." The emotion recognition engine analyzes the child's emotions and sends this data to the server.

[1044] Device (child's device)

[1045] The data entered by children is converted into JSON format or similar and sent to a server via the Internet.

[1046] server

[1047] The server stores the received data in a database and analyzes it using an AI algorithm, such as tools like TensorFlow or PyTorch. The AI ​​algorithm also includes the results of an emotion recognition engine analyzing the child's emotions. Feedback and rewards are generated based on the analysis results. Generative AI models (such as GPT-3 or BERT) are used to automatically generate optimal feedback that matches the child's emotions and content.

[1048] server

[1049] The generated feedback and rewards are pushed from the server to the parent's device in real time using a notification service such as Firebase Cloud Messaging (FCM).

[1050] Device (parent device)

[1051] The parent's device receives a push notification from the server and displays the new message in the notification center. When the parent taps the notification, they can view the child's request and receive feedback within the app.

[1052] Specific examples

[1053] Example 1: When a child wants to show a picture

[1054] A child enters text into the app saying, "I want to show my mom the picture I drew," and uploads and sends a photo of the drawing. The emotion recognition engine recognizes the child's emotion as "happy." The server receives the data, and the AI ​​feedback engine evaluates it as "great use of color," generating feedback such as "X-chan drew a wonderful picture." As a reward, the child is given a "Creative Kids" digital badge. A notification is sent to the parent's device stating, "X-chan drew a wonderful picture. A digital badge has been sent."

[1055] Example prompts for generative AI models

[1056] "A child says, 'I want to show my mom the picture I drew.' He / she is very happy. Consider this situation and generate feedback and give him / her a 'Creative Kids' digital badge."

[1057] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1058] Program processing steps

[1059] Step 1:

[1060] Input: The text, images, audio, and other content that your child types.

[1061] The child uses the device's application to input the content they want to show (for example, a picture they have drawn and a message). At this time, an emotion recognition engine is activated to recognize the child's emotions. This organizes the child's input data into the form of text, images, and emotion data.

[1062] Output: Organized input data (text, images, emotion data).

[1063] Step 2:

[1064] Input: Organized input data (text, images, sentiment data).

[1065] The child's device converts the organized input data into JSON format and sends it to the server, which requires a secure communication method to send the data over the Internet.

[1066] Output: JSON formatted data sent to the server.

[1067] Step 3:

[1068] Input: JSON formatted data sent to the server.

[1069] The server stores the received data in a database. The stored data includes the child's ID, input content, image, emotion data, and timestamp. The data is managed using database software (e.g., MySQL, PostgreSQL).

[1070] Output: Data stored in a database.

[1071] Step 4:

[1072] Input: Data stored in a database.

[1073] The server analyzes the data using AI algorithms and emotion recognition engines (e.g., TensorFlow, PyTorch), evaluates the content and emotional data of the received child input data, and generates an analysis result based on the child's emotions.

[1074] Output: Analysis results (evaluation based on the child's feelings).

[1075] Step 5:

[1076] Input: Analysis results.

[1077] The server uses a generative AI model (e.g., GPT-3 or BERT) to generate feedback and rewards based on the analysis results. In this case, the feedback correctly evaluates the child's input and creates appropriate messages based on their emotions. Rewards such as digital certification badges, creation sheets, and digital entertainment items are also generated.

[1078] Output: Generated feedback and rewards (e.g., feedback messages, digital badges).

[1079] Step 6:

[1080] Input: Generated feedback and rewards.

[1081] The server notifies the parent device of the generated feedback and reward in real time using a notification service such as Firebase Cloud Messaging (FCM) to instantly send a push notification to the parent device.

[1082] Output: Notifications sent to the parent device (feedback messages, digital badges).

[1083] Step 7:

[1084] Input: Notifications sent by the server (feedback messages, digital badges).

[1085] The parent's device will receive a notification, which will be displayed as a push notification. When the parent taps the notification, they can view the child's request and the feedback provided within the app, allowing parents to communicate more effectively with their children.

[1086] Output: Feedback and reward displayed in the app.

[1087] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1088] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1089] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1090] [Third embodiment]

[1091] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1092] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1093] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1094] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1095] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1096] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1097] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1098] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1099] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1100] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1101] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1102] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1103] This invention is a system for supporting communication between parents and children, and aims to realize a series of processes in which children input the content they want to see, the data is sent to a server, the server analyzes it, generates feedback and rewards, and notifies the parent's terminal.

[1104] System configuration

[1105] The system includes the following components:

[1106] 1. Children's devices

[1107] A means (interface) for children to input what they want to see

[1108] A means of sending input data to the server (communication function)

[1109] 2. Server

[1110] How data is received and stored

[1111] A means of analyzing the received data (AI or algorithms)

[1112] A means of generating feedback and rewards based on the analysis results

[1113] 3. Parent's device

[1114] A way to receive and communicate feedback and rewards

[1115] Program processing

[1116] User (child):

[1117] The child uses the device's input means to input the content they want their parent to see, saying "Look, look." The input content can be text, photos, videos, etc., and this data is sent to a server via the Internet.

[1118] Device (child's device):

[1119] The system receives the information entered by the child, formats it as data to be sent, and sends a POST request to the server, which then stores the data in the cloud and prepares it for analysis.

[1120] server:

[1121] The server receives the POST request and securely stores the data. The stored data is analyzed by an AI feedback engine, which evaluates the child's interests and behavioral patterns. For example, when evaluating a child's drawing, the engine analyzes the use of color, composition, and theme.

[1122] server:

[1123] Based on the analysis results, feedback and appropriate rewards are generated. The generated feedback is in text format and includes specific evaluations and words of encouragement for the child. Rewards are provided in the form of digital badges, drawing sheets, in-game items, etc., and serve to continue to pique the child's interest.

[1124] Device (parent device):

[1125] A push notification is sent to the parent's device, displaying feedback and a reward. When the parent taps the notification, the "Misete-chan" app opens, where they can check detailed feedback and information about the outcome the child wanted to show.

[1126] Specific examples

[1127] Example 1: When a child wants to show a picture

[1128] 1. User (child):

[1129] Children enter text into the app saying, "I want to show my mom the picture I drew," and then upload and send a photo of the drawing.

[1130] 2. Device (child's device):

[1131] It receives the input data (text and picture) and sends it to the server.

[1132] 3. Server:

[1133] The server receives the data and analyzes the photo of the painting using an AI feedback engine. As a result of the analysis, the painting may be evaluated as having excellent color usage, for example.

[1134] 4. Server:

[1135] Based on the analysis results, feedback such as "XX-chan drew a wonderful picture" is generated, and a digital badge "Creative Kids" is generated as a reward.

[1136] 5. Device (parent device):

[1137] A notification will be sent to the parent's device saying, "○○-chan has drawn a wonderful picture. A digital badge has been sent."

[1138] 6. User (Parent):

[1139] Parents can check the notification and view detailed feedback in the app. When they have time, they can give their child specific praise for what they think is great about their drawing.

[1140] In this way, this system allows parents to communicate smoothly with their children even when they are busy, and children can be properly recognized for their efforts and achievements.

[1141] The processing flow will be explained below.

[1142] Step 1:

[1143] User (child)

[1144] The child opens the "Misete-chan" app and accesses the input form within the app to enter "what they want to see."

[1145] Step 2:

[1146] User (child)

[1147] A child enters text, photos, videos, etc. into the input form. For example, a child can enter a photo of a drawing they have made and the text, "I want to show this to my mom."

[1148] Step 3:

[1149] Device (child's device)

[1150] It receives the input data, converts it into a transfer format such as JSON, and then sends a POST request to the server via the Internet.

[1151] Step 4:

[1152] server

[1153] The POST request is received and stored in a database. The stored data includes the child's ID, input, photo, and timestamp.

[1154] Step 5:

[1155] server

[1156] The stored data is analyzed using an AI feedback engine, which evaluates, for example, the use of color and composition in photos, and the content of text.

[1157] Step 6:

[1158] server

[1159] Feedback is generated based on the analysis results. For example, if the evaluation is "Excellent use of color," the system generates feedback such as "XX-chan drew a wonderful picture."

[1160] Step 7:

[1161] server

[1162] Use the reward generation engine to generate appropriate rewards, such as a digital badge for "creative kids."

[1163] Step 8:

[1164] server

[1165] Notification data is generated to notify the parent's terminal of the generated feedback and reward.

[1166] Step 9:

[1167] Device (parent device)

[1168] A push notification will be received and displayed in the notification center. When a parent taps the notification, the "Misete-chan" app will open and display the feedback details.

[1169] Step 10:

[1170] User (Parent)

[1171] Parents can review the app's feedback and give their child specific praise, such as, "This is what's great about your drawing."

[1172] This series of steps allows parents to quickly and appropriately communicate what their children want to see, and allows parents to maintain regular communication with their children even when they are busy.

[1173] Example 1

[1174] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1175] In today's parent-child relationships, parents need a way to communicate smoothly with their children even when they are busy. In particular, there are many situations where parents are unable to respond immediately when their children want to show their parents the artwork or results they have created as they grow. In such situations, children's efforts may not be properly evaluated, which can result in a decline in their motivation. Therefore, a system is needed that allows parents to properly evaluate the work their children want to show and, through that feedback, further motivate them.

[1176] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1177] In this invention, the server includes a means for receiving and storing data on the server, a means for analyzing the stored data with an AI feedback engine, and a means for generating feedback and a digital reward based on the analysis results. This allows parents to appropriately evaluate the results that their children want to show and notify the parents of the feedback and digital reward on their device, thereby motivating the children and facilitating communication between parents and children.

[1178] "Child" means a minor who is raised by his or her parents within the family home.

[1179] "Input means" refers to the interface that a user uses to provide data, such as text, photos, or videos, to the system.

[1180] "Transmission means" refers to a function for transmitting input data to a server using a communication protocol.

[1181] "Server" refers to a powerful computer system for receiving, storing, analyzing, and managing data.

[1182] "Receiving means" refers to the function by which the server receives data sent from the child's device.

[1183] "Storage means" refers to a memory or database that securely stores received data.

[1184] An "AI feedback engine" refers to a software component that uses artificial intelligence to analyze data and generate evaluations and feedback based on the results.

[1185] "Analysis means" refers to the function of using an AI feedback engine to perform detailed analysis of the received data.

[1186] "Feedback" refers to messages of evaluation and encouragement that are generated for children based on the analysis results.

[1187] "Digital rewards" refers to rewards for children, such as digital badges, points, and in-software items.

[1188] "Notification means" refers to a function that notifies the parent's device of feedback and digital reward information in real time.

[1189] "Parent's device" refers to electronic devices such as smartphones and tablets used by parents.

[1190] "Verification" refers to the ability for parents to view feedback and digital reward details on the device.

[1191] This invention is a system to support communication between parents and children. It implements a series of processes: a child inputs the content they want to see, the data is sent to a server, the server analyzes it, generates feedback and rewards, and notifies the parent's device.

[1192] System configuration

[1193] The system includes the following components:

[1194] 1. Children's devices

[1195] Input method: An interface for children to input what they want to see (e.g., a smartphone app)

[1196] Transmission method: Communication function for sending input data to the server (e.g., Wi-Fi, 4G communication)

[1197] 2. Server

[1198] Receiving means: A means for receiving and storing data (e.g., HTTP server, database)

[1199] Analysis tools: Tools for analyzing stored data with an AI feedback engine (e.g., machine learning models)

[1200] Generator: A generator (e.g., a natural language generation algorithm) for generating feedback and digital rewards based on the analysis results.

[1201] 3. Parent's device

[1202] Notification method: A method for notifying the parent of the generated feedback and digital rewards (e.g., push notification service)

[1203] Confirmation: An interface (e.g., a smartphone app) for parents to review feedback and digital rewards.

[1204] Program processing

[1205] User (child):

[1206] The child uses the device's interface to input what they want their parent to see, such as "Look, look." For example, they could type in the text "I want to show my mom the picture I drew," and then upload a photo of the drawing.

[1207] Device (child's device):

[1208] It receives the information entered by the child, converts it into an appropriate format, and sends it to the server as a POST request. Specifically, it converts the text data and photo data into JSON format and sends it to the server.

[1209] server:

[1210] The received data is securely stored. The stored data is then analyzed using an AI feedback engine. For example, if the target of analysis is a photo of a child's drawing, the machine learning model will analyze the color usage, composition, theme, etc.

[1211] server:

[1212] Based on the analysis results, feedback and digital rewards are generated. For example, feedback such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated.

[1213] server:

[1214] Set up push notifications to send generated feedback and digital reward information to the parent's device. For example, send a notification saying, "X-chan drew a great picture. We've sent you a digital badge."

[1215] Device (parent device):

[1216] A push notification is sent to the parent's device, and when the parent taps the notification, the corresponding app opens, displaying detailed feedback and information about the child's work.

[1217] Specific examples

[1218] Example 1: When a child wants to show a picture

[1219] 1. User (child):

[1220] Children enter text in the app saying, "I want you to see this picture," then upload and send a photo of the drawing.

[1221] 2. Device (child's device):

[1222] It receives the input data (text and picture) and sends it to the server.

[1223] 3. Server:

[1224] The data is received and a photo of the painting is analyzed. The color usage and composition are evaluated using a machine learning model. As a result of the analysis, feedback such as "the color usage is excellent" is received.

[1225] 4. Server:

[1226] Based on the analysis results, feedback such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated.

[1227] 5. Server:

[1228] A push notification will be sent to the parent's device saying, "○○-chan drew a wonderful picture. A digital badge has been sent."

[1229] 6. Device (parent device):

[1230] Parents can view the notification and open the corresponding app to view detailed feedback, allowing them to give specific praise to their child.

[1231] Prompt Sentence Examples

[1232] "Now that my daughter has uploaded her drawing, please generate a rating and feedback. Analyze it to assess color, composition, and theme, then choose words of encouragement and an appropriate digital reward."

[1233] This system allows for real-time recognition of a child's efforts and achievements, facilitating smooth communication between parents and children.

[1234] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1235] Step 1:

[1236] User (child):

[1237] A child opens the app and taps the "Look, look" button. They then enter data such as text, photos, and videos into the input interface. For example, they might enter the text "I want to show my mom the picture I drew," take a photo of the drawing, and upload it. The input in this case is text data and image data.

[1238] Step 2:

[1239] Device (child's device):

[1240] It takes the user's input (text and photo) and converts it to the appropriate format. Specifically, it converts the input data to JSON and prepares it as a POST request. For example, it generates the following JSON data:

[1241] json

[1242] {

[1243] "message": "I want to show my mom the picture I drew",

[1244] "image_data": "<base64_encoded_image_data> "

[1245] }

[1246] This is sent to a server via the Internet.

[1247] Step 3:

[1248] server:

[1249] Receives a POST request sent from the device. The received data is first validated and then securely stored in a database. For example, image data is stored in cloud storage (e.g., AWS S3), and its reference URL is stored in the database. The received data is then imported into "message" and "image_data".

[1250] Step 4:

[1251] server:

[1252] The saved data is input into an AI feedback engine for analysis. A machine learning model is used to evaluate the color usage, composition, theme, and other aspects of the pictures uploaded by children. For example, the image analysis engine evaluates the variety of colors and balance of the composition, and generates a rating such as "excellent color usage" as the analysis result. The output is text data of the analysis results.

[1253] Step 5:

[1254] server:

[1255] Based on the analysis results, a feedback message and digital reward are generated. For example, based on the text data of the analysis results, a feedback message such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated. The generated feedback and reward are stored in a database. The output is the feedback message and digital reward data.

[1256] Step 6:

[1257] server:

[1258] The generated feedback and digital reward information is sent to the parent's device via push notification. Specifically, a push notification service (e.g., Firebase Cloud Messaging) is used to notify the parent's device. For example, a notification message saying, "X-chan drew a great picture. We've sent you a digital badge." The input in this case is the feedback message and digital reward data, and the output is the sending of a push notification.

[1259] Step 7:

[1260] Device (parent device):

[1261] A push notification is sent to the parent's device, and when the parent taps the notification, the corresponding app opens. A detailed feedback message and information about the child's work are displayed in the app. For example, the feedback message "Your drawing is so colorful and wonderful!" and the digital badge "Creative Kids" are displayed. The parent can review this and give specific praise to their child. The output is the feedback message and a digital reward.

[1262] (Application example 1)

[1263] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1264] Robots used in factories are required to accurately detect abnormalities and areas requiring maintenance during operation and notify managers and workers in real time, enabling prompt and appropriate responses and improving work safety and efficiency. However, current systems have issues with the accuracy of abnormality detection and the speed of notification. In addition, they do not provide sufficient feedback on appropriate countermeasures or rewards, which creates challenges in maintaining motivation and improving work efficiency.

[1265] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1266] In this invention, the server includes a means for inputting the content that the worker wants to see, a means for transmitting the input data to the server, a means for analyzing the data received by the server and generating feedback and rewards based on the analysis results, and a means for notifying the generated feedback and rewards to the manager's terminal. This enables accurate detection and prompt notification of abnormalities and areas requiring maintenance, provides appropriate feedback for countermeasures and rewards to maintain motivation, and improves the safety and efficiency of work.

[1267] "Worker" means an employee who performs work within a factory.

[1268] An "administrator" is a person in charge of managing work within a factory and the operation of robots.

[1269] "Server" refers to a computer system for receiving, analyzing, storing data, and generating feedback.

[1270] "Input means" refers to the interface or device that allows the worker to input the information they want to see.

[1271] "Transmission means" refers to the communication functions and protocols used to transmit input data to the server.

[1272] "Means of analysis" refers to algorithms and AI engines that process the data received by the server and detect anomalies or identify areas requiring maintenance.

[1273] "Feedback" refers to evaluations and instructions provided to workers and managers based on the analysis results.

[1274] "Rewards" are digital badges or other rewards given to workers for taking corrective action.

[1275] "Means of notification" refers to communication methods and push notification functions for conveying generated feedback and rewards to managers and workers.

[1276] An "abnormality" refers to an operation or state that differs from normal in machines or systems within a factory.

[1277] "Maintenance required areas" are areas or parts that require preventative maintenance or repair.

[1278] "Digital Badge" means an electronic reward provided to recognize a worker's achievements.

[1279] A "safety badge" is an electronic certificate of knowledge provided to workers as recognition of safe work practices.

[1280] This invention is a system that supports communication between managers and workers to improve the safety and efficiency of robots used in factories. The system aims to realize a series of processes in which workers input what they want to see, send the data to a server, analyze it, generate feedback and rewards, and notify the manager's terminal.

[1281] System configuration

[1282] The system includes the following components:

[1283] 1. Worker's terminal

[1284] A means (interface) for workers to input what they want to see

[1285] A means of sending input data to the server (communication function)

[1286] 2. Server

[1287] How data is received and stored

[1288] A means of analyzing the received data (AI or algorithms)

[1289] A means of generating feedback and rewards based on the analysis results

[1290] 3. Administrator's terminal

[1291] A way to receive and communicate feedback and rewards

[1292] Program processing (natural language explanation)

[1293] Worker (user):

[1294] The worker uses the input means of the terminal to input what he or she wants the manager to see. The input content can be text, photos, videos, etc., and this data is sent to the server via the Internet.

[1295] Terminal (Worker's terminal):

[1296] The system receives the information entered by the worker, formats it as transmission data, and sends a POST request to the server, which saves the data in the cloud and prepares it for analysis.

[1297] server:

[1298] The server receives the POST request and securely stores the data. The stored data is analyzed by an AI feedback engine to track work progress and identify abnormalities. For example, when evaluating abnormal machine sounds, the characteristics and frequency of the sound are analyzed.

[1299] server:

[1300] Based on the analysis results, feedback and appropriate rewards are generated. The generated feedback is in text format and includes specific evaluations and measures for the worker. Rewards are provided in the form of digital badges, safety badges, etc., and serve to continuously motivate workers.

[1301] Terminal (Administrator's terminal):

[1302] A push notification is sent to the manager's device, informing them of the feedback and reward. When the manager taps the notification, the app opens and they can view detailed feedback and the information about the deliverables that the worker wanted to see.

[1303] Specific examples

[1304] Example 1: When the robot detects an abnormal sound

[1305] 1. Worker (user):

[1306] The worker enters text into the app saying, "There is an abnormal noise coming from the machine," and then uploads and sends the recording of the abnormal noise.

[1307] 2. Terminal (Worker's terminal):

[1308] Receives input data (text and audio data) and sends it to the server.

[1309] 3. Server:

[1310] The server receives the data and analyzes the recorded data using an AI feedback engine. As a result of the analysis, it may conclude that the cause is, for example, "wear on the bearings."

[1311] 4. Server:

[1312] Based on the analysis results, feedback is generated such as "Machine A's bearings are worn and require inspection," and a digital badge "Safety Awareness" is generated as a reward.

[1313] 5. Terminal (Administrator's terminal):

[1314] A notification is sent to the administrator's terminal stating, "An abnormality has been detected in Machine A. Inspection is required."

[1315] 6. Operator / Administrator:

[1316] The administrator checks the notification, views detailed feedback in the app, and issues instructions on the necessary response, which the worker then implements to resolve the abnormality.

[1317] Prompt Sentence Examples

[1318] Data from a machine where an abnormality was detected has been sent and analyzed. The abnormality detected is bearing wear. Generate feedback to notify managers and workers: "There is wear in the bearings of machine A. Inspection recommended." and assign a related digital badge.

[1319] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1320] Step 1:

[1321] The user (worker) uses the terminal to input the information they want to see (abnormal sounds or problems). The input method is text, photos, or video. The input data is saved in the terminal once and is ready to be sent.

[1322] Input: What the worker inputs (text, photos, videos)

[1323] Output: Input data ready to be sent

[1324] Step 2:

[1325] The terminal sends the formatted data to the server using the HTTP POST request as the communication protocol.

[1326] Input: Input data ready to be sent

[1327] Output: Data sent to the server

[1328] Step 3:

[1329] The server receives the data sent from the device and stores it securely in a database (e.g., MySQL).

[1330] Input: Data sent from the terminal

[1331] Output: Data stored in the database

[1332] Step 4:

[1333] The AI ​​feedback engine on the server analyzes the stored data, specifically using a sound analysis algorithm (e.g., SpaCy or TensorFlow) to analyze abnormal sounds.

[1334] Input: Saved data

[1335] Output: Analysis results (e.g. abnormal noise is caused by bearing wear)

[1336] Step 5:

[1337] The server generates feedback based on the analysis results, including specific measures and evaluations, and generates appropriate rewards (e.g., digital badges).

[1338] Input: Analysis results

[1339] Output: Feedback and reward (e.g., bearing wear is the cause. Inspection recommended. Digital badge "Safety Awareness")

[1340] Step 6:

[1341] The generated feedback and reward will be sent to the administrator's device via a push notification, which will include information about the feedback and reward.

[1342] Input: Feedback and Rewards

[1343] Output: Push notification sent to the administrator's device

[1344] Step 7:

[1345] The manager checks the notification on the terminal and views the detailed feedback content, and if necessary, issues instructions to the worker to resolve the problem.

[1346] Input: Push notification sent to the administrator's device

[1347] Output: Feedback viewed by the administrator and instructions to respond

[1348] Specific behavior:

[1349] 1. User enters text, photo, or video and presses the save button

[1350] 2. The device formats the data and sends it to the server

[1351] 3. The server receives the data and stores it in the database

[1352] 4. The AI ​​engine on the server analyzes the data

[1353] 5. The server generates feedback and rewards based on the analysis results.

[1354] 6. The server notifies the administrator of the generated feedback and rewards.

[1355] 7. The administrator checks the notification, reads the feedback, and takes any necessary action.

[1356] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1357] This invention relates to a system that supports communication between parents and children by allowing children to input what they want to see, sending the data to a server, which then analyzes the data to generate feedback and rewards, and notifying the parent's device of the generated feedback and rewards. Furthermore, this system incorporates an emotion engine that recognizes the child's emotions.

[1358] System configuration

[1359] The system includes the following components:

[1360] 1. Children's devices

[1361] A means (interface) for children to input what they want to see

[1362] A means of sending input data to the server (communication function)

[1363] 2. Server

[1364] How data is received and stored

[1365] A means of analyzing the received data (AI or algorithms)

[1366] Emotion recognition using an emotion engine

[1367] A means of generating feedback and rewards based on the analysis results

[1368] 3. Parent's device

[1369] A way to receive and communicate feedback and rewards

[1370] Program processing

[1371] User (child):

[1372] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[1373] Device (child's device):

[1374] The data entered by children is converted into JSON format or similar and sent to a server via the Internet.

[1375] server:

[1376] The server receives the POST request and stores it in a database. The stored data includes the child's ID, input content, photo, and timestamp. The emotion engine recognizes the child's emotions from the input text and image. This emotion data is also used for analysis.

[1377] server:

[1378] The received data is analyzed using an AI feedback engine. For example, the system evaluates the color usage and composition of the drawing, and provides analysis results that take the child's emotions into consideration.

[1379] server:

[1380] Based on the analysis results, feedback and rewards are generated. For example, if a child is pleased with the evaluation that "your use of color is excellent," the system generates feedback such as "Your drawing is very colorful and beautiful!" and provides the digital badge "Creative Kids" as a reward.

[1381] Device (parent device):

[1382] The generated feedback and reward notifications are sent to the parent's device. When a push notification is received, a new message appears in the notification center. When the parent taps the notification, they can view the child's request and the corresponding feedback within the app.

[1383] Specific examples

[1384] Example 1: When a child wants to show a picture

[1385] 1. User (child):

[1386] A child can type in text in the app saying, "I want to show my mom the picture I drew," upload a photo of the drawing, and send it. The emotion engine recognizes that the child is "happy."

[1387] 2. Device (child's device):

[1388] The entered data (text and picture) is sent to the server in JSON format.

[1389] 3. Server:

[1390] Receive and store data. The emotion engine recognizes when a child is happy.

[1391] 4. Server:

[1392] The AI ​​feedback engine analyzes the data and evaluates it as "great use of color." Taking into account the results of the emotion engine, the feedback is determined as "X-Chan drew a wonderful picture."

[1393] 5. Server:

[1394] A reward generation engine generates digital badges for "creative kids."

[1395] 6. Device (parent device):

[1396] A notification will be sent to the parent's device saying, "○○-chan has drawn a wonderful picture. A digital badge has been sent."

[1397] 7. User (Parent):

[1398] Parents can view the notification and detailed feedback within the app, giving specific praise such as, "Your drawing is so colorful and beautiful!"

[1399] In this way, this system allows parents to communicate smoothly with their children even when they are busy, and children can be properly recognized for their efforts and achievements. Furthermore, the emotion engine allows feedback that takes into account the child's emotions, resulting in greater understanding and consideration.

[1400] The processing flow will be explained below.

[1401] Step 1:

[1402] User (child)

[1403] Open the "Misete-chan" app. Access the input form within the app and enter the "content you want to see."

[1404] Step 2:

[1405] User (child)

[1406] Enter text, photos, videos, etc. into the input form. For example, take a photo of a drawing you've made and enter the text "I want my mom to see this."

[1407] Step 3:

[1408] Device (child's device)

[1409] It receives the input data, converts it to JSON format, and then sends a POST request to the server via the Internet.

[1410] Step 4:

[1411] server

[1412] It receives a POST request and stores it in a database. The data stored includes the child's ID, input, photo, and timestamp.

[1413] Step 5:

[1414] server

[1415] The data is passed to an AI feedback engine for analysis of text data and photos. At the same time, an emotion engine recognizes the child's emotions from the text and photos. For example, if the text is "I want my mom to see this," the emotion engine recognizes positive emotions (joy).

[1416] Step 6:

[1417] server

[1418] An AI feedback engine analyzes the data and evaluates the child's input and photos. For example, it analyzes a photo of a drawing and evaluates it as "great use of color."

[1419] Step 7:

[1420] server

[1421] The emotions recognized by the emotion engine are combined with the evaluation results of the AI ​​feedback engine to generate feedback. For example, specific feedback such as "Your drawing is very colorful and beautiful! You must be happy to show it to your mother" can be set.

[1422] Step 8:

[1423] server

[1424] The reward generation engine uses the analysis results and emotional data to generate appropriate rewards, such as creating a digital badge for "creative kids."

[1425] Step 9:

[1426] server

[1427] The system generates data to notify the parent's device of the generated feedback and reward. The notification includes a summary of the feedback and the reward.

[1428] Step 10:

[1429] Device (parent device)

[1430] A push notification will be received and displayed in the notification center. When a parent taps the notification, the "Misete-chan" app will open and display detailed feedback and reward information.

[1431] Step 11:

[1432] User (Parent)

[1433] Parents can check the feedback within the app and give their child specific praise, for example, "Your drawing is so colorful and beautiful!"

[1434] This series of steps allows children to quickly and appropriately communicate what they want to see to their parents, and allows parents to communicate with their children regularly even when they are busy. Furthermore, providing feedback and rewards that take children's emotions into consideration makes communication even more effective.

[1435] Example 2

[1436] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1437] Conventional parent-child communication systems lack a means for children to properly communicate what they want to see to their parents, or a means for providing feedback that understands the child's emotions. Furthermore, there is a lack of a way to generate rewards that take the child's emotions into account and notify the parent. This creates a challenge in that it is difficult to ensure smooth communication even when parents are busy.

[1438] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1439] In this invention, the server includes an emotion recognition means for recognizing the child's emotion, a means for notifying the parent of appropriate feedback based on the analysis, and a means for generating a reward such as a digital badge, a drawing sheet, or an in-game item, thereby making it possible to provide appropriate feedback and rewards while taking the child's emotion into consideration.

[1440] "Means for inputting content that children want to see" refers to devices or interfaces that allow children to input content that they want to see, and includes software such as applications that run on smartphones and tablets.

[1441] "Means for transmitting input data to a server" refers to a function for transmitting data input by a child to a server via a communication means such as the Internet.

[1442] "Means of analyzing data received by the server and generating feedback and rewards based on the analysis results" refers to a system that analyzes received data using AI or algorithms and automatically generates feedback messages and rewards based on the results.

[1443] "Means for notifying the parent's terminal of the generated feedback and reward" refers to a function for sending and notifying the parent's terminal of the generated feedback message and reward information.

[1444] "Emotion recognition means for recognizing children's emotions" refers to engines or algorithms that analyze and recognize the emotional state of children from text, images, etc. entered by them.

[1445] "Means for communicating data in JSON format" refers to the means for converting the content entered by the child into JSON (JavaScript Object Notation) format and sending it to the server according to the communication protocol.

[1446] "Means for using emotional data for analysis" refers to the ability to use a child's emotional state as part of data analysis to generate more appropriate feedback and rewards.

[1447] "Digital badges" refer to electronic awards or certificates given to children based on their behavior and achievements.

[1448] A "drawing sheet" refers to a digital or physical sheet generated based on a child's drawing and related information.

[1449] "In-game items" refer to benefits and rewards that can be used within the game a child is playing.

[1450] MODE FOR CARRYING OUT THE INVENTION

[1451] This invention relates to a system that supports communication between parents and children by allowing children to input what they want to see, sending the data to a server, which then analyzes the data to generate feedback and rewards, and notifying the parent's device of the generated feedback and rewards. Furthermore, this system incorporates an emotion engine that recognizes the child's emotions.

[1452] System configuration

[1453] The system includes the following components:

[1454] 1. Children's devices

[1455] Input method: An interface for children to input what they want to see. For example, a smartphone application.

[1456] Transmission means: A communication function for transmitting input data to a server.

[1457] 2. Server

[1458] Receiving means: A function that receives and stores data (e.g., a database system).

[1459] Analysis means: A function that analyzes the received data (e.g., AI feedback engine, emotion recognition engine).

[1460] Generation means: A function that generates feedback and rewards based on the analysis results.

[1461] Notification: A function that notifies the parent's device of the generated feedback and rewards.

[1462] 3. Parent's device

[1463] Receiving means: A function for receiving and notifying feedback and rewards (e.g., a smartphone application).

[1464] Program processing

[1465] User (child):

[1466] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[1467] Device (child's device):

[1468] The data entered by the child is converted into JSON format and sent to a server via the internet. The entered data includes the child's ID, input content, photo, timestamp, etc.

[1469] server:

[1470] The server receives the POST request and stores it in a database. This data contains all the information necessary for analysis, such as the child's ID, input content, photo, and timestamp. Next, an emotion recognition engine is used to recognize the child's emotions from the input text and images. Specifically, it identifies emotions such as "happy" from the child's text message and image.

[1471] server:

[1472] The received data, including emotional data, is analyzed by an AI feedback engine. For example, a drawing is evaluated for its color usage and composition. Emotional data is also taken into account in the analysis to generate more appropriate feedback.

[1473] server:

[1474] A feedback message and reward are generated based on the analysis results. For example, if the analysis result is "great use of color" and the child is pleased, the system generates feedback such as "Your drawing is very colorful and wonderful!" and provides a "Creative Kids" digital badge as a reward.

[1475] Device (parent device):

[1476] The generated feedback message and reward information are sent to the parent's device. The parent's device receives a push notification, and a new message appears in the notification center. When the parent taps the notification, they can view the child's request and the corresponding feedback within the "Misete-chan" app.

[1477] Specific examples

[1478] Example 1: When a child wants to show a picture

[1479] User (child):

[1480] A child uses the "Misete-chan" app to type, "I want to show my mom the picture I drew," and uploads a photo of the drawing. The emotion engine recognizes that the child is "happy."

[1481] Device (child's device):

[1482] The entered data (text and picture) is sent to the server in JSON format.

[1483] server:

[1484] Receive and store data. The emotion engine recognizes when a child is happy.

[1485] server:

[1486] The AI ​​feedback engine analyzes the data and evaluates it as "great use of color." Taking into account the results of the emotion engine, the feedback is determined as "X-Chan drew a wonderful picture."

[1487] server:

[1488] A reward generation engine generates digital badges for "creative kids."

[1489] Device (parent device):

[1490] A notification will be sent to the parent's device saying, "X-chan drew a wonderful picture. We've sent you a digital badge." The parent will then check the notification and view detailed feedback within the app. They can then give specific praise, such as, "Your drawing is so colorful and beautiful!"

[1491] Prompt Sentence Examples

[1492] Below are some example prompts to input to the generative AI model:

[1493] A child requests in the app, "Mommy, please show me your dinosaur drawing." Feedback: Great colors, this dinosaur looks so realistic. Emotion: Delighted. Generated feedback: "Great colors! This dinosaur looks so realistic!" Generated badge: "Creative Kids."

[1494] In this way, this system allows parents to communicate smoothly with their children even when they are busy. Children can be properly recognized for their efforts and achievements, and the emotion engine allows for feedback that takes children's emotions into consideration.

[1495] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1496] Step 1:

[1497] User (child):

[1498] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[1499] Input: Text message (e.g., "I want my mom to see this") and image data (e.g., a photo of a drawing).

[1500] Output: JSON formatted data.

[1501] Specific operation: Using the camera function within the app, an interface will appear where you can take a photo of the painting and enter a message.

[1502] Step 2:

[1503] Device (child's device):

[1504] The entered data is converted into JSON format and sent to the server via the Internet.

[1505] Input: Text messages and photos sent by users.

[1506] Output: A POST request to the server.

[1507] What happens: The app internally encodes the data into JSON format and sends a POST request to the server endpoint.

[1508] Step 3:

[1509] server:

[1510] The server receives the POST request and stores it in a database, which stores the child's ID, input, photo, timestamp, etc.

[1511] Input: JSON formatted data.

[1512] Output: Records stored in the database.

[1513] What happens: The server parses the POST request and creates a new record in the database.

[1514] Step 4:

[1515] server:

[1516] Using an emotion recognition engine, the system recognizes a child's emotions from input text and images. For example, it identifies emotions such as "happy" from a child's message.

[1517] Input: Text message and image data.

[1518] Output: Emotion data (e.g., "happy").

[1519] Specific operation: The emotion recognition engine performs text analysis and image analysis to estimate emotions.

[1520] Step 5:

[1521] server:

[1522] The AI ​​feedback engine analyzes the received data and emotional data, for example evaluating the color usage and composition of the picture and determining feedback taking the child's emotions into account.

[1523] Input: Stored database data and emotion data.

[1524] Output: Feedback content.

[1525] Specific operation: The AI ​​feedback engine analyzes the data and makes an evaluation.

[1526] Step 6:

[1527] server:

[1528] Based on the analysis results, feedback messages and rewards are generated. For example, based on the result that "children are delighted with the wonderful use of color," feedback such as "Your drawing is very colorful and wonderful!" and a digital badge of "Creative Kids" are generated.

[1529] Input: Analysis results and emotion data.

[1530] Output: Feedback message and digital badge.

[1531] What happens: The server constructs a feedback message and generates a digital badge.

[1532] Step 7:

[1533] server:

[1534] The generated feedback message and reward information are sent to the parent's device.

[1535] Input: Feedback message and digital badge.

[1536] Output: Notification to parent device.

[1537] Specific operation: The server sends a push notification to the parent device.

[1538] Step 8:

[1539] Device (parent device):

[1540] When parents tap the notification, they can view their child's request and feedback within the "Misete-chan" app.

[1541] Input: Notification from the server.

[1542] Output: Display of feedback message.

[1543] What it does: Parents receive a notification on their smartphone and receive detailed feedback within the app.

[1544] These steps allow the system to take into account the child's input and emotions, and provide appropriate feedback and rewards to the parent.

[1545] (Application example 2)

[1546] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1547] In modern society, busy parents tend to neglect communication with their children. This reduces opportunities for children to have their efforts and achievements seen, making it difficult for them to feel confident or happy. It is also often difficult to properly understand a child's emotions and provide them with feedback. This invention aims to solve these problems by providing a system that accurately understands the content and emotions entered by a child and provides appropriate feedback to parents in real time.

[1548] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for inputting content that the child wants to see, a means for transmitting the input data to the server, a means for analyzing the data received by the server and generating feedback and a reward based on the analysis results, a means for notifying the parent's device of the generated feedback and reward, a means for analyzing the child's emotions using an emotion recognition engine, a means for notifying the parent's device of the generated feedback and reward in real time, and a means for generating optimal feedback based on the analysis results using a generative AI model. This makes it possible to accurately understand the content and emotions input by the child and notify the parent of appropriate feedback and reward in real time.

[1549] Key Word Definitions

[1550] "Means for inputting what children want their parents to see" refers to an interface that allows children to input what they want their parents to see in the form of text, images, audio, etc.

[1551] "Means for transmitting input data to a server" refers to a communication function that transmits data input by a child to a server via the Internet.

[1552] "Means for analyzing data received by the server and generating feedback and rewards based on the analysis results" refers to a function that analyzes data received by the server and automatically generates feedback for the parent and rewards for the child based on the analysis results.

[1553] The "means for notifying the parent's terminal of the generated feedback and reward" is a communication function for transmitting the feedback and reward generated by the server to the parent's terminal in real time.

[1554] "Means for analyzing children's emotions using an emotion recognition engine" is an AI technology that analyzes emotions from text, voice, images, etc. entered by the child and identifies the child's current emotions.

[1555] "Means for notifying the parent's device of the generated feedback and reward in real time" is a function for instantly sending the generated feedback and reward to the parent's device, thereby quickly conveying the information to the parent.

[1556] "Means for generating optimal feedback based on analysis results using a generative AI model" refers to a function that uses an AI model to evaluate analysis results and generate optimal feedback for children.

[1557] A "digital certification badge" is a badge that digitally recognizes a child's efforts and achievements and is used to enhance a child's sense of accomplishment.

[1558] "Creative sheets" are digital tools that allow children to engage in creative activities, and examples include drawing sheets.

[1559] "Digital entertainment items" are digital items provided to increase children's enjoyment, including, for example, in-game bonuses and items.

[1560] MODE FOR CARRYING OUT THE INVENTION

[1561] This invention relates to a system for promoting communication between parents and children. A child inputs the content they want to see and sends the data to a server, which analyzes it, generates feedback and rewards, and notifies the parent's device. The system also uses an emotion recognition engine to analyze the child's emotions and generates optimal feedback accordingly.

[1562] System configuration

[1563] 1. Children's devices:

[1564] Input medium: The interface that a child uses to input content such as text, images, or audio.

[1565] Communication method: A communication function that sends the data entered by the child to a server via the Internet.

[1566] 2. Server:

[1567] Data storage means: The server has the function of storing the received data in a database.

[1568] Data analysis method: The server analyzes the received data using AI algorithms, including an emotion recognition engine.

[1569] Feedback generation method: The system has the ability to generate feedback and rewards based on the recorded data and analysis results. Using a generative AI model, it suggests optimal feedback based on the child's emotions.

[1570] Notification: The generated feedback and rewards are sent to the parent's device in real time.

[1571] 3. Parent device:

[1572] Receiving means: The parent's device receives feedback and reward notifications from the server.

[1573] Display: The reported feedback and rewards are displayed within the app for easy parental review.

[1574] Processing flow

[1575] User (child)

[1576] Using an application installed on the child's device, the child can input "what they want to show their mother" in the form of text, image, voice, etc. For example, the child can take a photo of a drawing they have made and attach a text message saying "I want to show this to my mother." The emotion recognition engine analyzes the child's emotions and sends this data to the server.

[1577] Device (child's device)

[1578] The data entered by children is converted into JSON format or similar and sent to a server via the Internet.

[1579] server

[1580] The server stores the received data in a database and analyzes it using an AI algorithm, such as tools like TensorFlow or PyTorch. The AI ​​algorithm also includes the results of an emotion recognition engine analyzing the child's emotions. Feedback and rewards are generated based on the analysis results. Generative AI models (such as GPT-3 or BERT) are used to automatically generate optimal feedback that matches the child's emotions and content.

[1581] server

[1582] The generated feedback and rewards are pushed from the server to the parent's device in real time using a notification service such as Firebase Cloud Messaging (FCM).

[1583] Device (parent device)

[1584] The parent's device receives a push notification from the server and displays the new message in the notification center. When the parent taps the notification, they can view the child's request and receive feedback within the app.

[1585] Specific examples

[1586] Example 1: When a child wants to show a picture

[1587] A child enters text into the app saying, "I want to show my mom the picture I drew," and uploads and sends a photo of the drawing. The emotion recognition engine recognizes the child's emotion as "happy." The server receives the data, and the AI ​​feedback engine evaluates it as "great use of color," generating feedback such as "X-chan drew a wonderful picture." As a reward, the child is given a "Creative Kids" digital badge. A notification is sent to the parent's device stating, "X-chan drew a wonderful picture. A digital badge has been sent."

[1588] Example prompts for generative AI models

[1589] "A child says, 'I want to show my mom the picture I drew.' He / she is very happy. Consider this situation and generate feedback and give him / her a 'Creative Kids' digital badge."

[1590] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1591] Program processing steps

[1592] Step 1:

[1593] Input: The text, images, audio, and other content that your child types.

[1594] The child uses the device's application to input the content they want to show (for example, a picture they have drawn and a message). At this time, an emotion recognition engine is activated to recognize the child's emotions. This organizes the child's input data into the form of text, images, and emotion data.

[1595] Output: Organized input data (text, images, emotion data).

[1596] Step 2:

[1597] Input: Organized input data (text, images, sentiment data).

[1598] The child's device converts the organized input data into JSON format and sends it to the server, which requires a secure communication method to send the data over the Internet.

[1599] Output: JSON formatted data sent to the server.

[1600] Step 3:

[1601] Input: JSON formatted data sent to the server.

[1602] The server stores the received data in a database. The stored data includes the child's ID, input content, image, emotion data, and timestamp. The data is managed using database software (e.g., MySQL, PostgreSQL).

[1603] Output: Data stored in a database.

[1604] Step 4:

[1605] Input: Data stored in a database.

[1606] The server analyzes the data using AI algorithms and emotion recognition engines (e.g., TensorFlow, PyTorch), evaluates the content and emotional data of the received child input data, and generates an analysis result based on the child's emotions.

[1607] Output: Analysis results (evaluation based on the child's feelings).

[1608] Step 5:

[1609] Input: Analysis results.

[1610] The server uses a generative AI model (e.g., GPT-3 or BERT) to generate feedback and rewards based on the analysis results. In this case, the feedback correctly evaluates the child's input and creates appropriate messages based on their emotions. Rewards such as digital certification badges, creation sheets, and digital entertainment items are also generated.

[1611] Output: Generated feedback and rewards (e.g., feedback messages, digital badges).

[1612] Step 6:

[1613] Input: Generated feedback and rewards.

[1614] The server notifies the parent device of the generated feedback and reward in real time using a notification service such as Firebase Cloud Messaging (FCM) to instantly send a push notification to the parent device.

[1615] Output: Notifications sent to the parent device (feedback messages, digital badges).

[1616] Step 7:

[1617] Input: Notifications sent by the server (feedback messages, digital badges).

[1618] The parent's device will receive a notification, which will be displayed as a push notification. When the parent taps the notification, they can view the child's request and the feedback provided within the app, allowing parents to communicate more effectively with their children.

[1619] Output: Feedback and reward displayed in the app.

[1620] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1621] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1622] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1623] [Fourth embodiment]

[1624] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1625] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1626] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1627] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1628] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1629] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1630] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1631] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1632] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1633] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1634] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1635] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1636] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1637] This invention is a system for supporting communication between parents and children, and aims to realize a series of processes in which children input the content they want to see, the data is sent to a server, the server analyzes it, generates feedback and rewards, and notifies the parent's terminal.

[1638] System configuration

[1639] The system includes the following components:

[1640] 1. Children's devices

[1641] A means (interface) for children to input what they want to see

[1642] A means of sending input data to the server (communication function)

[1643] 2. Server

[1644] How data is received and stored

[1645] A means of analyzing the received data (AI or algorithms)

[1646] A means of generating feedback and rewards based on the analysis results

[1647] 3. Parent's device

[1648] A way to receive and communicate feedback and rewards

[1649] Program processing

[1650] User (child):

[1651] The child uses the device's input means to input the content they want their parent to see, saying "Look, look." The input content can be text, photos, videos, etc., and this data is sent to a server via the Internet.

[1652] Device (child's device):

[1653] The system receives the information entered by the child, formats it as data to be sent, and sends a POST request to the server, which then stores the data in the cloud and prepares it for analysis.

[1654] server:

[1655] The server receives the POST request and securely stores the data. The stored data is analyzed by an AI feedback engine, which evaluates the child's interests and behavioral patterns. For example, when evaluating a child's drawing, the engine analyzes the use of color, composition, and theme.

[1656] server:

[1657] Based on the analysis results, feedback and appropriate rewards are generated. The generated feedback is in text format and includes specific evaluations and words of encouragement for the child. Rewards are provided in the form of digital badges, drawing sheets, in-game items, etc., and serve to continue to pique the child's interest.

[1658] Device (parent device):

[1659] A push notification is sent to the parent's device, displaying feedback and a reward. When the parent taps the notification, the "Misete-chan" app opens, where they can check detailed feedback and information about the outcome the child wanted to show.

[1660] Specific examples

[1661] Example 1: When a child wants to show a picture

[1662] 1. User (child):

[1663] Children enter text into the app saying, "I want to show my mom the picture I drew," and then upload and send a photo of the drawing.

[1664] 2. Device (child's device):

[1665] It receives the input data (text and picture) and sends it to the server.

[1666] 3. Server:

[1667] The server receives the data and analyzes the photo of the painting using an AI feedback engine. As a result of the analysis, the painting may be evaluated as having excellent color usage, for example.

[1668] 4. Server:

[1669] Based on the analysis results, feedback such as "XX-chan drew a wonderful picture" is generated, and a digital badge "Creative Kids" is generated as a reward.

[1670] 5. Device (parent device):

[1671] A notification will be sent to the parent's device saying, "○○-chan has drawn a wonderful picture. A digital badge has been sent."

[1672] 6. User (Parent):

[1673] Parents can check the notification and view detailed feedback in the app. When they have time, they can give their child specific praise for what they think is great about their drawing.

[1674] In this way, this system allows parents to communicate smoothly with their children even when they are busy, and children can be properly recognized for their efforts and achievements.

[1675] The processing flow will be explained below.

[1676] Step 1:

[1677] User (child)

[1678] The child opens the "Misete-chan" app and accesses the input form within the app to enter "what they want to see."

[1679] Step 2:

[1680] User (child)

[1681] A child enters text, photos, videos, etc. into the input form. For example, a child can enter a photo of a drawing they have made and the text, "I want to show this to my mom."

[1682] Step 3:

[1683] Device (child's device)

[1684] It receives the input data, converts it into a transfer format such as JSON, and then sends a POST request to the server via the Internet.

[1685] Step 4:

[1686] server

[1687] The POST request is received and stored in a database. The stored data includes the child's ID, input, photo, and timestamp.

[1688] Step 5:

[1689] server

[1690] The stored data is analyzed using an AI feedback engine, which evaluates, for example, the use of color and composition in photos, and the content of text.

[1691] Step 6:

[1692] server

[1693] Feedback is generated based on the analysis results. For example, if the evaluation is "Excellent use of color," the system generates feedback such as "XX-chan drew a wonderful picture."

[1694] Step 7:

[1695] server

[1696] Use the reward generation engine to generate appropriate rewards, such as a digital badge for "creative kids."

[1697] Step 8:

[1698] server

[1699] Notification data is generated to notify the parent's terminal of the generated feedback and reward.

[1700] Step 9:

[1701] Device (parent device)

[1702] A push notification will be received and displayed in the notification center. When a parent taps the notification, the "Misete-chan" app will open and display the feedback details.

[1703] Step 10:

[1704] User (Parent)

[1705] Parents can review the app's feedback and give their child specific praise, such as, "This is what's great about your drawing."

[1706] This series of steps allows parents to quickly and appropriately communicate what their children want to see, and allows parents to maintain regular communication with their children even when they are busy.

[1707] Example 1

[1708] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1709] In today's parent-child relationships, parents need a way to communicate smoothly with their children even when they are busy. In particular, there are many situations where parents are unable to respond immediately when their children want to show their parents the artwork or results they have created as they grow. In such situations, children's efforts may not be properly evaluated, which can result in a decline in their motivation. Therefore, a system is needed that allows parents to properly evaluate the work their children want to show and, through that feedback, further motivate them.

[1710] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1711] In this invention, the server includes a means for receiving and storing data on the server, a means for analyzing the stored data with an AI feedback engine, and a means for generating feedback and a digital reward based on the analysis results. This allows parents to appropriately evaluate the results that their children want to show and notify the parents of the feedback and digital reward on their device, thereby motivating the children and facilitating communication between parents and children.

[1712] "Child" means a minor who is raised by his or her parents within the family home.

[1713] "Input means" refers to the interface that a user uses to provide data, such as text, photos, or videos, to the system.

[1714] "Transmission means" refers to a function for transmitting input data to a server using a communication protocol.

[1715] "Server" refers to a powerful computer system for receiving, storing, analyzing, and managing data.

[1716] "Receiving means" refers to the function by which the server receives data sent from the child's device.

[1717] "Storage means" refers to a memory or database that securely stores received data.

[1718] An "AI feedback engine" refers to a software component that uses artificial intelligence to analyze data and generate evaluations and feedback based on the results.

[1719] "Analysis means" refers to the function of using an AI feedback engine to perform detailed analysis of the received data.

[1720] "Feedback" refers to messages of evaluation and encouragement that are generated for children based on the analysis results.

[1721] "Digital rewards" refers to rewards for children, such as digital badges, points, and in-software items.

[1722] "Notification means" refers to a function that notifies the parent's device of feedback and digital reward information in real time.

[1723] "Parent's device" refers to electronic devices such as smartphones and tablets used by parents.

[1724] "Verification" refers to the ability for parents to view feedback and digital reward details on the device.

[1725] This invention is a system to support communication between parents and children. It implements a series of processes: a child inputs the content they want to see, the data is sent to a server, the server analyzes it, generates feedback and rewards, and notifies the parent's device.

[1726] System configuration

[1727] The system includes the following components:

[1728] 1. Children's devices

[1729] Input method: An interface for children to input what they want to see (e.g., a smartphone app)

[1730] Transmission method: Communication function for sending input data to the server (e.g., Wi-Fi, 4G communication)

[1731] 2. Server

[1732] Receiving means: A means for receiving and storing data (e.g., HTTP server, database)

[1733] Analysis tools: Tools for analyzing stored data with an AI feedback engine (e.g., machine learning models)

[1734] Generator: A generator (e.g., a natural language generation algorithm) for generating feedback and digital rewards based on the analysis results.

[1735] 3. Parent's device

[1736] Notification method: A method for notifying the parent of the generated feedback and digital rewards (e.g., push notification service)

[1737] Confirmation: An interface (e.g., a smartphone app) for parents to review feedback and digital rewards.

[1738] Program processing

[1739] User (child):

[1740] The child uses the device's interface to input what they want their parent to see, such as "Look, look." For example, they could type in the text "I want to show my mom the picture I drew," and then upload a photo of the drawing.

[1741] Device (child's device):

[1742] It receives the information entered by the child, converts it into an appropriate format, and sends it to the server as a POST request. Specifically, it converts the text data and photo data into JSON format and sends it to the server.

[1743] server:

[1744] The received data is securely stored. The stored data is then analyzed using an AI feedback engine. For example, if the target of analysis is a photo of a child's drawing, the machine learning model will analyze the color usage, composition, theme, etc.

[1745] server:

[1746] Based on the analysis results, feedback and digital rewards are generated. For example, feedback such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated.

[1747] server:

[1748] Set up push notifications to send generated feedback and digital reward information to the parent's device. For example, send a notification saying, "X-chan drew a great picture. We've sent you a digital badge."

[1749] Device (parent device):

[1750] A push notification is sent to the parent's device, and when the parent taps the notification, the corresponding app opens, displaying detailed feedback and information about the child's work.

[1751] Specific examples

[1752] Example 1: When a child wants to show a picture

[1753] 1. User (child):

[1754] Children enter text in the app saying, "I want you to see this picture," then upload and send a photo of the drawing.

[1755] 2. Device (child's device):

[1756] It receives the input data (text and picture) and sends it to the server.

[1757] 3. Server:

[1758] The data is received and a photo of the painting is analyzed. The color usage and composition are evaluated using a machine learning model. As a result of the analysis, feedback such as "the color usage is excellent" is received.

[1759] 4. Server:

[1760] Based on the analysis results, feedback such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated.

[1761] 5. Server:

[1762] A push notification will be sent to the parent's device saying, "○○-chan drew a wonderful picture. A digital badge has been sent."

[1763] 6. Device (parent device):

[1764] Parents can view the notification and open the corresponding app to view detailed feedback, allowing them to give specific praise to their child.

[1765] Prompt Sentence Examples

[1766] "Now that my daughter has uploaded her drawing, please generate a rating and feedback. Analyze it to assess color, composition, and theme, then choose words of encouragement and an appropriate digital reward."

[1767] This system allows for real-time recognition of a child's efforts and achievements, facilitating smooth communication between parents and children.

[1768] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1769] Step 1:

[1770] User (child):

[1771] A child opens the app and taps the "Look, look" button. They then enter data such as text, photos, and videos into the input interface. For example, they might enter the text "I want to show my mom the picture I drew," take a photo of the drawing, and upload it. The input in this case is text data and image data.

[1772] Step 2:

[1773] Device (child's device):

[1774] It takes the user's input (text and photo) and converts it to the appropriate format. Specifically, it converts the input data to JSON and prepares it as a POST request. For example, it generates the following JSON data:

[1775] json

[1776] {

[1777] "message": "I want to show my mom the picture I drew",

[1778] "image_data": "<base64_encoded_image_data> "

[1779] }

[1780] This is sent to a server via the Internet.

[1781] Step 3:

[1782] server:

[1783] Receives a POST request sent from the device. The received data is first validated and then securely stored in a database. For example, image data is stored in cloud storage (e.g., AWS S3), and its reference URL is stored in the database. The received data is then imported into "message" and "image_data".

[1784] Step 4:

[1785] server:

[1786] The saved data is input into an AI feedback engine for analysis. A machine learning model is used to evaluate the color usage, composition, theme, and other aspects of the pictures uploaded by children. For example, the image analysis engine evaluates the variety of colors and balance of the composition, and generates a rating such as "excellent color usage" as the analysis result. The output is text data of the analysis results.

[1787] Step 5:

[1788] server:

[1789] Based on the analysis results, a feedback message and digital reward are generated. For example, based on the text data of the analysis results, a feedback message such as "Your drawing is so colorful and wonderful!" and a digital badge called "Creative Kids" are generated. The generated feedback and reward are stored in a database. The output is the feedback message and digital reward data.

[1790] Step 6:

[1791] server:

[1792] The generated feedback and digital reward information is sent to the parent's device via push notification. Specifically, a push notification service (e.g., Firebase Cloud Messaging) is used to notify the parent's device. For example, a notification message saying, "X-chan drew a great picture. We've sent you a digital badge." The input in this case is the feedback message and digital reward data, and the output is the sending of a push notification.

[1793] Step 7:

[1794] Device (parent device):

[1795] A push notification is sent to the parent's device, and when the parent taps the notification, the corresponding app opens. A detailed feedback message and information about the child's work are displayed in the app. For example, the feedback message "Your drawing is so colorful and wonderful!" and the digital badge "Creative Kids" are displayed. The parent can review this and give specific praise to their child. The output is the feedback message and a digital reward.

[1796] (Application example 1)

[1797] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1798] Robots used in factories are required to accurately detect abnormalities and areas requiring maintenance during operation and notify managers and workers in real time, enabling prompt and appropriate responses and improving work safety and efficiency. However, current systems have issues with the accuracy of abnormality detection and the speed of notification. In addition, they do not provide sufficient feedback on appropriate countermeasures or rewards, which creates challenges in maintaining motivation and improving work efficiency.

[1799] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1800] In this invention, the server includes a means for inputting the content that the worker wants to see, a means for transmitting the input data to the server, a means for analyzing the data received by the server and generating feedback and rewards based on the analysis results, and a means for notifying the generated feedback and rewards to the manager's terminal. This enables accurate detection and prompt notification of abnormalities and areas requiring maintenance, provides appropriate feedback for countermeasures and rewards to maintain motivation, and improves the safety and efficiency of work.

[1801] "Worker" means an employee who performs work within a factory.

[1802] An "administrator" is a person in charge of managing work within a factory and the operation of robots.

[1803] "Server" refers to a computer system for receiving, analyzing, storing data, and generating feedback.

[1804] "Input means" refers to the interface or device that allows the worker to input the information they want to see.

[1805] "Transmission means" refers to the communication functions and protocols used to transmit input data to the server.

[1806] "Means of analysis" refers to algorithms and AI engines that process the data received by the server and detect anomalies or identify areas requiring maintenance.

[1807] "Feedback" refers to evaluations and instructions provided to workers and managers based on the analysis results.

[1808] "Rewards" are digital badges or other rewards given to workers for taking corrective action.

[1809] "Means of notification" refers to communication methods and push notification functions for conveying generated feedback and rewards to managers and workers.

[1810] An "abnormality" refers to an operation or state that differs from normal in machines or systems within a factory.

[1811] "Maintenance required areas" are areas or parts that require preventative maintenance or repair.

[1812] "Digital Badge" means an electronic reward provided to recognize a worker's achievements.

[1813] A "safety badge" is an electronic certificate of knowledge provided to workers as recognition of safe work practices.

[1814] This invention is a system that supports communication between managers and workers to improve the safety and efficiency of robots used in factories. The system aims to realize a series of processes in which workers input what they want to see, send the data to a server, analyze it, generate feedback and rewards, and notify the manager's terminal.

[1815] System configuration

[1816] The system includes the following components:

[1817] 1. Worker's terminal

[1818] A means (interface) for workers to input what they want to see

[1819] A means of sending input data to the server (communication function)

[1820] 2. Server

[1821] How data is received and stored

[1822] A means of analyzing the received data (AI or algorithms)

[1823] A means of generating feedback and rewards based on the analysis results

[1824] 3. Administrator's terminal

[1825] A way to receive and communicate feedback and rewards

[1826] Program processing (natural language explanation)

[1827] Worker (user):

[1828] The worker uses the input means of the terminal to input what he or she wants the manager to see. The input content can be text, photos, videos, etc., and this data is sent to the server via the Internet.

[1829] Terminal (Worker's terminal):

[1830] The system receives the information entered by the worker, formats it as transmission data, and sends a POST request to the server, which saves the data in the cloud and prepares it for analysis.

[1831] server:

[1832] The server receives the POST request and securely stores the data. The stored data is analyzed by an AI feedback engine to track work progress and identify abnormalities. For example, when evaluating abnormal machine sounds, the characteristics and frequency of the sound are analyzed.

[1833] server:

[1834] Based on the analysis results, feedback and appropriate rewards are generated. The generated feedback is in text format and includes specific evaluations and measures for the worker. Rewards are provided in the form of digital badges, safety badges, etc., and serve to continuously motivate workers.

[1835] Terminal (Administrator's terminal):

[1836] A push notification is sent to the manager's device, informing them of the feedback and reward. When the manager taps the notification, the app opens and they can view detailed feedback and the information about the deliverables that the worker wanted to see.

[1837] Specific examples

[1838] Example 1: When the robot detects an abnormal sound

[1839] 1. Worker (user):

[1840] The worker enters text into the app saying, "There is an abnormal noise coming from the machine," and then uploads and sends the recording of the abnormal noise.

[1841] 2. Terminal (Worker's terminal):

[1842] Receives input data (text and audio data) and sends it to the server.

[1843] 3. Server:

[1844] The server receives the data and analyzes the recorded data using an AI feedback engine. As a result of the analysis, it may conclude that the cause is, for example, "wear on the bearings."

[1845] 4. Server:

[1846] Based on the analysis results, feedback is generated such as "Machine A's bearings are worn and require inspection," and a digital badge "Safety Awareness" is generated as a reward.

[1847] 5. Terminal (Administrator's terminal):

[1848] A notification is sent to the administrator's terminal stating, "An abnormality has been detected in Machine A. Inspection is required."

[1849] 6. Operator / Administrator:

[1850] The administrator checks the notification, views detailed feedback in the app, and issues instructions on the necessary response, which the worker then implements to resolve the abnormality.

[1851] Prompt Sentence Examples

[1852] Data from a machine where an abnormality was detected has been sent and analyzed. The abnormality detected is bearing wear. Generate feedback to notify managers and workers: "There is wear in the bearings of machine A. Inspection recommended." and assign a related digital badge.

[1853] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1854] Step 1:

[1855] The user (worker) uses the terminal to input the information they want to see (abnormal sounds or problems). The input method is text, photos, or video. The input data is saved in the terminal once and is ready to be sent.

[1856] Input: What the worker inputs (text, photos, videos)

[1857] Output: Input data ready to be sent

[1858] Step 2:

[1859] The terminal sends the formatted data to the server using the HTTP POST request as the communication protocol.

[1860] Input: Input data ready to be sent

[1861] Output: Data sent to the server

[1862] Step 3:

[1863] The server receives the data sent from the device and stores it securely in a database (e.g., MySQL).

[1864] Input: Data sent from the terminal

[1865] Output: Data stored in the database

[1866] Step 4:

[1867] The AI ​​feedback engine on the server analyzes the stored data, specifically using a sound analysis algorithm (e.g., SpaCy or TensorFlow) to analyze abnormal sounds.

[1868] Input: Saved data

[1869] Output: Analysis results (e.g. abnormal noise is caused by bearing wear)

[1870] Step 5:

[1871] The server generates feedback based on the analysis results, including specific measures and evaluations, and generates appropriate rewards (e.g., digital badges).

[1872] Input: Analysis results

[1873] Output: Feedback and reward (e.g., bearing wear is the cause. Inspection recommended. Digital badge "Safety Awareness")

[1874] Step 6:

[1875] The generated feedback and reward will be sent to the administrator's device via a push notification, which will include information about the feedback and reward.

[1876] Input: Feedback and Rewards

[1877] Output: Push notification sent to the administrator's device

[1878] Step 7:

[1879] The manager checks the notification on the terminal and views the detailed feedback content, and if necessary, issues instructions to the worker to resolve the problem.

[1880] Input: Push notification sent to the administrator's device

[1881] Output: Feedback viewed by the administrator and instructions to respond

[1882] Specific behavior:

[1883] 1. User enters text, photo, or video and presses the save button

[1884] 2. The device formats the data and sends it to the server

[1885] 3. The server receives the data and stores it in the database

[1886] 4. The AI ​​engine on the server analyzes the data

[1887] 5. The server generates feedback and rewards based on the analysis results.

[1888] 6. The server notifies the administrator of the generated feedback and rewards.

[1889] 7. The administrator checks the notification, reads the feedback, and takes any necessary action.

[1890] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1891] This invention relates to a system that supports communication between parents and children by allowing children to input what they want to see, sending the data to a server, which then analyzes the data to generate feedback and rewards, and notifying the parent's device of the generated feedback and rewards. Furthermore, this system incorporates an emotion engine that recognizes the child's emotions.

[1892] System configuration

[1893] The system includes the following components:

[1894] 1. Children's devices

[1895] A means (interface) for children to input what they want to see

[1896] A means of sending input data to the server (communication function)

[1897] 2. Server

[1898] How data is received and stored

[1899] A means of analyzing the received data (AI or algorithms)

[1900] Emotion recognition using an emotion engine

[1901] A means of generating feedback and rewards based on the analysis results

[1902] 3. Parent's device

[1903] A way to receive and communicate feedback and rewards

[1904] Program processing

[1905] User (child):

[1906] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[1907] Device (child's device):

[1908] The data entered by children is converted into JSON format or similar and sent to a server via the Internet.

[1909] server:

[1910] The server receives the POST request and stores it in a database. The stored data includes the child's ID, input content, photo, and timestamp. The emotion engine recognizes the child's emotions from the input text and image. This emotion data is also used for analysis.

[1911] server:

[1912] The received data is analyzed using an AI feedback engine. For example, the system evaluates the color usage and composition of the drawing, and provides analysis results that take the child's emotions into consideration.

[1913] server:

[1914] Based on the analysis results, feedback and rewards are generated. For example, if a child is pleased with the evaluation that "your use of color is excellent," the system generates feedback such as "Your drawing is very colorful and beautiful!" and provides the digital badge "Creative Kids" as a reward.

[1915] Device (parent device):

[1916] The generated feedback and reward notifications are sent to the parent's device. When a push notification is received, a new message appears in the notification center. When the parent taps the notification, they can view the child's request and the corresponding feedback within the app.

[1917] Specific examples

[1918] Example 1: When a child wants to show a picture

[1919] 1. User (child):

[1920] A child can type in text in the app saying, "I want to show my mom the picture I drew," upload a photo of the drawing, and send it. The emotion engine recognizes that the child is "happy."

[1921] 2. Device (child's device):

[1922] The entered data (text and picture) is sent to the server in JSON format.

[1923] 3. Server:

[1924] Receive and store data. The emotion engine recognizes when a child is happy.

[1925] 4. Server:

[1926] The AI ​​feedback engine analyzes the data and evaluates it as "great use of color." Taking into account the results of the emotion engine, the feedback is determined as "X-Chan drew a wonderful picture."

[1927] 5. Server:

[1928] A reward generation engine generates digital badges for "creative kids."

[1929] 6. Device (parent device):

[1930] A notification will be sent to the parent's device saying, "○○-chan has drawn a wonderful picture. A digital badge has been sent."

[1931] 7. User (Parent):

[1932] Parents can view the notification and detailed feedback within the app, giving specific praise such as, "Your drawing is so colorful and beautiful!"

[1933] In this way, this system allows parents to communicate smoothly with their children even when they are busy, and children can be properly recognized for their efforts and achievements. Furthermore, the emotion engine allows feedback that takes into account the child's emotions, resulting in greater understanding and consideration.

[1934] The processing flow will be explained below.

[1935] Step 1:

[1936] User (child)

[1937] Open the "Misete-chan" app. Access the input form within the app and enter the "content you want to see."

[1938] Step 2:

[1939] User (child)

[1940] Enter text, photos, videos, etc. into the input form. For example, take a photo of a drawing you've made and enter the text "I want my mom to see this."

[1941] Step 3:

[1942] Device (child's device)

[1943] It receives the input data, converts it to JSON format, and then sends a POST request to the server via the Internet.

[1944] Step 4:

[1945] server

[1946] It receives a POST request and stores it in a database. The data stored includes the child's ID, input, photo, and timestamp.

[1947] Step 5:

[1948] server

[1949] The data is passed to an AI feedback engine for analysis of text data and photos. At the same time, an emotion engine recognizes the child's emotions from the text and photos. For example, if the text is "I want my mom to see this," the emotion engine recognizes positive emotions (joy).

[1950] Step 6:

[1951] server

[1952] An AI feedback engine analyzes the data and evaluates the child's input and photos. For example, it analyzes a photo of a drawing and evaluates it as "great use of color."

[1953] Step 7:

[1954] server

[1955] The emotions recognized by the emotion engine are combined with the evaluation results of the AI ​​feedback engine to generate feedback. For example, specific feedback such as "Your drawing is very colorful and beautiful! You must be happy to show it to your mother" can be set.

[1956] Step 8:

[1957] server

[1958] The reward generation engine uses the analysis results and emotional data to generate appropriate rewards, such as creating a digital badge for "creative kids."

[1959] Step 9:

[1960] server

[1961] The system generates data to notify the parent's device of the generated feedback and reward. The notification includes a summary of the feedback and the reward.

[1962] Step 10:

[1963] Device (parent device)

[1964] A push notification will be received and displayed in the notification center. When a parent taps the notification, the "Misete-chan" app will open and display detailed feedback and reward information.

[1965] Step 11:

[1966] User (Parent)

[1967] Parents can check the feedback within the app and give their child specific praise, for example, "Your drawing is so colorful and beautiful!"

[1968] This series of steps allows children to quickly and appropriately communicate what they want to see to their parents, and allows parents to communicate with their children regularly even when they are busy. Furthermore, providing feedback and rewards that take children's emotions into consideration makes communication even more effective.

[1969] Example 2

[1970] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1971] Conventional parent-child communication systems lack a means for children to properly communicate what they want to see to their parents, or a means for providing feedback that understands the child's emotions. Furthermore, there is a lack of a way to generate rewards that take the child's emotions into account and notify the parent. This creates a challenge in that it is difficult to ensure smooth communication even when parents are busy.

[1972] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1973] In this invention, the server includes an emotion recognition means for recognizing the child's emotion, a means for notifying the parent of appropriate feedback based on the analysis, and a means for generating a reward such as a digital badge, a drawing sheet, or an in-game item, thereby making it possible to provide appropriate feedback and rewards while taking the child's emotion into consideration.

[1974] "Means for inputting content that children want to see" refers to devices or interfaces that allow children to input content that they want to see, and includes software such as applications that run on smartphones and tablets.

[1975] "Means for transmitting input data to a server" refers to a function for transmitting data input by a child to a server via a communication means such as the Internet.

[1976] "Means of analyzing data received by the server and generating feedback and rewards based on the analysis results" refers to a system that analyzes received data using AI or algorithms and automatically generates feedback messages and rewards based on the results.

[1977] "Means for notifying the parent's terminal of the generated feedback and reward" refers to a function for sending and notifying the parent's terminal of the generated feedback message and reward information.

[1978] "Emotion recognition means for recognizing children's emotions" refers to engines or algorithms that analyze and recognize the emotional state of children from text, images, etc. entered by them.

[1979] "Means for communicating data in JSON format" refers to the means for converting the content entered by the child into JSON (JavaScript Object Notation) format and sending it to the server according to the communication protocol.

[1980] "Means for using emotional data for analysis" refers to the ability to use a child's emotional state as part of data analysis to generate more appropriate feedback and rewards.

[1981] "Digital badges" refer to electronic awards or certificates given to children based on their behavior and achievements.

[1982] A "drawing sheet" refers to a digital or physical sheet generated based on a child's drawing and related information.

[1983] "In-game items" refer to benefits and rewards that can be used within the game a child is playing.

[1984] MODE FOR CARRYING OUT THE INVENTION

[1985] This invention relates to a system that supports communication between parents and children by allowing children to input what they want to see, sending the data to a server, which then analyzes the data to generate feedback and rewards, and notifying the parent's device of the generated feedback and rewards. Furthermore, this system incorporates an emotion engine that recognizes the child's emotions.

[1986] System configuration

[1987] The system includes the following components:

[1988] 1. Children's devices

[1989] Input method: An interface for children to input what they want to see. For example, a smartphone application.

[1990] Transmission means: A communication function for transmitting input data to a server.

[1991] 2. Server

[1992] Receiving means: A function that receives and stores data (e.g., a database system).

[1993] Analysis means: A function that analyzes the received data (e.g., AI feedback engine, emotion recognition engine).

[1994] Generation means: A function that generates feedback and rewards based on the analysis results.

[1995] Notification: A function that notifies the parent's device of the generated feedback and rewards.

[1996] 3. Parent's device

[1997] Receiving means: A function for receiving and notifying feedback and rewards (e.g., a smartphone application).

[1998] Program processing

[1999] User (child):

[2000] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[2001] Device (child's device):

[2002] The data entered by the child is converted into JSON format and sent to a server via the internet. The entered data includes the child's ID, input content, photo, timestamp, etc.

[2003] server:

[2004] The server receives the POST request and stores it in a database. This data contains all the information necessary for analysis, such as the child's ID, input content, photo, and timestamp. Next, an emotion recognition engine is used to recognize the child's emotions from the input text and images. Specifically, it identifies emotions such as "happy" from the child's text message and image.

[2005] server:

[2006] The received data, including emotional data, is analyzed by an AI feedback engine. For example, a drawing is evaluated for its color usage and composition. Emotional data is also taken into account in the analysis to generate more appropriate feedback.

[2007] server:

[2008] A feedback message and reward are generated based on the analysis results. For example, if the analysis result is "great use of color" and the child is pleased, the system generates feedback such as "Your drawing is very colorful and wonderful!" and provides a "Creative Kids" digital badge as a reward.

[2009] Device (parent device):

[2010] The generated feedback message and reward information are sent to the parent's device. The parent's device receives a push notification, and a new message appears in the notification center. When the parent taps the notification, they can view the child's request and the corresponding feedback within the "Misete-chan" app.

[2011] Specific examples

[2012] Example 1: When a child wants to show a picture

[2013] User (child):

[2014] A child uses the "Misete-chan" app to type, "I want to show my mom the picture I drew," and uploads a photo of the drawing. The emotion engine recognizes that the child is "happy."

[2015] Device (child's device):

[2016] The entered data (text and picture) is sent to the server in JSON format.

[2017] server:

[2018] Receive and store data. The emotion engine recognizes when a child is happy.

[2019] server:

[2020] The AI ​​feedback engine analyzes the data and evaluates it as "great use of color." Taking into account the results of the emotion engine, the feedback is determined as "X-Chan drew a wonderful picture."

[2021] server:

[2022] A reward generation engine generates digital badges for "creative kids."

[2023] Device (parent device):

[2024] A notification will be sent to the parent's device saying, "X-chan drew a wonderful picture. We've sent you a digital badge." The parent will then check the notification and view detailed feedback within the app. They can then give specific praise, such as, "Your drawing is so colorful and beautiful!"

[2025] Prompt Sentence Examples

[2026] Below are some example prompts to input to the generative AI model:

[2027] A child requests in the app, "Mommy, please show me your dinosaur drawing." Feedback: Great colors, this dinosaur looks so realistic. Emotion: Delighted. Generated feedback: "Great colors! This dinosaur looks so realistic!" Generated badge: "Creative Kids."

[2028] In this way, this system allows parents to communicate smoothly with their children even when they are busy. Children can be properly recognized for their efforts and achievements, and the emotion engine allows for feedback that takes children's emotions into consideration.

[2029] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2030] Step 1:

[2031] User (child):

[2032] The child opens the "Misete-chan" app and inputs what they want to see. For example, they can take a photo of a drawing they've made and attach a text message saying, "I want Mommy to see this."

[2033] Input: Text message (e.g., "I want my mom to see this") and image data (e.g., a photo of a drawing).

[2034] Output: JSON formatted data.

[2035] Specific operation: Using the camera function within the app, an interface will appear where you can take a photo of the painting and enter a message.

[2036] Step 2:

[2037] Device (child's device):

[2038] The entered data is converted into JSON format and sent to the server via the Internet.

[2039] Input: Text messages and photos sent by users.

[2040] Output: A POST request to the server.

[2041] What happens: The app internally encodes the data into JSON format and sends a POST request to the server endpoint.

[2042] Step 3:

[2043] server:

[2044] The server receives the POST request and stores it in a database, which stores the child's ID, input, photo, timestamp, etc.

[2045] Input: JSON formatted data.

[2046] Output: Records stored in the database.

[2047] What happens: The server parses the POST request and creates a new record in the database.

[2048] Step 4:

[2049] server:

[2050] Using an emotion recognition engine, the system recognizes a child's emotions from input text and images. For example, it identifies emotions such as "happy" from a child's message.

[2051] Input: Text message and image data.

[2052] Output: Emotion data (e.g., "happy").

[2053] Specific operation: The emotion recognition engine performs text analysis and image analysis to estimate emotions.

[2054] Step 5:

[2055] server:

[2056] The AI ​​feedback engine analyzes the received data and emotional data, for example evaluating the color usage and composition of the picture and determining feedback taking the child's emotions into account.

[2057] Input: Stored database data and emotion data.

[2058] Output: Feedback content.

[2059] Specific operation: The AI ​​feedback engine analyzes the data and makes an evaluation.

[2060] Step 6:

[2061] server:

[2062] Based on the analysis results, feedback messages and rewards are generated. For example, based on the result that "children are delighted with the wonderful use of color," feedback such as "Your drawing is very colorful and wonderful!" and a digital badge of "Creative Kids" are generated.

[2063] Input: Analysis results and emotion data.

[2064] Output: Feedback message and digital badge.

[2065] What happens: The server constructs a feedback message and generates a digital badge.

[2066] Step 7:

[2067] server:

[2068] The generated feedback message and reward information are sent to the parent's device.

[2069] Input: Feedback message and digital badge.

[2070] Output: Notification to parent device.

[2071] Specific operation: The server sends a push notification to the parent device.

[2072] Step 8:

[2073] Device (parent device):

[2074] When parents tap the notification, they can view their child's request and feedback within the "Misete-chan" app.

[2075] Input: Notification from the server.

[2076] Output: Display of feedback message.

[2077] What it does: Parents receive a notification on their smartphone and receive detailed feedback within the app.

[2078] These steps allow the system to take into account the child's input and emotions, and provide appropriate feedback and rewards to the parent.

[2079] (Application example 2)

[2080] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2081] In modern society, busy parents tend to neglect communication with their children. This reduces opportunities for children to have their efforts and achievements seen, making it difficult for them to feel confident or happy. It is also often difficult to properly understand a child's emotions and provide them with feedback. This invention aims to solve these problems by providing a system that accurately understands the content and emotions entered by a child and provides appropriate feedback to parents in real time.

[2082] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a means for inputting content that the child wants to see, a means for transmitting the input data to the server, a means for analyzing the data received by the server and generating feedback and a reward based on the analysis results, a means for notifying the parent's device of the generated feedback and reward, a means for analyzing the child's emotions using an emotion recognition engine, a means for notifying the parent's device of the generated feedback and reward in real time, and a means for generating optimal feedback based on the analysis results using a generative AI model. This makes it possible to accurately understand the content and emotions input by the child and notify the parent of appropriate feedback and reward in real time.

[2083] Key Word Definitions

[2084] "Means for inputting what children want their parents to see" refers to an interface that allows children to input what they want their parents to see in the form of text, images, audio, etc.

[2085] "Means for transmitting input data to a server" refers to a communication function that transmits data input by a child to a server via the Internet.

[2086] "Means for analyzing data received by the server and generating feedback and rewards based on the analysis results" refers to a function that analyzes data received by the server and automatically generates feedback for the parent and rewards for the child based on the analysis results.

[2087] The "means for notifying the parent's terminal of the generated feedback and reward" is a communication function for transmitting the feedback and reward generated by the server to the parent's terminal in real time.

[2088] "Means for analyzing children's emotions using an emotion recognition engine" is an AI technology that analyzes emotions from text, voice, images, etc. entered by the child and identifies the child's current emotions.

[2089] "Means for notifying the parent's device of the generated feedback and reward in real time" is a function for instantly sending the generated feedback and reward to the parent's device, thereby quickly conveying the information to the parent.

[2090] "Means for generating optimal feedback based on analysis results using a generative AI model" refers to a function that uses an AI model to evaluate analysis results and generate optimal feedback for children.

[2091] A "digital certification badge" is a badge that digitally recognizes a child's efforts and achievements and is used to enhance a child's sense of accomplishment.

[2092] "Creative sheets" are digital tools that allow children to engage in creative activities, and examples include drawing sheets.

[2093] "Digital entertainment items" are digital items provided to increase children's enjoyment, including, for example, in-game bonuses and items.

[2094] MODE FOR CARRYING OUT THE INVENTION

[2095] This invention relates to a system for promoting communication between parents and children. A child inputs the content they want to see and sends the data to a server, which analyzes it, generates feedback and rewards, and notifies the parent's device. The system also uses an emotion recognition engine to analyze the child's emotions and generates optimal feedback accordingly.

[2096] System configuration

[2097] 1. Children's devices:

[2098] Input medium: The interface that a child uses to input content such as text, images, or audio.

[2099] Communication method: A communication function that sends the data entered by the child to a server via the Internet.

[2100] 2. Server:

[2101] Data storage means: The server has the function of storing the received data in a database.

[2102] Data analysis method: The server analyzes the received data using AI algorithms, including an emotion recognition engine.

[2103] Feedback generation method: The system has the ability to generate feedback and rewards based on the recorded data and analysis results. Using a generative AI model, it suggests optimal feedback based on the child's emotions.

[2104] Notification: The generated feedback and rewards are sent to the parent's device in real time.

[2105] 3. Parent device:

[2106] Receiving means: The parent's device receives feedback and reward notifications from the server.

[2107] Display: The reported feedback and rewards are displayed within the app for easy parental review.

[2108] Processing flow

[2109] User (child)

[2110] Using an application installed on the child's device, the child can input "what they want to show their mother" in the form of text, image, voice, etc. For example, the child can take a photo of a drawing they have made and attach a text message saying "I want to show this to my mother." The emotion recognition engine analyzes the child's emotions and sends this data to the server.

[2111] Device (child's device)

[2112] The data entered by children is converted into JSON format or similar and sent to a server via the Internet.

[2113] server

[2114] The server stores the received data in a database and analyzes it using an AI algorithm, such as tools like TensorFlow or PyTorch. The AI ​​algorithm also includes the results of an emotion recognition engine analyzing the child's emotions. Feedback and rewards are generated based on the analysis results. Generative AI models (such as GPT-3 or BERT) are used to automatically generate optimal feedback that matches the child's emotions and content.

[2115] server

[2116] The generated feedback and rewards are pushed from the server to the parent's device in real time using a notification service such as Firebase Cloud Messaging (FCM).

[2117] Device (parent device)

[2118] The parent's device receives a push notification from the server and displays the new message in the notification center. When the parent taps the notification, they can view the child's request and receive feedback within the app.

[2119] Specific examples

[2120] Example 1: When a child wants to show a picture

[2121] A child enters text into the app saying, "I want to show my mom the picture I drew," and uploads and sends a photo of the drawing. The emotion recognition engine recognizes the child's emotion as "happy." The server receives the data, and the AI ​​feedback engine evaluates it as "great use of color," generating feedback such as "X-chan drew a wonderful picture." As a reward, the child is given a "Creative Kids" digital badge. A notification is sent to the parent's device stating, "X-chan drew a wonderful picture. A digital badge has been sent."

[2122] Example prompts for generative AI models

[2123] "A child says, 'I want to show my mom the picture I drew.' He / she is very happy. Consider this situation and generate feedback and give him / her a 'Creative Kids' digital badge."

[2124] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2125] Program processing steps

[2126] Step 1:

[2127] Input: The text, images, audio, and other content that your child types.

[2128] The child uses the device's application to input the content they want to show (for example, a picture they have drawn and a message). At this time, an emotion recognition engine is activated to recognize the child's emotions. This organizes the child's input data into the form of text, images, and emotion data.

[2129] Output: Organized input data (text, images, emotion data).

[2130] Step 2:

[2131] Input: Organized input data (text, images, sentiment data).

[2132] The child's device converts the organized input data into JSON format and sends it to the server, which requires a secure communication method to send the data over the Internet.

[2133] Output: JSON formatted data sent to the server.

[2134] Step 3:

[2135] Input: JSON formatted data sent to the server.

[2136] The server stores the received data in a database. The stored data includes the child's ID, input content, image, emotion data, and timestamp. The data is managed using database software (e.g., MySQL, PostgreSQL).

[2137] Output: Data stored in a database.

[2138] Step 4:

[2139] Input: Data stored in a database.

[2140] The server analyzes the data using AI algorithms and emotion recognition engines (e.g., TensorFlow, PyTorch), evaluates the content and emotional data of the received child input data, and generates an analysis result based on the child's emotions.

[2141] Output: Analysis results (evaluation based on the child's feelings).

[2142] Step 5:

[2143] Input: Analysis results.

[2144] The server uses a generative AI model (e.g., GPT-3 or BERT) to generate feedback and rewards based on the analysis results. In this case, the feedback correctly evaluates the child's input and creates appropriate messages based on their emotions. Rewards such as digital certification badges, creation sheets, and digital entertainment items are also generated.

[2145] Output: Generated feedback and rewards (e.g., feedback messages, digital badges).

[2146] Step 6:

[2147] Input: Generated feedback and rewards.

[2148] The server notifies the parent device of the generated feedback and reward in real time using a notification service such as Firebase Cloud Messaging (FCM) to instantly send a push notification to the parent device.

[2149] Output: Notifications sent to the parent device (feedback messages, digital badges).

[2150] Step 7:

[2151] Input: Notifications sent by the server (feedback messages, digital badges).

[2152] The parent's device will receive a notification, which will be displayed as a push notification. When the parent taps the notification, they can view the child's request and the feedback provided within the app, allowing parents to communicate more effectively with their children.

[2153] Output: Feedback and reward displayed in the app.

[2154] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2155] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2156] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2157] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2158] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2159] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2160] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2161] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2162] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2163] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2164] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2165] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2166] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2167] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2168] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2169] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2170] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2171] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2172] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2173] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2174] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2175] The following is further disclosed regarding the above embodiment.

[2176] Thank you. Below is a proposed draft of the patent claims for the parent-child communication tool system.

[2177] (Claim 1)

[2178] A way for children to input what they want to see,

[2179] means for transmitting the input data to a server;

[2180] means for analyzing the received data at the server and generating feedback and rewards based on the analysis results;

[2181] The system includes a means for notifying a parent device of the generated feedback and reward.

[2182] (Claim 2)

[2183] 10. The system of claim 1, further comprising means for notifying a parent of appropriate feedback based on the analysis results.

[2184] (Claim 3)

[2185] 10. The system of claim 1, further comprising means for generating a digital badge, drawing sheet, or in-game item reward based on the analysis results.

[2186] "Example 1"

[2187] The following claims are based on the content of the new invention.

[2188] (Claim 1)

[2189] A way for children to input what they want to see,

[2190] means for transmitting the input data to a server;

[2191] means for receiving and storing the data on a server;

[2192] A means to analyze the stored data with an AI feedback engine,

[2193] a means for generating feedback and digital rewards based on the analysis results;

[2194] A means of notifying the parent of the generated feedback and digital rewards on their device;

[2195] A system that includes a way for parents to see feedback and digital rewards.

[2196] (Claim 2)

[2197] 10. The system of claim 1, further comprising means for notifying a parent of appropriate feedback based on the analysis results.

[2198] (Claim 3)

[2199] 10. The system of claim 1, further comprising means for generating a digital reward, such as a digital badge, a drawing sheet, or an in-game item, based on the analysis results.

[2200] "Application Example 1"

[2201] (Claim 1)

[2202] A means for workers to input what they want to see;

[2203] means for transmitting the input data to a server;

[2204] means for analyzing the received data at the server and generating feedback and rewards based on the analysis results;

[2205] The system includes a means for notifying the generated feedback and rewards to the administrator's terminal.

[2206] (Claim 2)

[2207] 2. The system according to claim 1, further comprising means for identifying abnormalities or areas requiring maintenance within the factory based on the analysis results and notifying appropriate measures.

[2208] (Claim 3)

[2209] 10. The system of claim 1, further comprising means for generating a digital badge or safety badge reward based on the analysis results.

[2210] "Example 2: Combining Emotion Engines"

[2211] (Claim 1)

[2212] A way for children to input what they want to see,

[2213] means for transmitting the input data to a server;

[2214] means for analyzing the received data at the server and generating feedback and rewards based on the analysis results;

[2215] A means for notifying the parent's device of the generated feedback and reward;

[2216] an emotion recognition means for recognizing a child's emotion;

[2217] A means of communicating data in JSON format;

[2218] A system including means for using emotion data for analysis.

[2219] (Claim 2)

[2220] 10. The system of claim 1, further comprising means for notifying a parent of appropriate feedback based on the analysis results.

[2221] (Claim 3)

[2222] 10. The system of claim 1, further comprising means for generating a digital badge, drawing sheet, or in-game item reward based on the analysis results.

[2223] "Application example 2 when combining emotion engines"

[2224] (Claim 1)

[2225] A way for children to input what they want to see,

[2226] means for transmitting the input data to a server;

[2227] means for analyzing the received data at the server and generating feedback and rewards based on the analysis results;

[2228] A means for notifying the parent's device of the generated feedback and reward;

[2229] A means for analyzing a child's emotions using an emotion recognition engine;

[2230] A means of notifying the parent's device of the generated feedback and reward in real time;

[2231] A means for generating optimal feedback based on the analysis results using a generative AI model; and

[2232] A system including:

[2233] (Claim 2)

[2234] 10. The system of claim 1, further comprising means for notifying a parent terminal of the generated feedback and reward in real time.

[2235] (Claim 3)

[2236] 10. The system of claim 1, further comprising means for generating a digital authentication badge, a creation sheet, or a digital entertainment item reward based on the analysis results. [Explanation of symbols]

[2237] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A way for children to input what they want to see, means for transmitting the input data to a server; means for analyzing the received data at the server and generating feedback and rewards based on the analysis results; The system includes a means for notifying a parent device of the generated feedback and reward.

2. The system of claim 1 , further comprising means for notifying a parent of appropriate feedback based on the analysis results.

3. The system of claim 1 , further comprising means for generating a reward such as a digital badge, a drawing sheet, or an in-game item based on the analysis results.

Images