System

Abstract

To provide a system that enables a parent to understand an action or feeling of a child in real time and to take appropriate measures.SOLUTION: A system includes: means for recognizing a feeling of a child using a feeling engine; means for analyzing a meaning of an action or utterance of the child using a generative AI and a prompt sentence for instructing analysis of the meaning of the action or utterance of the child on the basis of the input action or utterance contents of the child and the feeling of the child; and means for providing a parent with a result of the analysis through smart glasses.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Many parents have no experience raising children, and they may have concerns about the meaning of their children's behavior or parenting issues, finding it difficult to find appropriate responses or solutions. There is also a lack of educational support for children, reading aloud, or the means to analyze children's speech and provide advice to parents. Furthermore, it is difficult to purchase related products with confidence. [Means for solving the problem]

[0005] Generative AI is used to analyze the meaning of children's behavior and provide it to parents. Parents can ask generative AI questions about child-rearing and it will provide answers. It provides educational support and reading to children, analyzes what children say, and provides advice to parents. It helps parents purchase related products with peace of mind. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] One embodiment of the present invention is a child-rearing support system that uses generative AI. This system analyzes a child's behavior and speech and provides the parent with its meaning. For example, if a child says, "I'm hungry," the system interprets this as a "behavior requesting food" and communicates this meaning to the parent. Furthermore, if a parent asks the system a question such as, "Why does my child cry in the middle of the night?", the system generates an answer to that question and provides it to the parent.

[0029] "Example 2"

[0030] Furthermore, this system has the function of supporting children's education and reading aloud. For example, if a child asks, "Why is the sky blue?", the system will generate a scientific answer to the question and provide it to the child. Also, if a parent requests the system to read a story to them today, the system will select a story that it predicts the child will like and read it to them.

[0031] "Example 3"

[0032] The system also has the ability to analyze what children say and provide advice to parents. For example, if a child says, "I hate school," the system will analyze the comment and provide advice to the parents, such as, "Your child may have some problems with school."

[0033] "Example 4"

[0034] Furthermore, the system has a function to support the safe purchase of related products. For example, if a parent requests the system to purchase a picture book for their child, the system will select a reliable online shop and help the parent make a purchase with peace of mind.

[0035] The processing flow of each embodiment will be described below.

[0036] "Example 1"

[0037] Step 1: The generative AI observes the child's behavior and comments and collects them as data.

[0038] Step 2: Analyze the collected data and understand the meaning of the child's behavior.

[0039] Step 3: Provide the analysis results to the parent.

[0040] "Example 2"

[0041] Step 1: Receive a parent's request for educational support or reading aloud.

[0042] Step 2: Generate appropriate educational content and stories on demand.

[0043] Step 3: Provide the generated educational content and stories to parents and children.

[0044] "Example 3"

[0045] Step 1: Observe and collect data on children's talk.

[0046] Step 2: Analyze the collected data and understand the child's feelings and problems.

[0047] Step 3: Based on the analysis results, advice is generated for parents.

[0048] Step 4: Provide the generated advice to the parent.

[0049] "Example 4"

[0050] Step 1: Receive a request from a parent to purchase a product.

[0051] Step 2: Choose a reliable online store based on your requirements.

[0052] Step 3: Provide parents with the details of the online store they have chosen.

[0053] Example 1

[0054] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0055] In today's child-rearing environment, parents often find it difficult to understand the meaning of their children's actions and words, and are unable to respond appropriately. Furthermore, when parents ask questions about child-rearing, there are limited ways to get reliable answers. Furthermore, there is a lack of comprehensive child-rearing support, such as educational support, reading aloud to children, and support for purchasing related products.

[0056] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0057] In this invention, the server includes a means for analyzing the meaning of a child's behavior using generative AI and providing the results to parents; a means for parents to ask the generative AI questions about child-rearing and provide answers; a means for providing educational support and reading to the child; a means for analyzing the child's speech and providing advice to the parent; a means for supporting the parent in purchasing related products with peace of mind; a means for the device to collect the child's behavior and statements as voice and text data and send it to the server; a means for the server to input the received data into a generative AI model and provide the analysis results to the parent; and a means for notifying the parent of the analysis results and answers. This allows parents to quickly and accurately understand the meaning of their child's behavior and statements and take appropriate action. It also provides reliable parenting information and advice, providing comprehensive parenting support.

[0058] "Generative AI" is an artificial intelligence technology that generates new information and answers based on data.

[0059] "Analyzing the meaning of children's behavior" means collecting data on children's actions and words and understanding the intentions and demands behind them.

[0060] "Providing to parent" means notifying the parent of the analysis results and answers and making them available to the parent.

[0061] "Asking questions to the generative AI" means that parents input their doubts or queries about child-rearing into the system, and the generative AI receives those questions.

[0062] "Providing an answer" means that the generative AI generates an appropriate answer to the parent's question and notifies the parent of it.

[0063] "Educational support" means providing information and activities to help children learn and develop.

[0064] "Reading aloud" means providing children with stories or picture books in audio or text format.

[0065] "Analyzing a child's speech" means analyzing what a child says and understanding the intentions and emotions behind it.

[0066] "Providing advice to parents" means providing parents with appropriate ways of responding and advice based on the analysis of their child's behavior and comments.

[0067] "Supporting parents in purchasing related products with peace of mind" means providing information and support so that parents can purchase products related to child-rearing with peace of mind.

[0068] "Devices" are devices used to collect information about children's behavior and statements, such as smartphones and tablets.

[0069] "Collecting as audio or text data" means digitizing children's statements and actions in the form of audio recordings or text input.

[0070] A "server" is a computer system that receives collected data and analyzes it using a generative AI model.

[0071] "Inputting into a generative AI model" means passing the collected data to the generative AI model and starting the process for analysis.

[0072] "Providing the analysis results to the parent" means that the generative AI model notifies the parent of the analysis results and makes them available to the parent.

[0073] "Notifying the parent's device" means sending the analysis results and answers to the parent's smartphone or tablet as a push notification or message.

[0074] MODE FOR CARRYING OUT THE INVENTION

[0075] This invention is a child-rearing support system that uses a generative AI model to analyze children's behavior and comments and provide their meaning to parents. A specific embodiment of this system is described below.

[0076] System configuration

[0077] Hardware:

[0078] Server: A server equipped with a high-performance GPU (e.g., NVIDIA Tesla V100)

[0079] Device: a device such as a smartphone or tablet

[0080] software:

[0081] Generative AI model: Using OpenAI® GPT-4® as an example

[0082] Data analysis tools: Python's Pandas library, etc.

[0083] Program processing

[0084] Data collection:

[0085] The device collects the child's actions and speech as audio and text data, for example, by using a microphone built into a smartphone or tablet to record what the child says.

[0086] Data transmission:

[0087] The device sends the collected data to a server, where it is encrypted and transmitted securely.

[0088] Data Analysis:

[0089] The server inputs the received data into a generative AI model, which converts the speech data into text and analyzes its meaning.

[0090] Result generation:

[0091] The server generates a message to provide to the parent based on the analysis results obtained from the generative AI model.

[0092] Result notification:

[0093] The server sends the generated message to the parent's device, and the parent receives the notification through the device.

[0094] Specific examples

[0095] Example 1:

[0096] Child says: "I'm hungry."

[0097] Process flow:

[0098] 1. The device records what the child says.

[0099] 2. The device sends the recorded audio data to the server.

[0100] 3. The server converts the voice data into text and inputs it into the generative AI model.

[0101] 4. The generative AI model analyzes "I'm hungry" as "the behavior of wanting food."

[0102] 5. The server generates the message "Your child wants food."

[0103] 6. The server sends the generated message to the parent device.

[0104] 7. Parents receive notifications via their devices.

[0105] Example 2:

[0106] Parents ask: "Why does my child cry in the middle of the night?"

[0107] Process flow:

[0108] 1. The parent enters a question through the terminal.

[0109] 2. The terminal sends the entered question to the server.

[0110] 3. The server inputs the question into the generative AI model.

[0111] 4. The generative AI model generates an answer to the question, such as "Children may cry in the middle of the night because they are hungry, scared, or unwell."

[0112] 5. The server sends the generated answer to the parent's device.

[0113] 6. Parents receive the answers via their device.

[0114] Example prompt sentence:

[0115] "When a child says, 'I'm hungry,' what does this mean?"

[0116] "Why does my child cry in the middle of the night?"

[0117] In this way, the system provides child-rearing support through collaboration between the server, terminals, and users.

[0118] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0119] Step 1: Data collection

[0120] The device collects the child's actions and comments as audio and text data, specifically by recording what the child says using a microphone built into the smartphone or tablet.

[0121] Input: Child's utterance (e.g., "I'm hungry")

[0122] Output: Recorded audio data

[0123] Step 2: Send data

[0124] The device sends the collected voice data to a server, where it is encrypted and transmitted securely.

[0125] Input: Recorded audio data

[0126] Output: Audio data sent to the server

[0127] Step 3: Data analysis

[0128] The server inputs the received voice data into a generative AI model, which converts the voice data into text and analyzes its meaning.

[0129] Input: Audio data sent to the server

[0130] Output: Analyzed text data (e.g., "I'm hungry" → "food-seeking behavior")

[0131] Step 4: Result Generation

[0132] The server generates a message to provide to the parent based on the analysis results obtained from the generative AI model.

[0133] Input: Parsed text data

[0134] Output: A message to provide to the parent (e.g., "Your child wants to eat")

[0135] Step 5: Notification of results

[0136] The server sends the generated message to the parent's device, and the parent receives the notification through the device.

[0137] Input: Message to provide to parent

[0138] Output: Notification displayed on parent's device (e.g. "Your child wants to eat")

[0139] In this way, the child-rearing support system functions by performing specific actions and inputting and outputting data at each step.

[0140] (Application example 1)

[0141] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0142] Modern parents face many challenges in raising children. In particular, they often find it difficult to understand the meaning of their children's actions and comments, which often makes it difficult to respond appropriately. It is also difficult to understand a child's needs and select appropriate products while shopping in a physical store. Furthermore, there is a lack of means to get quick and appropriate answers to questions about child-rearing. To solve these problems, a system is needed that analyzes children's actions and comments and provides parents with appropriate information.

[0143] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0144] In this invention, the server includes a means for analyzing the meaning of a child's behavior using generative AI and providing the results to parents, a means for parents to ask questions about child-rearing to the generative AI and receive answers, a means for providing educational support and reading to children, a means for analyzing children's speech and providing advice to parents, a means for analyzing children's needs while shopping in a physical store and suggesting appropriate products, and a means for supporting parents in purchasing related products with peace of mind. This makes it easier for parents to understand the meaning of their children's behavior and statements and respond appropriately. It also enables parents to understand their children's needs and select appropriate products while shopping in a physical store. Furthermore, it allows parents to receive prompt and appropriate answers to questions about child-rearing.

[0145] "Generative AI" refers to artificial intelligence that generates new information and answers based on data.

[0146] "Analyzing the meaning of a child's behavior" means analyzing a child's actions and words and understanding the intentions and needs behind them.

[0147] "Providing to parents" means communicating the analysis results and answers to parents.

[0148] "Asking questions to generative AI" means that parents input their doubts and queries about child-rearing into the artificial intelligence.

[0149] "Providing answers" means that the generative AI returns appropriate information and advice in response to parents' questions.

[0150] "Providing educational support and storytelling" means providing educational content and stories to help children learn and grow.

[0151] "Analyzing a child's speech" means analyzing in detail what the child says and understanding its meaning and background.

[0152] "Providing advice to parents" means providing appropriate responses and advice to parents based on their child's behavior and comments.

[0153] "Analyzing children's needs while shopping in a physical store" means analyzing children's behavior and comments in real time while shopping in a physical store to understand their needs.

[0154] "Suggesting appropriate products" means recommending products to parents that meet their child's needs based on the analysis results.

[0155] "Supporting parents in purchasing related products with confidence" means providing information and support so that parents can purchase products that meet their children's needs with confidence.

[0156] As an embodiment of the present invention, the following system can be constructed.

[0157] System Configuration

[0158] The system consists of a server equipped with generative AI, a smartphone used by parents, and a device used while shopping in a physical store. The server uses generative AI models to analyze children's behavior and comments and provide appropriate information to parents.

[0159] Hardware and software used

[0160] Hardware: Smartphones, servers, and in-store devices

[0161] Software: Python, OpenAI API, Database Management System

[0162] Data processing and calculation

[0163] 1. Analyze the meaning of your child's behavior:

[0164] Parents input their children's comments via their smartphones.

[0165] The server uses the OpenAI API to send prompt statements to the generative AI model and obtain the analysis results.

[0166] The analysis results are notified to the parent's smartphone.

[0167] 2. Parents ask questions about parenting to a generative AI that provides answers:

[0168] Parents enter questions via their smartphones.

[0169] The server sends questions to the generative AI model, which generates answers.

[0170] The answers are sent to the parent's smartphone.

[0171] 3. Analyze children's needs and suggest appropriate products while shopping in-store:

[0172] Devices in physical stores capture children's actions and comments in real time.

[0173] The server uses a generative AI model to analyze the child's needs and suggest appropriate products.

[0174] The suggested product information is displayed on the device and notified to the parent.

[0175] Specific examples

[0176] Child speech analysis:

[0177] If a child says "I'm hungry," the parent types the comment into their smartphone.

[0178] The server sends the prompt text "If a child says 'I'm hungry,' please analyze what that means." to the generative AI.

[0179] The generative AI analyzes this as "food seeking behavior" and notifies the parents.

[0180] Answers to parent questions:

[0181] A parent types in a question: "Why is my child crying in the middle of the night?"

[0182] The server sends the prompt "Please tell me why my child cries in the middle of the night" to the generative AI.

[0183] The generative AI responds, "Maybe he's hungry or he's having trouble sleeping," and notifies the parents.

[0184] In-store shopping assistance:

[0185] If a child says "I want a toy" in a physical store, the device will capture the statement.

[0186] The server sends the prompt statement "If a child says 'I want a toy,' please suggest a product that meets that need" to the generative AI.

[0187] The generative AI suggests appropriate products and displays them on the device.

[0188] This makes it easier for parents to understand the meaning of their children's actions and comments and respond appropriately. It also helps parents understand their children's needs and select appropriate products while shopping in physical stores. It also allows parents to get quick and appropriate answers to their child-rearing questions.

[0189] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0190] Step 1:

[0191] The user inputs the child's utterances using a smartphone. The input utterances are sent to the server. The input data is in text format, such as "I'm hungry."

[0192] Step 2:

[0193] The server generates a prompt based on the received utterance. The prompt takes the form "If a child says 'I'm hungry,' please analyze its meaning."

[0194] Step 3:

[0195] The server sends the generated prompt to the generative AI model using the OpenAI API. The generative AI model analyzes the prompt and generates an appropriate answer. The data processing here involves analyzing the prompt and generating an answer.

[0196] Step 4:

[0197] The server receives the answer from the generative AI model, and returns an analysis result such as "food-seeking behavior."

[0198] Step 5:

[0199] The server then notifies the user of the analysis results via a text message, which the user can then view on their smartphone.

[0200] Step 6:

[0201] A user uses a smartphone to input a question about child-rearing. The input question is sent to the server. The input data is in text format, and an example would be, "Why does my child cry in the middle of the night?"

[0202] Step 7:

[0203] The server generates a prompt based on the received question, such as "Please tell me why my child cries in the middle of the night."

[0204] Step 8:

[0205] The server sends the generated prompt to the generative AI model using the OpenAI API. The generative AI model analyzes the prompt and generates an appropriate answer. The data processing here involves analyzing the prompt and generating an answer.

[0206] Step 9:

[0207] The server receives the answer from the generative AI model, for example, "Maybe you're hungry, or maybe there's a reason you can't sleep."

[0208] Step 10:

[0209] The server then notifies the user of the received answer via a text message, which the user can then check on their smartphone.

[0210] Step 11:

[0211] While shopping in a physical store, the device captures what the child says. For example, if the child says, "I want a toy," that statement is entered into the device.

[0212] Step 12:

[0213] The device sends the received message to the server. The input data is in text format.

[0214] Step 13:

[0215] The server generates a prompt based on the received utterance. The prompt takes the form of "If a child says 'I want a toy,' please suggest a product that meets that need."

[0216] Step 14:

[0217] The server sends the generated prompt to the generative AI model using the OpenAI API. The generative AI model analyzes the prompt and suggests appropriate products. The data processing here involves analyzing the prompt and generating product suggestions.

[0218] Step 15:

[0219] The server receives suggestions from the generative AI model, such as "This toy is suitable."

[0220] Step 16:

[0221] The server then notifies the store terminal of the received proposal, which is then sent as a text message and displayed on the terminal. The user can then view the proposed products through the terminal.

[0222] Example 2

[0223] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0224] In modern child-rearing, parents are required to understand the meaning of their children's actions and comments and respond appropriately. However, it is not easy for parents to accurately analyze the meaning of their children's actions and comments and obtain appropriate advice. It is also difficult to select and effectively provide content that will interest children when providing educational support or reading aloud to them. Furthermore, when parents ask questions about child-rearing, it is important to receive answers that take into account the child's age and developmental stage. A system that can solve these issues is needed.

[0225] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0226] In this invention, the server includes a means for analyzing the meaning of a child's behavior using generative AI and providing the results to parents, a means for parents to ask questions about child-rearing to the generative AI and receive answers, a means for providing educational support and reading to children, a means for generating and providing scientific answers to children's questions, a means for selecting stories that the child likes based on the parent's request and reading them using voice synthesis, and a means for supporting the safe purchase of related products. This allows parents to understand the meaning of their child's behavior and statements and receive appropriate advice. It also enables effective educational support and reading that captures the child's interest. Furthermore, when parents ask questions about child-rearing, they can receive answers that take the child's age and developmental stage into consideration.

[0227] "Generative AI" is a system that uses artificial intelligence technology to analyze data and generate information and answers tailored to specific purposes.

[0228] "Analyzing the meaning of a child's behavior" means analyzing a child's behavioral patterns and the content of their statements to understand the intentions and emotions behind them.

[0229] "Providing to parent" means presenting the analysis results and generated information to the parent so that the parent can use them.

[0230] "Questions about child rearing" are inquiries about problems and doubts that parents face in raising their children.

[0231] "Providing answers" means that the generative AI presents appropriate information and solutions to parents' questions.

[0232] "Supporting children's education" means providing information and activities to promote children's learning and development.

[0233] "Reading aloud" means reading a story or text aloud to a child.

[0234] A "scientific answer" is an explanation or information generated based on scientific knowledge or theory.

[0235] "Speech synthesis" is a technology that converts text data into voice data.

[0236] "Supporting parents in purchasing related products with peace of mind" means supporting parents in purchasing products necessary for raising children in a safe and reliable manner.

[0237] This invention is a system that analyzes children's behavior and speech and provides appropriate information and advice to parents. The system includes means for using generative AI to analyze the meaning of children's behavior and provide the results to parents, means for parents to ask generative AI questions about child rearing and receive answers, means for providing educational support and reading to children, means for generating and providing scientific answers to children's questions, means for selecting stories that children like based on parental requests and reading to them using speech synthesis, and means for supporting parents in purchasing related products with peace of mind.

[0238] Hardware and software used

[0239] Hardware: Servers, devices (tablets and smartphones)

[0240] Software: Generative AI models (e.g., GPT-4), speech synthesis software (e.g., Google® Text-to-Speech)

[0241] Specific operation of the system

[0242] 1. Accepting user questions

[0243] A user uses a terminal to input a question into the system, for example, a child might ask, "Why is the sky blue?"

[0244] The terminal receives the entered question and proceeds to the next processing step.

[0245] 2. Submit your question

[0246] The device sends the received question to the server, specifically by sending data to the server using an HTTP request.

[0247] 3. Question Analysis and Answer Generation

[0248] The server analyzes the received question and creates a prompt for the generative AI model. For example, it generates a prompt such as, "My child asked me, 'Why is the sky blue?' Please generate a scientific answer."

[0249] The server inputs a prompt into a generative AI model (e.g., GPT-4) and generates an answer, such as, "The sky is blue because sunlight is scattered by molecules in the atmosphere. Blue light in particular is scattered more strongly than other colors, which is why the sky appears blue."

[0250] 4. Submit your response

[0251] The server sends the generated answer to the terminal, specifically, by returning data using an HTTP response.

[0252] 5. View Answers

[0253] The terminal displays the received answer to the user, specifically, as text on the screen.

[0254] 6. Reading requests accepted

[0255] A parent uses a device to request the system to read aloud, for example by typing, "I'd like you to read aloud to my child today."

[0256] The terminal receives the input request and proceeds to the next processing step.

[0257] 7. Reading Choices

[0258] The server analyzes the received request and selects stories that it predicts the child will like, based on past history and popular stories.

[0259] 8. Narrative Generation

[0260] The server inputs the selected story into the generation AI model as a prompt, for example, "Generate a story that children will like."

[0261] The generative AI model generates narrative text based on the prompt.

[0262] 9. Speech Synthesis

[0263] The server inputs the generated story text into speech synthesis software (e.g., Google Text-to-Speech) to generate audio data.

[0264] 10. Transmission of audio data

[0265] The server sends the generated audio data to the device. Specifically, it returns the data using an HTTP response.

[0266] 11. Reading aloud

[0267] The device then plays the received audio data and reads the story to the child. Specifically, the device's speaker is used to play the audio.

[0268] Specific examples

[0269] Example questions

[0270] User: "Why is the sky blue?"

[0271] Prompt for generative AI model: "A child asks, 'Why is the sky blue?' Generate a scientific answer."

[0272] Example of a reading request

[0273] Parent: "I'd like you to read to me today."

[0274] Prompt for generative AI model: "Generate a story that children will enjoy."

[0275] In this way, the system can provide scientific answers to children's questions and read to them at the parents' request.

[0276] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0277] Step 1:

[0278] A user uses a terminal to input a question into the system. For example, a child might ask, "Why is the sky blue?" The input is in text format, and the terminal receives this input. Specifically, the user enters the question into the input field on the terminal and presses the send button.

[0279] Step 2:

[0280] The terminal sends the received question to the server. Specifically, it sends data to the server using an HTTP request. The input is the user's question text, and the output is the request sent to the server. Specifically, the terminal sends the question text to the server in the body of the HTTP request.

[0281] Step 3:

[0282] The server analyzes the received question and creates a prompt for the generative AI model. The input is the user's question text, and the output is the prompt for the generative AI model. Specifically, the server generates the prompt: "A child asked, 'Why is the sky blue?' Please generate a scientific answer."

[0283] Step 4:

[0284] The server inputs a prompt into a generative AI model (e.g., GPT-4) and generates an answer. The input is the prompt, and the output is the generated answer text. Specifically, the server sends the prompt to the generative AI model and receives a response from the model. The generated answer will be something like, "The sky is blue because sunlight is scattered by molecules in the atmosphere. Blue light in particular is scattered more strongly than other colors, which is why the sky appears blue."

[0285] Step 5:

[0286] The server sends the generated answer to the terminal. Specifically, it returns data using an HTTP response. The input is the generated answer text, and the output is sending the response to the terminal. As a specific operation, the server includes the answer text in the body of the HTTP response and sends it to the terminal.

[0287] Step 6:

[0288] The terminal displays the received answer to the user. Specifically, it displays it as text on the screen. The input is the answer text from the server, and the output is what is displayed to the user. Specifically, the terminal displays the received answer text in a text area on the screen.

[0289] Step 7:

[0290] A parent uses a device to request the system to read to their child. For example, they might enter, "I'd like you to read to me today." The input is in text format, and the device receives this input. Specifically, the parent enters the request in the device's input field and presses the send button.

[0291] Step 8:

[0292] The terminal sends the received request to the server. Specifically, it sends data to the server using an HTTP request. The input is the parent's request text, and the output is the request sent to the server. Specifically, the terminal includes the request text in the body of the HTTP request and sends it to the server.

[0293] Step 9:

[0294] The server analyzes the received request and selects a story that it predicts the child will like. Selection criteria are based on past history and popular stories. The input is the parent's request text, and the output is the selected story text. Specifically, the server searches for and selects an appropriate story from the database.

[0295] Step 10:

[0296] The server inputs the selected story as a prompt to the generative AI model. For example, the prompt might be, "Generate a story that children will like." The input is the selected story text, and the output is the generated story text. Specifically, the server sends the prompt to the generative AI model and receives a response from the model.

[0297] Step 11:

[0298] The server inputs the generated story text into speech synthesis software (e.g., Google Text-to-Speech) to generate voice data. The input is the generated story text, and the output is voice data. In concrete terms, the server sends the story text to the speech synthesis software and receives the voice data.

[0299] Step 12:

[0300] The server sends the generated audio data to the terminal. Specifically, it returns the data using an HTTP response. The input is the generated audio data, and the output is sending the response to the terminal. Specifically, the server includes the audio data in the body of the HTTP response and sends it to the terminal.

[0301] Step 13:

[0302] The device plays the received audio data and reads to the child. Specifically, the audio is played using the device's speaker. The input is audio data from the server, and the output is audio playback. Specifically, the device decodes the received audio data and plays it back from the speaker.

[0303] (Application example 2)

[0304] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0305] Conventional children's educational support systems and reading systems are limited to use at home, and are not suitable for providing educational support or explaining work procedures to new employees or apprentice workers in factories. Furthermore, educational support in factories requires detailed explanations of operation procedures and work procedures, and an efficient method for doing this is required.

[0306] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to parents, means for parents to ask questions about child-rearing to the generative AI and provide answers, means for providing educational support and reading to children, means for analyzing children's speech and providing advice to parents, means for supporting the safe purchase of related products, means for explaining work procedures and machine operation methods to new employees and apprentice workers in a factory, means for explaining detailed operating procedures when new employees ask questions, and means for explaining the day's work procedures when requested by the factory manager. This makes it possible to efficiently provide educational support and reading to children at home, as well as educational support and explanations of work procedures to new employees and apprentice workers in a factory.

[0307] "Generative AI" is a system that uses artificial intelligence technology to generate answers and information in natural language based on user input.

[0308] "Analyzing the meaning of a child's behavior" means analyzing a child's behavioral patterns and the content of their statements to understand the intentions and emotions behind them.

[0309] "Providing to parents" means presenting the analysis results and advice to parents.

[0310] "Questions about child rearing" are questions and inquiries that parents have about raising and educating their children.

[0311] "Supporting children's education" means providing information and activities to help children learn and develop.

[0312] "Reading aloud" means reading stories or picture books aloud to children.

[0313] "Analyzing children's speech" means analyzing what a child says and generating appropriate advice based on that content.

[0314] "Providing advice to parents" means giving advice to parents based on their child's behavior and comments.

[0315] "Supporting the safe purchase of related products" means providing information and support so that products related to child-rearing can be purchased safely.

[0316] "Explaining work procedures and how to operate machines to new employees and apprentice workers in the factory" means teaching new employees working in the factory specific work procedures and how to operate machines.

[0317] "Explaining detailed operating procedures when new employees ask questions" means providing detailed explanations of operating procedures when newly hired employees ask questions about how to operate a machine.

[0318] "Explaining the work procedures for the day when requested by the factory manager" means providing a clear explanation of the specific work procedures when the factory manager requests an explanation of the work procedures for the day.

[0319] The system for implementing this invention includes functions that use generative AI to analyze the meaning of children's behavior and provide the results to parents, a function that allows parents to ask generative AI questions about child-rearing and provide answers, a function that provides educational support and reading to children, a function that analyzes children's speech and provides advice to parents, a function that helps parents purchase related products with peace of mind, a function that explains work procedures and how to operate machines to new employees and apprentice workers in the factory, a function that explains detailed operating procedures when new employees ask questions, and a function that explains the day's work procedures when requested by the factory manager.

[0320] The server contains software for running the generative AI model, specifically a Python program and the OpenAI API. The server receives input from the user, sends it as prompts to the generative AI model, and returns the generated answers to the user.

[0321] The terminals include robots (such as Pepper and Nao) that can move around the factory. The robots output answers from the server as voice and provide explanations to the user. The robots convert the user's questions into text using voice recognition technology and send the text to the server.

[0322] Users input questions through their devices and receive answers from the generative AI model. For example, if a new employee asks, "How do I operate this machine?", the server sends the question to the generative AI model as a prompt, and the robot outputs the generated answer aloud.

[0323] As a concrete example, if a new employee asks, "How do I operate this machine?", the prompt would be as follows:

[0324] How do I operate this machine?

[0325] In this way, it is possible to efficiently provide educational support and explanations of work procedures to new employees and apprentice workers in factories, as well as educational support and reading aloud to children at home.

[0326] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0327] Step 1:

[0328] A user inputs a question into a terminal. For example, a new employee might ask, "How do I operate this machine?" This input is converted into text using speech recognition technology. The input data is voice data, and the output data is text data.

[0329] Step 2:

[0330] The terminal transmits the question converted into text to the server. The input data is text data, and the output data is a request to the server.

[0331] Step 3:

[0332] The server sends the received question as a prompt to the generative AI model. The input data is text data, and the output data is a request to the generative AI model.

[0333] Step 4:

[0334] A generative AI model generates an answer based on a prompt sentence. The input data is the prompt sentence, and the output data is the generated answer text.

[0335] Step 5:

[0336] The server receives the generated answer and sends it to the terminal. The input data is the generated answer text, and the output data is the response to the terminal.

[0337] Step 6:

[0338] The terminal converts the received answer into speech and outputs it to the user. The input data is the answer text, and the output data is speech data.

[0339] Step 7:

[0340] The user listens to the voice output from the terminal and gets the answer to the question. The input data is the voice data, and the output data is the user's understanding.

[0341] In this way, a series of processes is realized in which a user inputs a question and obtains an answer using a generative AI model.

[0342] Example 3

[0343] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0344] Modern parents find it difficult to find appropriate ways to respond to their children's behavior and comments. It is also difficult to obtain reliable information on educational support, reading aloud, and even purchasing related products. This often leaves parents with many anxieties and questions about raising children.

[0345] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server includes a means for analyzing the meaning of a child's behavior using a generative AI and providing the parent with the results, a means for parents to ask questions about child-rearing to the generative AI and provide answers, a means for providing educational support and reading to the child, a means for analyzing the child's comments and providing advice to the parent, and a means for parents to select a reliable online shop and provide a purchase link when purchasing related products. This allows parents to know appropriate ways to respond to their child's behavior and comments, making it easier to provide educational support and reading to the child. It also enables parents to make safe selections when purchasing related products.

[0346] "Generative AI" is a system that uses artificial intelligence technology to analyze data and generate information and answers tailored to specific purposes.

[0347] "Analyzing the meaning of children's behavior" is the process of collecting data on children's behavior and words and analyzing them to understand their content and intentions.

[0348] "Providing to the parent" means presenting the analysis results and generated information to the parent.

[0349] "Questions about child rearing" are questions about doubts and problems that parents have in raising their children.

[0350] "Providing answers" means that the generative AI generates and presents appropriate answers to questions from parents.

[0351] "Educational support" refers to support activities to help children learn and develop.

[0352] "Reading aloud" is the act of parents reading books or stories aloud to their children.

[0353] "Analyzing children's utterances" is the process of collecting the words children say as data and analyzing them to understand their content and emotions.

[0354] "Providing advice to parents" means providing appropriate advice or suggestions to parents based on the analysis results.

[0355] "Related products" are products related to child rearing and children's education.

[0356] A "reliable online shop" is an online sales site that has a high reputation for quality and service.

[0357] "Providing a purchase link" means generating and presenting a link for the parent to purchase the related product.

[0358] MODE FOR CARRYING OUT THE INVENTION

[0359] The present invention is a system that analyzes a child's words and actions and provides appropriate advice and support to parents. A specific embodiment of this system will be described below.

[0360] 1. Generating the system program

[0361] The server analyzes the child's speech and generates a program to provide advice to parents. This program uses natural language processing (NLP) technology to analyze the child's speech and generate appropriate advice. It also includes a function to assist parents in purchasing related products.

[0362] 2. Hardware and Software Used

[0363] The server uses hardware equipped with a high-performance CPU and GPU, and the software uses Python, TENSORFLOW (registered trademark), and natural language processing libraries (e.g., spaCy, NLTK).

[0364] 3. Data processing and calculation

[0365] The server processes and calculates data in the following procedure.

[0366] 1. Input of child's statements:

[0367] The user (parent) uses a device (smartphone or PC) to input their child's comments into the system. For example, they might input "I hate school."

[0368] 2. Speech analysis:

[0369] The server analyzes the inputted speech using a natural language processing library, performing morphological analysis and sentiment analysis to extract the content and sentiment of the speech.

[0370] 3. Generating Advice:

[0371] The server generates advice for parents based on the analysis results, such as "Your child may be having problems at school."

[0372] 4. Related product purchasing assistance:

[0373] When a user (parent) requests the system to "purchase a picture book for their child," the server selects a reliable online shop and helps the parent make a purchase with peace of mind.

[0374] 4. Examples and prompts

[0375] As a concrete example, consider the following scenario.

[0376] Scenario 1: Your child says, "I hate school."

[0377] Enter: "I hate school."

[0378] Analysis result: The content of the statement was "school," and the emotion was "dislike."

[0379] Advice: "Your child may be having some issues with school."

[0380] Scenario 2: A parent requests to purchase a picture book for their child.

[0381] Enter: "I want to buy a picture book for my child."

[0382] Analysis result: The desired product is a picture book

[0383] Purchase assistance: We select reliable online stores and provide purchase links

[0384] Example prompt sentence:

[0385] "My child hates school. What should I do?"

[0386] "I want to buy a picture book for my child, where can I buy it?"

[0387] In this way, the server is a system that analyzes inputs from the user and provides appropriate advice and purchasing support. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0388] Step 1:

[0389] The user inputs the child's comments. The user inputs the child's comments in text format using a device such as a smartphone or PC. For example, the user might input "I hate school" and press the send button. The input data is saved as text data on the device.

[0390] Step 2:

[0391] The device sends the input data to the server. The device encrypts the input text data and sends it to the server. The transmitted data is received by the server and prepared for analysis.

[0392] Step 3:

[0393] The server analyzes the utterance. The server analyzes the received text data using a natural language processing library (e.g., spaCy, NLTK). Specifically, it performs morphological analysis to extract the content of the utterance (e.g., "school") and the emotion (e.g., "dislike"). As a result of analyzing the input data, a pair of utterance content and emotion is generated.

[0394] Step 4:

[0395] The server generates advice. Based on the analysis results, the server uses a generative AI model to generate advice for parents. For example, the server generates advice such as, "Your child may be having problems with school." The generated advice is saved as text data.

[0396] Step 5:

[0397] The server sends advice to the terminal. The server encrypts the advice it generates and sends it to the terminal. The transmitted data is received by the terminal and prepared for display.

[0398] Step 6:

[0399] The device displays the advice to the user. The device displays the received advice to the user. The user can check the advice on the device screen. The displayed advice serves as reference information for the user to deal with their child's problems.

[0400] Step 7:

[0401] The user requests the purchase of a related product. The user uses the terminal to input a purchase request in text format, such as "I would like to purchase a picture book for my child," and presses the send button. The input data is saved as text data on the terminal.

[0402] Step 8:

[0403] The terminal sends a purchase request to the server. The terminal encrypts the entered purchase request and sends it to the server. The transmitted data is received by the server and prepared for analysis.

[0404] Step 9:

[0405] The server selects a reliable online shop. The server retrieves a list of reliable online shops from the database and selects the shop with the highest rating. The information of the selected shop is saved as text data.

[0406] Step 10:

[0407] The server generates a purchase link and sends it to the device. The server generates a purchase link for the selected online shop, encrypts it, and sends it to the device. The transmitted data is received by the device and prepared for display.

[0408] Step 11:

[0409] The device displays the purchase link to the user. The device displays the received purchase link to the user. The user can click the link and make the purchase with confidence. The displayed link serves as reference information for the user to purchase related products.

[0410] (Application example 3)

[0411] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0412] Today's parents are seeking information and advice to understand their children's behavior and comments and respond appropriately. However, it is not easy to accurately analyze children's comments and actions and provide appropriate advice. It is also difficult to find a reliable source of information that allows parents to purchase related products for their children with peace of mind. To solve these issues, a system is needed that analyzes children's comments and actions and provides appropriate advice to parents.

[0413] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0414] In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to parents, means for parents to ask the generative AI questions about child-rearing and provide answers to those questions, means for providing educational support and reading to children, means for analyzing children's speech and providing advice to parents, means for supporting the safe purchase of related products, means for converting children's speech into text using speech recognition technology, means for analyzing children's speech using natural language processing, means for providing appropriate advice to parents based on the analysis results, and means for recommending reliable online shops for products specified by parents. This enables parents to accurately understand their children's speech and behavior, receive appropriate advice, and purchase related products with peace of mind.

[0415] "Generative AI" is a system that uses artificial intelligence technology to generate data and perform analysis and predictions.

[0416] "Means for analyzing the meaning of children's behavior" are techniques for observing children's behavior and understanding the intentions and emotions behind that behavior.

[0417] The "means of providing to parents" refers to a method for communicating the analysis results and advice to parents in an appropriate format.

[0418] "A means for parents to ask questions about child-rearing to a generative AI and have it provide answers" refers to a technology that allows parents to input questions about child-rearing into a generative AI, which then provides answers to those questions.

[0419] "Means of providing educational support and reading to children" refers to methods of providing educational content and reading to children to support their learning and development.

[0420] "Means for analyzing children's speech and providing advice to parents" refers to technology that analyzes the content of children's speech and provides appropriate advice to parents based on the results.

[0421] "Means to help parents purchase related products with confidence" refers to methods of providing reliable information about products that parents purchase for their children, and supporting them so that they can make purchases with confidence.

[0422] "Means of converting children's speech into text using voice recognition technology" refers to technology that analyzes children's speech and converts it into text format.

[0423] "Means for analyzing the content of children's statements using natural language processing" is a technology for analyzing children's statements converted into text and understanding their content.

[0424] The "means for recommending reliable online shops for products designated by parents" refers to a method for selecting and recommending reliable online shops for products that parents wish to purchase.

[0425] To implement this invention, the following system configuration is required. The system consists of a server, a terminal, and a user. The server uses generative AI, speech recognition technology, and natural language processing technology to analyze a child's comments and behavior and provide appropriate advice to parents. It also has a function to recommend reliable online shops that carry products specified by the parent.

[0426] Hardware and software used

[0427] Hardware: smartphone, server, microphone, speaker

[0428] Software: Python, speech_recognition library, transformers library

[0429] Data processing and calculation

[0430] 1. Speech recognition: The device (smartphone) records the child's speech with a microphone and sends the voice data to the server, which converts the voice data into text using the speech_recognition library.

[0431] 2. Natural language processing: The server uses the transformers library to analyze the text of the child's speech and understand its content. Specifically, it analyzes the emotion and intent of the child's speech.

[0432] 3. Providing advice: Based on the analysis results, the server generates appropriate advice for the parent and sends it to the device. The parent receives the advice via their smartphone.

[0433] 4. Product Recommendation: If a parent wants to purchase related products for their child, the server will recommend reliable online shops, and the parent will receive information about the recommended online shops via their smartphone.

[0434] Specific examples

[0435] For example, if a child says, "I hate school," the smartphone's microphone records the speech and sends it to a server. The server then converts the speech into text using speech recognition technology and analyzes it using natural language processing technology. Based on the analysis results, the server generates advice such as, "Your child may be having problems with school," and provides it to the parent.

[0436] Furthermore, when a parent requests the system to "purchase a picture book for their child," the server selects a reliable online shop and provides that information to the parent. The parent receives information about the recommended online shop via their smartphone, allowing them to make a purchase with peace of mind.

[0437] Prompt Sentence Examples

[0438] "Analyze what your child has said about school and offer advice to parents."

[0439] "Please recommend a reliable online store to purchase picture books for children."

[0440] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0441] Step 1:

[0442] The user (parent) starts the application on their smartphone and records what their child says. The application uses the smartphone's microphone to capture the audio data and sends it to the server.

[0443] Input: Child's voice

[0444] Output: Audio data (sent to server)

[0445] Step 2:

[0446] The server converts the received voice data into text using the speech_recognition library. Using speech recognition technology, it analyzes the voice data and generates corresponding text data.

[0447] Input: Audio data

[0448] Output: Text data

[0449] Step 3:

[0450] The server analyzes the text data using the transformers library, and uses natural language processing techniques to analyze the sentiment and intent of the text data and generate results.

[0451] Input: Text data

[0452] Output: Analysis results (emotions and intentions)

[0453] Step 4:

[0454] The server generates advice for parents based on the analysis results, using a generative AI to generate appropriate advice and sending it to the device in text format.

[0455] Input: Analysis results

[0456] Output: Advice (text format)

[0457] Step 5:

[0458] The device (smartphone) displays the advice received from the server to the user, who then checks the advice on the smartphone screen.

[0459] Input: Advice (text format)

[0460] Output: Display advice

[0461] Step 6:

[0462] The user (parent) inputs through a smartphone application that they would like to purchase related products for their child. The information about the products specified by the parent is sent to the server.

[0463] Input: Product purchase request (text format)

[0464] Output: Product information (sent to server)

[0465] Step 7:

[0466] The server selects reliable online shops based on the product information specified by the parent, uses generative AI to recommend appropriate online shops, and sends that information to the device.

[0467] Input: Product information

[0468] Output: Online store recommendations

[0469] Step 8:

[0470] The terminal (smartphone) displays the recommended online shop information received from the server to the user. The user can check the information of the recommended online shop on the smartphone screen and make a purchase with confidence.

[0471] Input: Online store recommendation information

[0472] Output: Display of online store information

[0473] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0474] "Example 1"

[0475] Generative AI observes and collects data on children's behavior and speech. It then uses an emotion engine to understand the child's emotional state. Specifically, it recognizes emotions such as joy, anger, sadness, and surprise from the child's facial expressions, tone of voice, and choice of words. The results of this emotion recognition provide important information for gaining a deeper understanding of the meaning of a child's behavior.

[0476] "Example 2"

[0477] The generative AI takes into account the child's emotional state when providing answers to questions from parents. For example, if the child expresses anger, it will provide the parent with advice on the cause and how to resolve it. If the child expresses joy, it will provide the parent with suggestions on how to further increase that joy.

[0478] "Example 3"

[0479] Generative AI takes into account a child's emotional state when providing educational support or reading to them. For example, if a child expresses sadness, it will read a comforting story. If a child expresses joy, it will suggest educational activities themed around that joy.

[0480] "Example 4"

[0481] The generative AI takes into account the child's emotional state when receiving a purchase request from a parent. For example, if a child breaks a toy indicating anger, it will suggest repurchasing the same toy. Also, if a child shows interest in a toy indicating joy, it will suggest purchasing that toy.

[0482] The processing flow of each embodiment will be described below.

[0483] "Example 1"

[0484] Step 1: The generative AI observes the child's behavior and speech and collects that data. Step 2: The generative AI inputs the collected data into the emotion engine.

[0485] Step 3: The emotion engine recognizes emotions such as joy, anger, sadness, and surprise from the child's facial expressions, tone of voice, and choice of words.

[0486] "Example 2"

[0487] Step 1: The generative AI receives a question from the parent.

[0488] Step 2: The generative AI takes into account the child's emotional state obtained from the emotion engine.

[0489] Step 3: The generative AI provides the parent with an answer that reflects the child's emotional state.

[0490] "Example 3"

[0491] Step 1: Generative AI provides educational support and reading to children.

[0492] Step 2: The generative AI takes into account the child's emotional state obtained from the emotion engine.

[0493] Step 3: The generative AI provides educational activities and stories that respond to the child's emotional state.

[0494] "Example 4"

[0495] Step 1: The generative AI receives a request from the parent to purchase a product.

[0496] Step 2: The generative AI takes into account the child's emotional state obtained from the emotion engine.

[0497] Step 3: The generative AI provides parents with product suggestions based on their child's emotional state.

[0498] Example 1

[0499] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0500] Conventional parenting support systems have had difficulty accurately analyzing the meaning of a child's behavior and utterances and providing the information to parents. Furthermore, they lacked a means of grasping a child's emotional state, making it difficult for parents to understand their child's true needs. Furthermore, when parents posed questions about parenting, they were unable to provide appropriate answers that took into account the child's age and developmental stage. To address these issues, the present invention aims to provide a system that analyzes the meaning of a child's behavior and utterances, grasps their emotional state, and provides appropriate information to parents.

[0501] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0502] In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to a parent, means for a parent to ask the generative AI questions about child-rearing and provide the answers, means for using an emotion engine to grasp the child's emotional state, means for observing the child's behavior and comments and collecting data, means for analyzing the collected data and extracting the meaning of the child's behavior and comments, and means for notifying the parent of the analysis results. This makes it possible to accurately analyze the meaning of a child's behavior and comments, grasp the emotional state, and provide appropriate information to the parent.

[0503] "Generative AI" is an artificial intelligence technology that analyzes children's behavior and words and extracts their meaning.

[0504] The "emotion engine" is a technology that recognizes and analyzes a child's emotional state from their facial expressions and tone of voice.

[0505] "Data collection methods" are means for observing and recording children's behavior and comments using hardware such as cameras and microphones.

[0506] "Data analysis means" refers to the means of inputting collected data into a generative AI model to analyze the meaning of children's behavior and statements.

[0507] The "meaning extraction method" is a means for integrating the analysis results of the generative AI model and the emotion engine to extract the meaning of children's actions and statements.

[0508] The "result notification means" is a means for notifying the parent of the analysis results, for example, by displaying a message on the parent's smartphone.

[0509] A "child-rearing support system" is a system that analyzes children's behavior and comments and provides parents with the meaning of these, thereby helping them raise their children more effectively.

[0510] MODE FOR CARRYING OUT THE INVENTION

[0511] This invention relates to a child-rearing support system that uses generative AI and an emotion engine. This system analyzes children's behavior and comments and provides their meaning to parents, thereby helping them raise their children more effectively.

[0512] Hardware and software used

[0513] The server uses the following hardware and software:

[0514] Camera: Used to record the child's facial expressions.

[0515] Microphone: Used to collect what the children say.

[0516] Generative AI model: Used to analyze children's actions and statements and extract their meaning.

[0517] Emotion engine: Used to recognize and analyze a child's emotional state from their facial expressions and tone of voice.

[0518] System Operation

[0519] The server uses a camera and microphone to observe the child's behavior and speech and collect data. The collected data is input into a generative AI model, which analyzes the meaning of the child's behavior and speech. Furthermore, an emotion engine is used to grasp the child's emotional state. This allows for a deeper understanding of the meaning of the child's behavior and speech.

[0520] The analysis results are sent to the parent via the device, and for example, a message such as "Your child is hungry and wants to eat" is displayed on the parent's smartphone.

[0521] Specific examples

[0522] As a concrete example, consider the case where a child says, "I'm hungry." In this case, the system operates as follows:

[0523] 1. Data collection: The server collects the child's utterance "I'm hungry" through a microphone. It also records the child's facial expressions using a camera.

[0524] 2. Data analysis: The collected voice data is input into a generative AI model. The generative AI model analyzes the voice data, such as "I'm hungry," and recognizes it as a "behavior requesting food."

[0525] 3. Emotion Recognition: The emotion engine analyzes the child's tone of voice and facial expression and recognizes it as "mild dissatisfaction due to hunger."

[0526] 4. Semantic extraction: The analysis results of the generative AI model and the emotion engine are integrated to conclude that "the child is hungry and is asking for food."

[0527] 5. Notification of results: The device notifies the parent of the analysis results sent from the server. A message saying "Your child is hungry and wants to eat" is displayed on the parent's smartphone.

[0528] Prompt Sentence Examples

[0529] An example of a prompt is as follows:

[0530] If a child says "I'm hungry," how does the system interpret this and notify the parent?

[0531] By inputting this prompt into the generative AI model, you can check the system's operation.

[0532] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0533] Step 1:

[0534] The server uses a camera and microphone to observe the child's behavior and speech and collect data. Specifically, the camera records the child's facial expressions and the microphone records the child's speech. The input data is the child's video and audio data. These data are used in the subsequent analysis steps.

[0535] Step 2:

[0536] The server inputs the collected video and audio data into a generative AI model. The generative AI model analyzes the audio data and extracts the meaning of the child's utterances. For example, it analyzes audio data such as "I'm hungry" and recognizes it as "a behavior requesting food." The output data is text data indicating the meaning of the utterance.

[0537] Step 3:

[0538] The server uses an emotion engine to analyze the collected video and audio data and understand the child's emotional state. The emotion engine recognizes emotions from the child's facial expressions and tone of voice. For example, if the child's tone of voice sounds dissatisfied, it will analyze it as "mild dissatisfaction due to hunger." The output data is text data that indicates the child's emotional state.

[0539] Step 4:

[0540] The server integrates the analysis results of the generative AI model and the emotion engine to gain a deeper understanding of the meaning of the child's actions and statements. Specifically, it combines the statement "I'm hungry" with the emotion recognition result of "mild dissatisfaction due to hunger" to conclude that "the child is hungry and is asking for food." The output data is text data that indicates the meaning of the behavior.

[0541] Step 5:

[0542] The device notifies the parent of the analysis results sent from the server. Specifically, it displays a message on the parent's smartphone saying, "Your child is hungry and wants to eat." The input data is the text data of the analysis results sent from the server, and the output data is the notification message displayed to the parent.

[0543] (Application example 1)

[0544] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0545] Today's parents often lack the time and knowledge to understand their children's behavior and emotions. In addition, there is no system that can analyze children's behavior and comments in real time and provide appropriate advice, making it difficult for parents to take appropriate measures in raising their children. Furthermore, there is a lack of systems that can provide answers that take into account the child's age and developmental stage when parents ask questions about raising children.

[0546] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0547] In this invention, the server includes means for recognizing a child's emotions using an emotion engine, a prompt sentence for instructing the server to analyze the meaning of the child's actions or comments based on the child's input actions or comments and the child's emotions, means for analyzing the meaning of the child's actions or comments using generative AI, and means for providing the analysis results to a parent via smart glasses, thereby enabling the parent to understand the child's actions and emotions in real time and take appropriate action. The server also includes a prompt sentence instructing the parent to answer a question about child-rearing input by the parent, a means for generating the answer using the generative AI, a means for providing the generated answer to the parent through the smart glasses, a prompt sentence instructing the parent to search for related products related to the generated answer, and a means for providing a link to purchase the related products using the generative AI.

[0548] "Generative AI" is an artificial intelligence technology that generates new information and answers based on data.

[0549] "Analyzing the meaning of a child's behavior" means observing a child's actions and words and understanding the intentions and emotions behind them.

[0550] "Providing to parents" means conveying the analysis results and advice to parents.

[0551] "Parents asking questions about child-rearing to generative AI" means that parents input their doubts and questions about child-rearing into artificial intelligence.

[0552] "Providing the answer" means that the generative AI generates an appropriate answer to the parent's question and conveys it to the parent.

[0553] "Supporting children's education" means providing activities and resources to help children learn and grow.

[0554] "Reading aloud" means conveying stories and information to children through audio.

[0555] "Analyzing a child's speech" means analyzing what a child says and understanding the intentions and emotions behind it.

[0556] "Providing advice to parents" means providing appropriate advice to parents based on the analysis results.

[0557] "Supporting the safe purchase of related products" means providing information and support so that products related to child-rearing can be purchased safely.

[0558] "Understanding a child's emotional state" means recognizing a child's emotions from their facial expressions, tone of voice, etc.

[0559] "Notifying parents" means informing parents of analysis results and important information.

[0560] "Smart glasses" are glasses-type devices equipped with a camera and a display that can display information and collect data.

[0561] "Real-time analysis" means processing data instantly and providing results immediately.

[0562] "Generating answers to parents' questions" means that the generative AI creates appropriate answers to questions entered by parents.

[0563] A system for implementing this invention uses generative AI to analyze a child's behavior and speech and provide the meaning to parents. The system includes smart glasses, a server, a generative AI model, an emotion recognition engine, and a function for generating answers to parental questions.

[0564] System Configuration

[0565] 1. Smart Glasses:

[0566] It is equipped with a camera and display that captures children's actions and comments in real time.

[0567] The video data is sent to the server.

[0568] 2. Server:

[0569] It receives video data and analyzes it using a generative AI model and emotion recognition engine.

[0570] It analyzes the meaning of a child's behavior and emotional state and notifies parents of the results.

[0571] It receives questions from parents and generates answers using a generative AI model.

[0572] 3. Generative AI Models:

[0573] This is a model for analyzing children's behavior and words and understanding their meaning.

[0574] Generate appropriate answers to questions from parents.

[0575] 4. Emotion Recognition Engine:

[0576] It is an engine that analyzes a child's facial expressions and tone of voice to understand their emotional state.

[0577] Data processing and calculation

[0578] Video Processing:

[0579] Video data acquired from the smart glasses camera is processed using OpenCV.

[0580] Facial recognition is performed to extract the child's facial expressions and behavior.

[0581] Emotion recognition:

[0582] The extracted facial data is analyzed using EmotionRecognizer to understand the child's emotional state.

[0583] Behavior analysis:

[0584] The meaning of a child's actions and statements is analyzed using a generative AI model based on a prompt that instructs the system to analyze the meaning of a child's actions or statements based on the child's actions or statements and their emotions.

[0585] The analysis results will be notified to the parents.

[0586] Question and answer generation:

[0587] It receives questions from parents and generates appropriate answers using a generative AI model.

[0588] Specific examples

[0589] If a child says, "I'm hungry," the system will notify the parent, "Your child seems hungry."

[0590] When a parent asks, "Why does my child cry in the middle of the night?" the system responds, "There are many reasons why a child might cry in the middle of the night. For example, they might be hungry, have a wet diaper, or be feeling unwell."

[0591] Example of prompt statement when parsing

[0592] "My child says, 'I'm hungry.' My child's emotion is, 'I'm lonely.' Please analyze the meaning of my child's behavior or statement."

[0593] In this way, the system of the present invention helps parents understand their children's behavior and emotions in real time and take appropriate measures.

[0594] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0595] Step 1:

[0596] The camera in the smart glasses captures footage of the child.

[0597] Input: Real-time video of child

[0598] Output: Video data

[0599] Specific operation: The camera in the smart glasses captures the child's actions and comments in real time and sends the video data to a server.

[0600] Step 2:

[0601] The server receives the video data and performs facial recognition using OpenCV.

[0602] Input: Video data

[0603] Output: Coordinate data of face area

[0604] Specific operation: The server receives the video data, detects faces in the video using OpenCV, and extracts the coordinate data of the face area.

[0605] Step 3:

[0606] The server inputs the facial region data into EmotionRecognizer to analyze the emotional state.

[0607] Input: Coordinate data of face area

[0608] Output: Emotional state data (e.g., happy, angry, sad)

[0609] Specific operation: The server inputs facial area data into EmotionRecognizer, which analyzes the child's facial expressions and tone of voice to understand their emotional state.

[0610] Step 4:

[0611] The server uses a generative AI model to analyze the meaning of a child's actions and comments.

[0612] Input: Video data, emotional state data

[0613] Output: Semantic data of the behavior (e.g. hungry, tired)

[0614] Specific operation: The server uses a generative AI model to analyze the child's behavior and comments and understand their meaning.

[0615] Step 5:

[0616] The server notifies the parent of the analysis results.

[0617] Input: Semantic data of actions

[0618] Output: Parent notification message

[0619] Specific operation: Based on the analysis results, the server generates an appropriate notification message for the parent and displays it on the smart glasses display or smartphone.

[0620] Step 6:

[0621] Parents send questions about child-rearing to the server via smart glasses or smartphones.

[0622] Input: Parent Question

[0623] Output: Question data

[0624] Specific operation: Parents use smart glasses or smartphones to input questions about child-rearing and send the question data to a server.

[0625] Step 7:

[0626] The server uses a generative AI model to generate answers to questions about child-rearing based on prompts entered by the parents that instruct the system to answer the questions.

[0627] Input: Question data

[0628] Output: Response data

[0629] Specific operation: The server uses a generative AI model to generate appropriate answers to the parent's questions.

[0630] Step 8:

[0631] The server notifies the parent of the generated answer.

[0632] Input: Response data

[0633] Output: Reply message to parent

[0634] Specific operation: Based on the answer generated by the server, an appropriate answer message is generated for the parent and displayed on the smart glasses display or smartphone.

[0635] In this way, through the specific actions and data flow that take place at each step, parents can understand their child's behavior and emotions in real time and take appropriate action. The server also uses a prompt sentence that instructs the user to search for related products related to the generated answer and a generative AI to generate data indicating a link to purchase the related products, and displays this data on the smart glasses display or smartphone.

[0636] Example 2

[0637] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0638] In modern child-rearing, parents are expected to understand their children's behavior and emotions and provide appropriate educational support and reading aloud. However, it is not easy for parents to accurately grasp their children's behavior and emotions and respond appropriately. It is also difficult to provide scientific answers to children's questions or advice that takes into account the child's emotional state. Furthermore, support is also needed to help parents purchase related products with confidence. A system that can solve these issues is needed.

[0639] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for analyzing the meaning of a child's behavior using a generative AI and providing the analysis result to the parent, a means for the parent to ask the generative AI questions about child rearing and provide the answers, a means for providing educational support and reading to the child, a means for analyzing the child's speech and providing advice to the parent, a means for providing advice to the parent taking into account the child's emotional state, and a means for supporting the parent in purchasing related products with peace of mind. This enables parents to accurately understand their child's behavior and emotions and respond appropriately. It is also possible to provide scientific answers to children's questions and advice that takes into account the child's emotional state. Furthermore, parents can receive support for purchasing related products with peace of mind.

[0640] "Generative AI" is an artificial intelligence system that uses natural language processing technology to generate text data and provide answers and advice to questions.

[0641] "Analyzing the meaning of a child's behavior" means analyzing a child's behavioral patterns and the content of their statements to understand the intentions and emotions behind them.

[0642] "Providing to parents" means notifying parents of the analysis results and generated information and providing support to parents in understanding their children's behavior and emotions.

[0643] "Questions about child-rearing" are questions that parents pose to generative AI about the doubts and problems they face in raising their children.

[0644] "Providing answers" means that the generative AI generates appropriate information and advice in response to questions from parents and notifies them.

[0645] "Educational support" means providing information and activities to promote children's learning and development.

[0646] "Reading aloud" means conveying stories and information that interest children through audio.

[0647] "Analyzing a child's speech" means analyzing the words and expressions a child uses and understanding their content and intentions.

[0648] "Providing advice to parents" means giving advice to parents to take appropriate action based on their child's behavior and emotions.

[0649] "Considering the child's emotional state" means recognizing the child's current emotions and providing responses and advice appropriate to those emotions.

[0650] "Supporting parents in purchasing related products with peace of mind" means providing appropriate information and recommendations so that parents can purchase child-rearing related products with peace of mind.

[0651] This invention is a system for supporting children's education and reading aloud, which uses generative AI to analyze children's behavior and emotions and provide appropriate information and advice to parents. Specific embodiments of this system are described below.

[0652] Hardware and software used

[0653] Hardware: Servers, devices (smartphones, tablets, PCs, etc.)

[0654] Software: Generative AI models (e.g., GPT-4), speech synthesis software (e.g., Google Text-to-Speech), facial expression recognition software

[0655] Handling Questions

[0656] 1. User: A child asks through the device, "Why is the sky blue?"

[0657] 2. Terminal: Receives the question as text data and sends it to the server.

[0658] 3. Server: Generates scientific answers to questions using generative AI models.

[0659] 4. Server: Sends the generated answer to the device.

[0660] 5. Device: The answers are converted into audio using speech synthesis software and provided to the child.

[0661] For example, if a child asks, "Why is the sky blue?" the prompt might look like this:

[0662] A child asks, "Why is the sky blue?" Generate a scientific answer.

[0663] Reading process

[0664] 1. User: The parent requests through the device, "I would like you to read to my child today."

[0665] 2. Terminal: Receives the request as text data and sends it to the server.

[0666] 3. Server: Uses a generative AI model to select stories that are predicted to be preferred by children.

[0667] 4. Server: Sends the selected story to the device.

[0668] 5. Device: The story is converted into audio using text-to-speech software and read to the child.

[0669] As a specific example, if a parent requests, "Please read to me today," the prompt would be as follows:

[0670] A parent has requested that you read a story to their child today. Please select a story that you think their child will enjoy.

[0671] Considering emotional states

[0672] 1. User: The child expresses emotions through the device (e.g., an angry facial expression is recognized by the camera).

[0673] 2. Device: Sends emotion data to the server.

[0674] 3. Server: Generates advice based on the emotional state using a generative AI model.

[0675] 4. Server: Sends the generated advice to the device.

[0676] 5. Device: Provide advice to parents.

[0677] For example, if a child is expressing anger, the prompt might be:

[0678] My child is showing signs of anger. Please provide some advice on why this is happening and how to resolve it.

[0679] This system allows parents to accurately understand their children's behavior and emotions and respond appropriately. It also provides scientific answers to their children's questions and offers advice that takes into account their emotional state. It also provides support for purchasing related products with peace of mind.

[0680] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0681] Handling Questions

[0682] Step 1:

[0683] User: A child asks through the device, "Why is the sky blue?"

[0684] Input: Child's voice

[0685] Output: Text data

[0686] What it does: A child speaks a question into the device, which uses voice recognition to convert the speech into text.

[0687] Step 2:

[0688] Terminal: Sends the question text data to the server.

[0689] Input: Text data

[0690] Output: HTTP request

[0691] Specific operation: The terminal sends the converted text data to the server as an HTTP request.

[0692] Step 3:

[0693] Server: Generates scientific answers to questions using generative AI models.

[0694] Input: Text data

[0695] Output: Answer text

[0696] Specific operation: The server inputs the prompt sentence "Why is the sky blue?" into the generative AI model and generates an answer.

[0697] Step 4:

[0698] Server: Sends the generated answer to the device.

[0699] Input: Answer text

[0700] Output: JSON format data

[0701] Specific operation: The server sends the generated answer in JSON format to the device.

[0702] Step 5:

[0703] Device: The answers are converted into audio using speech synthesis software and provided to the child.

[0704] Input: JSON data

[0705] Output: Audio data

[0706] What happens: The device parses the JSON data, gets the answer text, uses text-to-speech software to convert the answer into audio, and plays it back through the speaker.

[0707] Reading process

[0708] Step 1:

[0709] User: The parent requests through the device, "I'd like you to read to my child today."

[0710] Input: Parent voice

[0711] Output: Text data

[0712] Specific operation: The parent speaks a request into the device, and the device uses voice recognition to convert the speech into text.

[0713] Step 2:

[0714] Terminal: Sends the request content to the server as text data.

[0715] Input: Text data

[0716] Output: HTTP request

[0717] Specific operation: The terminal sends the converted text data to the server as an HTTP request.

[0718] Step 3:

[0719] Server: Uses a generative AI model to select stories that children are predicted to like.

[0720] Input: Text data

[0721] Output: Narrative text

[0722] Specific operation: The server inputs the prompt "Please select a story your child likes" into the generative AI model and generates a story.

[0723] Step 4:

[0724] Server: Sends the selected story to the device.

[0725] Input: Story text

[0726] Output: JSON format data

[0727] Specific operation: The server sends the generated story in JSON format to the device.

[0728] Step 5:

[0729] Device: The story is converted into audio using text-to-speech software and read to the child.

[0730] Input: JSON data

[0731] Output: Audio data

[0732] What it does: The device parses the JSON data to get the story text, uses text-to-speech software to convert the story into audio, and plays it back through the speaker.

[0733] Considering emotional states

[0734] Step 1:

[0735] User: The child expresses emotions through the device (e.g., an angry facial expression is recognized by the camera).

[0736] Input: Child's facial expression data

[0737] Output: Emotion data

[0738] What it does: A child expresses emotion in front of the device's camera. The device uses facial recognition software to capture the emotion data.

[0739] Step 2:

[0740] Device: Sends emotion data to the server.

[0741] Input: Emotion data

[0742] Output: HTTP request

[0743] Specific operation: The device sends the acquired emotion data to the server as an HTTP request.

[0744] Step 3:

[0745] Server: Generates advice based on emotional state using a generative AI model.

[0746] Input: Emotion data

[0747] Output: Advice text

[0748] Specific operation: The server inputs the prompt sentence "My child is showing signs of anger. Please generate advice about the cause and how to resolve it" into the generative AI model, and generates advice.

[0749] Step 4:

[0750] Server: Sends the generated advice to the device.

[0751] Input: Advice text

[0752] Output: JSON format data

[0753] Specific operation: The server sends the generated advice in JSON format to the device.

[0754] Step 5:

[0755] Device: Providing advice to parents.

[0756] Input: JSON data

[0757] Output: Text message

[0758] Specific behavior: The device parses the JSON data, obtains the advice text, and displays the advice as a text message to the parent.

[0759] (Application example 2)

[0760] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0761] Modern parents spend a lot of time and effort educating their children and managing their emotions, but it is often difficult to obtain appropriate information and support. Providing scientific answers to questions that interest children and properly understanding and responding to their children's emotional states are also challenges. Furthermore, selecting stories that children like and reading them aloud can be a burden for parents. To solve these challenges, a comprehensive support system that parents can easily use is needed.

[0762] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0763] In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to parents, means for parents to ask the generative AI questions about child rearing and provide answers to those questions, means for providing educational support and reading to children, means for analyzing children's speech and providing advice to parents, means for supporting the safe purchase of related products, means for generating and providing scientific answers to children's questions, means for analyzing children's emotional states and providing appropriate advice to parents, and means for selecting children's favorite stories and reading them aloud. This allows parents to easily receive comprehensive support for their children's education and emotional management.

[0764] "Generative AI" is a system that uses artificial intelligence technology to generate data and perform specific tasks.

[0765] "Analyzing the meaning of a child's behavior" means analyzing a child's actions and words and understanding the intentions and emotions behind them.

[0766] "Providing to the parent" means communicating the analysis results and information to the parent.

[0767] "Questions about child rearing" are questions and inquiries that parents have about raising and educating their children.

[0768] "Providing an answer" means presenting appropriate information or a solution to a question.

[0769] "Supporting children's education" means providing support to help children learn and grow.

[0770] "Reading aloud" means reading a story or text aloud.

[0771] "Analyzing children's speech" means analyzing what a child says and understanding its meaning and emotions.

[0772] "Providing advice to parents" means providing appropriate advice or suggestions to parents based on the analysis results.

[0773] "Supporting the safe purchase of related products" means supporting children and parents in safely purchasing products that are appropriate for them.

[0774] "Generating and providing scientific answers" means creating and providing scientifically based answers to children's questions.

[0775] "Analyzing a child's emotional state" means understanding a child's emotions and assessing their state.

[0776] "Providing appropriate advice" means giving advice and suggestions to parents that are appropriate to their emotional state.

[0777] "Choosing stories that children will like" means selecting appropriate stories based on the child's interests and preferences.

[0778] "Reading aloud" means reading a selected story aloud.

[0779] The system for carrying out this invention uses generative AI to support children's education and manage their emotions. Specific embodiments are described below.

[0780] System Configuration

[0781] The system uses the following hardware and software:

[0782] Hardware: smartphone, microphone, speaker

[0783] Software: OpenAI API, SpeechRecognition library, gTTS library, playsound library

[0784] Program processing overview

[0785] The server uses generative AI to:

[0786] 1. A means of analyzing the meaning of children's behavior and providing it to parents: Analyze children's behavior and words, understand the intentions and emotions behind them, and provide the results to parents.

[0787] 2. A means for parents to ask questions about child-rearing to a generative AI and receive answers: When parents input questions about child-rearing, the generative AI generates appropriate answers and provides them to the parents.

[0788] 3. A means of providing educational support and reading to children: Generative AI will provide educational support to children, select stories that children like, and read them aloud.

[0789] 4. A means of analyzing children's speech and providing advice to parents: Analyzes children's speech and provides appropriate advice to parents based on the results.

[0790] 5. Measures to help ensure safe purchasing of relevant products: Support children and parents in safely purchasing appropriate products.

[0791] 6. Means of generating and providing scientific answers to children's questions: Means of generating and providing scientifically based answers to children's questions.

[0792] 7. A means of analyzing a child's emotional state and providing appropriate advice to parents: A means of analyzing a child's emotional state and providing appropriate advice to parents based on the results.

[0793] 8. A means of selecting stories that children like and reading them aloud: Generative AI will select stories that children like and read them aloud.

[0794] Specific examples

[0795] Here are some concrete usage examples:

[0796] 1. Question and Answer Function:

[0797] If a child asks, "Why is the sky blue?", the generative AI might answer, "The sky is blue because sunlight is scattered by molecules in the atmosphere."

[0798] Example prompt: "A child asked: Why is the sky blue? Provide a scientific answer."

[0799] 2. Reading function:

[0800] If a parent requests, "I'd like you to read to my child today," the generative AI will select the story of "Momotaro" and read it aloud.

[0801] Example prompt: "Choose one story that your child likes."

[0802] 3. Emotional state analysis and advice:

[0803] If a child shows signs of anger, the generative AI generates a prompt such as, "The child is showing signs of anger. What advice would you offer to the parents?" and provides appropriate advice.

[0804] Example prompt: "Your child is displaying angry emotions. What advice would you offer the parents?"

[0805] This makes it easier for parents to receive comprehensive support for their children's education and emotional management.

[0806] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0807] Step 1:

[0808] The user uses a smartphone to voice-input questions for their child or requests for reading aloud, and the voice data is collected through the smartphone's microphone.

[0809] Step 2:

[0810] The device converts the collected voice data into text data using the SpeechRecognition library. Voice data is the input and text data is the output.

[0811] Step 3:

[0812] The device analyzes the converted text data and identifies the question or reading request, such as "Why is the sky blue?" or "I'd like you to read to me today."

[0813] Step 4:

[0814] The device sends the identified question or request to the generative AI model, which then uses the OpenAI API to generate a prompt and generate an appropriate answer or story. An example of a prompt is, "A child asked: Why is the sky blue? Please provide a scientific answer."

[0815] Step 5:

[0816] The server receives the answers and stories from the generative AI model and sends them to the terminal as text data. The answers and stories generated by the generative AI model are the output.

[0817] Step 6:

[0818] The device converts the received text data into voice data using the gTTS library. The text data is the input and the voice data is the output.

[0819] Step 7:

[0820] The device then plays the converted audio data through a speaker, allowing the user to listen to the answers to their child's questions and the reading aloud.

[0821] Step 8:

[0822] The server analyzes the input data from the user to analyze the emotional state of the child, for example, if the child is showing an angry emotion, it identifies the emotional state.

[0823] Step 9:

[0824] The server generates appropriate advice for the parent based on the identified emotional state. Using a generative AI model, it generates a prompt sentence such as "The child is showing angry emotions. What advice would you give to the parent?" and generates appropriate advice.

[0825] Step 10:

[0826] The server sends the generated advice as text data to the device, which then converts it into audio data and plays it back, allowing parents to receive appropriate audio advice for their child's emotional state.

[0827] Example 3

[0828] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0829] Conventional parenting support systems have difficulty properly analyzing children's comments and emotional states and providing specific advice to parents. Furthermore, when assisting parents in purchasing related products, they lacked suggestions that took into account the child's emotional state. This made it difficult for parents to properly understand and respond to their children's problems, and they could not purchase products with confidence.

[0830] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0831] In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to parents, means for parents to ask the generative AI questions about child-rearing and provide answers to the questions, means for providing educational support and reading to children, means for analyzing children's speech and providing advice to parents, means for supporting parents in purchasing related products with peace of mind, means for converting children's speech into text using speech recognition software, means for analyzing text data using a natural language processing library, means for generating advice using a generative AI model based on the analysis results, means for providing the generated advice to parents, means for receiving product purchase requests from parents and making product suggestions taking into account the child's emotional state, and means for selecting reliable online shops and providing purchase links. This makes it possible to appropriately analyze children's speech and emotional state and provide specific advice to parents, and by making product suggestions taking into account the child's emotional state, parents can purchase products with peace of mind.

[0832] "Generative AI" is a system that uses artificial intelligence technology to generate data and then analyze and make suggestions.

[0833] "Analyzing the meaning of a child's behavior" means analyzing a child's actions and words to understand the intentions and emotions behind them.

[0834] "Providing to parents" means notifying or displaying the analysis results and suggestions to parents.

[0835] "Questions about child rearing" are inquiries about doubts and problems that parents have regarding child rearing.

[0836] "Providing answers" means that the generative AI responds to parents' questions with appropriate information and advice.

[0837] "Educational support" means providing activities and resources to help children learn and grow.

[0838] "Reading aloud" means reading a story or text aloud to a child.

[0839] "Analyzing a child's speech" means analyzing what a child says and understanding its meaning and emotions.

[0840] "Providing advice to parents" means giving specific advice or suggestions to parents based on the analysis results.

[0841] "Supporting the safe purchase of related products" means selecting reliable purchasing sources and supporting parents so that they can purchase products with peace of mind.

[0842] "Speech recognition software" is software for converting voice data into text data.

[0843] "Converting to text" means converting audio data into text information.

[0844] A "natural language processing library" is a software library for analyzing text data and extracting meaning and emotion.

[0845] "Analyzing" means analyzing data to understand its meaning and patterns.

[0846] A "generative AI model" is an algorithm or model that is at the core of generative AI, and generates data and performs analysis and proposals.

[0847] "Generating advice" means creating specific advice or suggestions for parents based on the analysis results.

[0848] A "request to purchase a product" is a parent's wish or request to purchase a specific product.

[0849] "Considering the emotional state" means understanding the child's current emotions and moods and responding appropriately based on those.

[0850] "Making product suggestions" means recommending appropriate products based on the parent's requests and the child's emotional state.

[0851] A "reliable online shop" refers to a safe and trustworthy place to purchase products.

[0852] "Providing a purchase link" means providing a link to an online shop so that parents can easily purchase the product.

[0853] MODE FOR CARRYING OUT THE INVENTION

[0854] This invention is a system that analyzes a child's comments and emotional state and provides appropriate advice and product purchasing support to parents. A specific embodiment of this system is described below.

[0855] Hardware and software used

[0856] Hardware: Servers, devices (PCs, smartphones, tablets)

[0857] Software: Generative AI models (e.g., GPT-4), speech recognition software (e.g., Google Speech-to-Text), natural language processing libraries (e.g., spaCy)

[0858] System configuration

[0859] 1. Acquiring voice input

[0860] Users use a smartphone or tablet application to record their child's speech.

[0861] The terminal provides a record button and the user initiates the recording.

[0862] Once the recording is complete, the device sends the recording data to the server.

[0863] 2. Converting voice data to text

[0864] The server uses speech recognition software (e.g., Google Speech-to-Text) to convert the recording into text.

[0865] The server stores the converted text data.

[0866] 3. Text Data Analysis

[0867] The server uses a natural language processing library (e.g., spaCy) to parse the text data.

[0868] The server extracts the child's speech and emotional state from the text.

[0869] For example, extract the emotion "I hate school" from the statement "I hate school."

[0870] 4. Generating Advice

[0871] The server uses a generative AI model (e.g., GPT-4) to generate advice based on the analysis results.

[0872] For example, it generates advice such as "Your child may be having some problems at school."

[0873] 5. Providing advice

[0874] The server sends the generated advice to the terminal.

[0875] The terminal displays the advice to the user.

[0876] For example, it can be displayed as a smartphone notification or an in-app message.

[0877] 6. Assistance with purchasing products

[0878] A user enters a request to purchase a product into the system.

[0879] The terminal provides an input form, and the user inputs "I would like to purchase a picture book for my child."

[0880] The server uses the generated AI model to make product suggestions that take into account the child's emotional state.

[0881] For example, if your child expresses anger about breaking a toy, suggest buying the same toy again.

[0882] 7. Providing Purchase Links

[0883] The server selects a reliable online shop and generates a purchase link.

[0884] The server generates a purchase link and sends it to the device.

[0885] The device displays a purchase link to the user.

[0886] For example, you can be notified via a link within the app or by email.

[0887] Examples and prompts

[0888] Example 1: When a child says, "I don't like school"

[0889] Prompt: "What advice can I offer parents when their child says, 'I hate school'?"

[0890] Example 2: A parent requests, "I want to buy a picture book for my child."

[0891] Prompt: "If a parent asks to purchase a picture book for their child, explain how you would choose a reliable online store and provide them with a link to purchase."

[0892] In this way, the system can appropriately analyze the child's comments and emotional state, provide specific advice to the parents, and recommend products that take the child's emotional state into consideration, allowing the parents to purchase products with peace of mind.The flow of the identification process in Example 3 will be described with reference to Figure 21.

[0893] Program processing flow

[0894] Step 1: Getting voice input

[0895] Input: Child's speech

[0896] Output: Recording data

[0897] Specific behavior:

[0898] The user opens the application on their smartphone or tablet and taps the record button.

[0899] The user records what the child says.

[0900] Once the recording is complete, the device sends the recording data to the server.

[0901] Step 2: Convert audio data to text

[0902] Input: Recording data

[0903] Output: Text data

[0904] Specific behavior:

[0905] The server uses speech recognition software (e.g., Google Speech-to-Text) to convert the recording into text.

[0906] The server stores the converted text data.

[0907] Step 3: Analyzing the text data

[0908] Input: Text data

[0909] Output: Analysis results (content of speech, emotional state)

[0910] Specific behavior:

[0911] The server uses a natural language processing library (e.g., spaCy) to parse the text data.

[0912] The server extracts the child's speech and emotional state from the text.

[0913] For example, extract the emotion "I hate school" from the statement "I hate school."

[0914] Step 4: Generating Advice

[0915] Input: Analysis results (content of speech, emotional state)

[0916] Output: Advice

[0917] Specific behavior:

[0918] The server uses a generative AI model (e.g., GPT-4) to generate advice based on the analysis results.

[0919] For example, it generates advice such as "Your child may be having some problems at school."

[0920] Step 5: Providing advice

[0921] Input: Advice

[0922] Output: Parent notification

[0923] Specific behavior:

[0924] The server sends the generated advice to the terminal.

[0925] The terminal displays the advice to the user.

[0926] For example, it can be displayed as a smartphone notification or an in-app message.

[0927] Step 6: Help with purchasing products

[0928] Input: Parental purchase request

[0929] Output: Product proposal

[0930] Specific behavior:

[0931] The user enters "I would like to purchase a picture book for my child" into an input form within the app.

[0932] The terminal sends the input data to the server.

[0933] The server uses the generated AI model to make product suggestions that take into account the child's emotional state.

[0934] For example, if your child expresses anger about breaking a toy, suggest buying the same toy again.

[0935] Step 7: Provide a purchase link

[0936] Input: Product Proposal

[0937] Output: Purchase link

[0938] Specific behavior:

[0939] The server selects a reliable online shop and generates a purchase link.

[0940] The server generates a purchase link and sends it to the device.

[0941] The device displays a purchase link to the user.

[0942] For example, you can be notified via a link within the app or by email.

[0943] In this way, the system can properly analyze a child's comments and emotional state and provide specific advice to parents. It also makes product suggestions that take the child's emotional state into consideration, allowing parents to make purchases with peace of mind.

[0944] (Application example 3)

[0945] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0946] Conventional child-rearing support systems do not adequately consider a child's emotional state when proposing products or providing educational support, making it difficult for parents to choose appropriate products. Furthermore, there is a lack of specific advice and suggestions based on a child's emotional state, making it difficult for parents to respond in accordance with their child's emotions. This has led to the issue of it being difficult to provide support appropriate for a child's growth and development.

[0947] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0948] In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to parents, means for parents to ask the generative AI questions about child rearing and provide answers, means for providing educational support and reading to children, means for analyzing children's speech and providing advice to parents, means for supporting the safe purchase of related products, means for suggesting optimal products taking into account the child's emotional state, and means for suggesting products based on the child's emotional state. This enables parents to select appropriate products according to their child's emotional state and provide support appropriate for their child's growth and development.

[0949] "Generative AI" is an artificial intelligence technology that generates new information and suggestions based on data.

[0950] "Analyzing the meaning of a child's behavior" means analyzing a child's actions and words and understanding the intentions and emotions behind them.

[0951] "Means to provide to parents" refers to a method or system for communicating analysis results and advice to parents.

[0952] "Questions about child-rearing" are questions and concerns that parents have about child-rearing.

[0953] "Means for providing answers" refers to the method or system by which generative AI generates and provides appropriate answers to parents' questions.

[0954] "Educational support and storytelling tools" are methods and systems for delivering educational activities and storytelling to help children learn and grow.

[0955] "Means for analyzing children's speech and providing advice to parents" refers to a method or system for analyzing the content of children's speech and providing appropriate advice to parents based on the results.

[0956] "Means to help parents purchase related products with peace of mind" refers to methods and systems that help parents select reliable online shops and make purchases with peace of mind when purchasing products for their children.

[0957] "Means for proposing optimal products taking into consideration a child's emotional state" refers to a method or system that analyzes a child's emotional state and proposes to parents the optimal products according to that state.

[0958] A "means for making product suggestions based on a child's emotional state" is a method or system for selecting and suggesting appropriate products based on a child's emotional state.

[0959] To implement this invention, it is necessary to build a system in which the server, terminals, and users work together. A specific embodiment of this system is shown below.

[0960] System Configuration

[0961] The server is equipped with a generative AI and has a means for analyzing the meaning of a child's behavior and providing the results to parents. It also has a means for parents to ask the generative AI questions about child rearing and receive answers. It also includes a means for supporting children's education and reading aloud, a means for analyzing children's speech and providing advice to parents, a means for supporting the safe purchase of related products, a means for suggesting optimal products taking into account the child's emotional state, and a means for suggesting products based on the child's emotional state.

[0962] Hardware and Software

[0963] The server is a computer with a powerful processor and large memory capacity, and is installed with software to run the generative AI model, specifically using machine learning libraries such as Python and TensorFlow, and a database that stores data on children's behavioral patterns and emotional states.

[0964] The device is a smartphone or tablet used by a parent, with a dedicated application installed, which provides an interface for parents to input questions about parenting and report on their child's emotional state.

[0965] Data processing and calculation

[0966] The server receives the child's behavioral and emotional state data sent from the device and analyzes it using a generative AI model. The analysis results are then provided to parents as appropriate advice and product suggestions. Specifically, the following data processing and calculations are performed:

[0967] 1. Analysis of children's behavioral data: Analyze children's behavior and words to understand the intentions and emotions behind them.

[0968] 2. Emotional state assessment: Evaluate the child's emotional state and suggest the most appropriate products and educational support based on that state.

[0969] 3. Product Suggestion: Based on the emotional state, select and suggest appropriate products to parents.

[0970] Specific examples

[0971] For example, if a child says, "I hate school," the device sends that statement to the server, which uses a generative AI model to interpret the statement as "sad" and suggest a "comforting picture book" or "stuffed toy" to the parent.

[0972] Example prompts to input to a generative AI model:

[0973] If your child says, "I hate school," what products would you suggest?

[0974] In this way, parents can choose the right product based on their child's emotional state and provide support appropriate for their child's growth and development.

[0975] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0976] Step 1:

[0977] The user (parent) uses a device (smartphone or tablet) to input information about the child's actions and comments.

[0978] Input: Child's behavior and speech data (e.g., "I hate school")

[0979] Output: Sending data from the device to the server

[0980] Step 2:

[0981] The device transmits the entered data on the child's behavior and speech to the server.

[0982] Input: Children's behavior and speech data

[0983] Output: Send data to the server

[0984] Step 3:

[0985] The server inputs the received data on the child's behavior and speech into a generative AI model for analysis.

[0986] Input: Children's behavior and speech data

[0987] Output: Analysis result (e.g. "sad")

[0988] How it works: The generative AI model analyzes data and assesses the child's emotional state.

[0989] Step 4:

[0990] The server generates advice and product suggestions for parents based on the analysis results.

[0991] Input: Analysis result (e.g. "sad")

[0992] Output: Advice or product suggestions (e.g., "Comforting picture books" or "Stuffed toys")

[0993] Specific operation: The generative AI model selects appropriate products and advice based on the emotional state.

[0994] Step 5:

[0995] The server transmits the generated advice and product suggestions to the terminal.

[0996] Input: Advice or product suggestion

[0997] Output: Sending data to the terminal

[0998] Step 6:

[0999] The terminal displays the received advice and product suggestions to the user (parent).

[1000] Input: Advice or product suggestion

[1001] Output: Display to parent

[1002] What it does: The device application displays advice and product suggestions in a parent-friendly format.

[1003] Step 7:

[1004] The user (parent) selects and purchases appropriate products based on the displayed advice and product suggestions.

[1005] Input: Advice or product suggestion

[1006] Output: Purchase decision

[1007] Specific action: The parent purchases the suggested product from an online shop.

[1008] In this way, the system can provide appropriate advice and product suggestions to parents based on their child's behavior and emotional state.

[1009] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1010] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1011] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1012] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[1013] [Second embodiment]

[1014] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[1015] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[1016] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1017] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[1018] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1019] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1020] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1021] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1022] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1023] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1024] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1025] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1026] "Example 1"

[1027] One embodiment of the present invention is a child-rearing support system that uses generative AI. This system analyzes a child's behavior and speech and provides the parent with its meaning. For example, if a child says, "I'm hungry," the system interprets this as a "behavior requesting food" and communicates this meaning to the parent. Furthermore, if a parent asks the system a question such as, "Why does my child cry in the middle of the night?", the system generates an answer to that question and provides it to the parent.

[1028] "Example 2"

[1029] Furthermore, this system has the function of supporting children's education and reading aloud. For example, if a child asks, "Why is the sky blue?", the system will generate a scientific answer to the question and provide it to the child. Also, if a parent requests the system to read a story to them today, the system will select a story that it predicts the child will like and read it to them.

[1030] "Example 3"

[1031] The system also has the ability to analyze what children say and provide advice to parents. For example, if a child says, "I hate school," the system will analyze the comment and provide advice to the parents, such as, "Your child may have some problems with school."

[1032] "Example 4"

[1033] Furthermore, the system has a function to support the safe purchase of related products. For example, if a parent requests the system to purchase a picture book for their child, the system will select a reliable online shop and help the parent make a purchase with peace of mind.

[1034] The processing flow of each embodiment will be described below.

[1035] "Example 1"

[1036] Step 1: The generative AI observes the child's behavior and comments and collects them as data.

[1037] Step 2: Analyze the collected data and understand the meaning of the child's behavior.

[1038] Step 3: Provide the analysis results to the parent.

[1039] "Example 2"

[1040] Step 1: Receive a parent's request for educational support or reading aloud.

[1041] Step 2: Generate appropriate educational content and stories on demand.

[1042] Step 3: Provide the generated educational content and stories to parents and children.

[1043] "Example 3"

[1044] Step 1: Observe and collect data on children's talk.

[1045] Step 2: Analyze the collected data and understand the child's feelings and problems.

[1046] Step 3: Based on the analysis results, advice is generated for parents.

[1047] Step 4: Provide the generated advice to the parent.

[1048] "Example 4"

[1049] Step 1: Receive a request from a parent to purchase a product.

[1050] Step 2: Choose a reliable online store based on your requirements.

[1051] Step 3: Provide parents with the details of the online store they have chosen.

[1052] Example 1

[1053] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1054] In today's child-rearing environment, parents often find it difficult to understand the meaning of their children's actions and words, and are unable to respond appropriately. Furthermore, when parents ask questions about child-rearing, there are limited ways to get reliable answers. Furthermore, there is a lack of comprehensive child-rearing support, such as educational support, reading aloud to children, and support for purchasing related products.

[1055] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1056] In this invention, the server includes a means for analyzing the meaning of a child's behavior using generative AI and providing the results to parents; a means for parents to ask the generative AI questions about child-rearing and provide answers; a means for providing educational support and reading to the child; a means for analyzing the child's speech and providing advice to the parent; a means for supporting the parent in purchasing related products with peace of mind; a means for the device to collect the child's behavior and statements as voice and text data and send it to the server; a means for the server to input the received data into a generative AI model and provide the analysis results to the parent; and a means for notifying the parent of the analysis results and answers. This allows parents to quickly and accurately understand the meaning of their child's behavior and statements and take appropriate action. It also provides reliable parenting information and advice, providing comprehensive parenting support.

[1057] "Generative AI" is an artificial intelligence technology that generates new information and answers based on data.

[1058] "Analyzing the meaning of children's behavior" means collecting data on children's actions and words and understanding the intentions and demands behind them.

[1059] "Providing to parent" means notifying the parent of the analysis results and answers and making them available to the parent.

[1060] "Asking questions to the generative AI" means that parents input their doubts or queries about child-rearing into the system, and the generative AI receives those questions.

[1061] "Providing an answer" means that the generative AI generates an appropriate answer to the parent's question and notifies the parent of it.

[1062] "Educational support" means providing information and activities to help children learn and develop.

[1063] "Reading aloud" means providing children with stories or picture books in audio or text format.

[1064] "Analyzing a child's speech" means analyzing what a child says and understanding the intentions and emotions behind it.

[1065] "Providing advice to parents" means providing parents with appropriate ways of responding and advice based on the analysis of their child's behavior and comments.

[1066] "Supporting parents in purchasing related products with peace of mind" means providing information and support so that parents can purchase products related to child-rearing with peace of mind.

[1067] "Devices" are devices used to collect information about children's behavior and statements, such as smartphones and tablets.

[1068] "Collecting as audio or text data" means digitizing children's statements and actions in the form of audio recordings or text input.

[1069] A "server" is a computer system that receives collected data and analyzes it using a generative AI model.

[1070] "Inputting into a generative AI model" means passing the collected data to the generative AI model and starting the process for analysis.

[1071] "Providing the analysis results to the parent" means that the generative AI model notifies the parent of the analysis results and makes them available to the parent.

[1072] "Notifying the parent's device" means sending the analysis results and answers to the parent's smartphone or tablet as a push notification or message.

[1073] MODE FOR CARRYING OUT THE INVENTION

[1074] This invention is a child-rearing support system that uses a generative AI model to analyze children's behavior and comments and provide their meaning to parents. A specific embodiment of this system is described below.

[1075] System configuration

[1076] Hardware:

[1077] Server: A server equipped with a high-performance GPU (e.g., NVIDIA Tesla V100)

[1078] Device: a device such as a smartphone or tablet

[1079] software:

[1080] Generative AI model: Using OpenAI GPT-4 as an example

[1081] Data analysis tools: Python's Pandas library, etc.

[1082] Program processing

[1083] Data collection:

[1084] The device collects the child's actions and speech as audio and text data, for example, by using a microphone built into a smartphone or tablet to record what the child says.

[1085] Data transmission:

[1086] The device sends the collected data to a server, where it is encrypted and transmitted securely.

[1087] Data Analysis:

[1088] The server inputs the received data into a generative AI model, which converts the speech data into text and analyzes its meaning.

[1089] Result generation:

[1090] The server generates a message to provide to the parent based on the analysis results obtained from the generative AI model.

[1091] Result notification:

[1092] The server sends the generated message to the parent's device, and the parent receives the notification through the device.

[1093] Specific examples

[1094] Example 1:

[1095] Child says: "I'm hungry."

[1096] Process flow:

[1097] 1. The device records what the child says.

[1098] 2. The device sends the recorded audio data to the server.

[1099] 3. The server converts the voice data into text and inputs it into the generative AI model.

[1100] 4. The generative AI model analyzes "I'm hungry" as "the behavior of wanting food."

[1101] 5. The server generates the message "Your child wants food."

[1102] 6. The server sends the generated message to the parent device.

[1103] 7. Parents receive notifications via their devices.

[1104] Example 2:

[1105] Parents ask: "Why does my child cry in the middle of the night?"

[1106] Process flow:

[1107] 1. The parent enters a question through the terminal.

[1108] 2. The terminal sends the entered question to the server.

[1109] 3. The server inputs the question into the generative AI model.

[1110] 4. The generative AI model generates an answer to the question, such as "Children may cry in the middle of the night because they are hungry, scared, or unwell."

[1111] 5. The server sends the generated answer to the parent's device.

[1112] 6. Parents receive the answers via their device.

[1113] Example prompt sentence:

[1114] "When a child says, 'I'm hungry,' what does this mean?"

[1115] "Why does my child cry in the middle of the night?"

[1116] In this way, the system provides child-rearing support through collaboration between the server, terminals, and users.

[1117] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1118] Step 1: Data collection

[1119] The device collects the child's actions and comments as audio and text data, specifically by recording what the child says using a microphone built into the smartphone or tablet.

[1120] Input: Child's utterance (e.g., "I'm hungry")

[1121] Output: Recorded audio data

[1122] Step 2: Send data

[1123] The device sends the collected voice data to a server, where it is encrypted and transmitted securely.

[1124] Input: Recorded audio data

[1125] Output: Audio data sent to the server

[1126] Step 3: Data analysis

[1127] The server inputs the received voice data into a generative AI model, which converts the voice data into text and analyzes its meaning.

[1128] Input: Audio data sent to the server

[1129] Output: Analyzed text data (e.g., "I'm hungry" → "food-seeking behavior")

[1130] Step 4: Result Generation

[1131] The server generates a message to provide to the parent based on the analysis results obtained from the generative AI model.

[1132] Input: Parsed text data

[1133] Output: A message to provide to the parent (e.g., "Your child wants to eat")

[1134] Step 5: Notification of results

[1135] The server sends the generated message to the parent's device, and the parent receives the notification through the device.

[1136] Input: Message to provide to parent

[1137] Output: Notification displayed on parent's device (e.g. "Your child wants to eat")

[1138] In this way, the child-rearing support system functions by performing specific actions and inputting and outputting data at each step.

[1139] (Application example 1)

[1140] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1141] Modern parents face many challenges in raising children. In particular, they often find it difficult to understand the meaning of their children's actions and comments, which often makes it difficult to respond appropriately. It is also difficult to understand a child's needs and select appropriate products while shopping in a physical store. Furthermore, there is a lack of means to get quick and appropriate answers to questions about child-rearing. To solve these problems, a system is needed that analyzes children's actions and comments and provides parents with appropriate information.

[1142] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1143] In this invention, the server includes a means for analyzing the meaning of a child's behavior using generative AI and providing the results to parents, a means for parents to ask questions about child-rearing to the generative AI and receive answers, a means for providing educational support and reading to children, a means for analyzing children's speech and providing advice to parents, a means for analyzing children's needs while shopping in a physical store and suggesting appropriate products, and a means for supporting parents in purchasing related products with peace of mind. This makes it easier for parents to understand the meaning of their children's behavior and statements and respond appropriately. It also enables parents to understand their children's needs and select appropriate products while shopping in a physical store. Furthermore, it allows parents to receive prompt and appropriate answers to questions about child-rearing.

[1144] "Generative AI" refers to artificial intelligence that generates new information and answers based on data.

[1145] "Analyzing the meaning of a child's behavior" means analyzing a child's actions and words and understanding the intentions and needs behind them.

[1146] "Providing to parents" means communicating the analysis results and answers to parents.

[1147] "Asking questions to generative AI" means that parents input their doubts and queries about child-rearing into the artificial intelligence.

[1148] "Providing answers" means that the generative AI returns appropriate information and advice in response to parents' questions.

[1149] "Providing educational support and storytelling" means providing educational content and stories to help children learn and grow.

[1150] "Analyzing a child's speech" means analyzing in detail what the child says and understanding its meaning and background.

[1151] "Providing advice to parents" means providing appropriate responses and advice to parents based on their child's behavior and comments.

[1152] "Analyzing children's needs while shopping in a physical store" means analyzing children's behavior and comments in real time while shopping in a physical store to understand their needs.

[1153] "Suggesting appropriate products" means recommending products to parents that meet their child's needs based on the analysis results.

[1154] "Supporting parents in purchasing related products with confidence" means providing information and support so that parents can purchase products that meet their children's needs with confidence.

[1155] As an embodiment of the present invention, the following system can be constructed.

[1156] System Configuration

[1157] The system consists of a server equipped with generative AI, a smartphone used by parents, and a device used while shopping in a physical store. The server uses generative AI models to analyze children's behavior and comments and provide appropriate information to parents.

[1158] Hardware and software used

[1159] Hardware: Smartphones, servers, and in-store devices

[1160] Software: Python, OpenAI API, Database Management System

[1161] Data processing and calculation

[1162] 1. Analyze the meaning of your child's behavior:

[1163] Parents input their children's comments via their smartphones.

[1164] The server uses the OpenAI API to send prompt statements to the generative AI model and obtain the analysis results.

[1165] The analysis results are notified to the parent's smartphone.

[1166] 2. Parents ask questions about parenting to a generative AI that provides answers:

[1167] Parents enter questions via their smartphones.

[1168] The server sends questions to the generative AI model, which generates answers.

[1169] The answers are sent to the parent's smartphone.

[1170] 3. Analyze children's needs and suggest appropriate products while shopping in-store:

[1171] Devices in physical stores capture children's actions and comments in real time.

[1172] The server uses a generative AI model to analyze the child's needs and suggest appropriate products.

[1173] The suggested product information is displayed on the device and notified to the parent.

[1174] Specific examples

[1175] Child speech analysis:

[1176] If a child says "I'm hungry," the parent types the comment into their smartphone.

[1177] The server sends the prompt text "If a child says 'I'm hungry,' please analyze what that means." to the generative AI.

[1178] The generative AI analyzes this as "food seeking behavior" and notifies the parents.

[1179] Answers to parent questions:

[1180] A parent types in a question: "Why is my child crying in the middle of the night?"

[1181] The server sends the prompt "Please tell me why my child cries in the middle of the night" to the generative AI.

[1182] The generative AI responds, "Maybe he's hungry or he's having trouble sleeping," and notifies the parents.

[1183] In-store shopping assistance:

[1184] If a child says "I want a toy" in a physical store, the device will capture the statement.

[1185] The server sends the prompt statement "If a child says 'I want a toy,' please suggest a product that meets that need" to the generative AI.

[1186] The generative AI suggests appropriate products and displays them on the device.

[1187] This makes it easier for parents to understand the meaning of their children's actions and comments and respond appropriately. It also helps parents understand their children's needs and select appropriate products while shopping in physical stores. It also allows parents to get quick and appropriate answers to their child-rearing questions.

[1188] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1189] Step 1:

[1190] The user inputs the child's utterances using a smartphone. The input utterances are sent to the server. The input data is in text format, such as "I'm hungry."

[1191] Step 2:

[1192] The server generates a prompt based on the received utterance. The prompt takes the form "If a child says 'I'm hungry,' please analyze its meaning."

[1193] Step 3:

[1194] The server sends the generated prompt to the generative AI model using the OpenAI API. The generative AI model analyzes the prompt and generates an appropriate answer. The data processing here involves analyzing the prompt and generating an answer.

[1195] Step 4:

[1196] The server receives the answer from the generative AI model, and returns an analysis result such as "food-seeking behavior."

[1197] Step 5:

[1198] The server then notifies the user of the analysis results via a text message, which the user can then view on their smartphone.

[1199] Step 6:

[1200] A user uses a smartphone to input a question about child-rearing. The input question is sent to the server. The input data is in text format, and an example would be, "Why does my child cry in the middle of the night?"

[1201] Step 7:

[1202] The server generates a prompt based on the received question, such as "Please tell me why my child cries in the middle of the night."

[1203] Step 8:

[1204] The server sends the generated prompt to the generative AI model using the OpenAI API. The generative AI model analyzes the prompt and generates an appropriate answer. The data processing here involves analyzing the prompt and generating an answer.

[1205] Step 9:

[1206] The server receives the answer from the generative AI model, for example, "Maybe you're hungry, or maybe there's a reason you can't sleep."

[1207] Step 10:

[1208] The server then notifies the user of the received answer via a text message, which the user can then check on their smartphone.

[1209] Step 11:

[1210] While shopping in a physical store, the device captures what the child says. For example, if the child says, "I want a toy," that statement is entered into the device.

[1211] Step 12:

[1212] The device sends the received message to the server. The input data is in text format.

[1213] Step 13:

[1214] The server generates a prompt based on the received utterance. The prompt takes the form of "If a child says 'I want a toy,' please suggest a product that meets that need."

[1215] Step 14:

[1216] The server sends the generated prompt to the generative AI model using the OpenAI API. The generative AI model analyzes the prompt and suggests appropriate products. The data processing here involves analyzing the prompt and generating product suggestions.

[1217] Step 15:

[1218] The server receives suggestions from the generative AI model, such as "This toy is suitable."

[1219] Step 16:

[1220] The server then notifies the store terminal of the received proposal, which is then sent as a text message and displayed on the terminal. The user can then view the proposed products through the terminal.

[1221] Example 2

[1222] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1223] In modern child-rearing, parents are required to understand the meaning of their children's actions and comments and respond appropriately. However, it is not easy for parents to accurately analyze the meaning of their children's actions and comments and obtain appropriate advice. It is also difficult to select and effectively provide content that will interest children when providing educational support or reading aloud to them. Furthermore, when parents ask questions about child-rearing, it is important to receive answers that take into account the child's age and developmental stage. A system that can solve these issues is needed.

[1224] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1225] In this invention, the server includes a means for analyzing the meaning of a child's behavior using generative AI and providing the results to parents, a means for parents to ask questions about child-rearing to the generative AI and receive answers, a means for providing educational support and reading to children, a means for generating and providing scientific answers to children's questions, a means for selecting stories that the child likes based on the parent's request and reading them using voice synthesis, and a means for supporting the safe purchase of related products. This allows parents to understand the meaning of their child's behavior and statements and receive appropriate advice. It also enables effective educational support and reading that captures the child's interest. Furthermore, when parents ask questions about child-rearing, they can receive answers that take the child's age and developmental stage into consideration.

[1226] "Generative AI" is a system that uses artificial intelligence technology to analyze data and generate information and answers tailored to specific purposes.

[1227] "Analyzing the meaning of a child's behavior" means analyzing a child's behavioral patterns and the content of their statements to understand the intentions and emotions behind them.

[1228] "Providing to parent" means presenting the analysis results and generated information to the parent so that the parent can use them.

[1229] "Questions about child rearing" are inquiries about problems and doubts that parents face in raising their children.

[1230] "Providing answers" means that the generative AI presents appropriate information and solutions to parents' questions.

[1231] "Supporting children's education" means providing information and activities to promote children's learning and development.

[1232] "Reading aloud" means reading a story or text aloud to a child.

[1233] A "scientific answer" is an explanation or information generated based on scientific knowledge or theory.

[1234] "Speech synthesis" is a technology that converts text data into voice data.

[1235] "Supporting parents in purchasing related products with peace of mind" means supporting parents in purchasing products necessary for raising children in a safe and reliable manner.

[1236] This invention is a system that analyzes children's behavior and speech and provides appropriate information and advice to parents. The system includes means for using generative AI to analyze the meaning of children's behavior and provide the results to parents, means for parents to ask generative AI questions about child rearing and receive answers, means for providing educational support and reading to children, means for generating and providing scientific answers to children's questions, means for selecting stories that children like based on parental requests and reading to them using speech synthesis, and means for supporting parents in purchasing related products with peace of mind.

[1237] Hardware and software used

[1238] Hardware: Servers, devices (tablets and smartphones)

[1239] Software: Generative AI models (e.g., GPT-4), speech synthesis software (e.g., Google Text-to-Speech)

[1240] Specific operation of the system

[1241] 1. Accepting user questions

[1242] A user uses a terminal to input a question into the system, for example, a child might ask, "Why is the sky blue?"

[1243] The terminal receives the entered question and proceeds to the next processing step.

[1244] 2. Submit your question

[1245] The device sends the received question to the server, specifically by sending data to the server using an HTTP request.

[1246] 3. Question Analysis and Answer Generation

[1247] The server analyzes the received question and creates a prompt for the generative AI model. For example, it generates a prompt such as, "My child asked me, 'Why is the sky blue?' Please generate a scientific answer."

[1248] The server inputs a prompt into a generative AI model (e.g., GPT-4) and generates an answer, such as, "The sky is blue because sunlight is scattered by molecules in the atmosphere. Blue light in particular is scattered more strongly than other colors, which is why the sky appears blue."

[1249] 4. Submit your response

[1250] The server sends the generated answer to the terminal, specifically, by returning data using an HTTP response.

[1251] 5. View Answers

[1252] The terminal displays the received answer to the user, specifically, as text on the screen.

[1253] 6. Reading requests accepted

[1254] A parent uses a device to request the system to read aloud, for example by typing, "I'd like you to read aloud to my child today."

[1255] The terminal receives the input request and proceeds to the next processing step.

[1256] 7. Reading Choices

[1257] The server analyzes the received request and selects stories that it predicts the child will like, based on past history and popular stories.

[1258] 8. Narrative Generation

[1259] The server inputs the selected story into the generation AI model as a prompt, for example, "Generate a story that children will like."

[1260] The generative AI model generates narrative text based on the prompt.

[1261] 9. Speech Synthesis

[1262] The server inputs the generated story text into speech synthesis software (e.g., Google Text-to-Speech) to generate audio data.

[1263] 10. Transmission of audio data

[1264] The server sends the generated audio data to the device. Specifically, it returns the data using an HTTP response.

[1265] 11. Reading aloud

[1266] The device then plays the received audio data and reads the story to the child. Specifically, the device's speaker is used to play the audio.

[1267] Specific examples

[1268] Example questions

[1269] User: "Why is the sky blue?"

[1270] Prompt for generative AI model: "A child asks, 'Why is the sky blue?' Generate a scientific answer."

[1271] Example of a reading request

[1272] Parent: "I'd like you to read to me today."

[1273] Prompt for generative AI model: "Generate a story that children will enjoy."

[1274] In this way, the system can provide scientific answers to children's questions and read to them at the parents' request.

[1275] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1276] Step 1:

[1277] A user uses a terminal to input a question into the system. For example, a child might ask, "Why is the sky blue?" The input is in text format, and the terminal receives this input. Specifically, the user enters the question into the input field on the terminal and presses the send button.

[1278] Step 2:

[1279] The terminal sends the received question to the server. Specifically, it sends data to the server using an HTTP request. The input is the user's question text, and the output is the request sent to the server. Specifically, the terminal sends the question text to the server in the body of the HTTP request.

[1280] Step 3:

[1281] The server analyzes the received question and creates a prompt for the generative AI model. The input is the user's question text, and the output is the prompt for the generative AI model. Specifically, the server generates the prompt: "A child asked, 'Why is the sky blue?' Please generate a scientific answer."

[1282] Step 4:

[1283] The server inputs a prompt into a generative AI model (e.g., GPT-4) and generates an answer. The input is the prompt, and the output is the generated answer text. Specifically, the server sends the prompt to the generative AI model and receives a response from the model. The generated answer will be something like, "The sky is blue because sunlight is scattered by molecules in the atmosphere. Blue light in particular is scattered more strongly than other colors, which is why the sky appears blue."

[1284] Step 5:

[1285] The server sends the generated answer to the terminal. Specifically, it returns data using an HTTP response. The input is the generated answer text, and the output is sending the response to the terminal. As a specific operation, the server includes the answer text in the body of the HTTP response and sends it to the terminal.

[1286] Step 6:

[1287] The terminal displays the received answer to the user. Specifically, it displays it as text on the screen. The input is the answer text from the server, and the output is what is displayed to the user. Specifically, the terminal displays the received answer text in a text area on the screen.

[1288] Step 7:

[1289] A parent uses a device to request the system to read to their child. For example, they might enter, "I'd like you to read to me today." The input is in text format, and the device receives this input. Specifically, the parent enters the request in the device's input field and presses the send button.

[1290] Step 8:

[1291] The terminal sends the received request to the server. Specifically, it sends data to the server using an HTTP request. The input is the parent's request text, and the output is the request sent to the server. Specifically, the terminal includes the request text in the body of the HTTP request and sends it to the server.

[1292] Step 9:

[1293] The server analyzes the received request and selects a story that it predicts the child will like. Selection criteria are based on past history and popular stories. The input is the parent's request text, and the output is the selected story text. Specifically, the server searches for and selects an appropriate story from the database.

[1294] Step 10:

[1295] The server inputs the selected story as a prompt to the generative AI model. For example, the prompt might be, "Generate a story that children will like." The input is the selected story text, and the output is the generated story text. Specifically, the server sends the prompt to the generative AI model and receives a response from the model.

[1296] Step 11:

[1297] The server inputs the generated story text into speech synthesis software (e.g., Google Text-to-Speech) to generate voice data. The input is the generated story text, and the output is voice data. In concrete terms, the server sends the story text to the speech synthesis software and receives the voice data.

[1298] Step 12:

[1299] The server sends the generated audio data to the terminal. Specifically, it returns the data using an HTTP response. The input is the generated audio data, and the output is sending the response to the terminal. Specifically, the server includes the audio data in the body of the HTTP response and sends it to the terminal.

[1300] Step 13:

[1301] The device plays the received audio data and reads to the child. Specifically, the audio is played using the device's speaker. The input is audio data from the server, and the output is audio playback. Specifically, the device decodes the received audio data and plays it back from the speaker.

[1302] (Application example 2)

[1303] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1304] Conventional children's educational support systems and reading systems are limited to use at home, and are not suitable for providing educational support or explaining work procedures to new employees or apprentice workers in factories. Furthermore, educational support in factories requires detailed explanations of operation procedures and work procedures, and an efficient method for doing this is required.

[1305] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to parents, means for parents to ask questions about child-rearing to the generative AI and provide answers, means for providing educational support and reading to children, means for analyzing children's speech and providing advice to parents, means for supporting the safe purchase of related products, means for explaining work procedures and machine operation methods to new employees and apprentice workers in a factory, means for explaining detailed operating procedures when new employees ask questions, and means for explaining the day's work procedures when requested by the factory manager. This makes it possible to efficiently provide educational support and reading to children at home, as well as educational support and explanations of work procedures to new employees and apprentice workers in a factory.

[1306] "Generative AI" is a system that uses artificial intelligence technology to generate answers and information in natural language based on user input.

[1307] "Analyzing the meaning of a child's behavior" means analyzing a child's behavioral patterns and the content of their statements to understand the intentions and emotions behind them.

[1308] "Providing to parents" means presenting the analysis results and advice to parents.

[1309] "Questions about child rearing" are questions and inquiries that parents have about raising and educating their children.

[1310] "Supporting children's education" means providing information and activities to help children learn and develop.

[1311] "Reading aloud" means reading stories or picture books aloud to children.

[1312] "Analyzing children's speech" means analyzing what a child says and generating appropriate advice based on that content.

[1313] "Providing advice to parents" means giving advice to parents based on their child's behavior and comments.

[1314] "Supporting the safe purchase of related products" means providing information and support so that products related to child-rearing can be purchased safely.

[1315] "Explaining work procedures and how to operate machines to new employees and apprentice workers in the factory" means teaching new employees working in the factory specific work procedures and how to operate machines.

[1316] "Explaining detailed operating procedures when new employees ask questions" means providing detailed explanations of operating procedures when newly hired employees ask questions about how to operate a machine.

[1317] "Explaining the work procedures for the day when requested by the factory manager" means providing a clear explanation of the specific work procedures when the factory manager requests an explanation of the work procedures for the day.

[1318] The system for implementing this invention includes functions that use generative AI to analyze the meaning of children's behavior and provide the results to parents, a function that allows parents to ask generative AI questions about child-rearing and provide answers, a function that provides educational support and reading to children, a function that analyzes children's speech and provides advice to parents, a function that helps parents purchase related products with peace of mind, a function that explains work procedures and how to operate machines to new employees and apprentice workers in the factory, a function that explains detailed operating procedures when new employees ask questions, and a function that explains the day's work procedures when requested by the factory manager.

[1319] The server contains software for running the generative AI model, specifically a Python program and the OpenAI API. The server receives input from the user, sends it as prompts to the generative AI model, and returns the generated answers to the user.

[1320] The terminals include robots (such as Pepper and Nao) that can move around the factory. The robots output answers from the server as voice and provide explanations to the user. The robots convert the user's questions into text using voice recognition technology and send the text to the server.

[1321] Users input questions through their devices and receive answers from the generative AI model. For example, if a new employee asks, "How do I operate this machine?", the server sends the question to the generative AI model as a prompt, and the robot outputs the generated answer aloud.

[1322] As a concrete example, if a new employee asks, "How do I operate this machine?", the prompt would be as follows:

[1323] How do I operate this machine?

[1324] In this way, it is possible to efficiently provide educational support and explanations of work procedures to new employees and apprentice workers in factories, as well as educational support and reading aloud to children at home.

[1325] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1326] Step 1:

[1327] A user inputs a question into a terminal. For example, a new employee might ask, "How do I operate this machine?" This input is converted into text using speech recognition technology. The input data is voice data, and the output data is text data.

[1328] Step 2:

[1329] The terminal transmits the question converted into text to the server. The input data is text data, and the output data is a request to the server.

[1330] Step 3:

[1331] The server sends the received question as a prompt to the generative AI model. The input data is text data, and the output data is a request to the generative AI model.

[1332] Step 4:

[1333] A generative AI model generates an answer based on a prompt sentence. The input data is the prompt sentence, and the output data is the generated answer text.

[1334] Step 5:

[1335] The server receives the generated answer and sends it to the terminal. The input data is the generated answer text, and the output data is the response to the terminal.

[1336] Step 6:

[1337] The terminal converts the received answer into speech and outputs it to the user. The input data is the answer text, and the output data is speech data.

[1338] Step 7:

[1339] The user listens to the voice output from the terminal and gets the answer to the question. The input data is the voice data, and the output data is the user's understanding.

[1340] In this way, a series of processes is realized in which a user inputs a question and obtains an answer using a generative AI model.

[1341] Example 3

[1342] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1343] Modern parents find it difficult to find appropriate ways to respond to their children's behavior and comments. It is also difficult to obtain reliable information on educational support, reading aloud, and even purchasing related products. This often leaves parents with many anxieties and questions about raising children.

[1344] The identification process by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means. In this invention, the server includes a means for analyzing the meaning of a child's behavior using a generative AI and providing the parent with the results, a means for parents to ask questions about child-rearing to the generative AI and provide answers, a means for providing educational support and reading to the child, a means for analyzing the child's comments and providing advice to the parent, and a means for parents to select a reliable online shop and provide a purchase link when purchasing related products. This allows parents to know appropriate ways to respond to their child's behavior and comments, making it easier to provide educational support and reading to the child. It also enables parents to make safe selections when purchasing related products.

[1345] "Generative AI" is a system that uses artificial intelligence technology to analyze data and generate information and answers tailored to specific purposes.

[1346] "Analyzing the meaning of children's behavior" is the process of collecting data on children's behavior and words and analyzing them to understand their content and intentions.

[1347] "Providing to the parent" means presenting the analysis results and generated information to the parent.

[1348] "Questions about child rearing" are questions about doubts and problems that parents have in raising their children.

[1349] "Providing answers" means that the generative AI generates and presents appropriate answers to questions from parents.

[1350] "Educational support" refers to support activities to help children learn and develop.

[1351] "Reading aloud" is the act of parents reading books or stories aloud to their children.

[1352] "Analyzing children's utterances" is the process of collecting the words children say as data and analyzing them to understand their content and emotions.

[1353] "Providing advice to parents" means providing appropriate advice or suggestions to parents based on the analysis results.

[1354] "Related products" are products related to child rearing and children's education.

[1355] A "reliable online shop" is an online sales site that has a high reputation for quality and service.

[1356] "Providing a purchase link" means generating and presenting a link for the parent to purchase the related product.

[1357] MODE FOR CARRYING OUT THE INVENTION

[1358] The present invention is a system that analyzes a child's words and actions and provides appropriate advice and support to parents. A specific embodiment of this system will be described below.

[1359] 1. Generating the system program

[1360] The server analyzes the child's speech and generates a program to provide advice to parents. This program uses natural language processing (NLP) technology to analyze the child's speech and generate appropriate advice. It also includes a function to assist parents in purchasing related products.

[1361] 2. Hardware and Software Used

[1362] The server uses high-performance CPU and GPU hardware, and uses Python, TensorFlow, and natural language processing libraries (e.g., spaCy, NLTK) as software.

[1363] 3. Data processing and calculation

[1364] The server processes and calculates data in the following procedure.

[1365] 1. Input of child's statements:

[1366] The user (parent) uses a device (smartphone or PC) to input their child's comments into the system. For example, they might input "I hate school."

[1367] 2. Speech analysis:

[1368] The server analyzes the inputted speech using a natural language processing library, performing morphological analysis and sentiment analysis to extract the content and sentiment of the speech.

[1369] 3. Generating Advice:

[1370] The server generates advice for parents based on the analysis results, such as "Your child may be having problems at school."

[1371] 4. Related product purchasing assistance:

[1372] When a user (parent) requests the system to "purchase a picture book for their child," the server selects a reliable online shop and helps the parent make a purchase with peace of mind.

[1373] 4. Examples and prompts

[1374] As a concrete example, consider the following scenario.

[1375] Scenario 1: Your child says, "I hate school."

[1376] Enter: "I hate school."

[1377] Analysis result: The content of the statement was "school," and the emotion was "dislike."

[1378] Advice: "Your child may be having some issues with school."

[1379] Scenario 2: A parent requests to purchase a picture book for their child.

[1380] Enter: "I want to buy a picture book for my child."

[1381] Analysis result: The desired product is a picture book

[1382] Purchase assistance: We select reliable online stores and provide purchase links

[1383] Example prompt sentence:

[1384] "My child hates school. What should I do?"

[1385] "I want to buy a picture book for my child, where can I buy it?"

[1386] In this way, the server is a system that analyzes inputs from the user and provides appropriate advice and purchasing support. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1387] Step 1:

[1388] The user inputs the child's comments. The user inputs the child's comments in text format using a device such as a smartphone or PC. For example, the user might input "I hate school" and press the send button. The input data is saved as text data on the device.

[1389] Step 2:

[1390] The device sends the input data to the server. The device encrypts the input text data and sends it to the server. The transmitted data is received by the server and prepared for analysis.

[1391] Step 3:

[1392] The server analyzes the utterance. The server analyzes the received text data using a natural language processing library (e.g., spaCy, NLTK). Specifically, it performs morphological analysis to extract the content of the utterance (e.g., "school") and the emotion (e.g., "dislike"). As a result of analyzing the input data, a pair of utterance content and emotion is generated.

[1393] Step 4:

[1394] The server generates advice. Based on the analysis results, the server uses a generative AI model to generate advice for parents. For example, the server generates advice such as, "Your child may be having problems with school." The generated advice is saved as text data.

[1395] Step 5:

[1396] The server sends advice to the terminal. The server encrypts the advice it generates and sends it to the terminal. The transmitted data is received by the terminal and prepared for display.

[1397] Step 6:

[1398] The device displays the advice to the user. The device displays the received advice to the user. The user can check the advice on the device screen. The displayed advice serves as reference information for the user to deal with their child's problems.

[1399] Step 7:

[1400] The user requests the purchase of a related product. The user uses the terminal to input a purchase request in text format, such as "I would like to purchase a picture book for my child," and presses the send button. The input data is saved as text data on the terminal.

[1401] Step 8:

[1402] The terminal sends a purchase request to the server. The terminal encrypts the entered purchase request and sends it to the server. The transmitted data is received by the server and prepared for analysis.

[1403] Step 9:

[1404] The server selects a reliable online shop. The server retrieves a list of reliable online shops from the database and selects the shop with the highest rating. The information of the selected shop is saved as text data.

[1405] Step 10:

[1406] The server generates a purchase link and sends it to the device. The server generates a purchase link for the selected online shop, encrypts it, and sends it to the device. The transmitted data is received by the device and prepared for display.

[1407] Step 11:

[1408] The device displays the purchase link to the user. The device displays the received purchase link to the user. The user can click the link and make the purchase with confidence. The displayed link serves as reference information for the user to purchase related products.

[1409] (Application example 3)

[1410] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1411] Today's parents are seeking information and advice to understand their children's behavior and comments and respond appropriately. However, it is not easy to accurately analyze children's comments and actions and provide appropriate advice. It is also difficult to find a reliable source of information that allows parents to purchase related products for their children with peace of mind. To solve these issues, a system is needed that analyzes children's comments and actions and provides appropriate advice to parents.

[1412] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1413] In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to parents, means for parents to ask the generative AI questions about child-rearing and provide answers to those questions, means for providing educational support and reading to children, means for analyzing children's speech and providing advice to parents, means for supporting the safe purchase of related products, means for converting children's speech into text using speech recognition technology, means for analyzing children's speech using natural language processing, means for providing appropriate advice to parents based on the analysis results, and means for recommending reliable online shops for products specified by parents. This enables parents to accurately understand their children's speech and behavior, receive appropriate advice, and purchase related products with peace of mind.

[1414] "Generative AI" is a system that uses artificial intelligence technology to generate data and perform analysis and predictions.

[1415] "Means for analyzing the meaning of children's behavior" are techniques for observing children's behavior and understanding the intentions and emotions behind that behavior.

[1416] The "means of providing to parents" refers to a method for communicating the analysis results and advice to parents in an appropriate format.

[1417] "A means for parents to ask questions about child-rearing to a generative AI and have it provide answers" refers to a technology that allows parents to input questions about child-rearing into a generative AI, which then provides answers to those questions.

[1418] "Means of providing educational support and reading to children" refers to methods of providing educational content and reading to children to support their learning and development.

[1419] "Means for analyzing children's speech and providing advice to parents" refers to technology that analyzes the content of children's speech and provides appropriate advice to parents based on the results.

[1420] "Means to help parents purchase related products with confidence" refers to methods of providing reliable information about products that parents purchase for their children, and supporting them so that they can make purchases with confidence.

[1421] "Means of converting children's speech into text using voice recognition technology" refers to technology that analyzes children's speech and converts it into text format.

[1422] "Means for analyzing the content of children's statements using natural language processing" is a technology for analyzing children's statements converted into text and understanding their content.

[1423] The "means for recommending reliable online shops for products designated by parents" refers to a method for selecting and recommending reliable online shops for products that parents wish to purchase.

[1424] To implement this invention, the following system configuration is required. The system consists of a server, a terminal, and a user. The server uses generative AI, speech recognition technology, and natural language processing technology to analyze a child's comments and behavior and provide appropriate advice to parents. It also has a function to recommend reliable online shops that carry products specified by the parent.

[1425] Hardware and software used

[1426] Hardware: smartphone, server, microphone, speaker

[1427] Software: Python, speech_recognition library, transformers library

[1428] Data processing and calculation

[1429] 1. Speech recognition: The device (smartphone) records the child's speech with a microphone and sends the voice data to the server, which converts the voice data into text using the speech_recognition library.

[1430] 2. Natural language processing: The server uses the transformers library to analyze the text of the child's speech and understand its content. Specifically, it analyzes the emotion and intent of the child's speech.

[1431] 3. Providing advice: Based on the analysis results, the server generates appropriate advice for the parent and sends it to the device. The parent receives the advice via their smartphone.

[1432] 4. Product Recommendation: If a parent wants to purchase related products for their child, the server will recommend reliable online shops, and the parent will receive information about the recommended online shops via their smartphone.

[1433] Specific examples

[1434] For example, if a child says, "I hate school," the smartphone's microphone records the speech and sends it to a server. The server then converts the speech into text using speech recognition technology and analyzes it using natural language processing technology. Based on the analysis results, the server generates advice such as, "Your child may be having problems with school," and provides it to the parent.

[1435] Furthermore, when a parent requests the system to "purchase a picture book for their child," the server selects a reliable online shop and provides that information to the parent. The parent receives information about the recommended online shop via their smartphone, allowing them to make a purchase with peace of mind.

[1436] Prompt Sentence Examples

[1437] "Analyze what your child has said about school and offer advice to parents."

[1438] "Please recommend a reliable online store to purchase picture books for children."

[1439] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1440] Step 1:

[1441] The user (parent) starts the application on their smartphone and records what their child says. The application uses the smartphone's microphone to capture the audio data and sends it to the server.

[1442] Input: Child's voice

[1443] Output: Audio data (sent to server)

[1444] Step 2:

[1445] The server converts the received voice data into text using the speech_recognition library. Using speech recognition technology, it analyzes the voice data and generates corresponding text data.

[1446] Input: Audio data

[1447] Output: Text data

[1448] Step 3:

[1449] The server analyzes the text data using the transformers library, and uses natural language processing techniques to analyze the sentiment and intent of the text data and generate results.

[1450] Input: Text data

[1451] Output: Analysis results (emotions and intentions)

[1452] Step 4:

[1453] The server generates advice for parents based on the analysis results, using a generative AI to generate appropriate advice and sending it to the device in text format.

[1454] Input: Analysis results

[1455] Output: Advice (text format)

[1456] Step 5:

[1457] The device (smartphone) displays the advice received from the server to the user, who then checks the advice on the smartphone screen.

[1458] Input: Advice (text format)

[1459] Output: Display advice

[1460] Step 6:

[1461] The user (parent) inputs through a smartphone application that they would like to purchase related products for their child. The information about the products specified by the parent is sent to the server.

[1462] Input: Product purchase request (text format)

[1463] Output: Product information (sent to server)

[1464] Step 7:

[1465] The server selects reliable online shops based on the product information specified by the parent, uses generative AI to recommend appropriate online shops, and sends that information to the device.

[1466] Input: Product information

[1467] Output: Online store recommendations

[1468] Step 8:

[1469] The terminal (smartphone) displays the recommended online shop information received from the server to the user. The user can check the information of the recommended online shop on the smartphone screen and make a purchase with confidence.

[1470] Input: Online store recommendation information

[1471] Output: Display of online store information

[1472] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1473] "Example 1"

[1474] Generative AI observes and collects data on children's behavior and speech. It then uses an emotion engine to understand the child's emotional state. Specifically, it recognizes emotions such as joy, anger, sadness, and surprise from the child's facial expressions, tone of voice, and choice of words. The results of this emotion recognition provide important information for gaining a deeper understanding of the meaning of a child's behavior.

[1475] "Example 2"

[1476] The generative AI takes into account the child's emotional state when providing answers to questions from parents. For example, if the child expresses anger, it will provide the parent with advice on the cause and how to resolve it. If the child expresses joy, it will provide the parent with suggestions on how to further increase that joy.

[1477] "Example 3"

[1478] Generative AI takes into account a child's emotional state when providing educational support or reading to them. For example, if a child expresses sadness, it will read a comforting story. If a child expresses joy, it will suggest educational activities themed around that joy.

[1479] "Example 4"

[1480] The generative AI takes into account the child's emotional state when receiving a purchase request from a parent. For example, if a child breaks a toy indicating anger, it will suggest repurchasing the same toy. Also, if a child shows interest in a toy indicating joy, it will suggest purchasing that toy.

[1481] The processing flow of each embodiment will be described below.

[1482] "Example 1"

[1483] Step 1: The generative AI observes the child's behavior and speech and collects that data. Step 2: The generative AI inputs the collected data into the emotion engine.

[1484] Step 3: The emotion engine recognizes emotions such as joy, anger, sadness, and surprise from the child's facial expressions, tone of voice, and choice of words.

[1485] "Example 2"

[1486] Step 1: The generative AI receives a question from the parent.

[1487] Step 2: The generative AI takes into account the child's emotional state obtained from the emotion engine.

[1488] Step 3: The generative AI provides the parent with an answer that reflects the child's emotional state.

[1489] "Example 3"

[1490] Step 1: Generative AI provides educational support and reading to children.

[1491] Step 2: The generative AI takes into account the child's emotional state obtained from the emotion engine.

[1492] Step 3: The generative AI provides educational activities and stories that respond to the child's emotional state.

[1493] "Example 4"

[1494] Step 1: The generative AI receives a request from the parent to purchase a product.

[1495] Step 2: The generative AI takes into account the child's emotional state obtained from the emotion engine.

[1496] Step 3: The generative AI provides parents with product suggestions based on their child's emotional state.

[1497] Example 1

[1498] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1499] Conventional parenting support systems have had difficulty accurately analyzing the meaning of a child's behavior and utterances and providing the information to parents. Furthermore, they lacked a means of grasping a child's emotional state, making it difficult for parents to understand their child's true needs. Furthermore, when parents posed questions about parenting, they were unable to provide appropriate answers that took into account the child's age and developmental stage. To address these issues, the present invention aims to provide a system that analyzes the meaning of a child's behavior and utterances, grasps their emotional state, and provides appropriate information to parents.

[1500] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1501] In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to a parent, means for a parent to ask the generative AI questions about child-rearing and provide the answers, means for using an emotion engine to grasp the child's emotional state, means for observing the child's behavior and comments and collecting data, means for analyzing the collected data and extracting the meaning of the child's behavior and comments, and means for notifying the parent of the analysis results. This makes it possible to accurately analyze the meaning of a child's behavior and comments, grasp the emotional state, and provide appropriate information to the parent.

[1502] "Generative AI" is an artificial intelligence technology that analyzes children's behavior and words and extracts their meaning.

[1503] The "emotion engine" is a technology that recognizes and analyzes a child's emotional state from their facial expressions and tone of voice.

[1504] "Data collection methods" are means for observing and recording children's behavior and comments using hardware such as cameras and microphones.

[1505] "Data analysis means" refers to the means of inputting collected data into a generative AI model to analyze the meaning of children's behavior and statements.

[1506] The "meaning extraction method" is a means for integrating the analysis results of the generative AI model and the emotion engine to extract the meaning of children's actions and statements.

[1507] The "result notification means" is a means for notifying the parent of the analysis results, for example, by displaying a message on the parent's smartphone.

[1508] A "child-rearing support system" is a system that analyzes children's behavior and comments and provides parents with the meaning of these, thereby helping them raise their children more effectively.

[1509] MODE FOR CARRYING OUT THE INVENTION

[1510] This invention relates to a child-rearing support system that uses generative AI and an emotion engine. This system analyzes children's behavior and comments and provides their meaning to parents, thereby helping them raise their children more effectively.

[1511] Hardware and software used

[1512] The server uses the following hardware and software:

[1513] Camera: Used to record the child's facial expressions.

[1514] Microphone: Used to collect what the children say.

[1515] Generative AI model: Used to analyze children's actions and statements and extract their meaning.

[1516] Emotion engine: Used to recognize and analyze a child's emotional state from their facial expressions and tone of voice.

[1517] System Operation

[1518] The server uses a camera and microphone to observe the child's behavior and speech and collect data. The collected data is input into a generative AI model, which analyzes the meaning of the child's behavior and speech. Furthermore, an emotion engine is used to grasp the child's emotional state. This allows for a deeper understanding of the meaning of the child's behavior and speech.

[1519] The analysis results are sent to the parent via the device, and for example, a message such as "Your child is hungry and wants to eat" is displayed on the parent's smartphone.

[1520] Specific examples

[1521] As a concrete example, consider the case where a child says, "I'm hungry." In this case, the system operates as follows:

[1522] 1. Data collection: The server collects the child's utterance "I'm hungry" through a microphone. It also records the child's facial expressions using a camera.

[1523] 2. Data analysis: The collected voice data is input into a generative AI model. The generative AI model analyzes the voice data, such as "I'm hungry," and recognizes it as a "behavior requesting food."

[1524] 3. Emotion Recognition: The emotion engine analyzes the child's tone of voice and facial expression and recognizes it as "mild dissatisfaction due to hunger."

[1525] 4. Semantic extraction: The analysis results of the generative AI model and the emotion engine are integrated to conclude that "the child is hungry and is asking for food."

[1526] 5. Notification of results: The device notifies the parent of the analysis results sent from the server. A message saying "Your child is hungry and wants to eat" is displayed on the parent's smartphone.

[1527] Prompt Sentence Examples

[1528] An example of a prompt is as follows:

[1529] If a child says "I'm hungry," how does the system interpret this and notify the parent?

[1530] By inputting this prompt into the generative AI model, you can check the system's operation.

[1531] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1532] Step 1:

[1533] The server uses a camera and microphone to observe the child's behavior and speech and collect data. Specifically, the camera records the child's facial expressions and the microphone records the child's speech. The input data is the child's video and audio data. These data are used in the subsequent analysis steps.

[1534] Step 2:

[1535] The server inputs the collected video and audio data into a generative AI model. The generative AI model analyzes the audio data and extracts the meaning of the child's utterances. For example, it analyzes audio data such as "I'm hungry" and recognizes it as "a behavior requesting food." The output data is text data indicating the meaning of the utterance.

[1536] Step 3:

[1537] The server uses an emotion engine to analyze the collected video and audio data and understand the child's emotional state. The emotion engine recognizes emotions from the child's facial expressions and tone of voice. For example, if the child's tone of voice sounds dissatisfied, it will analyze it as "mild dissatisfaction due to hunger." The output data is text data that indicates the child's emotional state.

[1538] Step 4:

[1539] The server integrates the analysis results of the generative AI model and the emotion engine to gain a deeper understanding of the meaning of the child's actions and statements. Specifically, it combines the statement "I'm hungry" with the emotion recognition result of "mild dissatisfaction due to hunger" to conclude that "the child is hungry and is asking for food." The output data is text data that indicates the meaning of the behavior.

[1540] Step 5:

[1541] The device notifies the parent of the analysis results sent from the server. Specifically, it displays a message on the parent's smartphone saying, "Your child is hungry and wants to eat." The input data is the text data of the analysis results sent from the server, and the output data is the notification message displayed to the parent.

[1542] (Application example 1)

[1543] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1544] Today's parents often lack the time and knowledge to understand their children's behavior and emotions. In addition, there is no system that can analyze children's behavior and comments in real time and provide appropriate advice, making it difficult for parents to take appropriate measures in raising their children. Furthermore, there is a lack of systems that can provide answers that take into account the child's age and developmental stage when parents ask questions about raising children.

[1545] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1546] In this invention, the server includes means for recognizing a child's emotions using an emotion engine, a prompt sentence for instructing the server to analyze the meaning of the child's actions or comments based on the child's input actions or comments and the child's emotions, means for analyzing the meaning of the child's actions or comments using generative AI, and means for providing the analysis results to a parent via smart glasses, thereby enabling the parent to understand the child's actions and emotions in real time and take appropriate action. The server also includes a prompt sentence instructing the parent to answer a question about child-rearing input by the parent, a means for generating the answer using the generative AI, a means for providing the generated answer to the parent through the smart glasses, a prompt sentence instructing the parent to search for related products related to the generated answer, and a means for providing a link to purchase the related products using the generative AI.

[1547] "Generative AI" is an artificial intelligence technology that generates new information and answers based on data.

[1548] "Analyzing the meaning of a child's behavior" means observing a child's actions and words and understanding the intentions and emotions behind them.

[1549] "Providing to parents" means conveying the analysis results and advice to parents.

[1550] "Parents asking questions about child-rearing to generative AI" means that parents input their doubts and questions about child-rearing into artificial intelligence.

[1551] "Providing the answer" means that the generative AI generates an appropriate answer to the parent's question and conveys it to the parent.

[1552] "Supporting children's education" means providing activities and resources to help children learn and grow.

[1553] "Reading aloud" means conveying stories and information to children through audio.

[1554] "Analyzing a child's speech" means analyzing what a child says and understanding the intentions and emotions behind it.

[1555] "Providing advice to parents" means providing appropriate advice to parents based on the analysis results.

[1556] "Supporting the safe purchase of related products" means providing information and support so that products related to child-rearing can be purchased safely.

[1557] "Understanding a child's emotional state" means recognizing a child's emotions from their facial expressions, tone of voice, etc.

[1558] "Notifying parents" means informing parents of analysis results and important information.

[1559] "Smart glasses" are glasses-type devices equipped with a camera and a display that can display information and collect data.

[1560] "Real-time analysis" means processing data instantly and providing results immediately.

[1561] "Generating answers to parents' questions" means that the generative AI creates appropriate answers to questions entered by parents.

[1562] A system for implementing this invention uses generative AI to analyze a child's behavior and speech and provide the meaning to parents. The system includes smart glasses, a server, a generative AI model, an emotion recognition engine, and a function for generating answers to parental questions.

[1563] System Configuration

[1564] 1. Smart Glasses:

[1565] It is equipped with a camera and display that captures children's actions and comments in real time.

[1566] The video data is sent to the server.

[1567] 2. Server:

[1568] It receives video data and analyzes it using a generative AI model and emotion recognition engine.

[1569] It analyzes the meaning of a child's behavior and emotional state and notifies parents of the results.

[1570] It receives questions from parents and generates answers using a generative AI model.

[1571] 3. Generative AI Models:

[1572] This is a model for analyzing children's behavior and words and understanding their meaning.

[1573] Generate appropriate answers to questions from parents.

[1574] 4. Emotion Recognition Engine:

[1575] It is an engine that analyzes a child's facial expressions and tone of voice to understand their emotional state.

[1576] Data processing and calculation

[1577] Video Processing:

[1578] Video data acquired from the smart glasses camera is processed using OpenCV.

[1579] Facial recognition is performed to extract the child's facial expressions and behavior.

[1580] Emotion recognition:

[1581] The extracted facial data is analyzed using EmotionRecognizer to understand the child's emotional state.

[1582] Behavior analysis:

[1583] The meaning of a child's actions and statements is analyzed using a generative AI model based on a prompt that instructs the system to analyze the meaning of a child's actions or statements based on the child's actions or statements and their emotions.

[1584] The analysis results will be notified to the parents.

[1585] Question and answer generation:

[1586] It receives questions from parents and generates appropriate answers using a generative AI model.

[1587] Specific examples

[1588] If a child says, "I'm hungry," the system will notify the parent, "Your child seems hungry."

[1589] When a parent asks, "Why does my child cry in the middle of the night?" the system responds, "There are many reasons why a child might cry in the middle of the night. For example, they might be hungry, have a wet diaper, or be feeling unwell."

[1590] Example of prompt statement when parsing

[1591] "My child says, 'I'm hungry.' My child's emotion is, 'I'm lonely.' Please analyze the meaning of my child's behavior or statement."

[1592] In this way, the system of the present invention helps parents understand their children's behavior and emotions in real time and take appropriate measures.

[1593] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1594] Step 1:

[1595] The camera in the smart glasses captures footage of the child.

[1596] Input: Real-time video of child

[1597] Output: Video data

[1598] Specific operation: The camera in the smart glasses captures the child's actions and comments in real time and sends the video data to a server.

[1599] Step 2:

[1600] The server receives the video data and performs facial recognition using OpenCV.

[1601] Input: Video data

[1602] Output: Coordinate data of face area

[1603] Specific operation: The server receives the video data, detects faces in the video using OpenCV, and extracts the coordinate data of the face area.

[1604] Step 3:

[1605] The server inputs the facial region data into EmotionRecognizer to analyze the emotional state.

[1606] Input: Coordinate data of face area

[1607] Output: Emotional state data (e.g., happy, angry, sad)

[1608] Specific operation: The server inputs facial area data into EmotionRecognizer, which analyzes the child's facial expressions and tone of voice to understand their emotional state.

[1609] Step 4:

[1610] The server uses a generative AI model to analyze the meaning of a child's actions and comments.

[1611] Input: Video data, emotional state data

[1612] Output: Semantic data of the behavior (e.g. hungry, tired)

[1613] Specific operation: The server uses a generative AI model to analyze the child's behavior and comments and understand their meaning.

[1614] Step 5:

[1615] The server notifies the parent of the analysis results.

[1616] Input: Semantic data of actions

[1617] Output: Parent notification message

[1618] Specific operation: Based on the analysis results, the server generates an appropriate notification message for the parent and displays it on the smart glasses display or smartphone.

[1619] Step 6:

[1620] Parents send questions about child-rearing to the server via smart glasses or smartphones.

[1621] Input: Parent Question

[1622] Output: Question data

[1623] Specific operation: Parents use smart glasses or smartphones to input questions about child-rearing and send the question data to a server.

[1624] Step 7:

[1625] The server uses a generative AI model to generate answers to questions about child-rearing based on prompts entered by the parents that instruct the system to answer the questions.

[1626] Input: Question data

[1627] Output: Response data

[1628] Specific operation: The server uses a generative AI model to generate appropriate answers to the parent's questions.

[1629] Step 8:

[1630] The server notifies the parent of the generated answer.

[1631] Input: Response data

[1632] Output: Reply message to parent

[1633] Specific operation: Based on the answer generated by the server, an appropriate answer message is generated for the parent and displayed on the smart glasses display or smartphone.

[1634] In this way, through the specific actions and data flow that take place at each step, parents can understand their child's behavior and emotions in real time and take appropriate action. The server also uses a prompt sentence that instructs the user to search for related products related to the generated answer and a generative AI to generate data indicating a link to purchase the related products, and displays this data on the smart glasses display or smartphone.

[1635] Example 2

[1636] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1637] In modern child-rearing, parents are expected to understand their children's behavior and emotions and provide appropriate educational support and reading aloud. However, it is not easy for parents to accurately grasp their children's behavior and emotions and respond appropriately. It is also difficult to provide scientific answers to children's questions or advice that takes into account the child's emotional state. Furthermore, support is also needed to help parents purchase related products with confidence. A system that can solve these issues is needed.

[1638] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a means for analyzing the meaning of a child's behavior using a generative AI and providing the analysis result to the parent, a means for the parent to ask the generative AI questions about child rearing and provide the answers, a means for providing educational support and reading to the child, a means for analyzing the child's speech and providing advice to the parent, a means for providing advice to the parent taking into account the child's emotional state, and a means for supporting the parent in purchasing related products with peace of mind. This enables parents to accurately understand their child's behavior and emotions and respond appropriately. It is also possible to provide scientific answers to children's questions and advice that takes into account the child's emotional state. Furthermore, parents can receive support for purchasing related products with peace of mind.

[1639] "Generative AI" is an artificial intelligence system that uses natural language processing technology to generate text data and provide answers and advice to questions.

[1640] "Analyzing the meaning of a child's behavior" means analyzing a child's behavioral patterns and the content of their statements to understand the intentions and emotions behind them.

[1641] "Providing to parents" means notifying parents of the analysis results and generated information and providing support to parents in understanding their children's behavior and emotions.

[1642] "Questions about child-rearing" are questions that parents pose to generative AI about the doubts and problems they face in raising their children.

[1643] "Providing answers" means that the generative AI generates appropriate information and advice in response to questions from parents and notifies them.

[1644] "Educational support" means providing information and activities to promote children's learning and development.

[1645] "Reading aloud" means conveying stories and information that interest children through audio.

[1646] "Analyzing a child's speech" means analyzing the words and expressions a child uses and understanding their content and intentions.

[1647] "Providing advice to parents" means giving advice to parents to take appropriate action based on their child's behavior and emotions.

[1648] "Considering the child's emotional state" means recognizing the child's current emotions and providing responses and advice appropriate to those emotions.

[1649] "Supporting parents in purchasing related products with peace of mind" means providing appropriate information and recommendations so that parents can purchase child-rearing related products with peace of mind.

[1650] This invention is a system for supporting children's education and reading aloud, which uses generative AI to analyze children's behavior and emotions and provide appropriate information and advice to parents. Specific embodiments of this system are described below.

[1651] Hardware and software used

[1652] Hardware: Servers, devices (smartphones, tablets, PCs, etc.)

[1653] Software: Generative AI models (e.g., GPT-4), speech synthesis software (e.g., Google Text-to-Speech), facial expression recognition software

[1654] Handling Questions

[1655] 1. User: A child asks through the device, "Why is the sky blue?"

[1656] 2. Terminal: Receives the question as text data and sends it to the server.

[1657] 3. Server: Generates scientific answers to questions using generative AI models.

[1658] 4. Server: Sends the generated answer to the device.

[1659] 5. Device: The answers are converted into audio using speech synthesis software and provided to the child.

[1660] For example, if a child asks, "Why is the sky blue?" the prompt might look like this:

[1661] A child asks, "Why is the sky blue?" Generate a scientific answer.

[1662] Reading process

[1663] 1. User: The parent requests through the device, "I would like you to read to my child today."

[1664] 2. Terminal: Receives the request as text data and sends it to the server.

[1665] 3. Server: Uses a generative AI model to select stories that are predicted to be preferred by children.

[1666] 4. Server: Sends the selected story to the device.

[1667] 5. Device: The story is converted into audio using text-to-speech software and read to the child.

[1668] As a specific example, if a parent requests, "Please read to me today," the prompt would be as follows:

[1669] A parent has requested that you read a story to their child today. Please select a story that you think their child will enjoy.

[1670] Considering emotional states

[1671] 1. User: The child expresses emotions through the device (e.g., an angry facial expression is recognized by the camera).

[1672] 2. Device: Sends emotion data to the server.

[1673] 3. Server: Generates advice based on the emotional state using a generative AI model.

[1674] 4. Server: Sends the generated advice to the device.

[1675] 5. Device: Provide advice to parents.

[1676] For example, if a child is expressing anger, the prompt might be:

[1677] My child is showing signs of anger. Please provide some advice on why this is happening and how to resolve it.

[1678] This system allows parents to accurately understand their children's behavior and emotions and respond appropriately. It also provides scientific answers to their children's questions and offers advice that takes into account their emotional state. It also provides support for purchasing related products with peace of mind.

[1679] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1680] Handling Questions

[1681] Step 1:

[1682] User: A child asks through the device, "Why is the sky blue?"

[1683] Input: Child's voice

[1684] Output: Text data

[1685] What it does: A child speaks a question into the device, which uses voice recognition to convert the speech into text.

[1686] Step 2:

[1687] Terminal: Sends the question text data to the server.

[1688] Input: Text data

[1689] Output: HTTP request

[1690] Specific operation: The terminal sends the converted text data to the server as an HTTP request.

[1691] Step 3:

[1692] Server: Generates scientific answers to questions using generative AI models.

[1693] Input: Text data

[1694] Output: Answer text

[1695] Specific operation: The server inputs the prompt sentence "Why is the sky blue?" into the generative AI model and generates an answer.

[1696] Step 4:

[1697] Server: Sends the generated answer to the device.

[1698] Input: Answer text

[1699] Output: JSON format data

[1700] Specific operation: The server sends the generated answer in JSON format to the device.

[1701] Step 5:

[1702] Device: The answers are converted into audio using speech synthesis software and provided to the child.

[1703] Input: JSON data

[1704] Output: Audio data

[1705] What happens: The device parses the JSON data, gets the answer text, uses text-to-speech software to convert the answer into audio, and plays it back through the speaker.

[1706] Reading process

[1707] Step 1:

[1708] User: The parent requests through the device, "I'd like you to read to my child today."

[1709] Input: Parent voice

[1710] Output: Text data

[1711] Specific operation: The parent speaks a request into the device, and the device uses voice recognition to convert the speech into text.

[1712] Step 2:

[1713] Terminal: Sends the request content to the server as text data.

[1714] Input: Text data

[1715] Output: HTTP request

[1716] Specific operation: The terminal sends the converted text data to the server as an HTTP request.

[1717] Step 3:

[1718] Server: Uses a generative AI model to select stories that children are predicted to like.

[1719] Input: Text data

[1720] Output: Narrative text

[1721] Specific operation: The server inputs the prompt "Please select a story your child likes" into the generative AI model and generates a story.

[1722] Step 4:

[1723] Server: Sends the selected story to the device.

[1724] Input: Story text

[1725] Output: JSON format data

[1726] Specific operation: The server sends the generated story in JSON format to the device.

[1727] Step 5:

[1728] Device: The story is converted into audio using text-to-speech software and read to the child.

[1729] Input: JSON data

[1730] Output: Audio data

[1731] What it does: The device parses the JSON data to get the story text, uses text-to-speech software to convert the story into audio, and plays it back through the speaker.

[1732] Considering emotional states

[1733] Step 1:

[1734] User: The child expresses emotions through the device (e.g., an angry facial expression is recognized by the camera).

[1735] Input: Child's facial expression data

[1736] Output: Emotion data

[1737] What it does: A child expresses emotion in front of the device's camera. The device uses facial recognition software to capture the emotion data.

[1738] Step 2:

[1739] Device: Sends emotion data to the server.

[1740] Input: Emotion data

[1741] Output: HTTP request

[1742] Specific operation: The device sends the acquired emotion data to the server as an HTTP request.

[1743] Step 3:

[1744] Server: Generates advice based on emotional state using a generative AI model.

[1745] Input: Emotion data

[1746] Output: Advice text

[1747] Specific operation: The server inputs the prompt sentence "My child is showing signs of anger. Please generate advice about the cause and how to resolve it" into the generative AI model, and generates advice.

[1748] Step 4:

[1749] Server: Sends the generated advice to the device.

[1750] Input: Advice text

[1751] Output: JSON format data

[1752] Specific operation: The server sends the generated advice in JSON format to the device.

[1753] Step 5:

[1754] Device: Providing advice to parents.

[1755] Input: JSON data

[1756] Output: Text message

[1757] Specific behavior: The device parses the JSON data, obtains the advice text, and displays the advice as a text message to the parent.

[1758] (Application example 2)

[1759] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1760] Modern parents spend a lot of time and effort educating their children and managing their emotions, but it is often difficult to obtain appropriate information and support. Providing scientific answers to questions that interest children and properly understanding and responding to their children's emotional states are also challenges. Furthermore, selecting stories that children like and reading them aloud can be a burden for parents. To solve these challenges, a comprehensive support system that parents can easily use is needed.

[1761] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1762] In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to parents, means for parents to ask the generative AI questions about child rearing and provide answers to those questions, means for providing educational support and reading to children, means for analyzing children's speech and providing advice to parents, means for supporting the safe purchase of related products, means for generating and providing scientific answers to children's questions, means for analyzing children's emotional states and providing appropriate advice to parents, and means for selecting children's favorite stories and reading them aloud. This allows parents to easily receive comprehensive support for their children's education and emotional management.

[1763] "Generative AI" is a system that uses artificial intelligence technology to generate data and perform specific tasks.

[1764] "Analyzing the meaning of a child's behavior" means analyzing a child's actions and words and understanding the intentions and emotions behind them.

[1765] "Providing to the parent" means communicating the analysis results and information to the parent.

[1766] "Questions about child rearing" are questions and inquiries that parents have about raising and educating their children.

[1767] "Providing an answer" means presenting appropriate information or a solution to a question.

[1768] "Supporting children's education" means providing support to help children learn and grow.

[1769] "Reading aloud" means reading a story or text aloud.

[1770] "Analyzing children's speech" means analyzing what a child says and understanding its meaning and emotions.

[1771] "Providing advice to parents" means providing appropriate advice or suggestions to parents based on the analysis results.

[1772] "Supporting the safe purchase of related products" means supporting children and parents in safely purchasing products that are appropriate for them.

[1773] "Generating and providing scientific answers" means creating and providing scientifically based answers to children's questions.

[1774] "Analyzing a child's emotional state" means understanding a child's emotions and assessing their state.

[1775] "Providing appropriate advice" means giving advice and suggestions to parents that are appropriate to their emotional state.

[1776] "Choosing stories that children will like" means selecting appropriate stories based on the child's interests and preferences.

[1777] "Reading aloud" means reading a selected story aloud.

[1778] The system for carrying out this invention uses generative AI to support children's education and manage their emotions. Specific embodiments are described below.

[1779] System Configuration

[1780] The system uses the following hardware and software:

[1781] Hardware: smartphone, microphone, speaker

[1782] Software: OpenAI API, SpeechRecognition library, gTTS library, playsound library

[1783] Program processing overview

[1784] The server uses generative AI to:

[1785] 1. A means of analyzing the meaning of children's behavior and providing it to parents: Analyze children's behavior and words, understand the intentions and emotions behind them, and provide the results to parents.

[1786] 2. A means for parents to ask questions about child-rearing to a generative AI and receive answers: When parents input questions about child-rearing, the generative AI generates appropriate answers and provides them to the parents.

[1787] 3. A means of providing educational support and reading to children: Generative AI will provide educational support to children, select stories that children like, and read them aloud.

[1788] 4. A means of analyzing children's speech and providing advice to parents: Analyzes children's speech and provides appropriate advice to parents based on the results.

[1789] 5. Measures to help ensure safe purchasing of relevant products: Support children and parents in safely purchasing appropriate products.

[1790] 6. Means of generating and providing scientific answers to children's questions: Means of generating and providing scientifically based answers to children's questions.

[1791] 7. A means of analyzing a child's emotional state and providing appropriate advice to parents: A means of analyzing a child's emotional state and providing appropriate advice to parents based on the results.

[1792] 8. A means of selecting stories that children like and reading them aloud: Generative AI will select stories that children like and read them aloud.

[1793] Specific examples

[1794] Here are some concrete usage examples:

[1795] 1. Question and Answer Function:

[1796] If a child asks, "Why is the sky blue?", the generative AI might answer, "The sky is blue because sunlight is scattered by molecules in the atmosphere."

[1797] Example prompt: "A child asked: Why is the sky blue? Provide a scientific answer."

[1798] 2. Reading function:

[1799] If a parent requests, "I'd like you to read to my child today," the generative AI will select the story of "Momotaro" and read it aloud.

[1800] Example prompt: "Choose one story that your child likes."

[1801] 3. Emotional state analysis and advice:

[1802] If a child shows signs of anger, the generative AI generates a prompt such as, "The child is showing signs of anger. What advice would you offer to the parents?" and provides appropriate advice.

[1803] Example prompt: "Your child is displaying angry emotions. What advice would you offer the parents?"

[1804] This makes it easier for parents to receive comprehensive support for their children's education and emotional management.

[1805] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1806] Step 1:

[1807] The user uses a smartphone to voice-input questions for their child or requests for reading aloud, and the voice data is collected through the smartphone's microphone.

[1808] Step 2:

[1809] The device converts the collected voice data into text data using the SpeechRecognition library. Voice data is the input and text data is the output.

[1810] Step 3:

[1811] The device analyzes the converted text data and identifies the question or reading request, such as "Why is the sky blue?" or "I'd like you to read to me today."

[1812] Step 4:

[1813] The device sends the identified question or request to the generative AI model, which then uses the OpenAI API to generate a prompt and generate an appropriate answer or story. An example of a prompt is, "A child asked: Why is the sky blue? Please provide a scientific answer."

[1814] Step 5:

[1815] The server receives the answers and stories from the generative AI model and sends them to the terminal as text data. The answers and stories generated by the generative AI model are the output.

[1816] Step 6:

[1817] The device converts the received text data into voice data using the gTTS library. The text data is the input and the voice data is the output.

[1818] Step 7:

[1819] The device then plays the converted audio data through a speaker, allowing the user to listen to the answers to their child's questions and the reading aloud.

[1820] Step 8:

[1821] The server analyzes the input data from the user to analyze the emotional state of the child, for example, if the child is showing an angry emotion, it identifies the emotional state.

[1822] Step 9:

[1823] The server generates appropriate advice for the parent based on the identified emotional state. Using a generative AI model, it generates a prompt sentence such as "The child is showing angry emotions. What advice would you give to the parent?" and generates appropriate advice.

[1824] Step 10:

[1825] The server sends the generated advice as text data to the device, which then converts it into audio data and plays it back, allowing parents to receive appropriate audio advice for their child's emotional state.

[1826] Example 3

[1827] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1828] Conventional parenting support systems have difficulty properly analyzing children's comments and emotional states and providing specific advice to parents. Furthermore, when assisting parents in purchasing related products, they lacked suggestions that took into account the child's emotional state. This made it difficult for parents to properly understand and respond to their children's problems, and they could not purchase products with confidence.

[1829] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1830] In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to parents, means for parents to ask the generative AI questions about child-rearing and provide answers to the questions, means for providing educational support and reading to children, means for analyzing children's speech and providing advice to parents, means for supporting parents in purchasing related products with peace of mind, means for converting children's speech into text using speech recognition software, means for analyzing text data using a natural language processing library, means for generating advice using a generative AI model based on the analysis results, means for providing the generated advice to parents, means for receiving product purchase requests from parents and making product suggestions taking into account the child's emotional state, and means for selecting reliable online shops and providing purchase links. This makes it possible to appropriately analyze children's speech and emotional state and provide specific advice to parents, and by making product suggestions taking into account the child's emotional state, parents can purchase products with peace of mind.

[1831] "Generative AI" is a system that uses artificial intelligence technology to generate data and then analyze and make suggestions.

[1832] "Analyzing the meaning of a child's behavior" means analyzing a child's actions and words to understand the intentions and emotions behind them.

[1833] "Providing to parents" means notifying or displaying the analysis results and suggestions to parents.

[1834] "Questions about child rearing" are inquiries about doubts and problems that parents have regarding child rearing.

[1835] "Providing answers" means that the generative AI responds to parents' questions with appropriate information and advice.

[1836] "Educational support" means providing activities and resources to help children learn and grow.

[1837] "Reading aloud" means reading a story or text aloud to a child.

[1838] "Analyzing a child's speech" means analyzing what a child says and understanding its meaning and emotions.

[1839] "Providing advice to parents" means giving specific advice or suggestions to parents based on the analysis results.

[1840] "Supporting the safe purchase of related products" means selecting reliable purchasing sources and supporting parents so that they can purchase products with peace of mind.

[1841] "Speech recognition software" is software for converting voice data into text data.

[1842] "Converting to text" means converting audio data into text information.

[1843] A "natural language processing library" is a software library for analyzing text data and extracting meaning and emotion.

[1844] "Analyzing" means analyzing data to understand its meaning and patterns.

[1845] A "generative AI model" is an algorithm or model that is at the core of generative AI, and generates data and performs analysis and proposals.

[1846] "Generating advice" means creating specific advice or suggestions for parents based on the analysis results.

[1847] A "request to purchase a product" is a parent's wish or request to purchase a specific product.

[1848] "Considering the emotional state" means understanding the child's current emotions and moods and responding appropriately based on those.

[1849] "Making product suggestions" means recommending appropriate products based on the parent's requests and the child's emotional state.

[1850] A "reliable online shop" refers to a safe and trustworthy place to purchase products.

[1851] "Providing a purchase link" means providing a link to an online shop so that parents can easily purchase the product.

[1852] MODE FOR CARRYING OUT THE INVENTION

[1853] This invention is a system that analyzes a child's comments and emotional state and provides appropriate advice and product purchasing support to parents. A specific embodiment of this system is described below.

[1854] Hardware and software used

[1855] Hardware: Servers, devices (PCs, smartphones, tablets)

[1856] Software: Generative AI models (e.g., GPT-4), speech recognition software (e.g., Google Speech-to-Text), natural language processing libraries (e.g., spaCy)

[1857] System configuration

[1858] 1. Acquiring voice input

[1859] Users use a smartphone or tablet application to record their child's speech.

[1860] The terminal provides a record button and the user initiates the recording.

[1861] Once the recording is complete, the device sends the recording data to the server.

[1862] 2. Converting voice data to text

[1863] The server uses speech recognition software (e.g., Google Speech-to-Text) to convert the recording into text.

[1864] The server stores the converted text data.

[1865] 3. Text Data Analysis

[1866] The server uses a natural language processing library (e.g., spaCy) to parse the text data.

[1867] The server extracts the child's speech and emotional state from the text.

[1868] For example, extract the emotion "I hate school" from the statement "I hate school."

[1869] 4. Generating Advice

[1870] The server uses a generative AI model (e.g., GPT-4) to generate advice based on the analysis results.

[1871] For example, it generates advice such as "Your child may be having some problems at school."

[1872] 5. Providing advice

[1873] The server sends the generated advice to the terminal.

[1874] The terminal displays the advice to the user.

[1875] For example, it can be displayed as a smartphone notification or an in-app message.

[1876] 6. Assistance with purchasing products

[1877] A user enters a request to purchase a product into the system.

[1878] The terminal provides an input form, and the user inputs "I would like to purchase a picture book for my child."

[1879] The server uses the generated AI model to make product suggestions that take into account the child's emotional state.

[1880] For example, if your child expresses anger about breaking a toy, suggest buying the same toy again.

[1881] 7. Providing Purchase Links

[1882] The server selects a reliable online shop and generates a purchase link.

[1883] The server generates a purchase link and sends it to the device.

[1884] The device displays a purchase link to the user.

[1885] For example, you can be notified via a link within the app or by email.

[1886] Examples and prompts

[1887] Example 1: When a child says, "I don't like school"

[1888] Prompt: "What advice can I offer parents when their child says, 'I hate school'?"

[1889] Example 2: A parent requests, "I want to buy a picture book for my child."

[1890] Prompt: "If a parent asks to purchase a picture book for their child, explain how you would choose a reliable online store and provide them with a link to purchase."

[1891] In this way, the system can appropriately analyze the child's comments and emotional state, provide specific advice to the parents, and recommend products that take the child's emotional state into consideration, allowing the parents to purchase products with peace of mind.The flow of the identification process in Example 3 will be described with reference to Figure 21.

[1892] Program processing flow

[1893] Step 1: Getting voice input

[1894] Input: Child's speech

[1895] Output: Recording data

[1896] Specific behavior:

[1897] The user opens the application on their smartphone or tablet and taps the record button.

[1898] The user records what the child says.

[1899] Once the recording is complete, the device sends the recording data to the server.

[1900] Step 2: Convert audio data to text

[1901] Input: Recording data

[1902] Output: Text data

[1903] Specific behavior:

[1904] The server uses speech recognition software (e.g., Google Speech-to-Text) to convert the recording into text.

[1905] The server stores the converted text data.

[1906] Step 3: Analyzing the text data

[1907] Input: Text data

[1908] Output: Analysis results (content of speech, emotional state)

[1909] Specific behavior:

[1910] The server uses a natural language processing library (e.g., spaCy) to parse the text data.

[1911] The server extracts the child's speech and emotional state from the text.

[1912] For example, extract the emotion "I hate school" from the statement "I hate school."

[1913] Step 4: Generating Advice

[1914] Input: Analysis results (content of speech, emotional state)

[1915] Output: Advice

[1916] Specific behavior:

[1917] The server uses a generative AI model (e.g., GPT-4) to generate advice based on the analysis results.

[1918] For example, it generates advice such as "Your child may be having some problems at school."

[1919] Step 5: Providing advice

[1920] Input: Advice

[1921] Output: Parent notification

[1922] Specific behavior:

[1923] The server sends the generated advice to the terminal.

[1924] The terminal displays the advice to the user.

[1925] For example, it can be displayed as a smartphone notification or an in-app message.

[1926] Step 6: Help with purchasing products

[1927] Input: Parental purchase request

[1928] Output: Product proposal

[1929] Specific behavior:

[1930] The user enters "I would like to purchase a picture book for my child" into an input form within the app.

[1931] The terminal sends the input data to the server.

[1932] The server uses the generated AI model to make product suggestions that take into account the child's emotional state.

[1933] For example, if your child expresses anger about breaking a toy, suggest buying the same toy again.

[1934] Step 7: Provide a purchase link

[1935] Input: Product Proposal

[1936] Output: Purchase link

[1937] Specific behavior:

[1938] The server selects a reliable online shop and generates a purchase link.

[1939] The server generates a purchase link and sends it to the device.

[1940] The device displays a purchase link to the user.

[1941] For example, you can be notified via a link within the app or by email.

[1942] In this way, the system can properly analyze a child's comments and emotional state and provide specific advice to parents. It also makes product suggestions that take the child's emotional state into consideration, allowing parents to make purchases with peace of mind.

[1943] (Application example 3)

[1944] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1945] Conventional child-rearing support systems do not adequately consider a child's emotional state when proposing products or providing educational support, making it difficult for parents to choose appropriate products. Furthermore, there is a lack of specific advice and suggestions based on a child's emotional state, making it difficult for parents to respond in accordance with their child's emotions. This has led to the issue of it being difficult to provide support appropriate for a child's growth and development.

[1946] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1947] In this invention, the server includes means for analyzing the meaning of a child's behavior using a generative AI and providing the results to parents, means for parents to ask the generative AI questions about child rearing and provide answers, means for providing educational support and reading to children, means for analyzing children's speech and providing advice to parents, means for supporting the safe purchase of related products, means for suggesting optimal products taking into account the child's emotional state, and means for suggesting products based on the child's emotional state. This enables parents to select appropriate products according to their child's emotional state and provide support appropriate for their child's growth and development.

[1948] "Generative AI" is an artificial intelligence technology that generates new information and suggestions based on data.

[1949] "Analyzing the meaning of a child's behavior" means analyzing a child's actions and words and understanding the intentions and emotions behind them.

[1950] "Means to provide to parents" refers to a method or system for communicating analysis results and advice to parents.

[1951] "Questions about child-rearing" are questions and concerns that parents have about child-rearing.

[1952] "Means for providing answers" refers to the method or system by which generative AI generates and provides appropriate answers to parents' questions.

[1953] "Educational support and storytelling tools" are methods and systems for delivering educational activities and storytelling to help children learn and grow.

[1954] "Means for analyzing children's speech and providing advice to parents" refers to a method or system for analyzing the content of children's speech and providing appropriate advice to parents based on the results.

[1955] "Means to help parents purchase related products with peace of mind" refers to methods and systems that help parents select reliable online shops and make purchases with peace of mind when purchasing products for their children.

[1956] "Means for proposing optimal products taking into consideration a child's emotional state" refers to a method or system that analyzes a child's emotional state and proposes to parents the optimal products according to that state.

[1957] A "means for making product suggestions based on a child's emotional state" is a method or system for selecting and suggesting appropriate products based on a child's emotional state.

[1958] To implement this invention, it is necessary to build a system in which the server, terminals, and users work together. A specific embodiment of this system is shown below.

[1959] System Configuration

[1960] The server is equipped with a generative AI and has a means for analyzing the meaning of a child's behavior and providing the results to parents. It also has a means for parents to ask the generative AI questions about child rearing and receive answers. It also includes a means for supporting children's education and reading aloud, a means for analyzing children's speech and providing advice to parents, a means for supporting the safe purchase of related products, a means for suggesting optimal products taking into account the child's emotional state, and a means for suggesting products based on the child's emotional state.

[1961] Hardware and Software

[1962] The server is a computer with a powerful processor and large memory capacity, and is installed with software to run the generative AI model, specifically using machine learning libraries such as Python and TensorFlow, and a database that stores data on children's behavioral patterns and emotional states.

[1963] The device is a smartphone or tablet used by a parent, with a dedicated application installed, which provides an interface for parents to input questions about parenting and report on their child's emotional state.

[1964] Data processing and calculation

[1965] The server receives the child's behavioral and emotional state data sent from the device and analyzes it using a generative AI model. The analysis results are then provided to parents as appropriate advice and product suggestions. Specifically, the following data processing and calculations are performed:

[1966] 1. Analysis of children's behavioral data: Analyze children's behavior and words to understand the intentions and emotions behind them.

[1967] 2. Emotional state assessment: Evaluate the child's emotional state and suggest the most appropriate products and educational support based on that state.

[1968] 3. Product Suggestion: Based on the emotional state, select and suggest appropriate products to parents.

[1969] Specific examples

[1970] For example, if a child says, "I hate school," the device sends that statement to the server, which uses a generative AI model to interpret the statement as "sad" and suggest a "comforting picture book" or "stuffed toy" to the parent.

[1971] Example prompts to input to a generative AI model:

[1972] If your child says, "I hate school," what products would you suggest?

[1973] In this way, parents can choose the right product based on their child's emotional state and provide support appropriate for their child's growth and development.

[1974] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1975] Step 1:

[1976] The user (parent) uses a device (smartphone or tablet) to input information about the child's actions and comments.

[1977] Input: Child's behavior and speech data (e.g., "I hate school")

[1978] Output: Sending data from the device to the server

[1979] Step 2:

[1980] The device transmits the entered data on the child's behavior and speech to the server.

[1981] Input: Children's behavior and speech data

[1982] Output: Send data to the server

[1983] Step 3:

[1984] The server inputs the received data on the child's behavior and speech into a generative AI model for analysis.

[1985] Input: Children's behavior and speech data

[1986] Output: Analysis result (e.g. "sad")

[1987] How it works: The generative AI model analyzes data and assesses the child's emotional state.

[1988] Step 4:

[1989] The server generates advice and product suggestions for parents based on the analysis results.

[1990] Input: Analysis result (e.g. "sad")

[1991] Output: Advice or product suggestions (e.g., "Comforting picture books" or "Stuffed toys")

[1992] Specific operation: The generative AI model selects appropriate products and advice based on the emotional state.

[1993] Step 5:

[1994] The server transmits the generated advice and product suggestions to the terminal.

[1995] Input: Advice or product suggestion

[1996] Output: Sending data to the terminal

[1997] Step 6:

[1998] The terminal displays the received advice and product suggestions to the user (parent).

[1999] Input: Advice or product suggestion

[2000] Output: Display to parent

[2001] What it does: The device application displays advice and product suggestions in a parent-friendly format.

[2002] Step 7:

[2003] The user (parent) selects and purchases appropriate products based on the displayed advice and product suggestions.

[2004] Input: Advice or product suggestion

[2005] Output: Purchase decision

[2006] Specific action: The parent purchases the suggested product from an online shop.

[2007] In this way, the system can provide appropriate advice and product suggestions to parents based on their child's behavior and emotional state.

[2008] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2009] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generative AIs. Data generation models 58

[2010] , obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in the data format of voice data, text data, etc. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2011] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[2012] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[2013] [Third embodiment]

[2014] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[2015] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[2016] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2017] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[2018] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2019] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2020] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2021] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2022] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2023] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2024] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2025] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[2026] "Example 1"

[2027] One embodiment of the present invention is a child-rearing support system that uses generative AI. This system analyzes a child's behavior and speech and provides the parent with its meaning. For example, if a child says, "I'm hungry," the system interprets this as a "behavior requesting food" and communicates this meaning to the parent. Furthermore, if a parent asks the system a question such as, "Why does my child cry in the middle of the night?", the system generates an answer to that question and provides it to the parent.

[2028] "Example 2"

[2029] Furthermore, this system has the function of supporting children's education and reading aloud. For example, if a child asks, "Why is the sky blue?", the system will generate a scientific answer to the question and provide it to the child. Also, if a parent requests the system to read a story to them today, the system will select a story that it predicts the child will like and read it to them.

[2030] "Example 3"

[2031] The system also has the ability to analyze what children say and provide advice to parents. For example, if a child says, "I hate school," the system will analyze the comment and provide advice to the parents, such as, "Your child may have some problems with school."

[2032] "Example 4"

[2033] Furthermore, the system has a function to support the safe purchase of related products. For example, if a parent requests the system to purchase a picture book for their child, the system will select a reliable online shop and help the parent make a purchase with peace of mind.

[2034] The processing flow of each embodiment will be described below.

[2035] "Example 1"

[2036] Step 1: The generative AI observes the child's behavior and comments and collects them as data.

[2037] Step 2: Analyze the collected data and understand the meaning of the child's behavior.

[2038] Step 3: Provide the analysis results to the parent.

[2039] "Example 2"

[2040] Step 1: Receive a parent's request for educational support or reading aloud.

[2041] Step 2: Generate appropriate educational content and stories on demand.

[2042] Step 3: Provide the generated educational content and stories to parents and children.

[2043] "Example 3"

[2044] Step 1: Observe and collect data on children's talk.

[2045] Step 2: Analyze the collected data and understand the child's feelings and problems.

[2046] Step 3: Based on the analysis results, advice is generated for parents.

[2047] Step 4: Provide the generated advice to the parent.

[2048] "Example 4"

[2049] Step 1: Receive a request from a parent to purchase a product.

[2050] Step 2: Choose a reliable online store based on your requirements.

[2051] Step 3: Provide parents with the details of the online store they have chosen.

[2052] Example 1

[2053] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2054] In today's child-rearing environment, parents often find it difficult to understand the meaning of their children's actions and words, and are unable to respond appropriately. Furthermore, when parents ask questions about child-rearing, there are limited ways to get reliable answers. Furthermore, there is a lack of comprehensive child-rearing support, such as educational support, reading aloud to children, and support for purchasing related products.

[2055] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2056] In this invention, the server includes a means for analyzing the meaning of a child's behavior using generative AI and providing the results to parents; a means for parents to ask the generative AI questions about child-rearing and provide answers; a means for providing educational support and reading to the child; a means for analyzing the child's speech and providing advice to the parent; a means for supporting the parent in purchasing related products with peace of mind; a means for the device to collect the child's behavior and statements as voice and text data and send it to the server; a means for the server to input the received data into a generative AI model and provide the analysis results to the parent; and a means for notifying the parent of the analysis results and answers. This allows parents to quickly and accurately understand the meaning of their child's behavior and statements and take appropriate action. It also provides reliable parenting information and advice, providing comprehensive parenting support.

[2057] "Generative AI" is an artificial intelligence technology that generates new information and answers based on data.

[2058] "Analyzing the meaning of children's behavior" means collecting data on children's actions and words and understanding the intentions and demands behind them.

[2059] "Providing to parent" means notifying the parent of the analysis results and answers and making them available to the parent.

[2060] "Asking questions to the generative AI" means that parents input their doubts or queries about child-rearing into the system, and the generative AI receives those questions.

[2061] "Providing an answer" means that the generative AI generates an appropriate answer to the parent's question and notifies the parent of it.

[2062] "Educational support" means providing information and activities to help children learn and develop.

[2063] "Reading aloud" means providing children with stories or picture books in audio or text format.

[2064] "Analyzing a child's speech" means analyzing what a child says and understanding the intentions and emotions behind it.

[2065] "Providing advice to parents" means providing parents with appropriate ways of responding and advice based on the analysis of their child's behavior and comments.

[2066] "Supporting parents in purchasing related products with peace of mind" means providing information and support so that parents can purchase products related to child-rearing with peace of mind.

[2067] "Devices" are devices used to collect information about children's behavior and statements, such as smartphones and tablets.

[2068] "Collecting as audio or text data" means digitizing children's statements and actions in the form of audio recordings or text input.

[2069] A "server" is a computer system that receives collected data and analyzes it using a generative AI model.

[2070] "Inputting into a generative AI model" means passing the collected data to the generative AI model and starting the process for analysis.

[2071] "Providing the analysis results to the parent" means that the generative AI model notifies the parent of the analysis results and makes them available to the parent.

[2072] "Notifying the parent's device" means sending the analysis results and answers to the parent's smartphone or tablet as a push notification or message.

[2073] MODE FOR CARRYING OUT THE INVENTION

[2074] This invention is a child-rearing support system that uses a generative AI model to analyze children's behavior and comments and provide their meaning to parents. A specific embodiment of this system is described below.

[2075] System configuration

[2076] Hardware:

[2077] Server: A server equipped with a high-performance GPU (e.g., NVIDIA Tesla V100)

[2078] Device: a device such as a smartphone or tablet

[2079] software:

[2080] Generative AI model: Using OpenAI GPT-4 as an example

[2081] Data analysis tools: Python's Pandas library, etc.

[2082] Program processing

[2083] Data collection:

[2084] The device collects the child's actions and speech as audio and text data, for example, by using a microphone built into a smartphone or tablet to record what the child says.

[2085] Data transmission:

[2086] The device sends the collected data to a server, where it is encrypted and transmitted securely.

[2087] Data Analysis:

[2088] The server inputs the received data into a generative AI model, which converts the speech data into text and analyzes its meaning.

[2089] Result generation:

[2090] The server generates a message to provide to the parent based on the analysis results obtained from the generative AI model.

[2091] Result notification:

[2092] The server sends the generated message to the parent's device, and the parent receives the notification through the device.

[2093] Specific examples

[2094] Example 1:

[2095] Child says: "I'm hungry."

[2096] Process flow:

[2097] 1. The device records what the child says.

[2098] 2. The device sends the recorded audio data to the server.

[2099] 3. The server converts the voice data into text and inputs it into the generative AI model.

[2100] 4. The generative AI model analyzes "I'm hungry" as "the behavior of wanting food."

[2101] 5. The server generates the message "Your child wants food."

[2102] 6. The server sends the generated message to the parent device.

[2103] 7. Parents receive notifications via their devices.

[2104] Example 2:

[2105] Parents ask: "Why does my child cry in the middle of the night?"

[2106] Process flow:

[2107] 1. The parent enters a question through the terminal.

[2108] 2. The terminal sends the entered question to the server.

[2109] 3. The server inputs the question into the generative AI model.

[2110] 4. The generative AI model generates an answer to the question, such as "Children may cry in the middle of the night because they are hungry, scared, or unwell."

[2111] 5. The server sends the generated answer to the parent's device.

[2112] 6. Parents receive the answers via their device.

[2113] Example prompt sentence:

[2114] "When a child says, 'I'm hungry,' what does this mean?"

[2115] "Why does my child cry in the middle of the night?"

[2116] In this way, the system provides child-rearing support through collaboration between the server, terminals, and users.

[2117] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2118] Step 1: Data collection

[2119] The device collects the child's actions and comments as audio and text data, specifically by recording what the child says using a microphone built into the smartphone or tablet.

[2120] Input: Child's utterance (e.g., "I'm hungry")

[2121] Output: Recorded audio data

[2122] Step 2: Send data

[2123] The device sends the collected voice data to a server, where it is encrypted and transmitted securely.

[2124] Input: Recorded audio data

[2125] Output: Audio data sent to the server

[2126] Step 3: Data analysis

[2127] The server inputs the received voice data into a generative AI model, which converts the voice data into text and analyzes its meaning.

[2128] Input: Audio data sent to the server

[2129] Output: Analyzed text data (e.g., "I'm hungry" → "food-seeking behavior")

[2130] Step 4: Result Generation

[2131] The server generates a message to provide to the parent based on the analysis results obtained from the generative AI model.

[2132] Input: Parsed text data

[2133] Output: A message to provide to the parent (e.g., "Your child wants to eat")

[2134] Step 5: Notification of results

[2135] The server sends the generated message to the parent's device, and the parent receives the notification through the device.

[2136] Input: Message to provide to parent

[2137] Output: Notification displayed on parent's device (e.g. "Your child wants to eat")

[2138] In this way, the child-rearing support system functions by performing specific actions and inputting and outputting data at each step.

[2139] (Application example 1)

[2140] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2141] Modern parents face many challenges in raising children. In particular, they often find it difficult to understand the meaning of their children's actions and comments, which often makes it difficult to respond appropriately. It is also difficult to understand a child's needs and select appropriate products while shopping in a physical store. Furthermore, there is a lack of means to get quick and appropriate answers to questions about child-rearing. To solve these problems, a system is needed that analyzes children's actions and comments and provides parents with appropriate information.

[2142] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2143] In this invention, the server includes a means for analyzing the meaning of a child's behavior using generative AI and providing the results to parents, a means for parents to ask questions about child-rearing to the generative AI and receive answers, a means for providing educational support and reading to children, a means for analyzing children's speech and providing advice to parents, a means for analyzing children's needs while shopping in a physical store and suggesting appropriate products, and a means for supporting parents in purchasing related products with peace of mind. This makes it easier for parents to understand the meaning of their children's behavior and statements and respond appropriately. It also enables parents to understand their children's needs and select appropriate products while shopping in a physical store. Furthermore, it allows parents to receive prompt and appropriate answers to questions about child-rearing.

[2144] "Generative AI" refers to artificial intelligence that generates new information and answers based on data.

[2145] "Analyzing the meaning of a child's behavior" means analyzing a child's actions and words and understanding the intentions and needs behind them.

[2146] "Providing to parents" means communicating the analysis results and answers to parents.

[2147] "Asking questions to generative AI" means that parents input their doubts and queries about child-rearing into the artificial intelligence.

[2148] "Providing answers" means that the generative AI returns appropriate information and advice in response to parents' questions.

[2149] "Providing educational support and storytelling" means providing educational content and stories to help children learn and grow.

[2150] "Analyzing a child's speech" means analyzing in detail what the child says and understanding its meaning and background.

[2151] "Providing advice to parents" means providing appropriate responses and advice to parents based on their child's behavior and comments.

[2152] "Analyzing children's needs while shopping in a physical store" means analyzing children's behavior and comments in real time while shopping in a physical store to understand their needs.

[2153] "Suggesting appropriate products" means recommending products to parents that meet their child's needs based on the analysis results.

[2154] "Supporting parents in purchasing related products with confidence" means providing information and support so that parents can purchase products that meet their children's needs with confidence.

[2155] As an embodiment of the present invention, the following system can be constructed.

[2156] System Configuration

[2157] The system consists of a server equipped with generative AI, a smartphone used by parents, and a device used while shopping in a physical store. The server uses generative AI models to analyze children's behavior and comments and provide appropriate information to parents.

[2158] Hardware and software used

[2159] Hardware: Smartphones, servers, and in-store devices

[2160] Software: Python, OpenAI API, Database Management System

[2161] Data processing and calculation

[2162] 1. Analyze the meaning of your child's behavior:

[2163] Parents input their children's comments via their smartphones.

[2164] The server uses the OpenAI API to send prompt statements to the generative AI model and obtain the analysis results.

[2165] The analysis results are notified to the parent's smartphone.

[2166] 2. Parents ask questions about parenting to a generative AI that provides answers:

[2167] Parents enter questions via their smartphones.

[2168] The server sends questions to the generative AI model, which generates answers.

[2169] The answers are sent to the parent's smartphone.

[2170] 3. Analyze children's needs and suggest appropriate products while shopping in-store:

[2171] Devices in physical stores capture children's actions and comments in real time.

[2172] The server uses a generative AI model to analyze the child's needs and suggest appropriate products.

[2173] The suggested product information is displayed on the device and notified to the parent.

[2174] Specific examples

[2175] Child speech analysis:

[2176] If a child says "I'm hungry," the parent types the comment into their smartphone.

[2177] The server sends the prompt text "If a child says 'I'm hungry,' please analyze what that means." to the generative AI.

[2178] The generative AI analyzes this as "food seeking behavior" and notifies the parents.

[2179] Answers to parent questions:

[2180] A parent types in a question: "Why is my child crying in the middle of the night?"

[2181] The server sends the prompt "Please tell me why my child cries in the middle of the night" to the generative AI.

[2182] The generative AI responds, "Maybe he's hungry or he's having trouble sleeping," and notifies the parents.

[2183] In-store shopping assistance:

[2184] If a child says "I want a toy" in a physical store, the device will capture the statement.

[2185] The server sends the prompt statement "If a child says 'I want a toy,' please suggest a product that meets that need" to the generative AI.

[2186] The generative AI suggests appropriate products and displays them on the device.

[2187] This makes it easier for parents to understand the meaning of their children's actions and comments and respond appropriately. It also helps parents understand their children's needs and select appropriate products while shopping in physical stores. It also allows parents to get quick and appropriate answers to their child-rearing questions.

[2188] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2189] Step 1:

[2190] The user inputs the child's utterances using a smartphone. The input utterances are sent to the server. The input data is in text format, such as "I'm hungry."

[2191] Step 2:

[2192] The server generates a prompt based on the received utterance. The prompt takes the form "If a child says 'I'm hungry,' please analyze its meaning."

[2193] Step 3:

[2194] The server sends the generated prompt to the generative AI model using the OpenAI API. The generative AI model analyzes the prompt and generates an appropriate answer. The data processing here involves analyzing the prompt and generating an answer.

[2195] Step 4:

[2196] The server receives the answer from the generative AI model, and returns an analysis result such as "food-seeking behavior."

[2197] Step 5:

[2198] The server then notifies the user of the analysis results via a text message, which the user can then view on their smartphone.

[2199] Step 6:

[2200] A user uses a smartphone to input a question about child-rearing. The input question is sent to the server. The input data is in text format, and an example would be, "Why does my child cry in the middle of the night?"

[2201] Step 7:

[2202] The server generates a prompt based on the received question, such as "Please tell me why my child cries in the middle of the night."

[2203] Step 8:

[2204] The server sends the generated prompt to the generative AI model using the OpenAI API. The generative AI model analyzes the prompt and generates an appropriate answer. The data processing here involves analyzing the prompt and generating an answer.

[2205] Step 9:

[2206] The server receives the answer from the generative AI model, for example, "Maybe you're hungry, or maybe there's a reason you can't sleep."

[2207] Step 10:

[2208] The server then notifies the user of the received answer via a text message, which the user can then check on their smartphone.

[2209] Step 11:

[2210] While shopping in a physical store, the device captures what the child says. For example, if the child says, "I want a toy," that statement is entered into the device.

[2211] Step 12:

[2212] The device sends the received message to the server. The input data is in text format.

[2213] Step 13:

[2214] The server generates a prompt based on the received utterance. The prompt takes the form of "If a child says 'I want a toy,' please suggest a product that meets that need."

[2215] Step 14:

[2216] The server sends the generated prompt to the generative AI model using the OpenAI API. The generative AI model analyzes the prompt and suggests appropriate products. The data processing here involves analyzing the prompt and generating product suggestions.

[2217] Step 15:

[2218] The server receives suggestions from the generative AI model, such as "This toy is suitable."

[2219] Step 16:

[2220] The server then notifies the store terminal of the received proposal, which is then sent as a text message and displayed on the terminal. The user can then view the proposed products through the terminal.

[2221] Example 2

[2222] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2223] In modern child-rearing, parents are required to understand the meaning of their children's actions and comments and respond appropriately. However, it is not easy for parents to accurately analyze the meaning of their children's actions and comments and obtain appropriate advice. It is also difficult to select and effectively provide content that will interest children when providing educational support or reading aloud to them. Furthermore, when parents ask questions about child-rearing, it is important to receive answers that take into account the child's age and developmental stage. A system that can solve these issues is needed.

[2224] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2225] In this invention, the server includes a means for analyzing the meaning of a child's behavior using generative AI and providing the results to parents, a means for parents to ask questions about child-rearing to the generative AI and receive answers, a means for providing educational support and reading to children, a means for generating and providing scientific answers to children's questions, a means for selecting stories that the child likes based on the parent's request and reading them using voice synthesis, and a means for supporting the safe purchase of related products. This allows parents to understand the meaning of their child's behavior and statements and receive appropriate advice. It also enables effective educational support and reading that captures the child's interest. Furthermore, when parents ask questions about child-rearing, they can receive answers that take the child's age and developmental stage into consideration.

[2226] "Generative AI" is a system that uses artificial intelligence technology to analyze data and generate information and answers tailored to specific purposes.

[2227] "Analyzing the meaning of a child's behavior" means analyzing a child's behavioral patterns and the content of their statements to understand the intentions and emotions behind them.

[2228] "Providing to parent" means presenting the analysis results and generated information to the parent so that the parent can use them.

[2229] "Questions about child rearing" are inquiries about problems and doubts that parents face in raising their children.

[2230] "Providing answers" means that the generative AI presents appropriate information and solutions to parents' questions.

[2231] "Supporting children's education" means providing information and activities to promote children's learning and development.

[2232] "Reading aloud" means reading a story or text aloud to a child.

[2233] A "scientific answer" is an explanation or information generated based on scientific knowledge or theory.

[2234] "Speech synthesis" is a technology that converts text data into voice data.

[2235] "Supporting parents in purchasing related products with peace of mind" means supporting parents in purchasing products necessary for raising children in a safe and reliable manner.

[2236] This invention is a system that analyzes children's behavior and speech and provides appropriate information and advice to parents. The system includes means for using generative ...

Claims

1. A means for recognizing a child's emotions using an emotion engine; A means for analyzing the meaning of the child's behavior or remarks using a generative AI and a prompt sentence that instructs the system to analyze the meaning of the child's behavior or remarks based on the input content of the child's behavior or remarks and the child's emotions; A means for providing the analyzed results to a parent through smart glasses; A system including:

2. A prompt sentence that instructs the user to answer a question about child-rearing input by the parent, and a means for generating the answer using the generative AI; means for providing the generated answer to the parent via the smart glasses; The system of claim 1 further comprising:

3. 3. The system of claim 2, further comprising: means for using the generative AI to provide a prompt sentence instructing a user to search for related products related to the generated answer and a link to purchase the related products.

Images