system

Abstract

We provide the system. [Solution] Information acquisition methods for collecting and classifying materials from public institutions, A means of generating data to summarize acquired materials and provide them in a format that is easy for parents to understand, A notification means that receives information requests from users, searches for and provides relevant materials, An interface means that receives information requests using speech recognition and provides information visually or audibly, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance that responds to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern society, the birth rate is decreasing and anxiety about child-rearing costs is increasing. However, for many parents, the lack of understanding of economic support measures and child-rearing-related systems has become a problem. In addition, complex systems and procedures have become a heavy burden on parents, causing mental and physical exhaustion for parents during child-rearing. Against this background, there is a demand for a method that enables parents to efficiently understand and utilize support systems.

Means for Solving the Problems

[0005] The present invention solves the above problems by providing an AI agent specifically for childcare support. The system of the present invention includes an information acquisition means for collecting and organizing information from local governments and the national government; a generation means for summarizing the acquired information using a generation AI model and providing it in a format that is easy for parents to understand; and a notification means for receiving information requests from users, searching for relevant information, and providing it. Furthermore, it includes a support means for assisting users in applying for support programs, an automatic generation means for generating necessary forms and automatically filling in information, and a transmission means for sending data after final confirmation by the user. This facilitates the organization of information and simplifies procedures, and provides a collaborative means to reduce the burden on parents.

[0006] "Information acquisition means" refers to devices or methods for systematically collecting information from local governments and the national government and storing it in a database.

[0007] "Generating means" refers to a device or method that summarizes collected information using a generative AI model and converts it into an easily understandable format.

[0008] "Notification means" refers to a device or method for receiving information requests from a user, selecting relevant information, and providing it to the user.

[0009] "Support measures" refer to devices or methods that provide users with the necessary information and guidance when applying for support programs.

[0010] "Automatic generation means" refers to a device or method that generates the forms necessary for applying for support programs and automatically fills in the required information.

[0011] "Transmission means" refers to the device or method used to formally transmit application data to the relevant organizations after the user's final confirmation.

[0012] "Integration means" refers to a device or method for integrating and sharing information within a household with other household members or external applications. [Brief explanation of the drawing]

[0013] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0014] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc.

[0017] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0019] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] This invention provides a system using an AI agent to streamline the understanding and procedures of complex childcare support systems. An embodiment thereof is described below.

[0035] Information gathering and organization

[0036] First, the server regularly collects information on childcare support programs published by local governments and the national government. This includes using web crawling technologies and public APIs. The collected data is stored in a database, allowing for immediate responses to user requests.

[0037] Providing information

[0038] The device receives requests from users regarding childcare support programs. For example, if a user requests to know "how to apply for child allowance," the server searches the database for relevant information and summarizes it using a generative AI model. The device then notifies the user of the summarized information. This makes it easier for users to understand complex information.

[0039] Application support

[0040] When a user requires support, the terminal initiates the necessary application process. The server automatically generates the relevant forms and fills them in based on user-provided information and past data. This process frees users from the tedious task of creating paperwork.

[0041] Information sharing and collaboration

[0042] Users can configure settings on their devices to share household information. The device then integrates this information with external applications, allowing other family members to access schedules and childcare-related information. For example, it can integrate with a calendar app to share vaccination schedules.

[0043] This invention allows users to efficiently obtain important information regarding childcare and proceed with procedures in a less burdensome manner. This reduces the mental and physical burden on parents, providing an environment in which they can raise children more comfortably.

[0044] The following describes the processing flow.

[0045] Step 1:

[0046] The server collects information on childcare support programs from local governments and the national government. It uses web crawling technology to visit websites and stores the necessary information in a database.

[0047] Step 2:

[0048] Users request information they want to know or procedures they want to apply for via their device. For example, they might type, "I want to know the details of child allowance."

[0049] Step 3:

[0050] The terminal sends a request from the user to the server. The server retrieves relevant information from the database based on the received request.

[0051] Step 4:

[0052] The server uses a generative AI model to summarize search results and organize the information into a format that is easy for the user to understand.

[0053] Step 5:

[0054] The device notifies the user of summarized information. The user receives concise and clear information.

[0055] Step 6:

[0056] If a user wishes to apply for a specific program, they request support through their device. The server automatically generates the necessary application documents.

[0057] Step 7:

[0058] The server automatically fills out the form based on the user's basic information and sends it back to the terminal. The terminal displays the form to the user and asks for confirmation.

[0059] Step 8:

[0060] The user reviews the form, and if there are no problems, the terminal proceeds with the submission of the application data. The server stores the submitted data and forwards it to the necessary relevant organizations.

[0061] Step 9:

[0062] When a user wants to share information within their home network, they configure the settings on their device. The device then connects with an external application to share the selected information and completes the sharing process.

[0063] (Example 1)

[0064] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0065] Information on childcare support programs provided by local governments and the national government is complex and diverse, making it difficult for parents to understand and utilize it appropriately. Furthermore, the current situation requires considerable time and effort to smoothly complete the necessary procedures. In addition, a lack of information sharing within families and the complexity of integrating with external applications are also challenges, highlighting the need to create an environment where parents can focus on raising their children.

[0066] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0067] In this invention, the server includes information acquisition means for collecting and organizing publicly available information from local governments and the national government, data integration means for integrating and efficiently processing data obtained from multiple sources, and support means for assisting users in applying for support programs. This enables parents to easily grasp complex information, quickly complete procedures, and smoothly share necessary information both inside and outside the home.

[0068] "Information acquisition means" refers to technologies or devices for collecting and organizing information made public by local governments or the national government.

[0069] "Data management means" refers to a method or system for storing collected information in a database and keeping it up-to-date.

[0070] "Generative means" refers to methods and devices for summarizing collected data and providing it in a format that is easy for parents to understand.

[0071] A "notification means" is a function or device that receives information requests from users, searches for relevant information, and informs the user.

[0072] "Data integration means" refers to technologies and systems for integrating data obtained from multiple sources and processing it efficiently.

[0073] "Support measures" refer to methods or devices that assist users in applying for support programs.

[0074] "Automatic generation means" refers to systems and technologies that generate necessary forms and automatically fill them in based on user information.

[0075] "Data referencing means" refers to technologies and methods for referencing past data and optimizing the application process.

[0076] "Transmission means" refers to devices or technologies used to transmit data externally after final confirmation by the user.

[0077] "Integration methods" refer to methods and technologies for connecting data with external applications to facilitate information sharing within the home.

[0078] "Integration methods" refer to technologies and techniques for integrating information with external applications.

[0079] "Information customization means" refers to systems and technologies for providing customized information to family members.

[0080] This invention provides a system for a server to effectively collect publicly available information from local governments and national governments and provide that information in a user-friendly format. The server periodically retrieves publicly available information using web crawling technology and public APIs. This includes collecting information from multiple websites and databases. The collected data is stored in a database, and data management means are used to keep it up-to-date.

[0081] The server searches for relevant information in response to user requests and uses a generative AI model to summarize vast amounts of data. This summarization process makes complex information easier for users to understand. For example, if a user requests to know "how to apply for child allowance," the server searches the database and provides the results of a generative AI model that has summarized the information.

[0082] The terminal receives requests from users and provides information in cooperation with the server. If a user wishes to apply, the server generates the necessary forms using an automated generation mechanism and automatically fills them in based on the information provided by the user and past data. This eliminates the need for manual data entry and enables quick application. The server also provides a data retrieval mechanism to refer to past data and suggest the most suitable application procedure.

[0083] Furthermore, the device can integrate data with external applications via a linking mechanism for the purpose of sharing information within the family. Information customization is also available, providing information optimized for each user. It can also be linked with a calendar app for managing household schedules, allowing for the sharing of vaccination schedules among family members.

[0084] For example, if a user enters the prompt message "I want to know how to apply for child allowance" from their device, the server will collect and summarize relevant information and immediately notify the device. This system aims to reduce the burden of obtaining information and procedures for parents and provide efficient childcare support.

[0085] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0086] Step 1:

[0087] The server periodically collects publicly available information from local governments and municipalities on the internet using web crawling technology and APIs. It is given a list of source URLs or API endpoints as input, and outputs a dataset of the collected information. This dataset is stored in a database in raw data format, forming the basis for subsequent processing.

[0088] Step 2:

[0089] The server organizes and tidies up the raw data in the database using data processing techniques. The input is the dataset collected in step 1, and the processing involves removing data duplication and normalizing the items. The output is a clean and consistent dataset. This dataset is used to respond quickly to user requests.

[0090] Step 3:

[0091] The user requests information about a specific childcare support program via the terminal. The input is a prompt message entered by the user (e.g., "I want to know how to apply for child allowance"). The terminal receives this input and forwards it to the server. The output is the information request sent to the server.

[0092] Step 4:

[0093] Based on the request received in step 3, the server searches the database and extracts relevant information. The input is a query related to the prompt statement, and the process involves data retrieval and filtering. The output is a subset of the data containing the relevant information.

[0094] Step 5:

[0095] The server uses a generative AI model to summarize the data extracted in step 4. The input is a subset of the extracted data, and the generative AI model is used to compress the information and extract the key points. The output is information in a user-friendly summarized format.

[0096] Step 6:

[0097] The server sends summary information to the terminal. The terminal receives this information and issues a notification to the user. The input is the summary information sent from the server, and the output is the information notification displayed on the user's terminal screen. This process allows the user to quickly obtain the information they need.

[0098] Step 7:

[0099] If the user requests to proceed further with the application process, the terminal collects user information based on an automatically generated method and notifies the server. The input is the application information entered by the user, and the output is the information entered into the necessary application form.

[0100] Step 8:

[0101] The server uses the information obtained in step 7 to generate and automatically fill in the necessary application forms. The input consists of user-provided information and past data, and the output is an electronic form with the information already filled in. The server returns this form to the user and requests final confirmation.

[0102] Step 9:

[0103] The user performs a final confirmation on their device. The input is the electronic form generated in step 8, and the output is instructions for submitting the form after confirmation. Based on these instructions, the server sends the data to the relevant authorities and completes the application process.

[0104] (Application Example 1)

[0105] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0106] In recent years, with the increasing complexity of childcare support systems, it has become difficult for parents to understand the details of these systems. Furthermore, there is a need for an effective system that allows for the rapid and efficient acquisition of diverse information and the smooth progress of application procedures. In addition, information omissions and errors in verification can occur in situations where information sharing within the family or collaborative work among multiple people is necessary. Therefore, a system is needed to solve these problems and reduce the burden on parents.

[0107] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0108] In this invention, the server includes information acquisition means for collecting and classifying materials from public institutions, generation means for summarizing the acquired materials and providing them in a format easily understood by parents, and interface means for receiving information requests from users using speech recognition and providing information visually or audibly. This makes it possible to provide parents with the information they need quickly and in an easy-to-understand manner, thereby facilitating the use of childcare support systems.

[0109] "Information acquisition methods" refer to technologies for efficiently collecting and classifying materials distributed by public institutions.

[0110] A "generation method" is a processing device that summarizes acquired materials and converts them into a format that is easy for parents to understand.

[0111] A "notification mechanism" is part of a system that receives information requests from users and provides relevant materials in a timely manner.

[0112] An "interface means" is a device that receives information requests using speech recognition and provides information to the user visually or audibly.

[0113] "Support measures" refer to the process of providing the necessary support to users when applying for subsidy programs.

[0114] "Automatic generation means" refers to technology that generates the necessary forms for grant applications and automatically fills in the required documents.

[0115] "Transmission method" refers to the technology that transfers necessary data to an external source based on final confirmation by the user.

[0116] "Collaboration methods" refer to mechanisms for facilitating the sharing of documents within a household.

[0117] "Integration means" refers to technology for integrating external application devices with data.

[0118] This invention is an AI agent system that efficiently collects and summarizes information on childcare support programs, providing comprehensive support from information provision to application procedures. The server uses web crawling technology and public APIs to collect materials related to childcare support from public institutions and stores them in a database. This database contains the latest information disseminated by local governments and the national government.

[0119] Users make information requests using a device equipped with voice recognition capabilities. For example, they might say, "I want to know about child allowances," and the server analyzes the request. Based on the analyzed request, a generative AI model is used to summarize the information and present it in a format that is easy for the user to understand. Natural language processing technologies such as OpenAI® GPT are utilized to provide ambiguous or complex information in a clear and concise manner.

[0120] The information can be provided through both visual display and audio output, allowing users to choose the method that best suits their needs. Based on the information received, the terminal will begin assisting with the application process if necessary. A Python script automatically generates the required application documents, filling in the fields based on the information entered by the user. After final confirmation by the user, the data is sent to the remote institution.

[0121] Furthermore, the system allows for settings to share information within the household. Once the user configures these settings, the device integrates that information with external applications such as calendar apps. This feature allows other members of the household to share schedules and other information, facilitating smooth management of vaccination and school event schedules.

[0122] In particular, effective prompts for the generating AI model include requests such as, "Please summarize the latest changes related to the local government's childcare support system." For example, if a user requests, "I want to know the schedule for my next vaccination," the server will search for relevant information, the generating AI model will summarize that information and present it visually or audibly, and it can even be automatically added to the home calendar.

[0123] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0124] Step 1:

[0125] The server periodically collects data from public institution websites using web crawling technology. The server uses web crawler software to retrieve HTML and JSON data. This data is stored in a database for analysis and classification. The input is the URL of the target website, and the output is the collection of relevant childcare support information.

[0126] Step 2:

[0127] Users use a device equipped with speech recognition capabilities to input information requests regarding support programs via voice. The device converts this voice into digital data and then into text. The input here is the user's voice command, and the output is the information request in text format. Technologies such as Google® Cloud Speech-to-Text API are used for speech recognition.

[0128] Step 3:

[0129] The server receives text information sent from the terminal and uses a generative AI model to search for and summarize relevant materials. OpenAI GPT can be used as the generative AI model; the user's question text is provided as input, and a summarized answer is output. Natural language processing techniques are used in this process to perform semantic analysis and structuring of the information.

[0130] Step 4:

[0131] The terminal provides the user with summarized information received from the server, both visually and audibly. This allows the user to view the information on the display or receive it through audio. The input is summarized information from the server, and the output is the presentation of information to the user. Speech synthesis technology may be utilized at this stage.

[0132] Step 5:

[0133] When a user requests support with the application process, the terminal uses that information to communicate with the server and generate the necessary application documents. In this process, input is automatically filled in based on a template prepared in advance using a Python script, and the completed application documents are created as output.

[0134] Step 6:

[0135] After the application documents are verified, the terminal obtains final confirmation from the user before transmitting the data to an external organization via the server. The input is the application documents verified by the user, and the output is the transmission of data to the designated recipient. At this stage, security protocols such as SSL / TLS are commonly used.

[0136] Step 7:

[0137] The user configures information sharing within the home, and the device integrates this information with external application devices such as calendar apps. The input is the user's information sharing settings, and the output is the integrated calendar information. Data synchronization via API is often used in this scenario.

[0138] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0139] This invention is a system that uses an AI agent to facilitate childcare support and provides more personalized support by understanding the user's emotional state. This system has an information acquisition means for collecting and organizing information provided by local governments and the national government. In addition, it has a generation means for summarizing the collected information using a generation AI model and providing it to the user in an easy-to-understand manner.

[0140] Furthermore, the system incorporates an emotion engine that analyzes the user's emotions from voice and text data to recognize their current emotional state. Based on this emotion recognition, the system adjusts how information is presented and suggests the most appropriate support measures for the user.

[0141] For example, if the emotion engine determines that a user is experiencing stress related to childcare, it will prioritize displaying information and support systems that address that emotion. For instance, it might display information about local support groups or consultation services that can help alleviate childcare stress, enabling users to quickly resolve the challenges they face.

[0142] Furthermore, the emotion engine also works in conjunction with the information sharing function, appropriately communicating necessary information to family members and other collaborators based on the user's emotional state. For example, if the server detects that the user is defensive or exhausted, it will automatically notify the partner's device of important childcare-related tasks and encourage support.

[0143] In this way, the system according to the present invention provides meticulous support that takes the user's emotions into consideration, improving the richness and efficiency of daily life associated with childcare. Ultimately, it aims to reduce the mental burden on parents and make childcare more fulfilling.

[0144] The following describes the processing flow.

[0145] Step 1:

[0146] The server regularly collects information on childcare support programs from local governments and the national government and stores it in a database. It obtains the latest information through web crawling and public APIs using various data acquisition methods.

[0147] Step 2:

[0148] A user uses their device to request information about a specific childcare support program. For example, they might type, "I would like to know about information regarding prenatal and postnatal care."

[0149] Step 3:

[0150] The terminal sends the user's request to the server. The server retrieves relevant information from the database and summarizes the information using a generative AI model.

[0151] Step 4:

[0152] The generated summary information is sent to the device and notified to the user. The user can receive concise and specific information.

[0153] Step 5:

[0154] If a user wishes to apply for a specific program, they can request assistance with the procedure through their device. The server automatically generates the necessary forms, pre-fills the information, and sends them back to the device.

[0155] Step 6:

[0156] The device displays the generated application form to the user and prompts them to review its contents. Once the user reviews and agrees, the device sends the data and completes the application process.

[0157] Step 7:

[0158] Based on user input and voice data, the emotion engine analyzes the user's emotional state. For example, it can identify whether or not the user is feeling stressed.

[0159] Step 8:

[0160] Based on the recognized emotions, the server selects information appropriate to those emotions and sends it to the terminal. It also suggests additional support measures and information according to the emotions.

[0161] Step 9:

[0162] If a user wishes to share information within their household, they configure the necessary settings on their device. Based on the recognized emotional state, the server integrates the information with other household members and external applications to facilitate sharing.

[0163] This allows users to receive information and support that takes their emotions into consideration, contributing to reduced burden and more efficient parenting.

[0164] (Example 2)

[0165] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0166] In modern society, families raising children need access to a wide range of information, and personalized information tailored to individual circumstances is required to obtain appropriate support. However, it is difficult to quickly and effectively find the necessary information from a vast amount of data, and individualized support that takes into account the user's emotional state is particularly insufficient. This can increase mental burden and make parenting more difficult, so there is a need to solve this problem.

[0167] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0168] In this invention, the server includes information gathering means for collecting and organizing local government and national data, generation means for summarizing the data using a generative artificial intelligence model and providing it to users, and emotion analysis means for analyzing the user's voice and text data to identify their emotional state. This makes it possible to provide personalized information and propose support measures based on the user's emotional state.

[0169] "Information gathering means" refers to technologies for automatically collecting and organizing diverse data provided by local governments and the national government.

[0170] A "generative artificial intelligence model" is an artificial intelligence technology used to summarize and provide acquired data in an easily understandable format.

[0171] "Generation means" refers to a function that summarizes collected information and presents it to the user.

[0172] "Emotional analysis methods" refer to technologies that analyze a user's voice and text data to identify their emotional state.

[0173] "Personalized presentation methods" refer to functions that adjust the way information is presented according to the user's emotional state and propose individually optimized support measures.

[0174] "Information sharing methods" refer to technologies for notifying family members or collaborators of relevant information at the appropriate time.

[0175] "Support measures" refer to functions that assist users in the process of applying for childcare support programs.

[0176] "Automatic generation means" refers to technology for automatically generating necessary application documents and inputting the required information.

[0177] "Transmission method" refers to the technology used to transfer data and information created after user confirmation to an external source.

[0178] "Collaboration methods" refer to functions that facilitate data exchange in order to smoothly share information within the home.

[0179] This system is designed to support childcare. The server plays a central role in this system. The server automatically collects data from local government and municipal websites. This data collection uses software called a web crawler. The server starts up at a specific time in the morning to check if any new childcare support information is available.

[0180] The collected information is sent by the server to a generative artificial intelligence model. This model uses prompts for summarizing the information. For example, by using the prompt "Please summarize the latest childcare support information," the generative AI model organizes the information and generates a summary in a format that is easy for the user to understand.

[0181] The device is responsible for acquiring user voice and text data. In particular, voice data is collected using the smartphone's microphone and sent to emotion analysis tools. Voice recognition APIs and emotion analysis tools are used to analyze emotional states such as "stress" and "fatigue" from text and voice.

[0182] If the emotion analysis results indicate that the user is experiencing stress, the server generates information to provide support measures tailored to that emotion. For example, it requests information from the generating AI model using prompts such as, "Please tell me about effective childcare support to reduce stress." As a result, information on local support groups and consultation services is displayed on the user's device, with the aim of reducing the burden of daily childcare for the user.

[0183] Furthermore, the server also plays a role in notifying the appropriate person in the household of the user's emotional state. For example, if the system detects that the user is very tired, the server will send a suggestion message to the partner's terminal such as, "Please prepare dinner tonight." In this way, it also has a mechanism to promote the management and distribution of tasks within the household.

[0184] This system utilizes diverse hardware and software to automatically collect, analyze, and generate information, thereby more effectively supporting users in their parenting efforts.

[0185] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0186] Step 1:

[0187] The server collects childcare-related data from local government and municipal websites. The input to this process is a web crawler configuration file, and the output is the raw data retrieved. Data collection starts automatically at a specified time each day, with the web crawler patrolling the information sources to detect updates. When new data is found, the server records this data in the database.

[0188] Step 2:

[0189] The server uses a generative artificial intelligence model to generate a summary of the collected data. The input for this step is the raw data collected in step 1, and the output is information summarized in a way that is easy for the user to understand. To summarize the data, the prompt "Please summarize the latest childcare support information" is input to the generative AI model. The model generates the summary, and the server saves the result back to the database.

[0190] Step 3:

[0191] The device collects user voice and text data. The input for this step is the voice and text entered by the user into the smartphone, and the output is data transcribed into text by speech recognition software. Specifically, the smartphone's microphone is used to record the user's speech, which is then sent to the speech recognition API. The transcribed data is then passed to the sentiment analysis engine.

[0192] Step 4:

[0193] The server uses an emotion analysis engine to identify the user's emotional state. The input for this step is the text data generated in step 3, and the output is the identified emotional state. Labels such as "stress," "fatigue," and "joy" are used for emotion analysis, and the results are stored on the server again. Based on the analysis results, the next step is determined.

[0194] Step 5:

[0195] The server generates information and support measures tailored to the user's emotional state. The input for this step is the emotional state identified in step 4 and the information summarized in step 2, while the output is personalized support information. The prompt "Please tell me about effective childcare support to reduce stress" is used in the AI ​​model, and an optimized support plan is constructed based on the information provided by the model. The final information is displayed on the terminal.

[0196] Step 6:

[0197] The server shares information within the household based on the results of the sentiment analysis. The input for this step is the sentiment analysis results from step 4, and the output is the notification content sent to the collaborator's device. For example, upon receiving information that "the user is tired," the server sends a suggestion notification to the partner's smartphone such as "Please prepare dinner tonight." This promotes cooperation within the household.

[0198] (Application Example 2)

[0199] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0200] In modern society, parents raising children need access to a wealth of information and appropriate support. However, the sheer volume and disorganization of this information can increase stress. Furthermore, providing support that addresses parents' emotional needs presents a challenge. Therefore, there is a need to provide systems that enable parents to quickly and efficiently resolve challenges in child-rearing.

[0201] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0202] In this invention, the server includes information acquisition means for collecting and organizing information from local and governmental groups, generation means for summarizing the acquired information and providing it in a format easily understandable to users, and analysis means for analyzing the emotional state of users. This enables parents to obtain the necessary information appropriately and receive emotionally-based support.

[0203] "Information acquisition means" refers to means that have the function of collecting and organizing information from local governments and the national government.

[0204] A "generation method" is a means that has the function of summarizing acquired information and providing it in a format that is easy for users to understand.

[0205] A "notification means" is a means that has the function of receiving requests from users, searching for relevant information, and providing it.

[0206] An "analysis tool" is a tool that has the function of analyzing the emotional state of a user.

[0207] "Adjustment tools" are tools that have the function of adjusting the way information is presented based on emotions and proposing the most appropriate support.

[0208] "Support measures" refer to means that have the function of assisting users in applying for support programs.

[0209] An "automatic generation method" is a method that has the function of generating necessary documents and automatically filling in information.

[0210] A "transmission method" is a means that has the function of transmitting data after final confirmation by the user.

[0211] A "detection method" is a means that uses voice analysis to detect the user's emotions and presents support information.

[0212] "Means of collaboration" refer to means that facilitate information sharing within the household.

[0213] An "integration tool" is a means that has the function of integrating information with an external computer program.

[0214] A "means of communication" refers to a means of conveying information to a collaborator within the family, depending on one's emotional state.

[0215] To implement this invention, a system integrating specific functions is required. This system includes a server, a user terminal, related software, and an AI model. The server is equipped with information acquisition means for collecting and organizing necessary information from local governments and the national government. It also has generation means that uses a generation AI model to summarize the collected information and provide it in a format that is easy for parents and other caregivers to understand.

[0216] The user terminal has the function of receiving and analyzing the user's voice and text data as input. This analysis uses an emotion analysis engine that recognizes the user's emotions. Based on the user's emotional state, the server provides adjustment means to present the user with information that is appropriate to their emotions.

[0217] Furthermore, the system incorporates means of collaboration and integration to facilitate information sharing with external computer programs and family members. This allows users to quickly share appropriate information and receive efficient support, even in the stressful environment of childcare.

[0218] For example, if a user inputs a feeling such as "I've been feeling tired and stressed lately," the system detects that feeling and provides information on local stress reduction support groups and advice. Additionally, generative AI models are used to summarize information, which is useful in providing information that users can quickly understand.

[0219] An example of a prompt for the generating AI model is, "Please summarize the information in the following text: I've been feeling increasingly exhausted from childcare lately, so I'd like some advice on how to cope." In this way, the system can provide more personalized childcare support and emotionally resonant information to parents.

[0220] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0221] Step 1:

[0222] Users input statements related to childcare via their devices in either voice or text format. The input data is then converted from voice to text within the device and retrieved as text data.

[0223] Step 2:

[0224] The terminal sends text data to the server, which uses an emotion analysis engine to analyze the emotional state of the input text. This process analyzes the input text data and detects keywords that indicate emotions such as "fatigue" and "stress." The result of the analysis is an output of the user's emotional state.

[0225] Step 3:

[0226] The server selects appropriate information based on emotional states and prepares the base text for generating prompt sentences for the generative AI model. The server searches the collected local government and national information databases and retrieves the selected information.

[0227] Step 4:

[0228] The server sends prompt messages to the generative AI model, which then summarizes the selected informational data. These prompt messages include the user's emotional state and related information. Based on these prompt messages, the generative AI model summarizes the data and outputs information in a format easily understood by the user.

[0229] Step 5:

[0230] The server sends summarized information back to the terminal, which then displays the information on its screen or provides feedback to the user via audio. At this stage, the information selected by the user is provided visually or audibly, presenting the user with emotionally relevant and appropriate childcare support information.

[0231] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0232] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0233] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0234] [Second Embodiment]

[0235] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0236] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0237] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0238] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0239] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0240] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0241] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0242] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0243] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0244] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0245] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0246] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0247] This invention provides a system using an AI agent to streamline the understanding and procedures of complex childcare support systems. An embodiment thereof is described below.

[0248] Information gathering and organization

[0249] First, the server regularly collects information on childcare support programs published by local governments and the national government. This includes using web crawling technologies and public APIs. The collected data is stored in a database, allowing for immediate responses to user requests.

[0250] Providing information

[0251] The device receives requests from users regarding childcare support programs. For example, if a user requests to know "how to apply for child allowance," the server searches the database for relevant information and summarizes it using a generative AI model. The device then notifies the user of the summarized information. This makes it easier for users to understand complex information.

[0252] Application support

[0253] When a user requires support, the terminal initiates the necessary application process. The server automatically generates the relevant forms and fills them in based on user-provided information and past data. This process frees users from the tedious task of creating paperwork.

[0254] Information sharing and collaboration

[0255] Users can configure settings on their devices to share household information. The device then integrates this information with external applications, allowing other family members to access schedules and childcare-related information. For example, it can integrate with a calendar app to share vaccination schedules.

[0256] This invention allows users to efficiently obtain important information regarding childcare and proceed with procedures in a less burdensome manner. This reduces the mental and physical burden on parents, providing an environment in which they can raise children more comfortably.

[0257] The following describes the processing flow.

[0258] Step 1:

[0259] The server collects information on childcare support programs from local governments and the national government. It uses web crawling technology to visit websites and stores the necessary information in a database.

[0260] Step 2:

[0261] Users request information they want to know or procedures they want to apply for via their device. For example, they might type, "I want to know the details of child allowance."

[0262] Step 3:

[0263] The terminal sends a request from the user to the server. The server retrieves relevant information from the database based on the received request.

[0264] Step 4:

[0265] The server uses a generative AI model to summarize search results and organize the information into a format that is easy for the user to understand.

[0266] Step 5:

[0267] The device notifies the user of summarized information. The user receives concise and clear information.

[0268] Step 6:

[0269] If a user wishes to apply for a specific program, they request support through their device. The server automatically generates the necessary application documents.

[0270] Step 7:

[0271] The server automatically fills out the form based on the user's basic information and sends it back to the terminal. The terminal displays the form to the user and asks for confirmation.

[0272] Step 8:

[0273] The user reviews the form, and if there are no problems, the terminal proceeds with the submission of the application data. The server stores the submitted data and forwards it to the necessary relevant organizations.

[0274] Step 9:

[0275] When a user wants to share information within their home network, they configure the settings on their device. The device then connects with an external application to share the selected information and completes the sharing process.

[0276] (Example 1)

[0277] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0278] Information on childcare support programs provided by local governments and the national government is complex and diverse, making it difficult for parents to understand and utilize it appropriately. Furthermore, the current situation requires considerable time and effort to smoothly complete the necessary procedures. In addition, a lack of information sharing within families and the complexity of integrating with external applications are also challenges, highlighting the need to create an environment where parents can focus on raising their children.

[0279] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0280] In this invention, the server includes information acquisition means for collecting and organizing publicly available information from local governments and the national government, data integration means for integrating and efficiently processing data obtained from multiple sources, and support means for assisting users in applying for support programs. This enables parents to easily grasp complex information, quickly complete procedures, and smoothly share necessary information both inside and outside the home.

[0281] "Information acquisition means" refers to technologies or devices for collecting and organizing information made public by local governments or the national government.

[0282] "Data management means" refers to a method or system for storing collected information in a database and keeping it up-to-date.

[0283] The "generation means" is a method or device for summarizing the collected data and providing it in a form that is easy for parents to understand.

[0284] The "notification means" is a function or device that receives an information request from a user, searches for relevant information, and notifies the user.

[0285] The "data integration means" is a technology or system for integrating data obtained from multiple information sources and processing it efficiently.

[0286] The "support means" is a method or device for assisting a user in applying for a support system.

[0287] The "automatic generation means" is a system or technology for generating necessary forms and automatically filling them in based on user information.

[0288] The "data reference means" is a technology or method for referring to past data and optimizing the application process.

[0289] The "transmission means" is a device or technology for transmitting data externally after final confirmation by the user.

[0290] The "linkage means" is a method or technology for connecting data to an external application in order to promote information sharing within the family.

[0291] The "integration means" is a technology or method for integrating information with an external application.

[0292] The "information customization means" is a system or technology for providing customized information to family members.

[0293] This invention provides a system for a server to effectively collect publicly available information from local governments and national governments and provide that information in a user-friendly format. The server periodically retrieves publicly available information using web crawling technology and public APIs. This includes collecting information from multiple websites and databases. The collected data is stored in a database, and data management means are used to keep it up-to-date.

[0294] The server searches for relevant information in response to user requests and uses a generative AI model to summarize vast amounts of data. This summarization process makes complex information easier for users to understand. For example, if a user requests to know "how to apply for child allowance," the server searches the database and provides the results of a generative AI model that has summarized the information.

[0295] The terminal receives requests from users and provides information in cooperation with the server. If a user wishes to apply, the server generates the necessary forms using an automated generation mechanism and automatically fills them in based on the information provided by the user and past data. This eliminates the need for manual data entry and enables quick application. The server also provides a data retrieval mechanism to refer to past data and suggest the most suitable application procedure.

[0296] Furthermore, the device can integrate data with external applications via a linking mechanism for the purpose of sharing information within the family. Information customization is also available, providing information optimized for each user. It can also be linked with a calendar app for managing household schedules, allowing for the sharing of vaccination schedules among family members.

[0297] For example, if a user enters the prompt message "I want to know how to apply for child allowance" from their device, the server will collect and summarize relevant information and immediately notify the device. This system aims to reduce the burden of obtaining information and procedures for parents and provide efficient childcare support.

[0298] The process of a specific process in Example 1 will be described with reference to FIG. 11.

[0299] Step 1:

[0300] The server periodically collects public information of local governments and the government on the Internet using web crawling technology and APIs. Given a list of source URLs or API endpoints as input, it obtains a dataset of the collected information as output. This dataset is stored in a database in raw data format and serves as a basis for subsequent processing.

[0301] Step 2:

[0302] The server sorts and arranges the raw data in the database using data processing techniques. The input is the dataset collected in Step 1, and the processing involves eliminating data duplicates and normalizing items. The output is a clean and consistent dataset. This dataset is used to respond quickly to requests from users.

[0303] Step 3:

[0304] The user requests information about a specific child-rearing support system via a terminal. The input is the prompt text entered by the user (e.g., "I want to know how to apply for child allowance"). The terminal receives this input and transfers it to the server. The output is an information request to the server.

[0305] Step 4:

[0306] Based on the request received in Step 3, the server searches the database and extracts relevant information. The input is a query related to the prompt text, and the processing involves performing data search and filtering. The output is a subset of data containing the relevant information.

[0307] Step 5:

[0308] The server uses a generative AI model to summarize the data extracted in step 4. The input is a subset of the extracted data, and the generative AI model is used to compress the information and extract the key points. The output is information in a user-friendly summarized format.

[0309] Step 6:

[0310] The server sends summary information to the terminal. The terminal receives this information and issues a notification to the user. The input is the summary information sent from the server, and the output is the information notification displayed on the user's terminal screen. This process allows the user to quickly obtain the information they need.

[0311] Step 7:

[0312] If the user requests to proceed further with the application process, the terminal collects user information based on an automatically generated method and notifies the server. The input is the application information entered by the user, and the output is the information entered into the necessary application form.

[0313] Step 8:

[0314] The server uses the information obtained in step 7 to generate and automatically fill in the necessary application forms. The input consists of user-provided information and past data, and the output is an electronic form with the information already filled in. The server returns this form to the user and requests final confirmation.

[0315] Step 9:

[0316] The user performs a final confirmation on their device. The input is the electronic form generated in step 8, and the output is instructions for submitting the form after confirmation. Based on these instructions, the server sends the data to the relevant authorities and completes the application process.

[0317] (Application Example 1)

[0318] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0319] In recent years, with the increasing complexity of childcare support systems, it has become difficult for parents to understand the details of these systems. Furthermore, there is a need for an effective system that allows for the rapid and efficient acquisition of diverse information and the smooth progress of application procedures. In addition, information omissions and errors in verification can occur in situations where information sharing within the family or collaborative work among multiple people is necessary. Therefore, a system is needed to solve these problems and reduce the burden on parents.

[0320] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0321] In this invention, the server includes information acquisition means for collecting and classifying materials from public institutions, generation means for summarizing the acquired materials and providing them in a format easily understood by parents, and interface means for receiving information requests from users using speech recognition and providing information visually or audibly. This makes it possible to provide parents with the information they need quickly and in an easy-to-understand manner, thereby facilitating the use of childcare support systems.

[0322] "Information acquisition methods" refer to technologies for efficiently collecting and classifying materials distributed by public institutions.

[0323] A "generation method" is a processing device that summarizes acquired materials and converts them into a format that is easy for parents to understand.

[0324] A "notification mechanism" is part of a system that receives information requests from users and provides relevant materials in a timely manner.

[0325] An "interface means" is a device that receives information requests using speech recognition and provides information to the user visually or audibly.

[0326] "Support measures" refer to the process of providing the necessary support to users when applying for subsidy programs.

[0327] "Automatic generation means" refers to technology that generates the necessary forms for grant applications and automatically fills in the required documents.

[0328] "Transmission method" refers to the technology that transfers necessary data to an external source based on final confirmation by the user.

[0329] "Collaboration methods" refer to mechanisms for facilitating the sharing of documents within a household.

[0330] "Integration means" refers to technology for integrating external application devices with data.

[0331] This invention is an AI agent system that efficiently collects and summarizes information on childcare support programs, providing comprehensive support from information provision to application procedures. The server uses web crawling technology and public APIs to collect materials related to childcare support from public institutions and stores them in a database. This database contains the latest information disseminated by local governments and the national government.

[0332] Users make information requests using a device equipped with voice recognition capabilities. For example, they might say, "I want to know about child allowances," and the server analyzes the request. Based on the analyzed request, a generative AI model is used to summarize the information and present it in a format that is easy for the user to understand. Natural language processing technologies such as OpenAI GPT are utilized to provide ambiguous or complex information in a clear and concise manner.

[0333] The information can be provided through both visual display and audio output, allowing users to choose the method that best suits their needs. Based on the information received, the terminal will begin assisting with the application process if necessary. A Python script automatically generates the required application documents, filling in the fields based on the information entered by the user. After final confirmation by the user, the data is sent to the remote institution.

[0334] Furthermore, the system allows for settings to share information within the household. Once the user configures these settings, the device integrates that information with external applications such as calendar apps. This feature allows other members of the household to share schedules and other information, facilitating smooth management of vaccination and school event schedules.

[0335] In particular, effective prompts for the generating AI model include requests such as, "Please summarize the latest changes related to the local government's childcare support system." For example, if a user requests, "I want to know the schedule for my next vaccination," the server will search for relevant information, the generating AI model will summarize that information and present it visually or audibly, and it can even be automatically added to the home calendar.

[0336] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0337] Step 1:

[0338] The server periodically collects data from public institution websites using web crawling technology. The server uses web crawler software to retrieve HTML and JSON data. This data is stored in a database for analysis and classification. The input is the URL of the target website, and the output is the collection of relevant childcare support information.

[0339] Step 2:

[0340] Users use a device equipped with speech recognition capabilities to input information requests regarding support programs via voice. The device converts this voice into digital data and then into text. The input here is the user's voice command, and the output is the information request in text format. Technologies such as the Google Cloud Speech-to-Text API are used for speech recognition.

[0341] Step 3:

[0342] The server receives text information sent from the terminal and uses a generative AI model to search for and summarize relevant materials. OpenAI GPT can be used as the generative AI model; the user's question text is provided as input, and a summarized answer is output. Natural language processing techniques are used in this process to perform semantic analysis and structuring of the information.

[0343] Step 4:

[0344] The terminal provides the user with summarized information received from the server, both visually and audibly. This allows the user to view the information on the display or receive it through audio. The input is summarized information from the server, and the output is the presentation of information to the user. Speech synthesis technology may be utilized at this stage.

[0345] Step 5:

[0346] When a user requests support with the application process, the terminal uses that information to communicate with the server and generate the necessary application documents. In this process, input is automatically filled in based on a template prepared in advance using a Python script, and the completed application documents are created as output.

[0347] Step 6:

[0348] After the application documents are verified, the terminal obtains final confirmation from the user before transmitting the data to an external organization via the server. The input is the application documents verified by the user, and the output is the transmission of data to the designated recipient. At this stage, security protocols such as SSL / TLS are commonly used.

[0349] Step 7:

[0350] The user configures information sharing within the home, and the device integrates this information with external application devices such as calendar apps. The input is the user's information sharing settings, and the output is the integrated calendar information. Data synchronization via API is often used in this scenario.

[0351] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0352] This invention is a system that uses an AI agent to facilitate childcare support and provides more personalized support by understanding the user's emotional state. This system has an information acquisition means for collecting and organizing information provided by local governments and the national government. In addition, it has a generation means for summarizing the collected information using a generation AI model and providing it to the user in an easy-to-understand manner.

[0353] Furthermore, the system incorporates an emotion engine that analyzes the user's emotions from voice and text data to recognize their current emotional state. Based on this emotion recognition, the system adjusts how information is presented and suggests the most appropriate support measures for the user.

[0354] For example, if the emotion engine determines that a user is experiencing stress related to childcare, it will prioritize displaying information and support systems that address that emotion. For instance, it might display information about local support groups or consultation services that can help alleviate childcare stress, enabling users to quickly resolve the challenges they face.

[0355] Furthermore, the emotion engine also works in conjunction with the information sharing function, appropriately communicating necessary information to family members and other collaborators based on the user's emotional state. For example, if the server detects that the user is defensive or exhausted, it will automatically notify the partner's device of important childcare-related tasks and encourage support.

[0356] In this way, the system according to the present invention provides meticulous support that takes the user's emotions into consideration, improving the richness and efficiency of daily life associated with childcare. Ultimately, it aims to reduce the mental burden on parents and make childcare more fulfilling.

[0357] The following describes the processing flow.

[0358] Step 1:

[0359] The server regularly collects information on childcare support programs from local governments and the national government and stores it in a database. It obtains the latest information through web crawling and public APIs using various data acquisition methods.

[0360] Step 2:

[0361] A user uses their device to request information about a specific childcare support program. For example, they might type, "I would like to know about information regarding prenatal and postnatal care."

[0362] Step 3:

[0363] The terminal sends the user's request to the server. The server retrieves relevant information from the database and summarizes the information using a generative AI model.

[0364] Step 4:

[0365] The generated summary information is sent to the device and notified to the user. The user can receive concise and specific information.

[0366] Step 5:

[0367] If a user wishes to apply for a specific program, they can request assistance with the procedure through their device. The server automatically generates the necessary forms, pre-fills the information, and sends them back to the device.

[0368] Step 6:

[0369] The device displays the generated application form to the user and prompts them to review its contents. Once the user reviews and agrees, the device sends the data and completes the application process.

[0370] Step 7:

[0371] Based on user input and voice data, the emotion engine analyzes the user's emotional state. For example, it can identify whether or not the user is feeling stressed.

[0372] Step 8:

[0373] Based on the recognized emotions, the server selects information appropriate to those emotions and sends it to the terminal. It also suggests additional support measures and information according to the emotions.

[0374] Step 9:

[0375] If a user wishes to share information within their household, they configure the necessary settings on their device. Based on the recognized emotional state, the server integrates the information with other household members and external applications to facilitate sharing.

[0376] This allows users to receive information and support that takes their emotions into consideration, contributing to reduced burden and more efficient parenting.

[0377] (Example 2)

[0378] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0379] In modern society, families raising children need access to a wide range of information, and personalized information tailored to individual circumstances is required to obtain appropriate support. However, it is difficult to quickly and effectively find the necessary information from a vast amount of data, and individualized support that takes into account the user's emotional state is particularly insufficient. This can increase mental burden and make parenting more difficult, so there is a need to solve this problem.

[0380] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0381] In this invention, the server includes information gathering means for collecting and organizing local government and national data, generation means for summarizing the data using a generative artificial intelligence model and providing it to users, and emotion analysis means for analyzing the user's voice and text data to identify their emotional state. This makes it possible to provide personalized information and propose support measures based on the user's emotional state.

[0382] "Information gathering means" refers to technologies for automatically collecting and organizing diverse data provided by local governments and the national government.

[0383] A "generative artificial intelligence model" is an artificial intelligence technology used to summarize and provide acquired data in an easily understandable format.

[0384] "Generation means" refers to a function that summarizes collected information and presents it to the user.

[0385] "Emotional analysis methods" refer to technologies that analyze a user's voice and text data to identify their emotional state.

[0386] "Personalized presentation methods" refer to functions that adjust the way information is presented according to the user's emotional state and propose individually optimized support measures.

[0387] "Information sharing methods" refer to technologies for notifying family members or collaborators of relevant information at the appropriate time.

[0388] "Support measures" refer to functions that assist users in the process of applying for childcare support programs.

[0389] "Automatic generation means" refers to technology for automatically generating necessary application documents and inputting the required information.

[0390] "Transmission method" refers to the technology used to transfer data and information created after user confirmation to an external source.

[0391] "Collaboration methods" refer to functions that facilitate data exchange in order to smoothly share information within the home.

[0392] This system is designed to support childcare. The server plays a central role in this system. The server automatically collects data from local government and municipal websites. This data collection uses software called a web crawler. The server starts up at a specific time in the morning to check if any new childcare support information is available.

[0393] The collected information is sent by the server to a generative artificial intelligence model. This model uses prompts for summarizing the information. For example, by using the prompt "Please summarize the latest childcare support information," the generative AI model organizes the information and generates a summary in a format that is easy for the user to understand.

[0394] The device is responsible for acquiring user voice and text data. In particular, voice data is collected using the smartphone's microphone and sent to emotion analysis tools. Voice recognition APIs and emotion analysis tools are used to analyze emotional states such as "stress" and "fatigue" from text and voice.

[0395] If the emotion analysis results indicate that the user is experiencing stress, the server generates information to provide support measures tailored to that emotion. For example, it requests information from the generating AI model using prompts such as, "Please tell me about effective childcare support to reduce stress." As a result, information on local support groups and consultation services is displayed on the user's device, with the aim of reducing the burden of daily childcare for the user.

[0396] Furthermore, the server also plays a role in notifying the appropriate person in the household of the user's emotional state. For example, if the system detects that the user is very tired, the server will send a suggestion message to the partner's terminal such as, "Please prepare dinner tonight." In this way, it also has a mechanism to promote the management and distribution of tasks within the household.

[0397] This system utilizes diverse hardware and software to automatically collect, analyze, and generate information, thereby more effectively supporting users in their parenting efforts.

[0398] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0399] Step 1:

[0400] The server collects childcare-related data from local government and municipal websites. The input to this process is a web crawler configuration file, and the output is the raw data retrieved. Data collection starts automatically at a specified time each day, with the web crawler patrolling the information sources to detect updates. When new data is found, the server records this data in the database.

[0401] Step 2:

[0402] The server uses a generative artificial intelligence model to generate a summary of the collected data. The input for this step is the raw data collected in step 1, and the output is information summarized in a way that is easy for the user to understand. To summarize the data, the prompt "Please summarize the latest childcare support information" is input to the generative AI model. The model generates the summary, and the server saves the result back to the database.

[0403] Step 3:

[0404] The device collects user voice and text data. The input for this step is the voice and text entered by the user into the smartphone, and the output is data transcribed into text by speech recognition software. Specifically, the smartphone's microphone is used to record the user's speech, which is then sent to the speech recognition API. The transcribed data is then passed to the sentiment analysis engine.

[0405] Step 4:

[0406] The server uses an emotion analysis engine to identify the user's emotional state. The input for this step is the text data generated in step 3, and the output is the identified emotional state. Labels such as "stress," "fatigue," and "joy" are used for emotion analysis, and the results are stored on the server again. Based on the analysis results, the next step is determined.

[0407] Step 5:

[0408] The server generates information and support measures tailored to the user's emotional state. The input for this step is the emotional state identified in step 4 and the information summarized in step 2, while the output is personalized support information. The prompt "Please tell me about effective childcare support to reduce stress" is used in the AI ​​model, and an optimized support plan is constructed based on the information provided by the model. The final information is displayed on the terminal.

[0409] Step 6:

[0410] The server shares information within the household based on the results of the sentiment analysis. The input for this step is the sentiment analysis results from step 4, and the output is the notification content sent to the collaborator's device. For example, upon receiving information that "the user is tired," the server sends a suggestion notification to the partner's smartphone such as "Please prepare dinner tonight." This promotes cooperation within the household.

[0411] (Application Example 2)

[0412] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the smart glasses 214 as the "terminal".

[0413] In modern society, parents raising children need access to a wealth of information and appropriate support. However, the sheer volume and disorganization of this information can increase stress. Furthermore, providing support that addresses parents' emotional needs presents a challenge. Therefore, there is a need to provide systems that enable parents to quickly and efficiently resolve challenges in child-rearing.

[0414] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0415] In this invention, the server includes information acquisition means for collecting and organizing information from local and governmental groups, generation means for summarizing the acquired information and providing it in a format easily understandable to users, and analysis means for analyzing the emotional state of users. This enables parents to obtain the necessary information appropriately and receive emotionally-based support.

[0416] "Information acquisition means" refers to means that have the function of collecting and organizing information from local governments and the national government.

[0417] A "generation method" is a means that has the function of summarizing acquired information and providing it in a format that is easy for users to understand.

[0418] A "notification means" is a means that has the function of receiving requests from users, searching for relevant information, and providing it.

[0419] An "analysis tool" is a tool that has the function of analyzing the emotional state of a user.

[0420] "Adjustment tools" are tools that have the function of adjusting the way information is presented based on emotions and proposing the most appropriate support.

[0421] "Support measures" refer to means that have the function of assisting users in applying for support programs.

[0422] An "automatic generation method" is a method that has the function of generating necessary documents and automatically filling in information.

[0423] A "transmission method" is a means that has the function of transmitting data after final confirmation by the user.

[0424] A "detection method" is a means that uses voice analysis to detect the user's emotions and presents support information.

[0425] "Means of collaboration" refer to means that facilitate information sharing within the household.

[0426] An "integration tool" is a means that has the function of integrating information with an external computer program.

[0427] A "means of communication" refers to a means of conveying information to a collaborator within the family, depending on one's emotional state.

[0428] To implement this invention, a system integrating specific functions is required. This system includes a server, a user terminal, related software, and an AI model. The server is equipped with information acquisition means for collecting and organizing necessary information from local governments and the national government. It also has generation means that uses a generation AI model to summarize the collected information and provide it in a format that is easy for parents and other caregivers to understand.

[0429] The user terminal has the function of receiving and analyzing the user's voice and text data as input. This analysis uses an emotion analysis engine that recognizes the user's emotions. Based on the user's emotional state, the server provides adjustment means to present the user with information that is appropriate to their emotions.

[0430] Furthermore, the system incorporates means of collaboration and integration to facilitate information sharing with external computer programs and family members. This allows users to quickly share appropriate information and receive efficient support, even in the stressful environment of childcare.

[0431] For example, if a user inputs a feeling such as "I've been feeling tired and stressed lately," the system detects that feeling and provides information on local stress reduction support groups and advice. Additionally, generative AI models are used to summarize information, which is useful in providing information that users can quickly understand.

[0432] An example of a prompt for the generating AI model is, "Please summarize the information in the following text: I've been feeling increasingly exhausted from childcare lately, so I'd like some advice on how to cope." In this way, the system can provide more personalized childcare support and emotionally resonant information to parents.

[0433] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0434] Step 1:

[0435] Users input statements related to childcare via their devices in either voice or text format. The input data is then converted from voice to text within the device and retrieved as text data.

[0436] Step 2:

[0437] The terminal sends text data to the server, which uses an emotion analysis engine to analyze the emotional state of the input text. This process analyzes the input text data and detects keywords that indicate emotions such as "fatigue" and "stress." The result of the analysis is an output of the user's emotional state.

[0438] Step 3:

[0439] The server selects appropriate information based on emotional states and prepares the base text for generating prompt sentences for the generative AI model. The server searches the collected local government and national information databases and retrieves the selected information.

[0440] Step 4:

[0441] The server sends prompt messages to the generative AI model, which then summarizes the selected informational data. These prompt messages include the user's emotional state and related information. Based on these prompt messages, the generative AI model summarizes the data and outputs information in a format easily understood by the user.

[0442] Step 5:

[0443] The server sends summarized information back to the terminal, which then displays the information on its screen or provides feedback to the user via audio. At this stage, the information selected by the user is provided visually or audibly, presenting the user with emotionally relevant and appropriate childcare support information.

[0444] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0445] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0446] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0447] [Third Embodiment]

[0448] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0449] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0450] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0451] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0452] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0453] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0454] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0455] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0456] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0457] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0458] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0459] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0460] This invention provides a system using an AI agent to streamline the understanding and procedures of complex childcare support systems. An embodiment thereof is described below.

[0461] Information gathering and organization

[0462] First, the server regularly collects information on childcare support programs published by local governments and the national government. This includes using web crawling technologies and public APIs. The collected data is stored in a database, allowing for immediate responses to user requests.

[0463] Providing information

[0464] The device receives requests from users regarding childcare support programs. For example, if a user requests to know "how to apply for child allowance," the server searches the database for relevant information and summarizes it using a generative AI model. The device then notifies the user of the summarized information. This makes it easier for users to understand complex information.

[0465] Application support

[0466] When a user requires support, the terminal initiates the necessary application process. The server automatically generates the relevant forms and fills them in based on user-provided information and past data. This process frees users from the tedious task of creating paperwork.

[0467] Information sharing and collaboration

[0468] Users can configure settings on their devices to share household information. The device then integrates this information with external applications, allowing other family members to access schedules and childcare-related information. For example, it can integrate with a calendar app to share vaccination schedules.

[0469] This invention allows users to efficiently obtain important information regarding childcare and proceed with procedures in a less burdensome manner. This reduces the mental and physical burden on parents, providing an environment in which they can raise children more comfortably.

[0470] The following describes the processing flow.

[0471] Step 1:

[0472] The server collects information on childcare support programs from local governments and the national government. It uses web crawling technology to visit websites and stores the necessary information in a database.

[0473] Step 2:

[0474] Users request information they want to know or procedures they want to apply for via their device. For example, they might type, "I want to know the details of child allowance."

[0475] Step 3:

[0476] The terminal sends a request from the user to the server. The server retrieves relevant information from the database based on the received request.

[0477] Step 4:

[0478] The server uses a generative AI model to summarize search results and organize the information into a format that is easy for the user to understand.

[0479] Step 5:

[0480] The device notifies the user of summarized information. The user receives concise and clear information.

[0481] Step 6:

[0482] If a user wishes to apply for a specific program, they request support through their device. The server automatically generates the necessary application documents.

[0483] Step 7:

[0484] The server automatically fills out the form based on the user's basic information and sends it back to the terminal. The terminal displays the form to the user and asks for confirmation.

[0485] Step 8:

[0486] The user reviews the form, and if there are no problems, the terminal proceeds with the submission of the application data. The server stores the submitted data and forwards it to the necessary relevant organizations.

[0487] Step 9:

[0488] When a user wants to share information within their home network, they configure the settings on their device. The device then connects with an external application to share the selected information and completes the sharing process.

[0489] (Example 1)

[0490] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0491] Information on childcare support programs provided by local governments and the national government is complex and diverse, making it difficult for parents to understand and utilize it appropriately. Furthermore, the current situation requires considerable time and effort to smoothly complete the necessary procedures. In addition, a lack of information sharing within families and the complexity of integrating with external applications are also challenges, highlighting the need to create an environment where parents can focus on raising their children.

[0492] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0493] In this invention, the server includes information acquisition means for collecting and organizing publicly available information from local governments and the national government, data integration means for integrating and efficiently processing data obtained from multiple sources, and support means for assisting users in applying for support programs. This enables parents to easily grasp complex information, quickly complete procedures, and smoothly share necessary information both inside and outside the home.

[0494] "Information acquisition means" refers to technologies or devices for collecting and organizing information made public by local governments or the national government.

[0495] "Data management means" refers to a method or system for storing collected information in a database and keeping it up-to-date.

[0496] "Generative means" refers to methods and devices for summarizing collected data and providing it in a format that is easy for parents to understand.

[0497] A "notification means" is a function or device that receives information requests from users, searches for relevant information, and informs the user.

[0498] "Data integration means" refers to technologies and systems for integrating data obtained from multiple sources and processing it efficiently.

[0499] "Support measures" refer to methods or devices that assist users in applying for support programs.

[0500] "Automatic generation means" refers to systems and technologies that generate necessary forms and automatically fill them in based on user information.

[0501] "Data referencing means" refers to technologies and methods for referencing past data and optimizing the application process.

[0502] "Transmission means" refers to devices or technologies used to transmit data externally after final confirmation by the user.

[0503] "Integration methods" refer to methods and technologies for connecting data with external applications to facilitate information sharing within the home.

[0504] "Integration methods" refer to technologies and techniques for integrating information with external applications.

[0505] "Information customization means" refers to systems and technologies for providing customized information to family members.

[0506] This invention provides a system for a server to effectively collect publicly available information from local governments and national governments and provide that information in a user-friendly format. The server periodically retrieves publicly available information using web crawling technology and public APIs. This includes collecting information from multiple websites and databases. The collected data is stored in a database, and data management means are used to keep it up-to-date.

[0507] The server searches for relevant information in response to user requests and uses a generative AI model to summarize vast amounts of data. This summarization process makes complex information easier for users to understand. For example, if a user requests to know "how to apply for child allowance," the server searches the database and provides the results of a generative AI model that has summarized the information.

[0508] The terminal receives requests from users and provides information in cooperation with the server. If a user wishes to apply, the server generates the necessary forms using an automated generation mechanism and automatically fills them in based on the information provided by the user and past data. This eliminates the need for manual data entry and enables quick application. The server also provides a data retrieval mechanism to refer to past data and suggest the most suitable application procedure.

[0509] Furthermore, the device can integrate data with external applications via a linking mechanism for the purpose of sharing information within the family. Information customization is also available, providing information optimized for each user. It can also be linked with a calendar app for managing household schedules, allowing for the sharing of vaccination schedules among family members.

[0510] For example, if a user enters the prompt message "I want to know how to apply for child allowance" from their device, the server will collect and summarize relevant information and immediately notify the device. This system aims to reduce the burden of obtaining information and procedures for parents and provide efficient childcare support.

[0511] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0512] Step 1:

[0513] The server periodically collects publicly available information from local governments and municipalities on the internet using web crawling technology and APIs. It is given a list of source URLs or API endpoints as input, and outputs a dataset of the collected information. This dataset is stored in a database in raw data format, forming the basis for subsequent processing.

[0514] Step 2:

[0515] The server organizes and tidies up the raw data in the database using data processing techniques. The input is the dataset collected in step 1, and the processing involves removing data duplication and normalizing the items. The output is a clean and consistent dataset. This dataset is used to respond quickly to user requests.

[0516] Step 3:

[0517] The user requests information about a specific childcare support program via the terminal. The input is a prompt message entered by the user (e.g., "I want to know how to apply for child allowance"). The terminal receives this input and forwards it to the server. The output is the information request sent to the server.

[0518] Step 4:

[0519] Based on the request received in step 3, the server searches the database and extracts relevant information. The input is a query related to the prompt statement, and the process involves data retrieval and filtering. The output is a subset of the data containing the relevant information.

[0520] Step 5:

[0521] The server uses a generative AI model to summarize the data extracted in step 4. The input is a subset of the extracted data, and the generative AI model is used to compress the information and extract the key points. The output is information in a user-friendly summarized format.

[0522] Step 6:

[0523] The server sends summary information to the terminal. The terminal receives this information and issues a notification to the user. The input is the summary information sent from the server, and the output is the information notification displayed on the user's terminal screen. This process allows the user to quickly obtain the information they need.

[0524] Step 7:

[0525] If the user requests to proceed further with the application process, the terminal collects user information based on an automatically generated method and notifies the server. The input is the application information entered by the user, and the output is the information entered into the necessary application form.

[0526] Step 8:

[0527] The server uses the information obtained in step 7 to generate and automatically fill in the necessary application forms. The input consists of user-provided information and past data, and the output is an electronic form with the information already filled in. The server returns this form to the user and requests final confirmation.

[0528] Step 9:

[0529] The user performs a final confirmation on their device. The input is the electronic form generated in step 8, and the output is instructions for submitting the form after confirmation. Based on these instructions, the server sends the data to the relevant authorities and completes the application process.

[0530] (Application Example 1)

[0531] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0532] In recent years, with the increasing complexity of childcare support systems, it has become difficult for parents to understand the details of these systems. Furthermore, there is a need for an effective system that allows for the rapid and efficient acquisition of diverse information and the smooth progress of application procedures. In addition, information omissions and errors in verification can occur in situations where information sharing within the family or collaborative work among multiple people is necessary. Therefore, a system is needed to solve these problems and reduce the burden on parents.

[0533] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0534] In this invention, the server includes information acquisition means for collecting and classifying materials from public institutions, generation means for summarizing the acquired materials and providing them in a format easily understood by parents, and interface means for receiving information requests from users using speech recognition and providing information visually or audibly. This makes it possible to provide parents with the information they need quickly and in an easy-to-understand manner, thereby facilitating the use of childcare support systems.

[0535] "Information acquisition methods" refer to technologies for efficiently collecting and classifying materials distributed by public institutions.

[0536] A "generation method" is a processing device that summarizes acquired materials and converts them into a format that is easy for parents to understand.

[0537] A "notification mechanism" is part of a system that receives information requests from users and provides relevant materials in a timely manner.

[0538] An "interface means" is a device that receives information requests using speech recognition and provides information to the user visually or audibly.

[0539] "Support measures" refer to the process of providing the necessary support to users when applying for subsidy programs.

[0540] "Automatic generation means" refers to technology that generates the necessary forms for grant applications and automatically fills in the required documents.

[0541] "Transmission method" refers to the technology that transfers necessary data to an external source based on final confirmation by the user.

[0542] "Collaboration methods" refer to mechanisms for facilitating the sharing of documents within a household.

[0543] "Integration means" refers to technology for integrating external application devices with data.

[0544] This invention is an AI agent system that efficiently collects and summarizes information on childcare support programs, providing comprehensive support from information provision to application procedures. The server uses web crawling technology and public APIs to collect materials related to childcare support from public institutions and stores them in a database. This database contains the latest information disseminated by local governments and the national government.

[0545] Users make information requests using a device equipped with voice recognition capabilities. For example, they might say, "I want to know about child allowances," and the server analyzes the request. Based on the analyzed request, a generative AI model is used to summarize the information and present it in a format that is easy for the user to understand. Natural language processing technologies such as OpenAI GPT are utilized to provide ambiguous or complex information in a clear and concise manner.

[0546] The information can be provided through both visual display and audio output, allowing users to choose the method that best suits their needs. Based on the information received, the terminal will begin assisting with the application process if necessary. A Python script automatically generates the required application documents, filling in the fields based on the information entered by the user. After final confirmation by the user, the data is sent to the remote institution.

[0547] Furthermore, the system allows for settings to share information within the household. Once the user configures these settings, the device integrates that information with external applications such as calendar apps. This feature allows other members of the household to share schedules and other information, facilitating smooth management of vaccination and school event schedules.

[0548] In particular, effective prompts for the generating AI model include requests such as, "Please summarize the latest changes related to the local government's childcare support system." For example, if a user requests, "I want to know the schedule for my next vaccination," the server will search for relevant information, the generating AI model will summarize that information and present it visually or audibly, and it can even be automatically added to the home calendar.

[0549] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0550] Step 1:

[0551] The server periodically collects data from public institution websites using web crawling technology. The server uses web crawler software to retrieve HTML and JSON data. This data is stored in a database for analysis and classification. The input is the URL of the target website, and the output is the collection of relevant childcare support information.

[0552] Step 2:

[0553] Users use a device equipped with speech recognition capabilities to input information requests regarding support programs via voice. The device converts this voice into digital data and then into text. The input here is the user's voice command, and the output is the information request in text format. Technologies such as the Google Cloud Speech-to-Text API are used for speech recognition.

[0554] Step 3:

[0555] The server receives text information sent from the terminal and uses a generative AI model to search for and summarize relevant materials. OpenAI GPT can be used as the generative AI model; the user's question text is provided as input, and a summarized answer is output. Natural language processing techniques are used in this process to perform semantic analysis and structuring of the information.

[0556] Step 4:

[0557] The terminal provides the user with summarized information received from the server, both visually and audibly. This allows the user to view the information on the display or receive it through audio. The input is summarized information from the server, and the output is the presentation of information to the user. Speech synthesis technology may be utilized at this stage.

[0558] Step 5:

[0559] When a user requests support with the application process, the terminal uses that information to communicate with the server and generate the necessary application documents. In this process, input is automatically filled in based on a template prepared in advance using a Python script, and the completed application documents are created as output.

[0560] Step 6:

[0561] After the application documents are verified, the terminal obtains final confirmation from the user before transmitting the data to an external organization via the server. The input is the application documents verified by the user, and the output is the transmission of data to the designated recipient. At this stage, security protocols such as SSL / TLS are commonly used.

[0562] Step 7:

[0563] The user configures information sharing within the home, and the device integrates this information with external application devices such as calendar apps. The input is the user's information sharing settings, and the output is the integrated calendar information. Data synchronization via API is often used in this scenario.

[0564] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0565] This invention is a system that uses an AI agent to facilitate childcare support and provides more personalized support by understanding the user's emotional state. This system has an information acquisition means for collecting and organizing information provided by local governments and the national government. In addition, it has a generation means for summarizing the collected information using a generation AI model and providing it to the user in an easy-to-understand manner.

[0566] Furthermore, the system incorporates an emotion engine that analyzes the user's emotions from voice and text data to recognize their current emotional state. Based on this emotion recognition, the system adjusts how information is presented and suggests the most appropriate support measures for the user.

[0567] For example, if the emotion engine determines that a user is experiencing stress related to childcare, it will prioritize displaying information and support systems that address that emotion. For instance, it might display information about local support groups or consultation services that can help alleviate childcare stress, enabling users to quickly resolve the challenges they face.

[0568] Furthermore, the emotion engine also works in conjunction with the information sharing function, appropriately communicating necessary information to family members and other collaborators based on the user's emotional state. For example, if the server detects that the user is defensive or exhausted, it will automatically notify the partner's device of important childcare-related tasks and encourage support.

[0569] In this way, the system according to the present invention provides meticulous support that takes the user's emotions into consideration, improving the richness and efficiency of daily life associated with childcare. Ultimately, it aims to reduce the mental burden on parents and make childcare more fulfilling.

[0570] The following describes the processing flow.

[0571] Step 1:

[0572] The server regularly collects information on childcare support programs from local governments and the national government and stores it in a database. It obtains the latest information through web crawling and public APIs using various data acquisition methods.

[0573] Step 2:

[0574] A user uses their device to request information about a specific childcare support program. For example, they might type, "I would like to know about information regarding prenatal and postnatal care."

[0575] Step 3:

[0576] The terminal sends the user's request to the server. The server retrieves relevant information from the database and summarizes the information using a generative AI model.

[0577] Step 4:

[0578] The generated summary information is sent to the device and notified to the user. The user can receive concise and specific information.

[0579] Step 5:

[0580] If a user wishes to apply for a specific program, they can request assistance with the procedure through their device. The server automatically generates the necessary forms, pre-fills the information, and sends them back to the device.

[0581] Step 6:

[0582] The device displays the generated application form to the user and prompts them to review its contents. Once the user reviews and agrees, the device sends the data and completes the application process.

[0583] Step 7:

[0584] Based on user input and voice data, the emotion engine analyzes the user's emotional state. For example, it can identify whether or not the user is feeling stressed.

[0585] Step 8:

[0586] Based on the recognized emotions, the server selects information appropriate to those emotions and sends it to the terminal. It also suggests additional support measures and information according to the emotions.

[0587] Step 9:

[0588] If a user wishes to share information within their household, they configure the necessary settings on their device. Based on the recognized emotional state, the server integrates the information with other household members and external applications to facilitate sharing.

[0589] This allows users to receive information and support that takes their emotions into consideration, contributing to reduced burden and more efficient parenting.

[0590] (Example 2)

[0591] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0592] In modern society, families raising children need access to a wide range of information, and personalized information tailored to individual circumstances is required to obtain appropriate support. However, it is difficult to quickly and effectively find the necessary information from a vast amount of data, and individualized support that takes into account the user's emotional state is particularly insufficient. This can increase mental burden and make parenting more difficult, so there is a need to solve this problem.

[0593] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0594] In this invention, the server includes information gathering means for collecting and organizing local government and national data, generation means for summarizing the data using a generative artificial intelligence model and providing it to users, and emotion analysis means for analyzing the user's voice and text data to identify their emotional state. This makes it possible to provide personalized information and propose support measures based on the user's emotional state.

[0595] "Information gathering means" refers to technologies for automatically collecting and organizing diverse data provided by local governments and the national government.

[0596] A "generative artificial intelligence model" is an artificial intelligence technology used to summarize and provide acquired data in an easily understandable format.

[0597] "Generation means" refers to a function that summarizes collected information and presents it to the user.

[0598] "Emotional analysis methods" refer to technologies that analyze a user's voice and text data to identify their emotional state.

[0599] "Personalized presentation methods" refer to functions that adjust the way information is presented according to the user's emotional state and propose individually optimized support measures.

[0600] "Information sharing methods" refer to technologies for notifying family members or collaborators of relevant information at the appropriate time.

[0601] "Support measures" refer to functions that assist users in the process of applying for childcare support programs.

[0602] "Automatic generation means" refers to technology for automatically generating necessary application documents and inputting the required information.

[0603] "Transmission method" refers to the technology used to transfer data and information created after user confirmation to an external source.

[0604] "Collaboration methods" refer to functions that facilitate data exchange in order to smoothly share information within the home.

[0605] This system is designed to support childcare. The server plays a central role in this system. The server automatically collects data from local government and municipal websites. This data collection uses software called a web crawler. The server starts up at a specific time in the morning to check if any new childcare support information is available.

[0606] The collected information is sent by the server to a generative artificial intelligence model. This model uses prompts for summarizing the information. For example, by using the prompt "Please summarize the latest childcare support information," the generative AI model organizes the information and generates a summary in a format that is easy for the user to understand.

[0607] The device is responsible for acquiring user voice and text data. In particular, voice data is collected using the smartphone's microphone and sent to emotion analysis tools. Voice recognition APIs and emotion analysis tools are used to analyze emotional states such as "stress" and "fatigue" from text and voice.

[0608] If the emotion analysis results indicate that the user is experiencing stress, the server generates information to provide support measures tailored to that emotion. For example, it requests information from the generating AI model using prompts such as, "Please tell me about effective childcare support to reduce stress." As a result, information on local support groups and consultation services is displayed on the user's device, with the aim of reducing the burden of daily childcare for the user.

[0609] Furthermore, the server also plays a role in notifying the appropriate person in the household of the user's emotional state. For example, if the system detects that the user is very tired, the server will send a suggestion message to the partner's terminal such as, "Please prepare dinner tonight." In this way, it also has a mechanism to promote the management and distribution of tasks within the household.

[0610] This system utilizes diverse hardware and software to automatically collect, analyze, and generate information, thereby more effectively supporting users in their parenting efforts.

[0611] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0612] Step 1:

[0613] The server collects childcare-related data from local government and municipal websites. The input to this process is a web crawler configuration file, and the output is the raw data retrieved. Data collection starts automatically at a specified time each day, with the web crawler patrolling the information sources to detect updates. When new data is found, the server records this data in the database.

[0614] Step 2:

[0615] The server uses a generative artificial intelligence model to generate a summary of the collected data. The input for this step is the raw data collected in step 1, and the output is information summarized in a way that is easy for the user to understand. To summarize the data, the prompt "Please summarize the latest childcare support information" is input to the generative AI model. The model generates the summary, and the server saves the result back to the database.

[0616] Step 3:

[0617] The device collects user voice and text data. The input for this step is the voice and text entered by the user into the smartphone, and the output is data transcribed into text by speech recognition software. Specifically, the smartphone's microphone is used to record the user's speech, which is then sent to the speech recognition API. The transcribed data is then passed to the sentiment analysis engine.

[0618] Step 4:

[0619] The server uses an emotion analysis engine to identify the user's emotional state. The input for this step is the text data generated in step 3, and the output is the identified emotional state. Labels such as "stress," "fatigue," and "joy" are used for emotion analysis, and the results are stored on the server again. Based on the analysis results, the next step is determined.

[0620] Step 5:

[0621] The server generates information and support measures tailored to the user's emotional state. The input for this step is the emotional state identified in step 4 and the information summarized in step 2, while the output is personalized support information. The prompt "Please tell me about effective childcare support to reduce stress" is used in the AI ​​model, and an optimized support plan is constructed based on the information provided by the model. The final information is displayed on the terminal.

[0622] Step 6:

[0623] The server shares information within the household based on the results of the sentiment analysis. The input for this step is the sentiment analysis results from step 4, and the output is the notification content sent to the collaborator's device. For example, upon receiving information that "the user is tired," the server sends a suggestion notification to the partner's smartphone such as "Please prepare dinner tonight." This promotes cooperation within the household.

[0624] (Application Example 2)

[0625] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0626] In modern society, parents raising children need access to a wealth of information and appropriate support. However, the sheer volume and disorganization of this information can increase stress. Furthermore, providing support that addresses parents' emotional needs presents a challenge. Therefore, there is a need to provide systems that enable parents to quickly and efficiently resolve challenges in child-rearing.

[0627] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0628] In this invention, the server includes information acquisition means for collecting and organizing information from local and governmental groups, generation means for summarizing the acquired information and providing it in a format easily understandable to users, and analysis means for analyzing the emotional state of users. This enables parents to obtain the necessary information appropriately and receive emotionally-based support.

[0629] "Information acquisition means" refers to means that have the function of collecting and organizing information from local governments and the national government.

[0630] A "generation method" is a means that has the function of summarizing acquired information and providing it in a format that is easy for users to understand.

[0631] A "notification means" is a means that has the function of receiving requests from users, searching for relevant information, and providing it.

[0632] An "analysis tool" is a tool that has the function of analyzing the emotional state of a user.

[0633] "Adjustment tools" are tools that have the function of adjusting the way information is presented based on emotions and proposing the most appropriate support.

[0634] "Support measures" refer to means that have the function of assisting users in applying for support programs.

[0635] An "automatic generation method" is a method that has the function of generating necessary documents and automatically filling in information.

[0636] A "transmission method" is a means that has the function of transmitting data after final confirmation by the user.

[0637] A "detection method" is a means that uses voice analysis to detect the user's emotions and presents support information.

[0638] "Means of collaboration" refer to means that facilitate information sharing within the household.

[0639] An "integration tool" is a means that has the function of integrating information with an external computer program.

[0640] A "means of communication" refers to a means of conveying information to a collaborator within the family, depending on one's emotional state.

[0641] To implement this invention, a system integrating specific functions is required. This system includes a server, a user terminal, related software, and an AI model. The server is equipped with information acquisition means for collecting and organizing necessary information from local governments and the national government. It also has generation means that uses a generation AI model to summarize the collected information and provide it in a format that is easy for parents and other caregivers to understand.

[0642] The user terminal has the function of receiving and analyzing the user's voice and text data as input. This analysis uses an emotion analysis engine that recognizes the user's emotions. Based on the user's emotional state, the server provides adjustment means to present the user with information that is appropriate to their emotions.

[0643] Furthermore, the system incorporates means of collaboration and integration to facilitate information sharing with external computer programs and family members. This allows users to quickly share appropriate information and receive efficient support, even in the stressful environment of childcare.

[0644] For example, if a user inputs a feeling such as "I've been feeling tired and stressed lately," the system detects that feeling and provides information on local stress reduction support groups and advice. Additionally, generative AI models are used to summarize information, which is useful in providing information that users can quickly understand.

[0645] An example of a prompt for the generating AI model is, "Please summarize the information in the following text: I've been feeling increasingly exhausted from childcare lately, so I'd like some advice on how to cope." In this way, the system can provide more personalized childcare support and emotionally resonant information to parents.

[0646] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0647] Step 1:

[0648] Users input statements related to childcare via their devices in either voice or text format. The input data is then converted from voice to text within the device and retrieved as text data.

[0649] Step 2:

[0650] The terminal sends text data to the server, which uses an emotion analysis engine to analyze the emotional state of the input text. This process analyzes the input text data and detects keywords that indicate emotions such as "fatigue" and "stress." The result of the analysis is an output of the user's emotional state.

[0651] Step 3:

[0652] The server selects appropriate information based on emotional states and prepares the base text for generating prompt sentences for the generative AI model. The server searches the collected local government and national information databases and retrieves the selected information.

[0653] Step 4:

[0654] The server sends prompt messages to the generative AI model, which then summarizes the selected informational data. These prompt messages include the user's emotional state and related information. Based on these prompt messages, the generative AI model summarizes the data and outputs information in a format easily understood by the user.

[0655] Step 5:

[0656] The server sends summarized information back to the terminal, which then displays the information on its screen or provides feedback to the user via audio. At this stage, the information selected by the user is provided visually or audibly, presenting the user with emotionally relevant and appropriate childcare support information.

[0657] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0658] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0659] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0660] [Fourth Embodiment]

[0661] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0662] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0663] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0664] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0665] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0666] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0667] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0668] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0669] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0670] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0671] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0672] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0673] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0674] This invention provides a system using an AI agent to streamline the understanding and procedures of complex childcare support systems. An embodiment thereof is described below.

[0675] Information gathering and organization

[0676] First, the server regularly collects information on childcare support programs published by local governments and the national government. This includes using web crawling technologies and public APIs. The collected data is stored in a database, allowing for immediate responses to user requests.

[0677] Providing information

[0678] The device receives requests from users regarding childcare support programs. For example, if a user requests to know "how to apply for child allowance," the server searches the database for relevant information and summarizes it using a generative AI model. The device then notifies the user of the summarized information. This makes it easier for users to understand complex information.

[0679] Application support

[0680] When a user requires support, the terminal initiates the necessary application process. The server automatically generates the relevant forms and fills them in based on user-provided information and past data. This process frees users from the tedious task of creating paperwork.

[0681] Information sharing and collaboration

[0682] Users can configure settings on their devices to share household information. The device then integrates this information with external applications, allowing other family members to access schedules and childcare-related information. For example, it can integrate with a calendar app to share vaccination schedules.

[0683] This invention allows users to efficiently obtain important information regarding childcare and proceed with procedures in a less burdensome manner. This reduces the mental and physical burden on parents, providing an environment in which they can raise children more comfortably.

[0684] The following describes the processing flow.

[0685] Step 1:

[0686] The server collects information on childcare support programs from local governments and the national government. It uses web crawling technology to visit websites and stores the necessary information in a database.

[0687] Step 2:

[0688] Users request information they want to know or procedures they want to apply for via their device. For example, they might type, "I want to know the details of child allowance."

[0689] Step 3:

[0690] The terminal sends a request from the user to the server. The server retrieves relevant information from the database based on the received request.

[0691] Step 4:

[0692] The server uses a generative AI model to summarize search results and organize the information into a format that is easy for the user to understand.

[0693] Step 5:

[0694] The device notifies the user of summarized information. The user receives concise and clear information.

[0695] Step 6:

[0696] If a user wishes to apply for a specific program, they request support through their device. The server automatically generates the necessary application documents.

[0697] Step 7:

[0698] The server automatically fills out the form based on the user's basic information and sends it back to the terminal. The terminal displays the form to the user and asks for confirmation.

[0699] Step 8:

[0700] The user reviews the form, and if there are no problems, the terminal proceeds with the submission of the application data. The server stores the submitted data and forwards it to the necessary relevant organizations.

[0701] Step 9:

[0702] When a user wants to share information within their home network, they configure the settings on their device. The device then connects with an external application to share the selected information and completes the sharing process.

[0703] (Example 1)

[0704] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0705] Information on childcare support programs provided by local governments and the national government is complex and diverse, making it difficult for parents to understand and utilize it appropriately. Furthermore, the current situation requires considerable time and effort to smoothly complete the necessary procedures. In addition, a lack of information sharing within families and the complexity of integrating with external applications are also challenges, highlighting the need to create an environment where parents can focus on raising their children.

[0706] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0707] In this invention, the server includes information acquisition means for collecting and organizing publicly available information from local governments and the national government, data integration means for integrating and efficiently processing data obtained from multiple sources, and support means for assisting users in applying for support programs. This enables parents to easily grasp complex information, quickly complete procedures, and smoothly share necessary information both inside and outside the home.

[0708] "Information acquisition means" refers to technologies or devices for collecting and organizing information made public by local governments or the national government.

[0709] "Data management means" refers to a method or system for storing collected information in a database and keeping it up-to-date.

[0710] "Generative means" refers to methods and devices for summarizing collected data and providing it in a format that is easy for parents to understand.

[0711] A "notification means" is a function or device that receives information requests from users, searches for relevant information, and informs the user.

[0712] "Data integration means" refers to technologies and systems for integrating data obtained from multiple sources and processing it efficiently.

[0713] "Support measures" refer to methods or devices that assist users in applying for support programs.

[0714] "Automatic generation means" refers to systems and technologies that generate necessary forms and automatically fill them in based on user information.

[0715] "Data referencing means" refers to technologies and methods for referencing past data and optimizing the application process.

[0716] "Transmission means" refers to devices or technologies used to transmit data externally after final confirmation by the user.

[0717] "Integration methods" refer to methods and technologies for connecting data with external applications to facilitate information sharing within the home.

[0718] "Integration methods" refer to technologies and techniques for integrating information with external applications.

[0719] "Information customization means" refers to systems and technologies for providing customized information to family members.

[0720] This invention provides a system for a server to effectively collect publicly available information from local governments and national governments and provide that information in a user-friendly format. The server periodically retrieves publicly available information using web crawling technology and public APIs. This includes collecting information from multiple websites and databases. The collected data is stored in a database, and data management means are used to keep it up-to-date.

[0721] The server searches for relevant information in response to user requests and uses a generative AI model to summarize vast amounts of data. This summarization process makes complex information easier for users to understand. For example, if a user requests to know "how to apply for child allowance," the server searches the database and provides the results of a generative AI model that has summarized the information.

[0722] The terminal receives requests from users and provides information in cooperation with the server. If a user wishes to apply, the server generates the necessary forms using an automated generation mechanism and automatically fills them in based on the information provided by the user and past data. This eliminates the need for manual data entry and enables quick application. The server also provides a data retrieval mechanism to refer to past data and suggest the most suitable application procedure.

[0723] Furthermore, the device can integrate data with external applications via a linking mechanism for the purpose of sharing information within the family. Information customization is also available, providing information optimized for each user. It can also be linked with a calendar app for managing household schedules, allowing for the sharing of vaccination schedules among family members.

[0724] For example, if a user enters the prompt message "I want to know how to apply for child allowance" from their device, the server will collect and summarize relevant information and immediately notify the device. This system aims to reduce the burden of obtaining information and procedures for parents and provide efficient childcare support.

[0725] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0726] Step 1:

[0727] The server periodically collects publicly available information from local governments and municipalities on the internet using web crawling technology and APIs. It is given a list of source URLs or API endpoints as input, and outputs a dataset of the collected information. This dataset is stored in a database in raw data format, forming the basis for subsequent processing.

[0728] Step 2:

[0729] The server organizes and tidies up the raw data in the database using data processing techniques. The input is the dataset collected in step 1, and the processing involves removing data duplication and normalizing the items. The output is a clean and consistent dataset. This dataset is used to respond quickly to user requests.

[0730] Step 3:

[0731] The user requests information about a specific childcare support program via the terminal. The input is a prompt message entered by the user (e.g., "I want to know how to apply for child allowance"). The terminal receives this input and forwards it to the server. The output is the information request sent to the server.

[0732] Step 4:

[0733] Based on the request received in step 3, the server searches the database and extracts relevant information. The input is a query related to the prompt statement, and the process involves data retrieval and filtering. The output is a subset of the data containing the relevant information.

[0734] Step 5:

[0735] The server uses a generative AI model to summarize the data extracted in step 4. The input is a subset of the extracted data, and the generative AI model is used to compress the information and extract the key points. The output is information in a user-friendly summarized format.

[0736] Step 6:

[0737] The server sends summary information to the terminal. The terminal receives this information and issues a notification to the user. The input is the summary information sent from the server, and the output is the information notification displayed on the user's terminal screen. This process allows the user to quickly obtain the information they need.

[0738] Step 7:

[0739] If the user requests to proceed further with the application process, the terminal collects user information based on an automatically generated method and notifies the server. The input is the application information entered by the user, and the output is the information entered into the necessary application form.

[0740] Step 8:

[0741] The server uses the information obtained in step 7 to generate and automatically fill in the necessary application forms. The input consists of user-provided information and past data, and the output is an electronic form with the information already filled in. The server returns this form to the user and requests final confirmation.

[0742] Step 9:

[0743] The user performs a final confirmation on their device. The input is the electronic form generated in step 8, and the output is instructions for submitting the form after confirmation. Based on these instructions, the server sends the data to the relevant authorities and completes the application process.

[0744] (Application Example 1)

[0745] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0746] In recent years, with the increasing complexity of childcare support systems, it has become difficult for parents to understand the details of these systems. Furthermore, there is a need for an effective system that allows for the rapid and efficient acquisition of diverse information and the smooth progress of application procedures. In addition, information omissions and errors in verification can occur in situations where information sharing within the family or collaborative work among multiple people is necessary. Therefore, a system is needed to solve these problems and reduce the burden on parents.

[0747] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0748] In this invention, the server includes information acquisition means for collecting and classifying materials from public institutions, generation means for summarizing the acquired materials and providing them in a format easily understood by parents, and interface means for receiving information requests from users using speech recognition and providing information visually or audibly. This makes it possible to provide parents with the information they need quickly and in an easy-to-understand manner, thereby facilitating the use of childcare support systems.

[0749] "Information acquisition methods" refer to technologies for efficiently collecting and classifying materials distributed by public institutions.

[0750] A "generation method" is a processing device that summarizes acquired materials and converts them into a format that is easy for parents to understand.

[0751] A "notification mechanism" is part of a system that receives information requests from users and provides relevant materials in a timely manner.

[0752] An "interface means" is a device that receives information requests using speech recognition and provides information to the user visually or audibly.

[0753] "Support measures" refer to the process of providing the necessary support to users when applying for subsidy programs.

[0754] "Automatic generation means" refers to technology that generates the necessary forms for grant applications and automatically fills in the required documents.

[0755] "Transmission method" refers to the technology that transfers necessary data to an external source based on final confirmation by the user.

[0756] "Collaboration methods" refer to mechanisms for facilitating the sharing of documents within a household.

[0757] "Integration means" refers to technology for integrating external application devices with data.

[0758] This invention is an AI agent system that efficiently collects and summarizes information on childcare support programs, providing comprehensive support from information provision to application procedures. The server uses web crawling technology and public APIs to collect materials related to childcare support from public institutions and stores them in a database. This database contains the latest information disseminated by local governments and the national government.

[0759] Users make information requests using a device equipped with voice recognition capabilities. For example, they might say, "I want to know about child allowances," and the server analyzes the request. Based on the analyzed request, a generative AI model is used to summarize the information and present it in a format that is easy for the user to understand. Natural language processing technologies such as OpenAI GPT are utilized to provide ambiguous or complex information in a clear and concise manner.

[0760] The information can be provided through both visual display and audio output, allowing users to choose the method that best suits their needs. Based on the information received, the terminal will begin assisting with the application process if necessary. A Python script automatically generates the required application documents, filling in the fields based on the information entered by the user. After final confirmation by the user, the data is sent to the remote institution.

[0761] Furthermore, the system allows for settings to share information within the household. Once the user configures these settings, the device integrates that information with external applications such as calendar apps. This feature allows other members of the household to share schedules and other information, facilitating smooth management of vaccination and school event schedules.

[0762] In particular, effective prompts for the generating AI model include requests such as, "Please summarize the latest changes related to the local government's childcare support system." For example, if a user requests, "I want to know the schedule for my next vaccination," the server will search for relevant information, the generating AI model will summarize that information and present it visually or audibly, and it can even be automatically added to the home calendar.

[0763] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0764] Step 1:

[0765] The server periodically collects data from public institution websites using web crawling technology. The server uses web crawler software to retrieve HTML and JSON data. This data is stored in a database for analysis and classification. The input is the URL of the target website, and the output is the collection of relevant childcare support information.

[0766] Step 2:

[0767] Users use a device equipped with speech recognition capabilities to input information requests regarding support programs via voice. The device converts this voice into digital data and then into text. The input here is the user's voice command, and the output is the information request in text format. Technologies such as the Google Cloud Speech-to-Text API are used for speech recognition.

[0768] Step 3:

[0769] The server receives text information sent from the terminal and uses a generative AI model to search for and summarize relevant materials. OpenAI GPT can be used as the generative AI model; the user's question text is provided as input, and a summarized answer is output. Natural language processing techniques are used in this process to perform semantic analysis and structuring of the information.

[0770] Step 4:

[0771] The terminal provides the user with summarized information received from the server, both visually and audibly. This allows the user to view the information on the display or receive it through audio. The input is summarized information from the server, and the output is the presentation of information to the user. Speech synthesis technology may be utilized at this stage.

[0772] Step 5:

[0773] When a user requests support with the application process, the terminal uses that information to communicate with the server and generate the necessary application documents. In this process, input is automatically filled in based on a template prepared in advance using a Python script, and the completed application documents are created as output.

[0774] Step 6:

[0775] After the application documents are verified, the terminal obtains final confirmation from the user before transmitting the data to an external organization via the server. The input is the application documents verified by the user, and the output is the transmission of data to the designated recipient. At this stage, security protocols such as SSL / TLS are commonly used.

[0776] Step 7:

[0777] The user configures information sharing within the home, and the device integrates this information with external application devices such as calendar apps. The input is the user's information sharing settings, and the output is the integrated calendar information. Data synchronization via API is often used in this scenario.

[0778] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0779] This invention is a system that uses an AI agent to facilitate childcare support and provides more personalized support by understanding the user's emotional state. This system has an information acquisition means for collecting and organizing information provided by local governments and the national government. In addition, it has a generation means for summarizing the collected information using a generation AI model and providing it to the user in an easy-to-understand manner.

[0780] Furthermore, the system incorporates an emotion engine that analyzes the user's emotions from voice and text data to recognize their current emotional state. Based on this emotion recognition, the system adjusts how information is presented and suggests the most appropriate support measures for the user.

[0781] For example, if the emotion engine determines that a user is experiencing stress related to childcare, it will prioritize displaying information and support systems that address that emotion. For instance, it might display information about local support groups or consultation services that can help alleviate childcare stress, enabling users to quickly resolve the challenges they face.

[0782] Furthermore, the emotion engine also works in conjunction with the information sharing function, appropriately communicating necessary information to family members and other collaborators based on the user's emotional state. For example, if the server detects that the user is defensive or exhausted, it will automatically notify the partner's device of important childcare-related tasks and encourage support.

[0783] In this way, the system according to the present invention provides meticulous support that takes the user's emotions into consideration, improving the richness and efficiency of daily life associated with childcare. Ultimately, it aims to reduce the mental burden on parents and make childcare more fulfilling.

[0784] The following describes the processing flow.

[0785] Step 1:

[0786] The server regularly collects information on childcare support programs from local governments and the national government and stores it in a database. It obtains the latest information through web crawling and public APIs using various data acquisition methods.

[0787] Step 2:

[0788] A user uses their device to request information about a specific childcare support program. For example, they might type, "I would like to know about information regarding prenatal and postnatal care."

[0789] Step 3:

[0790] The terminal sends the user's request to the server. The server retrieves relevant information from the database and summarizes the information using a generative AI model.

[0791] Step 4:

[0792] The generated summary information is sent to the device and notified to the user. The user can receive concise and specific information.

[0793] Step 5:

[0794] If a user wishes to apply for a specific program, they can request assistance with the procedure through their device. The server automatically generates the necessary forms, pre-fills the information, and sends them back to the device.

[0795] Step 6:

[0796] The device displays the generated application form to the user and prompts them to review its contents. Once the user reviews and agrees, the device sends the data and completes the application process.

[0797] Step 7:

[0798] Based on user input and voice data, the emotion engine analyzes the user's emotional state. For example, it can identify whether or not the user is feeling stressed.

[0799] Step 8:

[0800] Based on the recognized emotions, the server selects information appropriate to those emotions and sends it to the terminal. It also suggests additional support measures and information according to the emotions.

[0801] Step 9:

[0802] If a user wishes to share information within their household, they configure the necessary settings on their device. Based on the recognized emotional state, the server integrates the information with other household members and external applications to facilitate sharing.

[0803] This allows users to receive information and support that takes their emotions into consideration, contributing to reduced burden and more efficient parenting.

[0804] (Example 2)

[0805] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0806] In modern society, families raising children need access to a wide range of information, and personalized information tailored to individual circumstances is required to obtain appropriate support. However, it is difficult to quickly and effectively find the necessary information from a vast amount of data, and individualized support that takes into account the user's emotional state is particularly insufficient. This can increase mental burden and make parenting more difficult, so there is a need to solve this problem.

[0807] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0808] In this invention, the server includes information gathering means for collecting and organizing local government and national data, generation means for summarizing the data using a generative artificial intelligence model and providing it to users, and emotion analysis means for analyzing the user's voice and text data to identify their emotional state. This makes it possible to provide personalized information and propose support measures based on the user's emotional state.

[0809] "Information gathering means" refers to technologies for automatically collecting and organizing diverse data provided by local governments and the national government.

[0810] A "generative artificial intelligence model" is an artificial intelligence technology used to summarize and provide acquired data in an easily understandable format.

[0811] "Generation means" refers to a function that summarizes collected information and presents it to the user.

[0812] "Emotional analysis methods" refer to technologies that analyze a user's voice and text data to identify their emotional state.

[0813] "Personalized presentation methods" refer to functions that adjust the way information is presented according to the user's emotional state and propose individually optimized support measures.

[0814] "Information sharing methods" refer to technologies for notifying family members or collaborators of relevant information at the appropriate time.

[0815] "Support measures" refer to functions that assist users in the process of applying for childcare support programs.

[0816] "Automatic generation means" refers to technology for automatically generating necessary application documents and inputting the required information.

[0817] "Transmission method" refers to the technology used to transfer data and information created after user confirmation to an external source.

[0818] "Collaboration methods" refer to functions that facilitate data exchange in order to smoothly share information within the home.

[0819] This system is designed to support childcare. The server plays a central role in this system. The server automatically collects data from local government and municipal websites. This data collection uses software called a web crawler. The server starts up at a specific time in the morning to check if any new childcare support information is available.

[0820] The collected information is sent by the server to a generative artificial intelligence model. This model uses prompts for summarizing the information. For example, by using the prompt "Please summarize the latest childcare support information," the generative AI model organizes the information and generates a summary in a format that is easy for the user to understand.

[0821] The device is responsible for acquiring user voice and text data. In particular, voice data is collected using the smartphone's microphone and sent to emotion analysis tools. Voice recognition APIs and emotion analysis tools are used to analyze emotional states such as "stress" and "fatigue" from text and voice.

[0822] If the emotion analysis results indicate that the user is experiencing stress, the server generates information to provide support measures tailored to that emotion. For example, it requests information from the generating AI model using prompts such as, "Please tell me about effective childcare support to reduce stress." As a result, information on local support groups and consultation services is displayed on the user's device, with the aim of reducing the burden of daily childcare for the user.

[0823] Furthermore, the server also plays a role in notifying the appropriate person in the household of the user's emotional state. For example, if the system detects that the user is very tired, the server will send a suggestion message to the partner's terminal such as, "Please prepare dinner tonight." In this way, it also has a mechanism to promote the management and distribution of tasks within the household.

[0824] This system utilizes diverse hardware and software to automatically collect, analyze, and generate information, thereby more effectively supporting users in their parenting efforts.

[0825] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0826] Step 1:

[0827] The server collects childcare-related data from local government and municipal websites. The input to this process is a web crawler configuration file, and the output is the raw data retrieved. Data collection starts automatically at a specified time each day, with the web crawler patrolling the information sources to detect updates. When new data is found, the server records this data in the database.

[0828] Step 2:

[0829] The server uses a generative artificial intelligence model to generate a summary of the collected data. The input for this step is the raw data collected in step 1, and the output is information summarized in a way that is easy for the user to understand. To summarize the data, the prompt "Please summarize the latest childcare support information" is input to the generative AI model. The model generates the summary, and the server saves the result back to the database.

[0830] Step 3:

[0831] The device collects user voice and text data. The input for this step is the voice and text entered by the user into the smartphone, and the output is data transcribed into text by speech recognition software. Specifically, the smartphone's microphone is used to record the user's speech, which is then sent to the speech recognition API. The transcribed data is then passed to the sentiment analysis engine.

[0832] Step 4:

[0833] The server uses an emotion analysis engine to identify the user's emotional state. The input for this step is the text data generated in step 3, and the output is the identified emotional state. Labels such as "stress," "fatigue," and "joy" are used for emotion analysis, and the results are stored on the server again. Based on the analysis results, the next step is determined.

[0834] Step 5:

[0835] The server generates information and support measures tailored to the user's emotional state. The input for this step is the emotional state identified in step 4 and the information summarized in step 2, while the output is personalized support information. The prompt "Please tell me about effective childcare support to reduce stress" is used in the AI ​​model, and an optimized support plan is constructed based on the information provided by the model. The final information is displayed on the terminal.

[0836] Step 6:

[0837] The server shares information within the household based on the results of the sentiment analysis. The input for this step is the sentiment analysis results from step 4, and the output is the notification content sent to the collaborator's device. For example, upon receiving information that "the user is tired," the server sends a suggestion notification to the partner's smartphone such as "Please prepare dinner tonight." This promotes cooperation within the household.

[0838] (Application Example 2)

[0839] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0840] In modern society, parents raising children need access to a wealth of information and appropriate support. However, the sheer volume and disorganization of this information can increase stress. Furthermore, providing support that addresses parents' emotional needs presents a challenge. Therefore, there is a need to provide systems that enable parents to quickly and efficiently resolve challenges in child-rearing.

[0841] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0842] In this invention, the server includes information acquisition means for collecting and organizing information from local and governmental groups, generation means for summarizing the acquired information and providing it in a format easily understandable to users, and analysis means for analyzing the emotional state of users. This enables parents to obtain the necessary information appropriately and receive emotionally-based support.

[0843] "Information acquisition means" refers to means that have the function of collecting and organizing information from local governments and the national government.

[0844] A "generation method" is a means that has the function of summarizing acquired information and providing it in a format that is easy for users to understand.

[0845] A "notification means" is a means that has the function of receiving requests from users, searching for relevant information, and providing it.

[0846] An "analysis tool" is a tool that has the function of analyzing the emotional state of a user.

[0847] "Adjustment tools" are tools that have the function of adjusting the way information is presented based on emotions and proposing the most appropriate support.

[0848] "Support measures" refer to means that have the function of assisting users in applying for support programs.

[0849] An "automatic generation method" is a method that has the function of generating necessary documents and automatically filling in information.

[0850] A "transmission method" is a means that has the function of transmitting data after final confirmation by the user.

[0851] A "detection method" is a means that uses voice analysis to detect the user's emotions and presents support information.

[0852] "Means of collaboration" refer to means that facilitate information sharing within the household.

[0853] An "integration tool" is a means that has the function of integrating information with an external computer program.

[0854] A "means of communication" refers to a means of conveying information to a collaborator within the family, depending on one's emotional state.

[0855] To implement this invention, a system integrating specific functions is required. This system includes a server, a user terminal, related software, and an AI model. The server is equipped with information acquisition means for collecting and organizing necessary information from local governments and the national government. It also has generation means that uses a generation AI model to summarize the collected information and provide it in a format that is easy for parents and other caregivers to understand.

[0856] The user terminal has the function of receiving and analyzing the user's voice and text data as input. This analysis uses an emotion analysis engine that recognizes the user's emotions. Based on the user's emotional state, the server provides adjustment means to present the user with information that is appropriate to their emotions.

[0857] Furthermore, the system incorporates means of collaboration and integration to facilitate information sharing with external computer programs and family members. This allows users to quickly share appropriate information and receive efficient support, even in the stressful environment of childcare.

[0858] For example, if a user inputs a feeling such as "I've been feeling tired and stressed lately," the system detects that feeling and provides information on local stress reduction support groups and advice. Additionally, generative AI models are used to summarize information, which is useful in providing information that users can quickly understand.

[0859] An example of a prompt for the generating AI model is, "Please summarize the information in the following text: I've been feeling increasingly exhausted from childcare lately, so I'd like some advice on how to cope." In this way, the system can provide more personalized childcare support and emotionally resonant information to parents.

[0860] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0861] Step 1:

[0862] Users input statements related to childcare via their devices in either voice or text format. The input data is then converted from voice to text within the device and retrieved as text data.

[0863] Step 2:

[0864] The terminal sends text data to the server, which uses an emotion analysis engine to analyze the emotional state of the input text. This process analyzes the input text data and detects keywords that indicate emotions such as "fatigue" and "stress." The result of the analysis is an output of the user's emotional state.

[0865] Step 3:

[0866] The server selects appropriate information based on emotional states and prepares the base text for generating prompt sentences for the generative AI model. The server searches the collected local government and national information databases and retrieves the selected information.

[0867] Step 4:

[0868] The server sends prompt messages to the generative AI model, which then summarizes the selected informational data. These prompt messages include the user's emotional state and related information. Based on these prompt messages, the generative AI model summarizes the data and outputs information in a format easily understood by the user.

[0869] Step 5:

[0870] The server sends summarized information back to the terminal, which then displays the information on its screen or provides feedback to the user via audio. At this stage, the information selected by the user is provided visually or audibly, presenting the user with emotionally relevant and appropriate childcare support information.

[0871] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0872] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0873] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0874] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0875] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0876] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0877] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0878] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0879] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0880] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0881] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0882] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0883] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0884] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0885] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0886] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0887] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0888] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0889] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0890] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0891] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0892] The following is further disclosed regarding the embodiments described above.

[0893] (Claim 1)

[0894] Information acquisition methods for collecting and organizing information from local governments and the national government,

[0895] A means of generating information to summarize the acquired information and provide it in a format that is easy for parents to understand,

[0896] A notification means that receives information requests from users, searches for relevant information, and provides it,

[0897] A system that includes this.

[0898] (Claim 2)

[0899] Support measures to assist users in applying for support programs,

[0900] An automated generation means for generating the necessary forms and automatically filling in the information,

[0901] A transmission method that sends data after final confirmation by the user,

[0902] The system according to claim 1, including the following:

[0903] (Claim 3)

[0904] A means of collaboration to promote information sharing within the family,

[0905] Integration means for integrating information with external applications,

[0906] A means of sending selected information to other household members,

[0907] The system according to claim 1, including the following:

[0908] "Example 1"

[0909] (Claim 1)

[0910] Information acquisition methods for collecting and organizing publicly available information from local governments and the national government,

[0911] A data management system that stores collected information in a database and keeps it up-to-date,

[0912] A means of generating information to summarize the acquired information and provide it in a format that is easy for parents to understand,

[0913] A notification means that receives information requests from users, searches for relevant information, and provides it,

[0914] A data integration means for integrating and efficiently processing data obtained from multiple sources,

[0915] A system that includes this.

[0916] (Claim 2)

[0917] Support measures to assist users in applying for support programs,

[0918] An automated generation means for generating the necessary forms and automatically filling in the information,

[0919] A data referencing mechanism for optimizing the application process by referring to past data,

[0920] A transmission method that sends data after final confirmation by the user,

[0921] The system according to claim 1, including the following:

[0922] (Claim 3)

[0923] A means of collaboration to promote information sharing within the family,

[0924] Integration means for integrating information with external applications,

[0925] Information customization means for providing customized information to family members,

[0926] A means of sending selected information to other household members,

[0927] The system according to claim 1, including the following:

[0928] "Application Example 1"

[0929] (Claim 1)

[0930] Information acquisition methods for collecting and classifying materials from public institutions,

[0931] A means of generating data to summarize acquired materials and provide them in a format that is easy for parents to understand,

[0932] A notification means that receives information requests from users, searches for and provides relevant materials,

[0933] An interface means that receives information requests using speech recognition and provides information visually or audibly,

[0934] A system that includes this.

[0935] (Claim 2)

[0936] Support measures to assist users in applying for subsidy programs,

[0937] An automated generation method for generating the necessary forms and automatically filling in documents,

[0938] A transmission method that transfers data after final confirmation by the user,

[0939] The system according to claim 1, including the following:

[0940] (Claim 3)

[0941] Collaboration methods to promote the sharing of documents within the home,

[0942] Integration means for integrating data with external application devices,

[0943] A means of sending selected materials to other members of the household,

[0944] The system according to claim 1, including the following:

[0945] "Example 2 of combining an emotion engine"

[0946] (Claim 1)

[0947] Information gathering methods for collecting and organizing data from local governments and the national government,

[0948] A generation method for summarizing acquired data using an artificial intelligence model and providing it in a format that is easy for users to understand,

[0949] An emotion analysis means for identifying an emotional state by analyzing the user's voice and text data,

[0950] A personalized presentation method that adjusts the way information is presented based on emotional state and proposes individualized support measures,

[0951] A means of sharing information to notify family members and collaborators of relevant information,

[0952] A system that includes this.

[0953] (Claim 2)

[0954] Support measures to assist users in applying for support programs,

[0955] An automated generation method for generating necessary documents and automatically filling in data,

[0956] A means of transmission for transferring data after final confirmation by the user,

[0957] The system according to claim 1, including the following:

[0958] (Claim 3)

[0959] Collaboration methods to promote data sharing within the home,

[0960] Integration means for integrating data with external programs,

[0961] A means of transmitting selected data to other household members,

[0962] The system according to claim 1, including the following:

[0963] "Application example 2 when combining with an emotional engine"

[0964] (Claim 1)

[0965] Information acquisition methods for collecting and organizing information from local government and government groups,

[0966] A means of generating information to summarize the acquired information and provide it in a format that is easy for users to understand,

[0967] A notification means that receives requests from users, searches for and provides relevant information,

[0968] An analytical means for analyzing the emotional state of users,

[0969] A means of adjusting the way information is presented based on emotions and proposing the most appropriate support,

[0970] A system that includes this.

[0971] (Claim 2)

[0972] Support measures to assist users in applying for support programs,

[0973] An automated generation means for generating necessary documents and automatically filling in information,

[0974] A transmission method that sends data after final confirmation by the user,

[0975] A detection means for detecting the user's emotions using voice analysis and presenting support information,

[0976] The system according to claim 1, including the following:

[0977] (Claim 3)

[0978] A means of collaboration to promote information sharing within the family,

[0979] An integration means for integrating information with external computer programs,

[0980] A means of transmitting selected information to other household members,

[0981] A means of communication for conveying information to family members in accordance with their emotional state,

[0982] The system according to claim 1, including the following: [Explanation of Symbols]

[0983] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. Information acquisition methods for collecting and classifying materials from public institutions, A means of generating data to summarize acquired materials and provide them in a format that is easy for parents to understand, A notification means that receives information requests from users, searches for and provides relevant materials, An interface means that receives information requests using speech recognition and provides information visually or audibly, A system that includes this.

2. Support measures to assist users in applying for subsidy programs, An automated generation method for generating the necessary forms and automatically filling in documents, A transmission method that transfers data after final confirmation by the user, The system according to claim 1, including the following:

3. Collaboration methods to promote the sharing of documents within the home, Integration means for integrating data with external application devices, A means of sending selected materials to other members of the household, The system according to claim 1, including the following:

Images