system

Abstract

We provide the system. [Solution] A means of analyzing individual needs based on user input information, A means of providing the generated information as individualized advice regarding marriage activities, pregnancy, childcare, and household financial management, A means of displaying relevant information and suggestions on a corresponding terminal, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a society with a declining birthrate, the lack of knowledge and support regarding marriage activities, pregnancy, child-rearing, and household management has become a significant burden for individuals and families. Therefore, it is necessary to develop a system that provides efficient and comprehensive support for these issues.

Means for Solving the Problems

[0005] This invention constructs a system that analyzes user input information to understand individual needs and uses generating AI to provide personalized advice on marriage activities, pregnancy, childcare, and household financial management. This system effectively solves conventional problems by displaying relevant information on a corresponding terminal and providing means to promote interaction among users through community forums and group chats.

[0006] A "user" is an individual or organization that uses the platform to receive support for marriage activities, pregnancy, childcare, and household finances.

[0007] "Input information" refers to data such as personal information, interests, and household financial information that users provide to the platform.

[0008] "Needs" refer to the individual requests, information needs, and support requirements that users have.

[0009] "Generative AI" is an artificial intelligence technology that analyzes input data and generates optimal advice and information for the user.

[0010] "Marriage-seeking activities" refer to activities undertaken by users with the aim of forming a marriage or partnership.

[0011] "Pregnancy" refers to the state of being in the process of a user or their family receiving a new life.

[0012] "Childcare" refers to all activities related to the upbringing and education of infants and children.

[0013] "Household financial management" refers to the activity of efficiently managing a user's income and expenses to achieve financial stability.

[0014] A "community forum" is an online platform for users to exchange information and interact with each other.

[0015] "Group chat" is a function that enables multiple users to send and receive text messages in real time for communication purposes.

Brief Explanation of Drawings

[0016] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which multiple emotions are mapped. [Figure 10] It shows an emotion map to which multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Embodiment for Carrying out the Invention

[0017] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0020] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0021] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] This invention provides a comprehensive system for users to receive support regarding marriage activities, pregnancy, childcare, and household finances. The system begins with the user accessing the platform and entering the necessary data.

[0038] Users input personal information, interests, and household financial data through the interface. This information is used as foundational data for providing the various support services described below.

[0039] The server stores data received from users and analyzes individual needs using AI algorithms. Based on this analysis, it creates support plans for marriage activities and childcare. For marriage activities, it suggests events and potential partners that match the user's hobbies and values.

[0040] Pregnant users receive information and advice tailored to their health status and gestational week. This includes, for example, guidance on proper nutrition and exercise, and reminders for regular checkups. This information is customized based on the user's input, making it more personalized and practical.

[0041] Regarding childcare support, the system provides tips and recommended activities tailored to each stage of development. For example, during infancy, the server displays recommended toys that promote language development and videos on self-care to the user's device.

[0042] The household budgeting feature analyzes the user's income and spending patterns and provides specific advice on how to manage their budget. This advice also includes information on available government subsidies and saving tips.

[0043] Furthermore, this system includes online community forums and group chat functions, providing users with opportunities to interact with other users who share similar needs. This broadens the scope of support, as users can refer not only to their own opinions but also to those of other users.

[0044] This system allows users to receive personalized information and support at each stage of marriage, pregnancy, childcare, and household finance management. In this way, the system contributes to addressing the declining birthrate and supports the creation of a better family environment.

[0045] The following describes the processing flow.

[0046] Step 1:

[0047] Users access the platform through a dedicated interface and input personal information, interests, and household financial data. This prepares the system to form a basic profile of the user.

[0048] Step 2:

[0049] The server receives the input data and stores it in the database. Then, it performs analysis based on the collected data to identify the individual needs of the user.

[0050] Step 3:

[0051] The server utilizes generative AI to generate personalized advice on marriage activities, pregnancy, childcare, and household finances, tailored to identified needs.

[0052] Step 4:

[0053] The device displays the generated advice to the user. In the context of matchmaking, information on events and potential partners suited to the user's attributes is presented.

[0054] Step 5:

[0055] Based on the advice received, users can consider specific actions related to marriage and pregnancy. They can request further information or customization if necessary.

[0056] Step 6:

[0057] The server generates and sends professional information and advice tailored to the user's health condition and gestational week to their device.

[0058] Step 7:

[0059] The device displays pregnancy-related advice and health management information to the user, enabling them to maintain appropriate lifestyle habits during pregnancy.

[0060] Step 8:

[0061] When a user seeks childcare support, they enter their questions and concerns about childcare into the platform.

[0062] Step 9:

[0063] The server analyzes the input childcare-related information, generates childcare methods and recommended activities appropriate for the child's developmental stage, and provides them to the terminal.

[0064] Step 10:

[0065] The device displays childcare information provided to the user and helps them incorporate that information into their daily life.

[0066] Step 11:

[0067] Users enter their household financial information and request advice on household financial management.

[0068] Step 12:

[0069] The server analyzes the user's income and expense data and generates an efficient household budget management plan. It also provides information on available subsidies and other relevant resources.

[0070] Step 13:

[0071] The device notifies the user of the generated household budget management plan and subsidy information, and suggests actionable steps.

[0072] (Example 1)

[0073] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0074] In modern society, individuals face the challenge of difficulty in effectively obtaining the information and support they need at crucial junctures in their lives, such as marriage, pregnancy, child-rearing, and financial management. Furthermore, there is a growing need for personalized, specific, and practical information to be provided. Additionally, there is an increasing need for platforms that facilitate interaction among users and allow for the sharing of knowledge and experiences.

[0075] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0076] This invention includes a server that analyzes individual requests based on user input information, provides information generated using a generative AI model as individualized advice related to marriage activities, pregnancy, childcare, and financial management, and generates and provides customized educational materials and health guidance tailored to the user's health condition and stage of development. This enables users to receive specific support that meets their needs and to obtain appropriate information and support at each stage of life. In addition, online forums and group communication functions enable users to share knowledge and experiences with each other.

[0077] "User input information" refers to a collection of data, including personal information, interests, and family-related data, provided by individuals using the system through the interface.

[0078] "Means for analyzing individual requests" refers to algorithms or processes that analyze user input information to identify the specific needs and requests of that individual.

[0079] A "generative AI model" is a form of artificial intelligence that uses machine learning techniques to learn patterns in data and generate information and suggestions related to a specific task.

[0080] "Individualized advice related to marriage activities, pregnancy, childcare, and financial management" refers to personalized support information and recommendations tailored to the specific situations users face at different stages of their lives.

[0081] "Customized educational materials and health guidance tailored to health status and developmental stage" refers to information that provides individualized educational content and health guidance based on the user's health information, age, and progress in childcare.

[0082] "Online forums and group communication functions" refer to digital platforms and communication methods that allow users to exchange opinions and share experiences with each other.

[0083] "Budget management plans and public financial support information based on financial information" is a dataset designed to analyze a user's income and expenditure situation and provide optimal budget management methods and information on available public subsidies.

[0084] This invention provides a system that allows users to receive comprehensive support regarding marriage activities, pregnancy, childcare, and financial management. Users input personal information, interests, and family-related data through the system's interface. This data forms the basis for providing personalized support based on the user's requests. For example, a user might input a prompt such as, "I'm looking for a family summer vacation plan within my budget."

[0085] The server securely stores data received from users in a database. A standard database management system can be used for data storage and management. The server further analyzes user data using generative AI models to create individually customized information. These AI models utilize natural language processing and machine learning algorithms.

[0086] Specifically, the server suggests events and potential partners based on the user's interests in their marriage search. For pregnant users, it analyzes health data to provide advice tailored to their health status and gestational week, creating appropriate nutritional guidance, exercise advice, and reminders for regular checkups.

[0087] Furthermore, the server generates and provides information on educational materials and activities appropriate for each stage of development to support the user's childcare. For example, during early childhood, it may display recommendations for toys that aid language development and links to self-care-related videos on the device.

[0088] For financial management, the server analyzes the user's income and expenses and provides an optimal budget management plan. This can include information on public subsidies and savings advice.

[0089] Furthermore, the server features online forums and group chat functions to facilitate interaction among users. Users can share their opinions and experiences with other users and receive broader support. This communication function has an interface that is easy for end users to use.

[0090] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0091] Step 1:

[0092] Users enter their personal information, interests, and family-related data through the interface. This data is entered using text boxes and dropdown menus. For example, if a user enters the prompt "I'm looking for budget-friendly weekend events that my family can attend," this becomes input to the server.

[0093] Step 2:

[0094] The server securely stores data received from users in a database. Here, it checks for duplicate data and updates new information. This data storage process forms the basis for later analysis. The input is raw data entered by the user, and it is output in a neatly organized format within the database.

[0095] Step 3:

[0096] The server analyzes the accumulated data using a generating AI model. The analysis process identifies individual requests based on the input user information and generates personalized support information. The AI ​​model uses natural language processing to understand the intent of prompts, for example, by suggesting events that match the user's interests. The input is organized user data, and the output is customized support information.

[0097] Step 4:

[0098] The server generates a customized plan from the analyzed information and displays it on the terminal. At this stage, specific advice and recommendations tailored to the user's situation are provided. For example, a pregnant user will be shown nutritional guidance and exercise advice tailored to their health condition. The input is the analyzed data, and the output is the customized plan displayed to the user.

[0099] Step 5:

[0100] The terminal visually presents information provided by the server to the user, enabling practical assistance. Users can view the information through the terminal's screen and take action as needed. Specifically, they can view details of provided events and register to participate if interested. The terminal's input is a custom plan, and its output is the user's perception and actions.

[0101] Step 6:

[0102] The server oversees online forums and group chat functions, facilitating communication among users. Through interaction with other users, users can share their experiences and information, thereby gaining broader knowledge. Input consists of user posts and comments, while output is interaction and information feedback from other users.

[0103] (Application Example 1)

[0104] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0105] In today's busy lifestyle, users often have difficulty accessing the necessary information and support at each stage of life, such as marriage, pregnancy, childcare, and household finances. Furthermore, there is a lack of products and services tailored to individual users, creating a need for a comprehensive support system that can appropriately address these life stages.

[0106] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0107] In this invention, the server includes means for analyzing data based on user input information and extracting individual needs; means for providing the generated information as individual advice regarding marriage activities, pregnancy, childcare, and household financial management; means for proposing customized products and services based on the analyzed data and displaying them on a corresponding information processing device; and means for processing user input information and proposing information appropriate to the life stage. As a result, users can receive personalized and appropriate information and product suggestions for each life stage.

[0108] "User input information" refers to personal information such as profiles, interests, and financial status that users themselves input into the system through the interface.

[0109] "Means of analyzing data" refer to technical methods and processes for analyzing user input information to identify individual needs and trends.

[0110] "Methods for extracting individual needs" refer to techniques for clarifying specific requests and needs for each user based on the analysis results.

[0111] "Generated information" refers to information such as advice and suggestions that users are seeking, derived from data analysis.

[0112] "Individualized advice on marriage activities, pregnancy, childcare, and household financial management" refers to specific and expert advice in each area tailored to the user's life stage.

[0113] "Customized products and services" refer to a list of products and services that have been adjusted and optimized based on the individual needs and life stage of the user.

[0114] An "information processing device" is a digital device used to display generated information and proposed products / services to users.

[0115] "Means of suggesting information tailored to life stage" refers to a function that takes into account the user's current stage in life and provides information that is appropriate for that stage.

[0116] This invention provides a system for users to receive necessary information and product suggestions regarding marriage activities, pregnancy, childcare, and household finance management. The system mainly consists of the following components:

[0117] The server receives user input and analyzes the data using an AI model. Specifically, a program using Python and Flask processes and analyzes the user's data. The AI ​​model utilizes TENSORFLOW® and PyTorch to extract the user's individual needs. The cloud platform uses Google® Cloud AI Platform to provide a scalable data analysis environment.

[0118] Based on the analysis results, the server generates and suggests advice and product information best suited to each user's needs. This generated information is displayed on the user's information processing device, specifically a smartphone app developed with React Native. This app provides an interface for reviewing and purchasing the suggested products and services.

[0119] Users can access the application via their smartphones and visually view information tailored to their life stage. Furthermore, users can send prompts to the AI ​​generating system to receive more personalized suggestions.

[0120] As a concrete example, a user might send a prompt such as, "Please list products for users in their 30s who are planning to get married, interested in childcare, and prioritize household budget management." The server then creates a product list tailored to the user's needs and displays the results on their smartphone. This approach allows users to smoothly make the best choices that suit their life stage.

[0121] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0122] Step 1:

[0123] Users input basic information about marriage activities, pregnancy, childcare, and household finances, as well as personal interests and household financial data, through a smartphone application. The entered data is sent to the server in JSON format.

[0124] Step 2:

[0125] The server receives data sent by the user and stores it in the database. Firebase is used as the database for this purpose. In this step, the integrity of the user's data is verified and any missing information is checked.

[0126] Step 3:

[0127] The server supplies stored data to the AI ​​model, which then analyzes individual needs. The AI ​​model is trained using TensorFlow and generates necessary advice and product information for each stage of the user's life. It analyzes features extracted from the input data to generate optimal advice.

[0128] Step 4:

[0129] Based on the output information from the AI ​​model, the server selects customized products and services. In this process, it generates prompt messages (e.g., "Please list products for users in their 30s who are planning to get married, interested in childcare, and prioritize household budget management") and creates a list of suggested products.

[0130] Step 5:

[0131] The server sends a list of generated products and services to a smartphone application. This information is displayed on a user interface built with React Native, allowing users to visually see options optimized for their needs.

[0132] Step 6:

[0133] Based on the suggested information, users can select and purchase the necessary products and services. This interaction takes place within the application, and detailed information corresponding to the selected service or product is displayed on the device.

[0134] By repeating the above steps, users can always receive the latest information relevant to their current life stage.

[0135] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0136] This invention combines a system for users to receive support regarding marriage activities, pregnancy, childcare, and household finances with an emotion recognition engine. Based on the user's input information, the system identifies individual needs and provides more personalized advice by analyzing the user's emotional state at any given time using the emotion engine.

[0137] Users access the platform through a dedicated interface and provide input that expresses their emotions through text, voice, images, etc. The emotion engine analyzes this input data to identify the user's emotions. This emotion information is stored as part of the user profile.

[0138] The server uses AI to generate advice best suited to the user's situation, based on collected emotional information. For example, if a user is feeling stressed, it provides suggestions for relaxing activities or counseling information. This enables flexible support tailored to the user's emotional state.

[0139] The device displays advice and support information to the user based on emotions received from the server. In the case of matchmaking activities, if the user has positive emotions, it displays information that encourages active participation in events; if negative emotions are detected, it presents encouraging content.

[0140] For example, if a user is experiencing anxiety during pregnancy, the emotion engine will detect this emotional state, and the server will provide specific advice and support information to alleviate reassurance, as well as reliable resources related to pregnancy and childcare. In this way, the present invention builds a system that takes the user's emotions into consideration, responding to individual needs and providing more appropriate support.

[0141] Furthermore, this system includes community forums and group chat functions to facilitate interaction among users, and by utilizing emotion recognition technology, it enables users to understand each other's emotions and engage in more constructive communication.

[0142] The following describes the processing flow.

[0143] Step 1:

[0144] Users input text messages or voice data to the system to express their emotions. This provides the emotion engine with the necessary background data to identify the user's current mood.

[0145] Step 2:

[0146] The server receives the input data and uses an emotion engine to analyze the emotional state. As a result of the analysis, emotional categories such as "joy," "excitement," "anxiety," and "sadness" are identified.

[0147] Step 3:

[0148] The server integrates the analyzed sentiment information into user profiles. This allows for tracking each user's emotional tendencies and patterns.

[0149] Step 4:

[0150] Based on emotional information, the server uses generative AI to generate appropriate advice for the user regarding marriage activities, pregnancy, childcare, and household finances. For example, if anxiety is detected, it prepares support information and resources to calm the user.

[0151] Step 5:

[0152] The device displays generated advice and information on its screen. When the user is in a state of "joy," information that encourages positive action is prioritized.

[0153] Step 6:

[0154] Users receive emotion-based advice and implement strategies related to marriage, pregnancy, childcare, and household finances. They can also request further information or customization if needed.

[0155] Step 7:

[0156] The server utilizes an emotion engine to support smoother communication between users when they participate in forums or group chats.

[0157] Step 8:

[0158] The device facilitates interaction with other users by suggesting appropriate communication methods and topics based on the user's emotional state. This ensures that interactions are sensitive to the user's feelings.

[0159] (Example 2)

[0160] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0161] In modern society, stress is increasing in various aspects of life, such as marriage, child-rearing, and financial management. In this context, there is a lack of support systems that provide personalized advice that takes into account individual emotional states. Furthermore, there is a need for effective community building to foster interaction among users. Conventional systems have faced challenges in providing flexible responses based on emotional states and real-time advice.

[0162] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0163] In this invention, the server includes means for analyzing individual needs based on user input information, means for identifying emotional states using analysis means and generating individual advice, and means for generating and presenting emotion-based advice using a generative AI model. This enables the provision of personalized advice tailored to the user's emotional state and promotes community interaction.

[0164] A "user" refers to an individual or organization that uses the system to input information and receives personalized advice or support based on that information.

[0165] "Input information" refers to data such as text, audio, and images that users provide to the system, and it forms the basis for analyzing individual needs and emotional states.

[0166] "Individual needs" refer to the specific advice and support that users require based on their individual circumstances and emotional state.

[0167] "Analysis means" refers to technologies and processes used to analyze user input information and identify emotional states and individual needs.

[0168] "Emotional state" refers to information that represents the user's current psychological state or mood, and is an element that can be identified by analytical means.

[0169] A "generative AI model" refers to a computational model or algorithm used to generate advice and information based on user input using artificial intelligence.

[0170] An "information display device" refers to a terminal or interface device used to display information and advice provided by a server to the user.

[0171] "Community interaction" refers to online or offline activities aimed at sharing information and emotions among users and deepening their relationships.

[0172] "Financial information" refers to all data that forms the basis for financial management, such as a user's income, expenses, and asset status.

[0173] This invention is a system for users to receive support regarding marriage activities, childcare, and financial management, and incorporates an emotion engine that recognizes emotions. Users access the system using an interface and provide input that expresses emotions in text, voice, or images. The server receives this input information and analyzes it using the emotion engine. The emotion engine often employs natural language processing and computer vision technologies, specifically using commonly available natural language APIs and emotion recognition APIs. The analysis results are stored in the user profile, enabling support tailored to individual needs.

[0174] The server uses a generative AI model based on the analysis results from the emotion engine to generate advice tailored to the user's state. Commonly used natural language generation models can be applied as the generative AI. An example of a prompt is, "The user has been feeling stressed recently. Please provide suggestions for relaxation." This AI model can generate personalized information that takes emotional states into account.

[0175] The device displays advice and information received from the server to the user. For example, if the user is experiencing stress related to childcare, the device might display, "Listening to music is a recommended way to relax while raising children." In this way, the device provides advice along with related information and reference links, making it easy for the user to access helpful information.

[0176] This system not only provides information but also features community forums and group chat functions, allowing users to interact with each other. The server collects user feedback and uses it to improve the system. Specifically, after receiving advice, users can perform a brief evaluation of its effectiveness and send feedback through their device. This feedback information is collected by the server and becomes a valuable source of information for improving the service.

[0177] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0178] Step 1:

[0179] Users express their emotions through a dedicated interface by providing input in the form of text, audio, or image data. Based on this, the emotion engine acquires data to identify the user's emotional state. The input information includes text messages about everyday anxieties and stresses, voice expressions of feelings, and images that reflect emotions.

[0180] Step 2:

[0181] The server processes the input data received by the emotion engine, specifically using natural language processing and computer vision technologies to identify emotions. This data processing involves keyword extraction and the application of emotion models to quantify the user's emotional state (e.g., stress, relief, joy). The analyzed emotional state is then output and recorded in the user profile.

[0182] Step 3:

[0183] The server uses natural language generation technology, a generative AI model, to generate advice tailored to the user's situation, based on the output from the emotion engine. The input data is the result of an analysis of the emotional state, and the generative AI model is given a prompt in the format of "Please suggest countermeasures for the stress the user is feeling." In terms of data processing, the AI ​​model generates the optimal countermeasures, and specific advice is provided as output.

[0184] Step 4:

[0185] The device visually displays advice provided by the server to the user. Specifically, related resources and links are presented on the user's screen along with the advice. For example, advice such as "Try listening to meditation music as a way to relax" might be displayed. In this case, links to related apps and other resources are also displayed so that the user can take action immediately.

[0186] Step 5:

[0187] Users provide feedback on the advice they receive. This includes a function within the app to evaluate the usefulness of the advice and suggest areas for improvement. The feedback received is stored on the server, contributing to system improvements and increased accuracy in future advice generation.

[0188] (Application Example 2)

[0189] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0190] Traditional support systems for marriage activities, pregnancy, childcare, and household finance management have struggled to understand users' emotions in real time and provide personalized recommendations. Furthermore, the inability to recommend products based on the user's emotional state poses a challenge, potentially leading to decreased satisfaction.

[0191] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0192] In this invention, the server includes means for analyzing individual needs based on user input information, means for providing the generated information as individualized advice regarding marriage activities, pregnancy, childcare, and household financial management, means for displaying relevant information and suggestions on a corresponding terminal, and means for presenting relevant recommendation items based on sentiment analysis. This enables personalized support and product recommendations tailored to the user's emotional state.

[0193] "Means of analyzing individual needs based on user input information" refers to technologies that receive data such as text, audio, and images provided by users and identify and analyze the user's current situation and requests.

[0194] "A means of providing generated information as individualized advice on marriage activities, pregnancy, childcare, and household financial management" refers to a technology that provides users with specific and appropriate advice and information related to each area, based on the analyzed needs of the user.

[0195] "Means for displaying relevant information and suggestions on a corresponding terminal" refers to technologies for visually or audibly presenting analysis results and recommended information on the user's terminal device.

[0196] "Means of presenting relevant recommendations based on sentiment analysis" refers to technologies that analyze a user's emotional state and select and recommend products or services that are appropriate for that state.

[0197] In the system that implements this application, users express their emotions in the form of text, voice, images, etc., using smart devices. The devices are equipped with a dedicated application that sends this data to a server. This data is analyzed by a software platform that includes an emotion analysis engine. The emotion engine identifies the user's emotional state, for example, using the TensorFlow library. This identified emotion data is then used with generative AI to recommend products and services.

[0198] The server uses a recommendation system called ProductRecommender to suggest products that are tailored to the user's emotions and needs. This recommendation information is displayed in real time on smartphones and other devices and is optimized according to the user's viewing situation and emotions. For example, if the system determines that the user is feeling stressed, it can generate prompts recommending products that are effective for relaxation and mood improvement.

[0199] By using a generative AI model, dynamic recommendations can be made that respond to changes in the user's emotions. For example, the system might receive a request such as, "Generate a list of recommended products for when the user is seeking relaxation," and then provide corresponding recommendations.

[0200] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0201] Step 1:

[0202] Users express their emotions using text, voice, and images, and input them into the device. The device sends this input data to the server in real time. The input is the user's emotional information, and the output is the transmission of the input data to the server.

[0203] Step 2:

[0204] The server passes the received input data to the sentiment analysis engine. The sentiment analysis engine analyzes the input data and uses the TensorFlow library to identify the user's emotional state. The input is the user's input data, and the output is the identified emotional state.

[0205] Step 3:

[0206] The server passes the identified emotional state to the generating AI, which uses the ProductRecommender system to generate a list of appropriate product recommendations. The input is emotional state data, and the output is a product recommendation list optimized for the user.

[0207] Step 4:

[0208] The server sends the generated recommendation list to the terminal. The terminal receives this data and displays it to the user. The input is the recommendation list data, and the output is the recommendation information displayed on the user's terminal.

[0209] Step 5:

[0210] Users review product and service recommendations displayed on their devices and make selections or purchases as needed. The input is the displayed recommendation information, and the output is the user's selection or action.

[0211] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0212] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0213] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0214] [Second Embodiment]

[0215] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0216] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0217] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0218] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0219] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0220] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0221] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0222] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0223] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0224] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0225] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0226] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0227] This invention provides a comprehensive system for users to receive support regarding marriage activities, pregnancy, childcare, and household finances. The system begins with the user accessing the platform and entering the necessary data.

[0228] Users input personal information, interests, and household financial data through the interface. This information is used as foundational data for providing the various forms of support described below.

[0229] The server stores data received from users and analyzes individual needs using AI algorithms. Based on this analysis, it creates support plans for marriage activities and childcare. For marriage activities, it suggests events and potential partners that match the user's hobbies and values.

[0230] Pregnant users receive information and advice tailored to their health status and gestational week. This includes, for example, guidance on proper nutrition and exercise, and reminders for regular checkups. This information is customized based on the user's input, making it more personalized and practical.

[0231] Regarding childcare support, the system provides tips and recommended activities tailored to each stage of development. For example, during early childhood, the server displays recommended toys that promote language development and videos on self-care to the user's device.

[0232] The household budgeting feature analyzes the user's income and spending patterns and provides specific advice on how to manage their budget. This advice also includes information on available government subsidies and saving tips.

[0233] Furthermore, this system includes online community forums and group chat functions, providing users with opportunities to interact with other users who share similar needs. This broadens the scope of support, as users can refer not only to their own opinions but also to those of other users.

[0234] This system allows users to receive personalized information and support at each stage of marriage, pregnancy, childcare, and household finance management. In this way, the system contributes to addressing the declining birthrate and supports the creation of a better family environment.

[0235] The following describes the processing flow.

[0236] Step 1:

[0237] Users access the platform through a dedicated interface and input personal information, interests, and household financial data. This prepares the system to form a basic profile of the user.

[0238] Step 2:

[0239] The server receives the input data and stores it in the database. Then, it performs analysis based on the collected data to identify the individual needs of the user.

[0240] Step 3:

[0241] The server utilizes generative AI to generate personalized advice on marriage activities, pregnancy, childcare, and household finances, tailored to identified needs.

[0242] Step 4:

[0243] The device displays the generated advice to the user. In the context of matchmaking, information on events and potential partners suited to the user's attributes is presented.

[0244] Step 5:

[0245] Based on the advice received, users can consider specific actions related to marriage and pregnancy. They can request further information or customization if necessary.

[0246] Step 6:

[0247] The server generates and sends professional information and advice tailored to the user's health condition and gestational week to their device.

[0248] Step 7:

[0249] The device displays pregnancy-related advice and health management information to the user, enabling them to maintain appropriate lifestyle habits during pregnancy.

[0250] Step 8:

[0251] When a user seeks childcare support, they enter their questions and concerns about childcare into the platform.

[0252] Step 9:

[0253] The server analyzes the input childcare-related information, generates childcare methods and recommended activities appropriate for the child's developmental stage, and provides them to the terminal.

[0254] Step 10:

[0255] The device displays childcare information provided to the user and helps them incorporate that information into their daily life.

[0256] Step 11:

[0257] Users enter their household financial information and request advice on household financial management.

[0258] Step 12:

[0259] The server analyzes the user's income and expense data and generates an efficient household budget management plan. It also provides information on available subsidies and other relevant resources.

[0260] Step 13:

[0261] The device notifies the user of the generated household budget management plan and subsidy information, and suggests actionable steps.

[0262] (Example 1)

[0263] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0264] In modern society, individuals face the challenge of difficulty in effectively obtaining the information and support they need at crucial junctures in their lives, such as marriage, pregnancy, child-rearing, and financial management. Furthermore, there is a growing need for personalized, specific, and practical information to be provided. Additionally, there is an increasing need for platforms that facilitate interaction among users and allow for the sharing of knowledge and experiences.

[0265] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0266] This invention includes a server that analyzes individual requests based on user input information, provides information generated using a generative AI model as individualized advice related to marriage activities, pregnancy, childcare, and financial management, and generates and provides customized educational materials and health guidance tailored to the user's health condition and stage of development. This enables users to receive specific support that meets their needs and to obtain appropriate information and support at each stage of life. In addition, online forums and group communication functions enable users to share knowledge and experiences with each other.

[0267] "User input information" refers to a collection of data, including personal information, interests, and family-related data, provided by individuals using the system through the interface.

[0268] "Means for analyzing individual requests" refers to algorithms or processes that analyze user input information to identify the specific needs and requests of that individual.

[0269] A "generative AI model" is a form of artificial intelligence that uses machine learning techniques to learn patterns in data and generate information and suggestions related to a specific task.

[0270] "Individualized advice related to marriage activities, pregnancy, childcare, and financial management" refers to personalized support information and recommendations tailored to the specific situations users face at different stages of their lives.

[0271] "Customized educational materials and health guidance tailored to health status and developmental stage" refers to information that provides individualized educational content and health guidance based on the user's health information, age, and progress in childcare.

[0272] "Online forums and group communication functions" refer to digital platforms and communication methods that allow users to exchange opinions and share experiences with each other.

[0273] "Budget management plans and public financial support information based on financial information" is a dataset designed to analyze a user's income and expenditure situation and provide optimal budget management methods and information on available public subsidies.

[0274] This invention provides a system that allows users to receive comprehensive support regarding marriage activities, pregnancy, childcare, and financial management. Users input personal information, interests, and family-related data through the system's interface. This data forms the basis for providing personalized support based on the user's requests. For example, a user might input a prompt such as, "I'm looking for a family summer vacation plan within my budget."

[0275] The server securely stores data received from users in a database. A standard database management system can be used for data storage and management. The server further analyzes user data using generative AI models to create individually customized information. These AI models utilize natural language processing and machine learning algorithms.

[0276] Specifically, the server suggests events and potential partners based on the user's interests in their marriage search. For pregnant users, it analyzes health data to provide advice tailored to their health status and gestational week, creating appropriate nutritional guidance, exercise advice, and reminders for regular checkups.

[0277] Furthermore, the server generates and provides information on educational materials and activities appropriate for each stage of development to support the user's childcare. For example, during early childhood, it may display recommendations for toys that aid language development and links to self-care-related videos on the device.

[0278] For financial management, the server analyzes the user's income and expenses and provides an optimal budget management plan. This can include information on public subsidies and savings advice.

[0279] Furthermore, the server features online forums and group chat functions to facilitate interaction among users. Users can share their opinions and experiences with other users and receive broader support. This communication function has an interface that is easy for end users to use.

[0280] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0281] Step 1:

[0282] Users enter their personal information, interests, and family-related data through the interface. This data is entered using text boxes and dropdown menus. For example, if a user enters the prompt "I'm looking for budget-friendly weekend events that my family can attend," this becomes input to the server.

[0283] Step 2:

[0284] The server securely stores the data received from the user in the database. Here, it checks for data duplication and updates new information. This data storage operation serves as the basic data for subsequent analysis. The input is the raw data entered by the user, and the output is in a neatly organized form within the database.

[0285] Step 3:

[0286] The server analyzes the stored data using a generative AI model. In the analysis process, it identifies individual requests based on the input user information and generates personalized assistance information. The AI model uses natural language processing to understand the intent of the prompt text and, for example, proposes events suitable for the user's hobbies. The input is the organized user data, and the output is the customized assistance information.

[0287] Step 4:

[0288] The server generates a customized plan from the analyzed information and displays it on the terminal. At this stage, specific advice and recommendations according to the user's situation are provided. For example, for a pregnant user, nutritional guides and exercise advice according to the health status are displayed. The input is the analyzed data, and the output is the custom plan displayed to the user.

[0289] Step 5:

[0290] The terminal visually presents the information provided by the server to the user to achieve practical assistance. The user checks the information through the terminal screen and takes actions as needed. Specifically, the user can check the details of the provided event and register for participation if interested. The input to the terminal is the custom plan, and the output is the user's recognition and actions.

[0291] Step 6:

[0292] The server oversees online forums and group chat functions, facilitating communication among users. Through interaction with other users, users can share their experiences and information, thereby gaining broader knowledge. Input consists of user posts and comments, while output is interaction and information feedback from other users.

[0293] (Application Example 1)

[0294] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0295] In today's busy lifestyle, users often have difficulty accessing the necessary information and support at each stage of life, such as marriage, pregnancy, childcare, and household finances. Furthermore, there is a lack of products and services tailored to individual users, creating a need for a comprehensive support system that can appropriately address these life stages.

[0296] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0297] In this invention, the server includes means for analyzing data based on user input information and extracting individual needs; means for providing the generated information as individual advice regarding marriage activities, pregnancy, childcare, and household financial management; means for proposing customized products and services based on the analyzed data and displaying them on a corresponding information processing device; and means for processing user input information and proposing information appropriate to the life stage. As a result, users can receive personalized and appropriate information and product suggestions for each life stage.

[0298] "User input information" refers to personal information such as profiles, interests, and financial status that users themselves input into the system through the interface.

[0299] "Means of analyzing data" refer to technical methods and processes for analyzing user input information to identify individual needs and trends.

[0300] "Methods for extracting individual needs" refer to techniques for clarifying specific requests and needs for each user based on the analysis results.

[0301] "Generated information" refers to information such as advice and suggestions that users are seeking, derived from data analysis.

[0302] "Individualized advice on marriage activities, pregnancy, childcare, and household financial management" refers to specific and expert advice in each area tailored to the user's life stage.

[0303] "Customized products and services" refer to a list of products and services that have been adjusted and optimized based on the individual needs and life stage of the user.

[0304] An "information processing device" is a digital device used to display generated information and proposed products / services to users.

[0305] "Means of suggesting information tailored to life stage" refers to a function that takes into account the user's current stage in life and provides information that is appropriate for that stage.

[0306] This invention provides a system for users to receive necessary information and product suggestions regarding marriage activities, pregnancy, childcare, and household finance management. The system mainly consists of the following components:

[0307] The server receives the user's input information and analyzes the data using an AI model. Specifically, a program using Python and Flask processes and analyzes the user's data. TensorFlow or PyTorch is used in the AI model to extract the user's individual needs. The cloud platform uses Google Cloud AI Platform to provide a scalable data analysis environment.

[0308] Based on the analysis results, the server generates and proposes the advice and product information most suitable for each user's needs. The generated information is displayed on the information processing device used by the user, specifically, a smartphone app developed with React Native. This app provides an interface for viewing and purchasing the proposed products and services.

[0309] The user can access the application through the smartphone and visually confirm the information according to their life stage. Also, the user can send a prompt to the generative AI to receive more personalized proposals.

[0310] As a specific example, when the user sends a prompt such as "List up products for users in their 30s, planning to get married, interested in childcare, and emphasizing household management.", the server creates a product list that meets the user's needs and displays the result on the smartphone. With this approach, the user can smoothly make an optimal choice corresponding to their life stage.

[0311] The flow of the specific process in Application Example 1 will be described using FIG. 12.

[0312] Step 1:

[0313] Users input basic information about marriage activities, pregnancy, childcare, and household finances, as well as personal interests and household financial data, through a smartphone application. The entered data is sent to the server in JSON format.

[0314] Step 2:

[0315] The server receives data sent by the user and stores it in the database. Firebase is used as the database for this purpose. In this step, the integrity of the user's data is verified and any missing information is checked.

[0316] Step 3:

[0317] The server supplies stored data to the AI ​​model, which then analyzes individual needs. The AI ​​model is trained using TensorFlow and generates necessary advice and product information for each stage of the user's life. It analyzes features extracted from the input data to generate optimal advice.

[0318] Step 4:

[0319] Based on the output information from the AI ​​model, the server selects customized products and services. In this process, it generates prompt messages (e.g., "Please list products for users in their 30s who are planning to get married, interested in childcare, and prioritize household budget management") and creates a list of suggested products.

[0320] Step 5:

[0321] The server sends a list of generated products and services to a smartphone application. This information is displayed on a user interface built with React Native, allowing users to visually see options optimized for their needs.

[0322] Step 6:

[0323] Based on the suggested information, users can select and purchase the necessary products and services. This interaction takes place within the application, and detailed information corresponding to the selected service or product is displayed on the device.

[0324] By repeating the above steps, users can always receive the latest information relevant to their current life stage.

[0325] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0326] This invention combines a system for users to receive support regarding marriage activities, pregnancy, childcare, and household finances with an emotion recognition engine. Based on the user's input information, the system identifies individual needs and provides more personalized advice by analyzing the user's emotional state at any given time using the emotion engine.

[0327] Users access the platform through a dedicated interface and provide input that expresses their emotions through text, voice, images, etc. The emotion engine analyzes this input data to identify the user's emotions. This emotion information is stored as part of the user profile.

[0328] The server uses AI to generate advice best suited to the user's situation, based on collected emotional information. For example, if a user is feeling stressed, it provides suggestions for relaxing activities or counseling information. This enables flexible support tailored to the user's emotional state.

[0329] The device displays advice and support information to the user based on emotions received from the server. In the case of matchmaking activities, if the user has positive emotions, it displays information that encourages active participation in events; if negative emotions are detected, it presents encouraging content.

[0330] For example, if a user is experiencing anxiety during pregnancy, the emotion engine will detect this emotional state, and the server will provide specific advice and support information to alleviate reassurance, as well as reliable resources related to pregnancy and childcare. In this way, the present invention builds a system that takes the user's emotions into consideration, responding to individual needs and providing more appropriate support.

[0331] Furthermore, this system includes community forums and group chat functions to facilitate interaction among users, and by utilizing emotion recognition technology, it enables users to understand each other's emotions and engage in more constructive communication.

[0332] The following describes the processing flow.

[0333] Step 1:

[0334] Users input text messages or voice data to the system to express their emotions. This provides the emotion engine with the necessary background data to identify the user's current mood.

[0335] Step 2:

[0336] The server receives the input data and uses an emotion engine to analyze the emotional state. As a result of the analysis, emotional categories such as "joy," "excitement," "anxiety," and "sadness" are identified.

[0337] Step 3:

[0338] The server integrates the analyzed sentiment information into user profiles. This allows for tracking each user's emotional tendencies and patterns.

[0339] Step 4:

[0340] Based on emotional information, the server uses generative AI to generate appropriate advice for the user regarding marriage activities, pregnancy, childcare, and household finances. For example, if anxiety is detected, it prepares support information and resources to calm the user.

[0341] Step 5:

[0342] The device displays generated advice and information on its screen. When the user is in a state of "joy," information that encourages positive action is prioritized.

[0343] Step 6:

[0344] Users receive emotion-based advice and implement strategies related to marriage, pregnancy, childcare, and household finances. They can also request further information or customization if needed.

[0345] Step 7:

[0346] The server utilizes an emotion engine to support smoother communication between users when they participate in forums or group chats.

[0347] Step 8:

[0348] The device facilitates interaction with other users by suggesting appropriate communication methods and topics based on the user's emotional state. This ensures that interactions are sensitive to the user's feelings.

[0349] (Example 2)

[0350] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0351] In modern society, stress is increasing in various aspects of life, such as marriage, child-rearing, and financial management. In this context, there is a lack of support systems that provide personalized advice that takes into account individual emotional states. Furthermore, there is a need for effective community building to foster interaction among users. Conventional systems have faced challenges in providing flexible responses based on emotional states and real-time advice.

[0352] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0353] In this invention, the server includes means for analyzing individual needs based on user input information, means for identifying emotional states using analysis means and generating individual advice, and means for generating and presenting emotion-based advice using a generative AI model. This enables the provision of personalized advice tailored to the user's emotional state and promotes community interaction.

[0354] A "user" refers to an individual or organization that uses the system to input information and receives personalized advice or support based on that information.

[0355] "Input information" refers to data such as text, audio, and images that users provide to the system, and it forms the basis for analyzing individual needs and emotional states.

[0356] "Individual needs" refer to the specific advice and support that users require based on their individual circumstances and emotional state.

[0357] "Analysis means" refers to technologies and processes used to analyze user input information and identify emotional states and individual needs.

[0358] "Emotional state" refers to information that represents the user's current psychological state or mood, and is an element that can be identified by analytical means.

[0359] A "generative AI model" refers to a computational model or algorithm used to generate advice and information based on user input using artificial intelligence.

[0360] An "information display device" refers to a terminal or interface device used to display information and advice provided by a server to the user.

[0361] "Community interaction" refers to online or offline activities aimed at sharing information and emotions among users and deepening their relationships.

[0362] "Financial information" refers to all data that forms the basis for financial management, such as a user's income, expenses, and asset status.

[0363] This invention is a system for users to receive support regarding marriage activities, childcare, and financial management, and incorporates an emotion engine that recognizes emotions. Users access the system using an interface and provide input that expresses emotions in text, voice, or images. The server receives this input information and analyzes it using the emotion engine. The emotion engine often employs natural language processing and computer vision technologies, specifically using commonly available natural language APIs and emotion recognition APIs. The analysis results are stored in the user profile, enabling support tailored to individual needs.

[0364] The server uses a generative AI model based on the analysis results from the emotion engine to generate advice tailored to the user's state. Commonly used natural language generation models can be applied as the generative AI. An example of a prompt is, "The user has been feeling stressed recently. Please provide suggestions for relaxation." This AI model can generate personalized information that takes emotional states into account.

[0365] The device displays advice and information received from the server to the user. For example, if the user is experiencing stress related to childcare, the device might display, "Listening to music is a recommended way to relax while raising children." In this way, the device provides advice along with related information and reference links, making it easy for the user to access helpful information.

[0366] This system not only provides information but also features community forums and group chat functions, allowing users to interact with each other. The server collects user feedback and uses it to improve the system. Specifically, after receiving advice, users can perform a brief evaluation of its effectiveness and send feedback through their device. This feedback information is collected by the server and becomes a valuable source of information for improving the service.

[0367] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0368] Step 1:

[0369] Users express their emotions through a dedicated interface by providing input in the form of text, audio, or image data. Based on this, the emotion engine acquires data to identify the user's emotional state. The input information includes text messages about everyday anxieties and stresses, voice expressions of feelings, and images that reflect emotions.

[0370] Step 2:

[0371] The server processes the input data received by the emotion engine, specifically using natural language processing and computer vision technologies to identify emotions. This data processing involves keyword extraction and the application of emotion models to quantify the user's emotional state (e.g., stress, relief, joy). The analyzed emotional state is then output and recorded in the user profile.

[0372] Step 3:

[0373] The server uses natural language generation technology, a generative AI model, to generate advice tailored to the user's situation, based on the output from the emotion engine. The input data is the result of an analysis of the emotional state, and the generative AI model is given a prompt in the format of "Please suggest countermeasures for the stress the user is feeling." In terms of data processing, the AI ​​model generates the optimal countermeasures, and specific advice is provided as output.

[0374] Step 4:

[0375] The device visually displays advice provided by the server to the user. Specifically, related resources and links are presented on the user's screen along with the advice. For example, advice such as "Try listening to meditation music as a way to relax" might be displayed. In this case, links to related apps and other resources are also displayed so that the user can take action immediately.

[0376] Step 5:

[0377] Users provide feedback on the advice they receive. This includes a function within the app to evaluate the usefulness of the advice and suggest areas for improvement. The feedback received is stored on the server, contributing to system improvements and increased accuracy in future advice generation.

[0378] (Application Example 2)

[0379] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0380] Traditional support systems for marriage activities, pregnancy, childcare, and household finance management have struggled to understand users' emotions in real time and provide personalized recommendations. Furthermore, the inability to recommend products based on the user's emotional state poses a challenge, potentially leading to decreased satisfaction.

[0381] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0382] In this invention, the server includes means for analyzing individual needs based on user input information, means for providing the generated information as individualized advice regarding marriage activities, pregnancy, childcare, and household financial management, means for displaying relevant information and suggestions on a corresponding terminal, and means for presenting relevant recommendation items based on sentiment analysis. This enables personalized support and product recommendations tailored to the user's emotional state.

[0383] "Means of analyzing individual needs based on user input information" refers to technologies that receive data such as text, audio, and images provided by users and identify and analyze the user's current situation and requests.

[0384] "A means of providing generated information as individualized advice on marriage activities, pregnancy, childcare, and household financial management" refers to a technology that provides users with specific and appropriate advice and information related to each area, based on the analyzed needs of the user.

[0385] "Means for displaying relevant information and suggestions on a corresponding terminal" refers to technologies for visually or audibly presenting analysis results and recommended information on the user's terminal device.

[0386] "Means of presenting relevant recommendations based on sentiment analysis" refers to technologies that analyze a user's emotional state and select and recommend products or services that are appropriate for that state.

[0387] In the system that implements this application, users express their emotions in the form of text, voice, images, etc., using smart devices. The devices are equipped with a dedicated application that sends this data to a server. This data is analyzed by a software platform that includes an emotion analysis engine. The emotion engine identifies the user's emotional state, for example, using the TensorFlow library. This identified emotion data is then used with generative AI to recommend products and services.

[0388] The server uses a recommendation system called ProductRecommender to suggest products that are tailored to the user's emotions and needs. This recommendation information is displayed in real time on smartphones and other devices and is optimized according to the user's viewing situation and emotions. For example, if the system determines that the user is feeling stressed, it can generate prompts recommending products that are effective for relaxation and mood improvement.

[0389] By using a generative AI model, dynamic recommendations can be made that respond to changes in the user's emotions. For example, the system might receive a request such as, "Generate a list of recommended products for when the user is seeking relaxation," and then provide corresponding recommendations.

[0390] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0391] Step 1:

[0392] Users express their emotions using text, voice, and images, and input them into the device. The device sends this input data to the server in real time. The input is the user's emotional information, and the output is the transmission of the input data to the server.

[0393] Step 2:

[0394] The server passes the received input data to the sentiment analysis engine. The sentiment analysis engine analyzes the input data and uses the TensorFlow library to identify the user's emotional state. The input is the user's input data, and the output is the identified emotional state.

[0395] Step 3:

[0396] The server passes the identified emotional state to the generating AI, which uses the ProductRecommender system to generate a list of appropriate product recommendations. The input is emotional state data, and the output is a product recommendation list optimized for the user.

[0397] Step 4:

[0398] The server sends the generated recommendation list to the terminal. The terminal receives this data and displays it to the user. The input is the recommendation list data, and the output is the recommendation information displayed on the user's terminal.

[0399] Step 5:

[0400] Users review product and service recommendations displayed on their devices and make selections or purchases as needed. The input is the displayed recommendation information, and the output is the user's selection or action.

[0401] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0402] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0403] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0404] [Third Embodiment]

[0405] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0406] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0407] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0408] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0409] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0410] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0411] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0412] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0413] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0414] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0415] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0416] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0417] This invention provides a comprehensive system for users to receive support regarding marriage activities, pregnancy, childcare, and household finances. The system begins with the user accessing the platform and entering the necessary data.

[0418] Users input personal information, interests, and household financial data through the interface. This information is used as foundational data for providing the various forms of support described below.

[0419] The server stores data received from users and analyzes individual needs using AI algorithms. Based on this analysis, it creates support plans for marriage activities and childcare. For marriage activities, it suggests events and potential partners that match the user's hobbies and values.

[0420] Pregnant users receive information and advice tailored to their health status and gestational week. This includes, for example, guidance on proper nutrition and exercise, and reminders for regular checkups. This information is customized based on the user's input, making it more personalized and practical.

[0421] Regarding childcare support, the system provides tips and recommended activities tailored to each stage of development. For example, during early childhood, the server displays recommended toys that promote language development and videos on self-care to the user's device.

[0422] The household budgeting feature analyzes the user's income and spending patterns and provides specific advice on how to manage their budget. This advice also includes information on available government subsidies and saving tips.

[0423] Furthermore, this system includes online community forums and group chat functions, providing users with opportunities to interact with other users who share similar needs. This broadens the scope of support, as users can refer not only to their own opinions but also to those of other users.

[0424] This system allows users to receive personalized information and support at each stage of marriage, pregnancy, childcare, and household finance management. In this way, the system contributes to addressing the declining birthrate and supports the creation of a better family environment.

[0425] The following describes the processing flow.

[0426] Step 1:

[0427] Users access the platform through a dedicated interface and input personal information, interests, and household financial data. This prepares the system to form a basic profile of the user.

[0428] Step 2:

[0429] The server receives the input data and stores it in the database. Then, it performs analysis based on the collected data to identify the individual needs of the user.

[0430] Step 3:

[0431] The server utilizes generative AI to generate personalized advice on marriage activities, pregnancy, childcare, and household finances, tailored to identified needs.

[0432] Step 4:

[0433] The device displays the generated advice to the user. In the context of matchmaking, information on events and potential partners suited to the user's attributes is presented.

[0434] Step 5:

[0435] Based on the advice received, users can consider specific actions related to marriage and pregnancy. They can request further information or customization if necessary.

[0436] Step 6:

[0437] The server generates and sends professional information and advice tailored to the user's health condition and gestational week to their device.

[0438] Step 7:

[0439] The device displays pregnancy-related advice and health management information to the user, enabling them to maintain appropriate lifestyle habits during pregnancy.

[0440] Step 8:

[0441] When a user seeks childcare support, they enter their questions and concerns about childcare into the platform.

[0442] Step 9:

[0443] The server analyzes the input childcare-related information, generates childcare methods and recommended activities appropriate for the child's developmental stage, and provides them to the terminal.

[0444] Step 10:

[0445] The device displays childcare information provided to the user and helps them incorporate that information into their daily life.

[0446] Step 11:

[0447] Users enter their household financial information and request advice on household financial management.

[0448] Step 12:

[0449] The server analyzes the user's income and expense data and generates an efficient household budget management plan. It also provides information on available subsidies and other relevant resources.

[0450] Step 13:

[0451] The device notifies the user of the generated household budget management plan and subsidy information, and suggests actionable steps.

[0452] (Example 1)

[0453] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0454] In modern society, individuals face the challenge of difficulty in effectively obtaining the information and support they need at crucial junctures in their lives, such as marriage, pregnancy, child-rearing, and financial management. Furthermore, there is a growing need for personalized, specific, and practical information to be provided. Additionally, there is an increasing need for platforms that facilitate interaction among users and allow for the sharing of knowledge and experiences.

[0455] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0456] This invention includes a server that analyzes individual requests based on user input information, provides information generated using a generative AI model as individualized advice related to marriage activities, pregnancy, childcare, and financial management, and generates and provides customized educational materials and health guidance tailored to the user's health condition and stage of development. This enables users to receive specific support that meets their needs and to obtain appropriate information and support at each stage of life. In addition, online forums and group communication functions enable users to share knowledge and experiences with each other.

[0457] "User input information" refers to a collection of data, including personal information, interests, and family-related data, provided by individuals using the system through the interface.

[0458] "Means for analyzing individual requests" refers to algorithms or processes that analyze user input information to identify the specific needs and requests of that individual.

[0459] A "generative AI model" is a form of artificial intelligence that uses machine learning techniques to learn patterns in data and generate information and suggestions related to a specific task.

[0460] "Individualized advice related to marriage activities, pregnancy, childcare, and financial management" refers to personalized support information and recommendations tailored to the specific situations users face at different stages of their lives.

[0461] "Customized educational materials and health guidance tailored to health status and developmental stage" refers to information that provides individualized educational content and health guidance based on the user's health information, age, and progress in childcare.

[0462] "Online forums and group communication functions" refer to digital platforms and communication methods that allow users to exchange opinions and share experiences with each other.

[0463] "Budget management plans and public financial support information based on financial information" is a dataset designed to analyze a user's income and expenditure situation and provide optimal budget management methods and information on available public subsidies.

[0464] This invention provides a system that allows users to receive comprehensive support regarding marriage activities, pregnancy, childcare, and financial management. Users input personal information, interests, and family-related data through the system's interface. This data forms the basis for providing personalized support based on the user's requests. For example, a user might input a prompt such as, "I'm looking for a family summer vacation plan within my budget."

[0465] The server securely stores data received from users in a database. A standard database management system can be used for data storage and management. The server further analyzes user data using generative AI models to create individually customized information. These AI models utilize natural language processing and machine learning algorithms.

[0466] Specifically, the server suggests events and potential partners based on the user's interests in their marriage search. For pregnant users, it analyzes health data to provide advice tailored to their health status and gestational week, creating appropriate nutritional guidance, exercise advice, and reminders for regular checkups.

[0467] Furthermore, the server generates and provides information on educational materials and activities appropriate for each stage of development to support the user's childcare. For example, during early childhood, it may display recommendations for toys that aid language development and links to self-care-related videos on the device.

[0468] For financial management, the server analyzes the user's income and expenses and provides an optimal budget management plan. This can include information on public subsidies and savings advice.

[0469] Furthermore, the server features online forums and group chat functions to facilitate interaction among users. Users can share their opinions and experiences with other users and receive broader support. This communication function has an interface that is easy for end users to use.

[0470] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0471] Step 1:

[0472] Users enter their personal information, interests, and family-related data through the interface. This data is entered using text boxes and dropdown menus. For example, if a user enters the prompt "I'm looking for budget-friendly weekend events that my family can attend," this becomes input to the server.

[0473] Step 2:

[0474] The server securely stores data received from users in a database. Here, it checks for duplicate data and updates new information. This data storage process forms the basis for later analysis. The input is raw data entered by the user, and it is output in a neatly organized format within the database.

[0475] Step 3:

[0476] The server analyzes the accumulated data using a generating AI model. The analysis process identifies individual requests based on the input user information and generates personalized support information. The AI ​​model uses natural language processing to understand the intent of prompts, for example, by suggesting events that match the user's interests. The input is organized user data, and the output is customized support information.

[0477] Step 4:

[0478] The server generates a customized plan from the analyzed information and displays it on the terminal. At this stage, specific advice and recommendations tailored to the user's situation are provided. For example, a pregnant user will be shown nutritional guidance and exercise advice tailored to their health condition. The input is the analyzed data, and the output is the customized plan displayed to the user.

[0479] Step 5:

[0480] The terminal visually presents information provided by the server to the user, enabling practical assistance. Users can view the information through the terminal's screen and take action as needed. Specifically, they can view details of provided events and register to participate if interested. The terminal's input is a custom plan, and its output is the user's perception and actions.

[0481] Step 6:

[0482] The server oversees online forums and group chat functions, facilitating communication among users. Through interaction with other users, users can share their experiences and information, thereby gaining broader knowledge. Input consists of user posts and comments, while output is interaction and information feedback from other users.

[0483] (Application Example 1)

[0484] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0485] In today's busy lifestyle, users often have difficulty accessing the necessary information and support at each stage of life, such as marriage, pregnancy, childcare, and household finances. Furthermore, there is a lack of products and services tailored to individual users, creating a need for a comprehensive support system that can appropriately address these life stages.

[0486] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0487] In this invention, the server includes means for analyzing data based on user input information and extracting individual needs; means for providing the generated information as individual advice regarding marriage activities, pregnancy, childcare, and household financial management; means for proposing customized products and services based on the analyzed data and displaying them on a corresponding information processing device; and means for processing user input information and proposing information appropriate to the life stage. As a result, users can receive personalized and appropriate information and product suggestions for each life stage.

[0488] "User input information" refers to personal information such as profiles, interests, and financial status that users themselves input into the system through the interface.

[0489] "Means of analyzing data" refer to technical methods and processes for analyzing user input information to identify individual needs and trends.

[0490] "Methods for extracting individual needs" refer to techniques for clarifying specific requests and needs for each user based on the analysis results.

[0491] "Generated information" refers to information such as advice and suggestions that users are seeking, derived from data analysis.

[0492] "Individualized advice on marriage activities, pregnancy, childcare, and household financial management" refers to specific and expert advice in each area tailored to the user's life stage.

[0493] "Customized products and services" refer to a list of products and services that have been adjusted and optimized based on the individual needs and life stage of the user.

[0494] An "information processing device" is a digital device used to display generated information and proposed products / services to users.

[0495] "Means of suggesting information tailored to life stage" refers to a function that takes into account the user's current stage in life and provides information that is appropriate for that stage.

[0496] This invention provides a system for users to receive necessary information and product suggestions regarding marriage activities, pregnancy, childcare, and household finance management. The system mainly consists of the following components:

[0497] The server receives user input and analyzes the data using an AI model. Specifically, a program using Python and Flask processes and analyzes the user's data. TensorFlow and PyTorch are used in the AI ​​model to extract the user's individual needs. The cloud platform utilizes Google Cloud AI Platform to provide a scalable data analysis environment.

[0498] Based on the analysis results, the server generates and suggests advice and product information best suited to each user's needs. This generated information is displayed on the user's information processing device, specifically a smartphone app developed with React Native. This app provides an interface for reviewing and purchasing the suggested products and services.

[0499] Users can access the application via their smartphones and visually view information tailored to their life stage. Furthermore, users can receive more personalized suggestions by sending prompts to the AI ​​generating system.

[0500] As a concrete example, a user might send a prompt such as, "Please list products for users in their 30s who are planning to get married, interested in childcare, and prioritize household budget management." The server then creates a product list tailored to the user's needs and displays the results on their smartphone. This approach allows users to smoothly make the best choices that suit their life stage.

[0501] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0502] Step 1:

[0503] Users input basic information about marriage activities, pregnancy, childcare, and household finances, as well as personal interests and household financial data, through a smartphone application. The entered data is sent to the server in JSON format.

[0504] Step 2:

[0505] The server receives data sent by the user and stores it in the database. Firebase is used as the database for this purpose. In this step, the integrity of the user's data is verified and any missing information is checked.

[0506] Step 3:

[0507] The server supplies stored data to the AI ​​model, which then analyzes individual needs. The AI ​​model is trained using TensorFlow and generates necessary advice and product information for each stage of the user's life. It analyzes features extracted from the input data to generate optimal advice.

[0508] Step 4:

[0509] Based on the output information from the AI ​​model, the server selects customized products and services. During this process, it generates prompt messages (e.g., "Please list products for users in their 30s who are planning to marry, interested in childcare, and prioritize household budget management") and creates a list of suggested products.

[0510] Step 5:

[0511] The server sends a list of generated products and services to a smartphone application. This information is displayed on a user interface built with React Native, allowing users to visually see options optimized for their needs.

[0512] Step 6:

[0513] Based on the suggested information, users can select and purchase the necessary products and services. This interaction takes place within the application, and detailed information corresponding to the selected service or product is displayed on the device.

[0514] By repeating the above steps, users can always receive the latest information relevant to their current life stage.

[0515] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0516] This invention combines a system for users to receive support regarding marriage activities, pregnancy, childcare, and household finances with an emotion recognition engine. Based on the user's input information, the system identifies individual needs and provides more personalized advice by analyzing the user's emotional state at any given time using the emotion engine.

[0517] Users access the platform through a dedicated interface and provide input that expresses their emotions through text, voice, images, etc. The emotion engine analyzes this input data to identify the user's emotions. This emotion information is stored as part of the user profile.

[0518] The server uses AI to generate advice best suited to the user's situation, based on collected emotional information. For example, if a user is feeling stressed, it provides suggestions for relaxing activities or counseling information. This enables flexible support tailored to the user's emotional state.

[0519] The device displays advice and support information to the user based on emotions received from the server. In the case of matchmaking activities, if the user has positive emotions, it displays information that encourages active participation in events; if negative emotions are detected, it presents encouraging content.

[0520] For example, if a user is experiencing anxiety during pregnancy, the emotion engine will detect this emotional state, and the server will provide specific advice and support information to alleviate reassurance, as well as reliable resources related to pregnancy and childcare. In this way, the present invention builds a system that takes the user's emotions into consideration, responding to individual needs and providing more appropriate support.

[0521] Furthermore, this system includes community forums and group chat functions to facilitate interaction among users, and by utilizing emotion recognition technology, it enables users to understand each other's emotions and engage in more constructive communication.

[0522] The following describes the processing flow.

[0523] Step 1:

[0524] Users input text messages or voice data to the system to express their emotions. This provides the emotion engine with the necessary background data to identify the user's current mood.

[0525] Step 2:

[0526] The server receives the input data and uses an emotion engine to analyze the emotional state. As a result of the analysis, emotional categories such as "joy," "excitement," "anxiety," and "sadness" are identified.

[0527] Step 3:

[0528] The server integrates the analyzed sentiment information into user profiles. This allows for tracking each user's emotional tendencies and patterns.

[0529] Step 4:

[0530] Based on emotional information, the server uses generative AI to generate appropriate advice for the user regarding marriage activities, pregnancy, childcare, and household finances. For example, if anxiety is detected, it prepares support information and resources to calm the user.

[0531] Step 5:

[0532] The device displays generated advice and information on its screen. When the user is in a state of "joy," information that encourages positive action is prioritized.

[0533] Step 6:

[0534] Users receive emotion-based advice and implement strategies related to marriage, pregnancy, childcare, and household finances. They can also request further information or customization if needed.

[0535] Step 7:

[0536] The server utilizes an emotion engine to support smoother communication between users when they participate in forums or group chats.

[0537] Step 8:

[0538] The device facilitates interaction with other users by suggesting appropriate communication methods and topics based on the user's emotional state. This ensures that interactions are sensitive to the user's feelings.

[0539] (Example 2)

[0540] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0541] In modern society, stress is increasing in various aspects of life, such as marriage, child-rearing, and financial management. In this context, there is a lack of support systems that provide personalized advice that takes into account individual emotional states. Furthermore, there is a need for effective community building to foster interaction among users. Conventional systems have faced challenges in providing flexible responses based on emotional states and real-time advice.

[0542] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0543] In this invention, the server includes means for analyzing individual needs based on user input information, means for identifying emotional states using analysis means and generating individual advice, and means for generating and presenting emotion-based advice using a generative AI model. This enables the provision of personalized advice tailored to the user's emotional state and promotes community interaction.

[0544] A "user" refers to an individual or organization that uses the system to input information and receives personalized advice or support based on that information.

[0545] "Input information" refers to data such as text, audio, and images that users provide to the system, and it forms the basis for analyzing individual needs and emotional states.

[0546] "Individual needs" refer to the specific advice and support that users require based on their individual circumstances and emotional state.

[0547] "Analysis means" refers to technologies and processes used to analyze user input information and identify emotional states and individual needs.

[0548] "Emotional state" refers to information that represents the user's current psychological state or mood, and is an element that can be identified by analytical means.

[0549] A "generative AI model" refers to a computational model or algorithm used to generate advice and information based on user input using artificial intelligence.

[0550] An "information display device" refers to a terminal or interface device used to display information and advice provided by a server to the user.

[0551] "Community interaction" refers to online or offline activities aimed at sharing information and emotions among users and deepening their relationships.

[0552] "Financial information" refers to all data that forms the basis for financial management, such as a user's income, expenses, and asset status.

[0553] This invention is a system for users to receive support regarding marriage activities, childcare, and financial management, and incorporates an emotion engine that recognizes emotions. Users access the system using an interface and provide input that expresses emotions in text, voice, or images. The server receives this input information and analyzes it using the emotion engine. The emotion engine often employs natural language processing and computer vision technologies, specifically using commonly available natural language APIs and emotion recognition APIs. The analysis results are stored in the user profile, enabling support tailored to individual needs.

[0554] The server uses a generative AI model based on the analysis results from the emotion engine to generate advice tailored to the user's state. Commonly used natural language generation models can be applied as the generative AI. An example of a prompt is, "The user has been feeling stressed recently. Please provide suggestions for relaxation." This AI model can generate personalized information that takes emotional states into account.

[0555] The device displays advice and information received from the server to the user. For example, if the user is experiencing stress related to childcare, the device might display, "Listening to music is a recommended way to relax while raising children." In this way, the device provides advice along with related information and reference links, making it easy for the user to access helpful information.

[0556] This system not only provides information but also features community forums and group chat functions, allowing users to interact with each other. The server collects user feedback and uses it to improve the system. Specifically, after receiving advice, users can perform a brief evaluation of its effectiveness and send feedback through their device. This feedback information is collected by the server and becomes a valuable source of information for improving the service.

[0557] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0558] Step 1:

[0559] Users express their emotions through a dedicated interface by providing input in the form of text, audio, or image data. Based on this, the emotion engine acquires data to identify the user's emotional state. The input information includes text messages about everyday anxieties and stresses, voice expressions of feelings, and images that reflect emotions.

[0560] Step 2:

[0561] The server processes the input data received by the emotion engine, specifically using natural language processing and computer vision technologies to identify emotions. This data processing involves keyword extraction and the application of emotion models to quantify the user's emotional state (e.g., stress, relief, joy). The analyzed emotional state is then output and recorded in the user profile.

[0562] Step 3:

[0563] The server uses natural language generation technology, a generative AI model, to generate advice tailored to the user's situation, based on the output from the emotion engine. The input data is the result of an analysis of the emotional state, and the generative AI model is given a prompt in the format of "Please suggest countermeasures for the stress the user is feeling." In terms of data processing, the AI ​​model generates the optimal countermeasures, and specific advice is provided as output.

[0564] Step 4:

[0565] The device visually displays advice provided by the server to the user. Specifically, related resources and links are presented on the user's screen along with the advice. For example, advice such as "Try listening to meditation music as a way to relax" might be displayed. In this case, links to related apps and other resources are also displayed so that the user can take action immediately.

[0566] Step 5:

[0567] Users provide feedback on the advice they receive. This includes a function within the app to evaluate the usefulness of the advice and suggest areas for improvement. The feedback received is stored on the server, contributing to system improvements and increased accuracy in future advice generation.

[0568] (Application Example 2)

[0569] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0570] Traditional support systems for marriage activities, pregnancy, childcare, and household finance management have struggled to understand users' emotions in real time and provide personalized recommendations. Furthermore, the inability to recommend products based on the user's emotional state poses a challenge, potentially leading to decreased satisfaction.

[0571] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0572] In this invention, the server includes means for analyzing individual needs based on user input information, means for providing the generated information as individualized advice regarding marriage activities, pregnancy, childcare, and household financial management, means for displaying relevant information and suggestions on a corresponding terminal, and means for presenting relevant recommendation items based on sentiment analysis. This enables personalized support and product recommendations tailored to the user's emotional state.

[0573] "Means of analyzing individual needs based on user input information" refers to technologies that receive data such as text, audio, and images provided by users and identify and analyze the user's current situation and requests.

[0574] "A means of providing generated information as individualized advice on marriage activities, pregnancy, childcare, and household financial management" refers to a technology that provides users with specific and appropriate advice and information related to each area, based on the analyzed needs of the user.

[0575] "Means for displaying relevant information and suggestions on a corresponding terminal" refers to technologies for visually or audibly presenting analysis results and recommended information on the user's terminal device.

[0576] "Means of presenting relevant recommendations based on sentiment analysis" refers to technologies that analyze a user's emotional state and select and recommend products or services that are appropriate for that state.

[0577] In the system that implements this application, users express their emotions in the form of text, voice, images, etc., using smart devices. The devices are equipped with a dedicated application that sends this data to a server. This data is analyzed by a software platform that includes an emotion analysis engine. The emotion engine identifies the user's emotional state, for example, using the TensorFlow library. This identified emotion data is then used with generative AI to recommend products and services.

[0578] The server uses a recommendation system called ProductRecommender to suggest products that are tailored to the user's emotions and needs. This recommendation information is displayed in real time on smartphones and other devices and is optimized according to the user's viewing situation and emotions. For example, if the system determines that the user is feeling stressed, it can generate prompts recommending products that are effective for relaxation and mood improvement.

[0579] By using a generative AI model, dynamic recommendations can be made that respond to changes in the user's emotions. For example, the system might receive a request such as, "Generate a list of recommended products for when the user is seeking relaxation," and then provide corresponding recommendations.

[0580] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0581] Step 1:

[0582] Users express their emotions using text, voice, and images, and input them into the device. The device sends this input data to the server in real time. The input is the user's emotional information, and the output is the transmission of the input data to the server.

[0583] Step 2:

[0584] The server passes the received input data to the sentiment analysis engine. The sentiment analysis engine analyzes the input data and uses the TensorFlow library to identify the user's emotional state. The input is the user's input data, and the output is the identified emotional state.

[0585] Step 3:

[0586] The server passes the identified emotional state to the generating AI, which uses the ProductRecommender system to generate a list of appropriate product recommendations. The input is emotional state data, and the output is a product recommendation list optimized for the user.

[0587] Step 4:

[0588] The server sends the generated recommendation list to the terminal. The terminal receives this data and displays it to the user. The input is the recommendation list data, and the output is the recommendation information displayed on the user's terminal.

[0589] Step 5:

[0590] Users review product and service recommendations displayed on their devices and make selections or purchases as needed. The input is the displayed recommendation information, and the output is the user's selection or action.

[0591] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0592] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0593] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0594] [Fourth Embodiment]

[0595] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0596] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0597] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0598] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0599] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0600] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0601] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0602] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0603] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0604] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0605] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0606] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0607] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0608] This invention provides a comprehensive system for users to receive support regarding marriage activities, pregnancy, childcare, and household finances. The system begins with the user accessing the platform and entering the necessary data.

[0609] Users input personal information, interests, and household financial data through the interface. This information is used as foundational data for providing the various forms of support described below.

[0610] The server stores data received from users and analyzes individual needs using AI algorithms. Based on this analysis, it creates support plans for marriage activities and childcare. For marriage activities, it suggests events and potential partners that match the user's hobbies and values.

[0611] Pregnant users receive information and advice tailored to their health status and gestational week. This includes, for example, guidance on proper nutrition and exercise, and reminders for regular checkups. This information is customized based on the user's input, making it more personalized and practical.

[0612] Regarding childcare support, the system provides tips and recommended activities tailored to each stage of development. For example, during early childhood, the server displays recommended toys that promote language development and videos on self-care to the user's device.

[0613] The household budgeting feature analyzes the user's income and spending patterns and provides specific advice on how to manage their budget. This advice also includes information on available government subsidies and saving tips.

[0614] Furthermore, this system includes online community forums and group chat functions, providing users with opportunities to interact with other users who share similar needs. This broadens the scope of support, as users can refer not only to their own opinions but also to those of other users.

[0615] This system allows users to receive personalized information and support at each stage of marriage, pregnancy, childcare, and household finance management. In this way, the system contributes to addressing the declining birthrate and supports the creation of a better family environment.

[0616] The following describes the processing flow.

[0617] Step 1:

[0618] Users access the platform through a dedicated interface and input personal information, interests, and household financial data. This prepares the system to form a basic profile of the user.

[0619] Step 2:

[0620] The server receives the input data and stores it in the database. Then, it performs analysis based on the collected data to identify the individual needs of the user.

[0621] Step 3:

[0622] The server utilizes generative AI to generate personalized advice on marriage activities, pregnancy, childcare, and household finances, tailored to identified needs.

[0623] Step 4:

[0624] The device displays the generated advice to the user. In the context of matchmaking, information on events and potential partners suited to the user's attributes is presented.

[0625] Step 5:

[0626] Based on the advice received, users can consider specific actions related to marriage and pregnancy. They can request further information or customization if necessary.

[0627] Step 6:

[0628] The server generates and sends professional information and advice tailored to the user's health condition and gestational week to their device.

[0629] Step 7:

[0630] The device displays pregnancy-related advice and health management information to the user, enabling them to maintain appropriate lifestyle habits during pregnancy.

[0631] Step 8:

[0632] When a user seeks childcare support, they enter their questions and concerns about childcare into the platform.

[0633] Step 9:

[0634] The server analyzes the input childcare-related information, generates childcare methods and recommended activities appropriate for the child's developmental stage, and provides them to the terminal.

[0635] Step 10:

[0636] The device displays childcare information provided to the user and helps them incorporate that information into their daily life.

[0637] Step 11:

[0638] Users enter their household financial information and request advice on household financial management.

[0639] Step 12:

[0640] The server analyzes the user's income and expense data and generates an efficient household budget management plan. It also provides information on available subsidies and other relevant resources.

[0641] Step 13:

[0642] The device notifies the user of the generated household budget management plan and subsidy information, and suggests actionable steps.

[0643] (Example 1)

[0644] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0645] In modern society, individuals face the challenge of difficulty in effectively obtaining the information and support they need at crucial junctures in their lives, such as marriage, pregnancy, child-rearing, and financial management. Furthermore, there is a growing need for personalized, specific, and practical information to be provided. Additionally, there is an increasing need for platforms that facilitate interaction among users and allow for the sharing of knowledge and experiences.

[0646] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0647] This invention includes a server that analyzes individual requests based on user input information, provides information generated using a generative AI model as individualized advice related to marriage activities, pregnancy, childcare, and financial management, and generates and provides customized educational materials and health guidance tailored to the user's health condition and stage of development. This enables users to receive specific support that meets their needs and to obtain appropriate information and support at each stage of life. In addition, online forums and group communication functions enable users to share knowledge and experiences with each other.

[0648] "User input information" refers to a collection of data, including personal information, interests, and family-related data, provided by individuals using the system through the interface.

[0649] "Means for analyzing individual requests" refers to algorithms or processes that analyze user input information to identify the specific needs and requests of that individual.

[0650] A "generative AI model" is a form of artificial intelligence that uses machine learning techniques to learn patterns in data and generate information and suggestions related to a specific task.

[0651] "Individualized advice related to marriage activities, pregnancy, childcare, and financial management" refers to personalized support information and recommendations tailored to the specific situations users face at different stages of their lives.

[0652] "Customized educational materials and health guidance tailored to health status and developmental stage" refers to information that provides individualized educational content and health guidance based on the user's health information, age, and progress in childcare.

[0653] "Online forums and group communication functions" refer to digital platforms and communication methods that allow users to exchange opinions and share experiences with each other.

[0654] "Budget management plans and public financial support information based on financial information" is a dataset designed to analyze a user's income and expenditure situation and provide optimal budget management methods and information on available public subsidies.

[0655] This invention provides a system that allows users to receive comprehensive support regarding marriage activities, pregnancy, childcare, and financial management. Users input personal information, interests, and family-related data through the system's interface. This data forms the basis for providing personalized support based on the user's requests. For example, a user might input a prompt such as, "I'm looking for a family summer vacation plan within my budget."

[0656] The server securely stores data received from users in a database. A standard database management system can be used for data storage and management. The server further analyzes user data using generative AI models to create individually customized information. These AI models utilize natural language processing and machine learning algorithms.

[0657] Specifically, the server suggests events and potential partners based on the user's interests in their marriage search. For pregnant users, it analyzes health data to provide advice tailored to their health status and gestational week, creating appropriate nutritional guidance, exercise advice, and reminders for regular checkups.

[0658] Furthermore, the server generates and provides information on educational materials and activities appropriate for each stage of development to support the user's childcare. For example, during early childhood, it may display recommendations for toys that aid language development and links to self-care-related videos on the device.

[0659] For financial management, the server analyzes the user's income and expenses and provides an optimal budget management plan. This can include information on public subsidies and savings advice.

[0660] Furthermore, the server features online forums and group chat functions to facilitate interaction among users. Users can share their opinions and experiences with other users and receive broader support. This communication function has an interface that is easy for end users to use.

[0661] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0662] Step 1:

[0663] Users enter their personal information, interests, and family-related data through the interface. This data is entered using text boxes and dropdown menus. For example, if a user enters the prompt "I'm looking for budget-friendly weekend events that my family can attend," this becomes input to the server.

[0664] Step 2:

[0665] The server securely stores data received from users in a database. Here, it checks for duplicate data and updates new information. This data storage process forms the basis for later analysis. The input is raw data entered by the user, and it is output in a neatly organized format within the database.

[0666] Step 3:

[0667] The server analyzes the accumulated data using a generating AI model. The analysis process identifies individual requests based on the input user information and generates personalized support information. The AI ​​model uses natural language processing to understand the intent of prompts, for example, by suggesting events that match the user's interests. The input is organized user data, and the output is customized support information.

[0668] Step 4:

[0669] The server generates a customized plan from the analyzed information and displays it on the terminal. At this stage, specific advice and recommendations tailored to the user's situation are provided. For example, a pregnant user will be shown nutritional guidance and exercise advice tailored to their health condition. The input is the analyzed data, and the output is the customized plan displayed to the user.

[0670] Step 5:

[0671] The terminal visually presents information provided by the server to the user, enabling practical assistance. Users can view the information through the terminal's screen and take action as needed. Specifically, they can view details of provided events and register to participate if interested. The terminal's input is a custom plan, and its output is the user's perception and actions.

[0672] Step 6:

[0673] The server oversees online forums and group chat functions, facilitating communication among users. Through interaction with other users, users can share their experiences and information, thereby gaining broader knowledge. Input consists of user posts and comments, while output is interaction and information feedback from other users.

[0674] (Application Example 1)

[0675] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0676] In today's busy lifestyle, users often have difficulty accessing the necessary information and support at each stage of life, such as marriage, pregnancy, childcare, and household finances. Furthermore, there is a lack of products and services tailored to individual users, creating a need for a comprehensive support system that can appropriately address these life stages.

[0677] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0678] In this invention, the server includes means for analyzing data based on user input information and extracting individual needs; means for providing the generated information as individual advice regarding marriage activities, pregnancy, childcare, and household financial management; means for proposing customized products and services based on the analyzed data and displaying them on a corresponding information processing device; and means for processing user input information and proposing information appropriate to the life stage. As a result, users can receive personalized and appropriate information and product suggestions for each life stage.

[0679] "User input information" refers to personal information such as profiles, interests, and financial status that users themselves input into the system through the interface.

[0680] "Means of analyzing data" refer to technical methods and processes for analyzing user input information to identify individual needs and trends.

[0681] "Methods for extracting individual needs" refer to techniques for clarifying specific requests and needs for each user based on the analysis results.

[0682] "Generated information" refers to information such as advice and suggestions that users are seeking, derived from data analysis.

[0683] "Individualized advice on marriage activities, pregnancy, childcare, and household financial management" refers to specific and expert advice in each area tailored to the user's life stage.

[0684] "Customized products and services" refer to a list of products and services that have been adjusted and optimized based on the individual needs and life stage of the user.

[0685] An "information processing device" is a digital device used to display generated information and proposed products / services to users.

[0686] "Means of suggesting information tailored to life stage" refers to a function that takes into account the user's current stage in life and provides information that is appropriate for that stage.

[0687] This invention provides a system for users to receive necessary information and product suggestions regarding marriage activities, pregnancy, childcare, and household finance management. The system mainly consists of the following components:

[0688] The server receives user input and analyzes the data using an AI model. Specifically, a program using Python and Flask processes and analyzes the user's data. TensorFlow and PyTorch are used in the AI ​​model to extract the user's individual needs. The cloud platform utilizes Google Cloud AI Platform to provide a scalable data analysis environment.

[0689] Based on the analysis results, the server generates and suggests advice and product information best suited to each user's needs. This generated information is displayed on the user's information processing device, specifically a smartphone app developed with React Native. This app provides an interface for reviewing and purchasing the suggested products and services.

[0690] Users can access the application via their smartphones and visually view information tailored to their life stage. Furthermore, users can receive more personalized suggestions by sending prompts to the AI ​​generating system.

[0691] As a concrete example, a user might send a prompt such as, "Please list products for users in their 30s who are planning to get married, interested in childcare, and prioritize household budget management." The server then creates a product list tailored to the user's needs and displays the results on their smartphone. This approach allows users to smoothly make the best choices that suit their life stage.

[0692] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0693] Step 1:

[0694] Users input basic information about marriage activities, pregnancy, childcare, and household finances, as well as personal interests and household financial data, through a smartphone application. The entered data is sent to the server in JSON format.

[0695] Step 2:

[0696] The server receives data sent by the user and stores it in the database. Firebase is used as the database for this purpose. In this step, the integrity of the user's data is verified and any missing information is checked.

[0697] Step 3:

[0698] The server supplies stored data to the AI ​​model, which then analyzes individual needs. The AI ​​model is trained using TensorFlow and generates necessary advice and product information for each stage of the user's life. It analyzes features extracted from the input data to generate optimal advice.

[0699] Step 4:

[0700] Based on the output information from the AI ​​model, the server selects customized products and services. During this process, it generates prompt messages (e.g., "Please list products for users in their 30s who are planning to marry, interested in childcare, and prioritize household budget management") and creates a list of suggested products.

[0701] Step 5:

[0702] The server sends a list of generated products and services to a smartphone application. This information is displayed on a user interface built with React Native, allowing users to visually see options optimized for their needs.

[0703] Step 6:

[0704] Based on the suggested information, users can select and purchase the necessary products and services. This interaction takes place within the application, and detailed information corresponding to the selected service or product is displayed on the device.

[0705] By repeating the above steps, users can always receive the latest information relevant to their current life stage.

[0706] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0707] This invention combines a system for users to receive support regarding marriage activities, pregnancy, childcare, and household finances with an emotion recognition engine. Based on the user's input information, the system identifies individual needs and provides more personalized advice by analyzing the user's emotional state at any given time using the emotion engine.

[0708] Users access the platform through a dedicated interface and provide input that expresses their emotions through text, voice, images, etc. The emotion engine analyzes this input data to identify the user's emotions. This emotion information is stored as part of the user profile.

[0709] The server uses AI to generate advice best suited to the user's situation, based on collected emotional information. For example, if a user is feeling stressed, it provides suggestions for relaxing activities or counseling information. This enables flexible support tailored to the user's emotional state.

[0710] The device displays advice and support information to the user based on emotions received from the server. In the case of matchmaking activities, if the user has positive emotions, it displays information that encourages active participation in events; if negative emotions are detected, it presents encouraging content.

[0711] For example, if a user is experiencing anxiety during pregnancy, the emotion engine will detect this emotional state, and the server will provide specific advice and support information to alleviate reassurance, as well as reliable resources related to pregnancy and childcare. In this way, the present invention builds a system that takes the user's emotions into consideration, responding to individual needs and providing more appropriate support.

[0712] Furthermore, this system includes community forums and group chat functions to facilitate interaction among users, and by utilizing emotion recognition technology, it enables users to understand each other's emotions and engage in more constructive communication.

[0713] The following describes the processing flow.

[0714] Step 1:

[0715] Users input text messages or voice data to the system to express their emotions. This provides the emotion engine with the necessary background data to identify the user's current mood.

[0716] Step 2:

[0717] The server receives the input data and uses an emotion engine to analyze the emotional state. As a result of the analysis, emotional categories such as "joy," "excitement," "anxiety," and "sadness" are identified.

[0718] Step 3:

[0719] The server integrates the analyzed sentiment information into user profiles. This allows for tracking each user's emotional tendencies and patterns.

[0720] Step 4:

[0721] Based on emotional information, the server uses generative AI to generate appropriate advice for the user regarding marriage activities, pregnancy, childcare, and household finances. For example, if anxiety is detected, it prepares support information and resources to calm the user.

[0722] Step 5:

[0723] The device displays generated advice and information on its screen. When the user is in a state of "joy," information that encourages positive action is prioritized.

[0724] Step 6:

[0725] Users receive emotion-based advice and implement strategies related to marriage, pregnancy, childcare, and household finances. They can also request further information or customization if needed.

[0726] Step 7:

[0727] The server utilizes an emotion engine to support smoother communication between users when they participate in forums or group chats.

[0728] Step 8:

[0729] The device facilitates interaction with other users by suggesting appropriate communication methods and topics based on the user's emotional state. This ensures that interactions are sensitive to the user's feelings.

[0730] (Example 2)

[0731] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0732] In modern society, stress is increasing in various aspects of life, such as marriage, child-rearing, and financial management. In this context, there is a lack of support systems that provide personalized advice that takes into account individual emotional states. Furthermore, there is a need for effective community building to foster interaction among users. Conventional systems have faced challenges in providing flexible responses based on emotional states and real-time advice.

[0733] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0734] In this invention, the server includes means for analyzing individual needs based on user input information, means for identifying emotional states using analysis means and generating individual advice, and means for generating and presenting emotion-based advice using a generative AI model. This enables the provision of personalized advice tailored to the user's emotional state and promotes community interaction.

[0735] A "user" refers to an individual or organization that uses the system to input information and receives personalized advice or support based on that information.

[0736] "Input information" refers to data such as text, audio, and images that users provide to the system, and it forms the basis for analyzing individual needs and emotional states.

[0737] "Individual needs" refer to the specific advice and support that users require based on their individual circumstances and emotional state.

[0738] "Analysis means" refers to technologies and processes used to analyze user input information and identify emotional states and individual needs.

[0739] "Emotional state" refers to information that represents the user's current psychological state or mood, and is an element that can be identified by analytical means.

[0740] A "generative AI model" refers to a computational model or algorithm used to generate advice and information based on user input using artificial intelligence.

[0741] An "information display device" refers to a terminal or interface device used to display information and advice provided by a server to the user.

[0742] "Community interaction" refers to online or offline activities aimed at sharing information and emotions among users and deepening their relationships.

[0743] "Financial information" refers to all data that forms the basis for financial management, such as a user's income, expenses, and asset status.

[0744] This invention is a system for users to receive support regarding marriage activities, childcare, and financial management, and incorporates an emotion engine that recognizes emotions. Users access the system using an interface and provide input that expresses emotions in text, voice, or images. The server receives this input information and analyzes it using the emotion engine. The emotion engine often employs natural language processing and computer vision technologies, specifically using commonly available natural language APIs and emotion recognition APIs. The analysis results are stored in the user profile, enabling support tailored to individual needs.

[0745] The server uses a generative AI model based on the analysis results from the emotion engine to generate advice tailored to the user's state. Commonly used natural language generation models can be applied as the generative AI. An example of a prompt is, "The user has been feeling stressed recently. Please provide suggestions for relaxation." This AI model can generate personalized information that takes emotional states into account.

[0746] The device displays advice and information received from the server to the user. For example, if the user is experiencing stress related to childcare, the device might display, "Listening to music is a recommended way to relax while raising children." In this way, the device provides advice along with related information and reference links, making it easy for the user to access helpful information.

[0747] This system not only provides information but also features community forums and group chat functions, allowing users to interact with each other. The server collects user feedback and uses it to improve the system. Specifically, after receiving advice, users can perform a brief evaluation of its effectiveness and send feedback through their device. This feedback information is collected by the server and becomes a valuable source of information for improving the service.

[0748] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0749] Step 1:

[0750] Users express their emotions through a dedicated interface by providing input in the form of text, audio, or image data. Based on this, the emotion engine acquires data to identify the user's emotional state. The input information includes text messages about everyday anxieties and stresses, voice expressions of feelings, and images that reflect emotions.

[0751] Step 2:

[0752] The server processes the input data received by the emotion engine, specifically using natural language processing and computer vision technologies to identify emotions. This data processing involves keyword extraction and the application of emotion models to quantify the user's emotional state (e.g., stress, relief, joy). The analyzed emotional state is then output and recorded in the user profile.

[0753] Step 3:

[0754] The server uses natural language generation technology, a generative AI model, to generate advice tailored to the user's situation, based on the output from the emotion engine. The input data is the result of an analysis of the emotional state, and the generative AI model is given a prompt in the format of "Please suggest countermeasures for the stress the user is feeling." In terms of data processing, the AI ​​model generates the optimal countermeasures, and specific advice is provided as output.

[0755] Step 4:

[0756] The device visually displays advice provided by the server to the user. Specifically, related resources and links are presented on the user's screen along with the advice. For example, advice such as "Try listening to meditation music as a way to relax" might be displayed. In this case, links to related apps and other resources are also displayed so that the user can take action immediately.

[0757] Step 5:

[0758] Users provide feedback on the advice they receive. This includes a function within the app to evaluate the usefulness of the advice and suggest areas for improvement. The feedback received is stored on the server, contributing to system improvements and increased accuracy in future advice generation.

[0759] (Application Example 2)

[0760] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0761] Traditional support systems for marriage activities, pregnancy, childcare, and household finance management have struggled to understand users' emotions in real time and provide personalized recommendations. Furthermore, the inability to recommend products based on the user's emotional state poses a challenge, potentially leading to decreased satisfaction.

[0762] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0763] In this invention, the server includes means for analyzing individual needs based on user input information, means for providing the generated information as individualized advice regarding marriage activities, pregnancy, childcare, and household financial management, means for displaying relevant information and suggestions on a corresponding terminal, and means for presenting relevant recommendation items based on sentiment analysis. This enables personalized support and product recommendations tailored to the user's emotional state.

[0764] "Means of analyzing individual needs based on user input information" refers to technologies that receive data such as text, audio, and images provided by users and identify and analyze the user's current situation and requests.

[0765] "A means of providing generated information as individualized advice on marriage activities, pregnancy, childcare, and household financial management" refers to a technology that provides users with specific and appropriate advice and information related to each area, based on the analyzed needs of the user.

[0766] "Means for displaying relevant information and suggestions on a corresponding terminal" refers to technologies for visually or audibly presenting analysis results and recommended information on the user's terminal device.

[0767] "Means of presenting relevant recommendations based on sentiment analysis" refers to technologies that analyze a user's emotional state and select and recommend products or services that are appropriate for that state.

[0768] In the system that implements this application, users express their emotions in the form of text, voice, images, etc., using smart devices. The devices are equipped with a dedicated application that sends this data to a server. This data is analyzed by a software platform that includes an emotion analysis engine. The emotion engine identifies the user's emotional state, for example, using the TensorFlow library. This identified emotion data is then used with generative AI to recommend products and services.

[0769] The server uses a recommendation system called ProductRecommender to suggest products that are tailored to the user's emotions and needs. This recommendation information is displayed in real time on smartphones and other devices and is optimized according to the user's viewing situation and emotions. For example, if the system determines that the user is feeling stressed, it can generate prompts recommending products that are effective for relaxation and mood improvement.

[0770] By using a generative AI model, dynamic recommendations can be made that respond to changes in the user's emotions. For example, the system might receive a request such as, "Generate a list of recommended products for when the user is seeking relaxation," and then provide corresponding recommendations.

[0771] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0772] Step 1:

[0773] Users express their emotions using text, voice, and images, and input them into the device. The device sends this input data to the server in real time. The input is the user's emotional information, and the output is the transmission of the input data to the server.

[0774] Step 2:

[0775] The server passes the received input data to the sentiment analysis engine. The sentiment analysis engine analyzes the input data and uses the TensorFlow library to identify the user's emotional state. The input is the user's input data, and the output is the identified emotional state.

[0776] Step 3:

[0777] The server passes the identified emotional state to the generating AI, which uses the ProductRecommender system to generate a list of appropriate product recommendations. The input is emotional state data, and the output is a product recommendation list optimized for the user.

[0778] Step 4:

[0779] The server sends the generated recommendation list to the terminal. The terminal receives this data and displays it to the user. The input is the recommendation list data, and the output is the recommendation information displayed on the user's terminal.

[0780] Step 5:

[0781] Users review product and service recommendations displayed on their devices and make selections or purchases as needed. The input is the displayed recommendation information, and the output is the user's selection or action.

[0782] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0783] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0784] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0785] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0786] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0787] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0788] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0789] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0790] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0791] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0792] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0793] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0794] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0795] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0796] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0797] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0798] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0799] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0800] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0801] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0802] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0803] The following is further disclosed regarding the embodiments described above.

[0804] (Claim 1)

[0805] A means of analyzing individual needs based on user input information,

[0806] A means of providing the generated information as individualized advice regarding marriage activities, pregnancy, childcare, and household financial management,

[0807] A means of displaying relevant information and suggestions on a corresponding terminal,

[0808] A system that includes this.

[0809] (Claim 2)

[0810] The system according to claim 1, comprising means for facilitating interaction among users in a community forum and group chat.

[0811] (Claim 3)

[0812] The system according to claim 1, comprising means for providing a household financial management plan and public assistance information based on the user's household financial information.

[0813] "Example 1"

[0814] (Claim 1)

[0815] A means of analyzing individual requests based on user input information,

[0816] A means of providing information generated using a generative AI model as personalized advice related to marriage activities, pregnancy, childcare, and financial management,

[0817] A means of generating and providing customized educational materials and health guidance tailored to the user's health condition and stage of development,

[0818] A means of displaying diverse information and suggestions on a computer,

[0819] A system that includes this.

[0820] (Claim 2)

[0821] The system according to claim 1, comprising means for facilitating interaction between individuals through online forums and group communication functions.

[0822] (Claim 3)

[0823] The system according to claim 1, comprising means for providing a budget management plan and public financial support information based on the user's financial information.

[0824] "Application Example 1"

[0825] (Claim 1)

[0826] A means of analyzing data based on user input and extracting individual needs,

[0827] A means of providing the generated information as individualized advice regarding marriage activities, pregnancy, childcare, and household financial management,

[0828] A means of proposing customized products and services based on analyzed data and displaying them on a corresponding information processing device,

[0829] A means of processing user input information and suggesting information appropriate to the life stage,

[0830] A system that includes this.

[0831] (Claim 2)

[0832] The system according to claim 1, comprising means for facilitating interaction among users in a communication forum and group dialogue.

[0833] (Claim 3)

[0834] The system according to claim 1, comprising means for providing a household budget management plan and public assistance information based on the user's income and expenditure data.

[0835] "Example 2 of combining an emotion engine"

[0836] (Claim 1)

[0837] A means of analyzing individual needs based on user input information,

[0838] A means for identifying emotional states through analysis and generating individual advice,

[0839] A means of generating and presenting emotion-based advice using a generative AI model,

[0840] A means of providing the generated information as advice related to marriage activities, childcare, or financial management,

[0841] Means for displaying relevant information and suggestions on a corresponding information display device,

[0842] A system that includes this.

[0843] (Claim 2)

[0844] The system according to claim 1, comprising means for promoting relationships among users through community interaction and information sharing.

[0845] (Claim 3)

[0846] The system according to claim 1, comprising means for providing a financial management plan and supplementary information based on the user's financial information.

[0847] "Application example 2 when combining with an emotional engine"

[0848] (Claim 1)

[0849] A means of analyzing individual needs based on user input information,

[0850] A means of providing the generated information as individualized advice regarding marriage activities, pregnancy, childcare, and household financial management,

[0851] A means of displaying relevant information and suggestions on a corresponding terminal,

[0852] A means of presenting relevant recommendations based on sentiment analysis,

[0853] A system that includes this.

[0854] (Claim 2)

[0855] The system according to claim 1, comprising means for facilitating interaction among users in a community forum and group chat.

[0856] (Claim 3)

[0857] The system according to claim 1, comprising means for providing a household financial management plan and public assistance information based on the user's household financial information. [Explanation of symbols]

[0858] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of analyzing individual needs based on user input information, A means of providing the generated information as individualized advice regarding marriage activities, pregnancy, childcare, and household financial management, A means of displaying relevant information and suggestions on a corresponding terminal, A system that includes this.

2. The system according to claim 1, comprising means for facilitating interaction among users in a community forum and group chat.

3. The system according to claim 1, comprising means for providing a household financial management plan and public assistance information based on the user's household financial information.

Images