System

Abstract

A system is provided.SOLUTION: The system includes a means for inputting personal information such as a nursing care state and an income state from a user, a means for transmitting the inputted information to a server, a means for analyzing the information received in the server and proposing a proper nursing care service and a subsidy, a means for displaying detailed information and a procedure guide of the proposed nursing care service and the subsidy, and a means for periodically confirming the state of the user and updating data based on the state.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The need for care often arises suddenly, and many caregivers struggle to obtain appropriate information and support. Information about government-provided services and subsidies is often difficult to understand, and access to these services is often limited by application. Furthermore, the quality of support provided by care managers varies, and caregivers are not always able to receive consistent support. This places a significant burden on caregivers. The present invention aims to solve these problems and bridge the gap between those receiving and providing care. [Means for solving the problem]

[0005] The system of the present invention includes the following means: a means for having the user input personal information such as care status and income status; a means for transmitting the input information to a server; a means for analyzing the received information in the server and proposing appropriate care services and subsidies; a means for displaying detailed information and procedure guides for the proposed care services and subsidies; and a means for periodically checking the user's status and updating the data based on the status. The system also includes a means for listing the information required for the procedure to use the care services selected by the user and generating procedure guides, and a means for cooperating with a care manager to provide and update information based on the user's latest care status. This configuration allows caregivers to easily obtain appropriate information and receive appropriate support.

[0006] "User" refers to the caregiver or their family member who uses the system, or the person in need of care.

[0007] "Care situation" refers to the specific care situation or environment that an individual faces, such as home care, admission to a facility, or use of day care services.

[0008] "Income status" refers to the income and asset status of the user, which affects the eligibility for nursing care services and subsidies.

[0009] "Server" means a central system, or computer with such functionality, that receives, analyzes, and generates recommendations from users.

[0010] "Making suggestions" means that the server presents appropriate nursing care services and subsidy options based on the data entered by the user.

[0011] "Procedure Guide" refers to an information document that includes information such as the procedures, necessary documents, procedure locations, and contact information required to use the nursing care service selected by the user.

[0012] A "care manager" is a professional who provides and coordinates nursing care services, and who creates nursing care plans for users and supports them in using the services.

[0013] "Status check" refers to the process of regularly checking the user's care status and any changes in it.

[0014] "Updating data" means keeping the latest information available at all times by reflecting the latest user status and information in the database within the system. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] As an embodiment of the present invention, a system and a program based on the following method are provided.

[0037] 1. User Registration and Login

[0038] Download and launch the app

[0039] User: First, the user downloads the app from the app store and launches it.

[0040] Create an account

[0041] Device: Displays an account creation screen, allowing users to enter information such as name, contact details, care level, and income status.

[0042] User: Enter the required information and press the "Register" button.

[0043] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[0044] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[0045] 2. Interactive current situation assessment

[0046] Show Questions

[0047] Terminal: After the user logs in, the device displays the question "Please tell us about your care situation" and offers options (home care, day care, admission to a facility, etc.).

[0048] User: Choose the appropriate option.

[0049] Terminal: Sends the selected answer to the server.

[0050] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[0051] Show next question

[0052] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[0053] Terminal: Display the next question to the user.

[0054] User: Enters the required information and submits. Repeat this process to gain a detailed understanding of the user's current situation.

[0055] 3. Proposing appropriate services and subsidies

[0056] Data analysis

[0057] Server: Based on the accumulated user data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[0058] View the list of suggestions

[0059] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[0060] 4. Service selection and procedure guide

[0061] Service Selection

[0062] User: Select the service they wish to use from the list of suggestions.

[0063] Terminal: Sends the selected service to the server.

[0064] Procedure guide generation

[0065] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[0066] Display procedure guide

[0067] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[0068] 5. Regular status checks and cooperation with care managers

[0069] Periodic notification

[0070] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[0071] Device: Receives notification and displays status questions to the user.

[0072] Check the situation

[0073] User: Answers questions about recent care status and changes.

[0074] Terminal: Sends the answer to the server.

[0075] Data updates and care manager collaboration

[0076] Server: Analyzes the latest status data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[0077] Specific examples

[0078] Mr. Yamada (the user) downloads the app and creates an account. He then enters his current care situation. For example, Mr. Yamada selects "home care" and also enters information such as his family composition and income. The server analyzes this information and suggests a list of home care services and subsidies to Mr. Yamada. When Mr. Yamada selects a home care service, the server displays details of the application procedure and the necessary documents to support the procedure. The server also periodically checks Mr. Yamada's care situation, updates the data based on new information, and works with the care manager to provide appropriate support.

[0079] This system allows users to easily obtain the right information and quickly receive the assistance they need.

[0080] The processing flow will be explained below.

[0081] 1. User Registration and Login

[0082] Step 1:

[0083] Device: The user downloads and launches the app.

[0084] Step 2:

[0085] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[0086] Step 3:

[0087] User: Enter the required information and press the "Register" button.

[0088] Step 4:

[0089] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[0090] Step 5:

[0091] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[0092] 2. Interactive current situation assessment

[0093] Step 1:

[0094] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, admission to a facility, etc.).

[0095] Step 2:

[0096] User: Select the appropriate option and submit.

[0097] Step 3:

[0098] Terminal: Sends the selected answer to the server.

[0099] Step 4:

[0100] Server: Receives the response, analyzes it, and saves the analysis results in a database.

[0101] Step 5:

[0102] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[0103] Step 6:

[0104] Terminal: Display the next question to the user.

[0105] Step 7:

[0106] User: Enter the required information and submit.

[0107] Step 8:

[0108] The device: sends the entered answers to the server. This process is repeated to obtain a detailed picture of the user's current situation.

[0109] 3. Proposing appropriate services and subsidies

[0110] Step 1:

[0111] Server: Based on the accumulated user data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[0112] Step 2:

[0113] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[0114] 4. Service selection and procedure guide

[0115] Step 1:

[0116] User: Select the service they wish to use from the list of suggestions.

[0117] Step 2:

[0118] Terminal: Sends the selected service to the server.

[0119] Step 3:

[0120] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[0121] Step 4:

[0122] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[0123] 5. Regular status checks and cooperation with care managers

[0124] Step 1:

[0125] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[0126] Step 2:

[0127] Device: Receives notification and displays status questions to the user.

[0128] Step 3:

[0129] User: Answers questions about recent care status and changes.

[0130] Step 4:

[0131] Terminal: Sends the answer to the server.

[0132] Step 5:

[0133] Server: Analyzes the latest status data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[0134] This allows users to easily obtain the right information and quickly get the help they need.

[0135] Example 1

[0136] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0137] With conventional nursing care support systems, it was difficult for users to obtain timely information about appropriate nursing care services and subsidies, and there was a lack of information on application procedures, making it difficult to receive the necessary support promptly.In addition, there was also the problem that support based on the user's latest situation was not provided due to a lack of regular status checks and appropriate coordination with care managers.

[0138] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0139] In this invention, the server includes means for downloading and launching an application, means for the user to input personal information, means for saving the input information in a database, means for displaying questions about the user's care status and collecting responses, means for transmitting the collected information to the server, means for analyzing the information received in the server and proposing appropriate services and subsidies based on the analysis results, means for displaying detailed information about the proposed services and subsidies and application procedures, means for periodically checking the user's status and updating the data based on the obtained information, means for providing necessary information to a care manager, means for generating questions about the care status using a generative AI model and presenting them to the user, and means for generating the next necessary question based on the user's answers. This enables users to obtain information about appropriate care services and subsidies in a timely manner, receive specific guidance on application procedures, and further receive prompt support tailored to their latest care status through regular status checks and collaboration with care managers.

[0140] An "Application" is a software program that a User installs and uses on a mobile or desktop device.

[0141] "Downloading" is the process of transferring data or applications over the internet or network to a user's device.

[0142] "Launch" is the process by which a user runs an application and enables its initial settings and functionality.

[0143] "User" refers to an individual who uses the system to obtain information on nursing care services and subsidies.

[0144] "Personal information" refers to information that can identify a specific individual, such as a user's name, contact information, care level, and income status.

[0145] A "database" is a system for systematically managing and storing specific data.

[0146] "Care status" is information that indicates the type and status of care services used by the user or their family.

[0147] "Questions" refer to items presented to gain a detailed understanding of the user's care situation and needs.

[0148] "Answer" refers to information provided by a User in response to a Question.

[0149] A "server" is a computer system that receives data from users, analyzes it, and provides appropriate information.

[0150] "Analysis" is the process of analyzing the input data and proposing the most suitable services and subsidies to users.

[0151] "Services" refers to specific programs and activities designed to provide care-related assistance and support.

[0152] "Subsidy" refers to financial assistance that can be received by users who meet certain conditions.

[0153] "Detailed information" refers to information such as the specific content of the service or subsidy, terms of provision, and procedures.

[0154] "Usage procedures" refers to the process of submitting documents and procedures required for users to receive services and subsidies.

[0155] The "Procedure Guide" is a detailed instruction manual that includes the information necessary for the usage procedure (required documents, procedure location, contact information, etc.).

[0156] "Periodic" means that the process is repeated at predetermined time intervals (for example, monthly).

[0157] "Status check" is a process for understanding the user's current care situation and any changes.

[0158] "Data update" is the process of updating existing data based on newly acquired information.

[0159] A "care manager" is a professional who manages the planning and implementation of nursing care services and provides the necessary support.

[0160] A "generative AI model" is an algorithm that uses artificial intelligence to generate appropriate questions and suggestions for users.

[0161] "Next Questions" are questions generated based on the user's answers to gather further information.

[0162] The present invention relates to a system for providing information on nursing care services and subsidies and for streamlining procedures for using the services. Specific embodiments for carrying out the present invention are described below.

[0163] System Overview

[0164] First, users download and launch a dedicated application onto their mobile or desktop device. When first launched, an account creation screen appears, where users enter personal information such as their name, contact details, care level, and income status. The entered information is sent from the device to a server via the Internet and stored in a database on the server.

[0165] Collection of User Information

[0166] After logging in, the device displays questions about the user's care situation. The questions include options such as "home care," "day care," and "facility admission." When the user selects an appropriate option, the answer is sent to the server, which analyzes the answer and stores it in a database.

[0167] Analysis of information and suggestions

[0168] The server analyzes the collected user information and proposes appropriate nursing care services and subsidies to the user. The proposal list includes detailed information such as the service name, summary, and terms of use. This list is sent to the terminal and displayed to the user.

[0169] Providing procedural guidance

[0170] The information required for the procedure to use the nursing care service selected by the user (e.g., required documents, procedure location, contact information, etc.) is listed on the server and generated as a procedure guide. This guide is displayed to the user via their device, and a download link is also provided to suggest specific steps to take.

[0171] Regular status checks

[0172] The server periodically (e.g., monthly) sends notifications to the user regarding their status. The device receives the notifications and displays status check questions to the user. When the user enters an answer, the answer is sent from the device to the server, where it is saved and analyzed as the latest status data.

[0173] Collaboration with care managers

[0174] Based on the analysis results, the system provides the care manager with the latest information as needed, allowing users to receive the most appropriate care services at the appropriate time.

[0175] Using generative AI models

[0176] This system uses a generative AI model to generate the next question based on the user's care situation. These questions are dynamically generated based on the user's answers, allowing for more detailed information to be gathered. Specifically, the following prompts are used:

[0177] "What are the next questions to ask if you choose home care?"

[0178] "Please tell me the procedure for using the home care service."

[0179] "Generate additional questions about recent caregiving situations."

[0180] Specific examples

[0181] For example, User A downloads a care app and creates an account. User A then selects "home care" and enters information such as family composition and income status. The server analyzes this information and proposes to User A a list of home care services and subsidies. When User A selects a home care service, details of the application procedure and necessary documents are displayed to support User A. The server also periodically checks User A's care status and shares the latest data with the care manager to provide appropriate support.

[0182] In this way, this system provides comprehensive support to users to easily obtain information on appropriate nursing care services and subsidies, and to efficiently complete the application procedures.

[0183] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0184] Step 1:

[0185] The user downloads and launches an application. This causes the application to run on the device. The input is the user's input actions when launching the application for the first time. The output is the display of the application's initial setup screen.

[0186] Step 2:

[0187] The user enters personal information such as name, contact details, care level, and income status on the account creation screen. The device presents this information as an input form and collects the input data. The input is the personal information entered by the user, and the output is the collected personal information.

[0188] Step 3:

[0189] The terminal sends the entered user information to the server. The server receives it and stores it in a database. The input of this step is the personal information sent from the terminal, and the output is the data stored in the server.

[0190] Step 4:

[0191] The server generates an initial question about the user's care situation and sends it to the terminal. The terminal displays the question. The input is the user information stored in the database, and the output is the generated question about the care situation.

[0192] Step 5:

[0193] The user answers questions about the displayed care situation. The device collects the user's answers and sends them to the server. The input is the user's answers about the care situation, and the output is the data sent from the device to the server.

[0194] Step 6:

[0195] The server analyzes the received answer and generates the next question. This generation uses a generative AI model. The generated question is then sent to the device. The input is the answer data from the user, and the output is the generated next question.

[0196] Step 7:

[0197] The terminal will again display the next question from the server to the user, and this will continue until the user enters an answer. The input is the new question from the server, and the output is the question displayed to the user.

[0198] Step 8:

[0199] The server analyzes the accumulated user data, searches for appropriate nursing care services and subsidies, and generates a list. The input is the user data accumulated in the database, and the output is a list of services and subsidies.

[0200] Step 9:

[0201] The server sends the generated list to the terminal, which then displays the list to the user. The input is the service list from the server, and the output is the list displayed to the user.

[0202] Step 10:

[0203] The user selects the service they want to use from the list. The terminal sends the selected service information to the server. The input is the user's selection, and the output is the data sent to the server.

[0204] Step 11:

[0205] The server lists the information required to use the selected service and generates a procedure guide. The input is the user's selection information and the output is the procedure guide.

[0206] Step 12:

[0207] The terminal displays a procedure guide to the user and suggests the necessary actions. It also provides download links for the necessary documents. The input is the procedure guide from the server, and the output is the guide displayed to the user.

[0208] Step 13:

[0209] The server periodically sends status check notifications to the terminal. The terminal receives the notifications and displays them to the user. The input is the notification data generated by the server, and the output is the notification displayed by the terminal.

[0210] Step 14:

[0211] The user answers questions about the recent care situation. The device sends the answers to the server. The input is the latest care situation provided by the user, and the output is the data sent to the server.

[0212] Step 15:

[0213] The server analyzes the latest status data and updates the database. If necessary, it sends information to the care manager. The input is the user's latest data, and the output is the updated database and information provided to the care manager.

[0214] (Application example 1)

[0215] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0216] The current nursing care system is limited to functions such as proposing nursing care services and subsidies, and does not consider individual menu suggestions or delivery service support according to the user's dietary preferences or restrictions. For this reason, there is a need to further reduce the burden on users receiving care and provide appropriate nutritional management.

[0217] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0218] In this invention, the server includes means for having the user input personal information such as care status, income status, etc., means for transmitting the input information to the server, means for analyzing the information received in the server and proposing appropriate care services and subsidies, means for displaying detailed information on the proposed care services and subsidies and a procedure guide, means for periodically checking the user's status and updating the data based on the status, means for having the user input information on dietary preferences and restrictions, means for proposing appropriate menus and dining facilities based on the input preference and restriction information, means for displaying detailed information on the proposed menus and dining facilities, and means for notifying the progress of delivery. This enables users receiving care to obtain information on care services and subsidies, as well as receive meal suggestions and delivery service support tailored to their dietary preferences and restrictions.

[0219] "User" refers to an individual who uses the system to input information and receive services.

[0220] "Care status" refers to information that indicates the user's current care environment and needs.

[0221] "Income status" refers to information that indicates a user's current income and financial situation.

[0222] "Personal Information" means information about a user, including name, contact information, care level, etc.

[0223] A "server" is a device that receives information input by a user, analyzes it, and stores the data.

[0224] "Menu" means the meal options from which a User can choose.

[0225] "Food and beverage establishment" refers to a facility such as a restaurant that provides meals to users.

[0226] "Preferences" refers to information about ingredients that a user likes or dislikes.

[0227] "Restrictions" refer to dietary restrictions based on a user's health or religious reasons.

[0228] "Delivery" refers to a service that delivers the meal selected by the user.

[0229] "Progress" refers to information indicating the current status of a delivery in the delivery process.

[0230] "Suggestion" means showing the user the most suitable services and menus based on the analyzed information.

[0231] A "procedure guide" is a guidebook that explains the procedures for users to use various services and menus.

[0232] "Regular status checks" refers to the process of checking the user's current status at regular intervals and updating the database.

[0233] "Dietary preferences and restrictions information" refers to information entered by the user regarding allergies and dietary preferences.

[0234] This invention is a system that inputs personal information such as a user's care status and income status and proposes appropriate services based on that information. Furthermore, this system is characterized by the fact that it also proposes food delivery services. Specific embodiments are described below.

[0235] The system uses a terminal for users to input information and a server that receives and analyzes the information. The server has the following functions:

[0236] A means for users to input personal information such as care status, income status, etc.

[0237] A means of sending input information to the server

[0238] A means of analyzing received information and proposing appropriate nursing care services and subsidies

[0239] A means to display detailed information and procedural guidance for proposed care services and subsidies

[0240] A means to periodically check in with users and update the data accordingly

[0241] A means for users to input information about their dietary preferences and restrictions

[0242] A means of suggesting appropriate menus and dining facilities based on input preferences and constraint information

[0243] A way to view suggested menus and detailed information about dining options

[0244] A means of communicating delivery progress

[0245] The specific processing procedure is as follows:

[0246] First, the user accesses the system using a smartphone app. The app provides a screen for the user to enter information about their care status, income, preferences, and restrictions. After the user enters this information and presses the "Submit" button, the information is sent to the server.

[0247] The server stores this information in a database and analyzes it using a generative AI model to suggest care services, subsidies, menus, and dining options that best fit the user's needs. The results are sent to the user's device and displayed on the screen.

[0248] An example of a suggested prompt would be:

[0249] "Tell us about your dietary preferences or restrictions today. Choose the appropriate option: vegetarian, gluten-free, low-calorie, etc."

[0250] When the user selects a suggested service or menu, detailed information and a procedure guide will be displayed, and the user will receive regular notifications on the delivery progress.

[0251] This system allows for more comprehensive support by linking the user's care support with meal selection and delivery. The main hardware used is the user's smartphone and a server (e.g., AWS (registered trademark) EC2), and the software is a smartphone app (e.g., Kotlin) and a server-side database (e.g., MySQL (registered trademark)).

[0252] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0253] Step 1:

[0254] The user downloads and launches the smartphone app, which displays an account creation screen where the user enters basic information such as name, contact details, caregiving status, and income status.

[0255] Input: Basic information such as user name, contact information, caregiving status, income status, etc.

[0256] Output: Account creation request sent to server

[0257] Step 2:

[0258] The server processes the received account creation request, stores the information in a database, and then sends a notification of successful account creation to the device.

[0259] Input: Account creation request

[0260] Data processing: Save the input information in a database (e.g. MySQL)

[0261] Output: A notification of successful account creation is sent to the device.

[0262] Step 3:

[0263] The user logs in at the login screen. If successful, the device displays the question, "Please tell us about your dietary preferences and restrictions today," and offers options (e.g., vegetarian, gluten-free, low-calorie).

[0264] Input: User login information, preferences and constraints options

[0265] Output: Preferences and constraints options are displayed on the terminal.

[0266] Step 4:

[0267] When a user selects their dietary preferences and restrictions, the information is sent to the server, which then analyzes the information and searches for appropriate menus and dining facilities.

[0268] Input: User preferences and constraints

[0269] Data computation: Using generative AI models based on preferences and constraints to find appropriate menus and dining options

[0270] Output: Search results (menus and restaurants) are generated and sent to the device.

[0271] Step 5:

[0272] The device displays a list of suggested menus and dining options to the user, who then selects the menu item they wish to order from the suggested list.

[0273] Input: Menus and dining establishments received from the server

[0274] Output: The suggested list is displayed in the terminal.

[0275] Step 6:

[0276] Once the user has made a menu selection, an order request is sent to the server, which processes the order request and sends the order to the relevant dining establishment.

[0277] Input: User's order request

[0278] Data Computing: Processing order requests and sending orders to the relevant food and beverage establishments

[0279] Output: Order acceptance notification is sent to the terminal

[0280] Step 7:

[0281] The server tracks the delivery progress and periodically sends progress notifications to the device, which the user can then check via the app.

[0282] Input: Delivery progress

[0283] Output: Progress notifications are sent to the terminal

[0284] Step 8:

[0285] The server periodically generates questions to check the user's status and sends them to the device. The user answers the questions and sends new information to the server.

[0286] Input: Periodic status check questions

[0287] Output: Status check questions are displayed on the terminal.

[0288] Data processing: Save and update new information from users to the database

[0289] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0290] As an embodiment of the present invention, a system and a program are provided that combine a conventional nursing care service suggestion system with an emotion engine that recognizes the user's emotions.

[0291] User Registration and Login

[0292] Download and launch the app

[0293] User: First, the user downloads the app from the app store and launches it.

[0294] Create an account

[0295] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[0296] User: Enter the required information and press the "Register" button.

[0297] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[0298] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[0299] Interactive situation analysis and emotion recognition

[0300] Show Questions

[0301] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, admission to a facility, etc.).

[0302] User: Select the appropriate option and submit.

[0303] Terminal: Sends the selected answer to the server.

[0304] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[0305] emotion recognition

[0306] Server: Analyzes the user's emotions using the emotion engine based on the user's input data and dialogue content. Stores the emotion data in a database.

[0307] Show next question

[0308] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[0309] Terminal: Display the next question to the user.

[0310] User: Enters the required information and submits. Repeat this process to gain a detailed understanding of the user's current situation.

[0311] Proposal of appropriate services and subsidies and optimization based on emotions

[0312] Data analysis

[0313] Server: Based on the accumulated user data and emotion data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[0314] Emotion-Based Optimization

[0315] Server: Optimizes suggested care services and subsidies based on the user's emotional state. For example, if stress levels are high, services related to psychological support and relaxation will be prioritized.

[0316] View the list of suggestions

[0317] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[0318] Service selection and procedure guide

[0319] Service Selection

[0320] User: Select the service they wish to use from the list of suggestions.

[0321] Terminal: Sends the selected service to the server.

[0322] Procedure guide generation

[0323] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[0324] Display procedure guide

[0325] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[0326] Regular status checks and cooperation with care managers

[0327] Periodic notification

[0328] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[0329] Device: Receives notification and displays status questions to the user.

[0330] Check the situation

[0331] User: Answers questions about recent care status and changes.

[0332] Terminal: Sends the answer to the server.

[0333] Data updates and care manager collaboration

[0334] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[0335] Specific examples

[0336] Yamada (the user) downloads the app and creates an account. He then enters his care situation and emotional state. For example, Yamada selects "home care" and also enters information such as his family structure and income. The server analyzes this information and suggests a list of home care services and subsidies to Yamada. Furthermore, the emotion engine recognizes a high level of stress from Yamada's responses and prioritizes suggestions for relaxation services that will help reduce stress. Once Yamada selects a home care service, the app displays details of the application procedure and the necessary documents to support the process. The app also regularly checks Yamada's care situation and emotional state, updates the data based on new information, and works with the care manager to provide appropriate support.

[0337] This system allows users to easily obtain the right information and quickly receive the assistance they need, while also reducing psychological burden through the use of an emotion engine.

[0338] The processing flow will be explained below.

[0339] User Registration and Login

[0340] Step 1:

[0341] User: The user downloads and launches the app.

[0342] Step 2:

[0343] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[0344] Step 3:

[0345] User: Enter the required information and press the "Register" button.

[0346] Step 4:

[0347] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[0348] Step 5:

[0349] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[0350] Interactive situation analysis and emotion recognition

[0351] Step 1:

[0352] Terminal: After the user logs in, the device displays the question "Please tell us about your care situation" and offers options (home care, day care, admission to a facility, etc.).

[0353] Step 2:

[0354] User: Select the appropriate option and submit.

[0355] Step 3:

[0356] Terminal: Sends the selected answer to the server.

[0357] Step 4:

[0358] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[0359] Step 5:

[0360] Server: Analyzes the user's emotions using the emotion engine based on the user's input data and dialogue content. Stores the emotion data in a database.

[0361] Step 6:

[0362] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[0363] Step 7:

[0364] Terminal: Display the next question to the user.

[0365] Step 8:

[0366] User: Enters the required information and submits. This process is repeated to capture a detailed current situation and emotional state.

[0367] Proposal of appropriate services and subsidies and optimization based on emotions

[0368] Step 1:

[0369] Server: Based on the accumulated user data and emotion data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[0370] Step 2:

[0371] Server: Optimizes the suggested nursing care services and subsidies based on the user's emotional state.

[0372] Step 3:

[0373] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[0374] Service selection and procedure guide

[0375] Step 1:

[0376] User: Select the service they wish to use from the list of suggestions.

[0377] Step 2:

[0378] Terminal: Sends the selected service to the server.

[0379] Step 3:

[0380] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[0381] Step 4:

[0382] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[0383] Regular status checks and cooperation with care managers

[0384] Step 1:

[0385] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[0386] Step 2:

[0387] Device: Receives notification and displays status questions to the user.

[0388] Step 3:

[0389] User: Answers questions about recent care status and changes.

[0390] Step 4:

[0391] Terminal: Sends the answer to the server.

[0392] Step 5:

[0393] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[0394] Example 2

[0395] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0396] Conventional nursing care service recommendation systems have the problem of not providing sufficient support because they do not take into account the user's emotional state. In addition, there is a lack of regular status checks and collaboration with care professionals, making it difficult to provide appropriate support based on the user's latest status.

[0397] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0398] In this invention, the server includes means for having the user input personal data such as status information and financial information, means for transmitting the input data to the server, means for analyzing the data received in the server and proposing appropriate support services and financial assistance, means for analyzing the user's emotional state using an emotion analysis engine and optimizing appropriate proposals, and means for periodically checking the user's status and updating the data based on the status. This makes it possible to propose optimal nursing care services and financial assistance taking into account the user's emotional state, and by regularly checking the status and collaborating with care professionals, appropriate support based on the latest status can be provided.

[0399] "Status information" refers to information relating to the user's health condition, care situation, living environment, and the like.

[0400] "Financial Information" means information about a user's financial situation, such as income, assets, and expenses.

[0401] "Personal Data" is information about you that is specific to you, such as status information or financial information.

[0402] A "server" is a computer system that receives, analyzes, and processes data sent by users.

[0403] The "emotion analysis engine" is software that analyzes emotions from the data and conversation content provided by users and uses the results to optimize support services and financial assistance proposals.

[0404] "Support services" are services such as nursing care, medical care, and life support provided to users.

[0405] "Financial assistance" refers to financial assistance such as subsidies and grants provided to users.

[0406] "Procedure Guide" is a guideline that shows the procedure for using the support services or financial assistance selected by the user.

[0407] A "care professional" is a professional with specialized knowledge of care who is responsible for providing care support to users.

[0408] The present invention is a system that proposes appropriate nursing care services and financial assistance based on the user's emotion analysis. This system is mainly composed of the user, a terminal, and a server. Specifically, the system uses the following hardware and software to process and calculate various data.

[0409] Hardware and software used

[0410] 1. User device: A smartphone or tablet device with iOS or ANDROID (registered trademark) applications installed.

[0411] 2. Server: A cloud-based database and analysis system, specifically using a cloud platform such as Amazon Web Services (AWS) or Microsoft® Azure®.

[0412] 3. Sentiment Analysis Engine: A natural language processing (NLP) model using the Python transformers library. This model is used to emotionally analyze the user's text input.

[0413] Data processing and calculation

[0414] User Registration and Login:

[0415] Users download the app from the app store and create an account after installing it. When creating an account, they enter information such as their name, contact details, care level, and income status. This data is sent from the device to the server and stored in a database.

[0416] Conversational situational awareness with emotion recognition:

[0417] When a user logs in, the device displays the question, "Please tell us about your care situation," and the user selects the appropriate option from the options (home care, day care, facility admission, etc.). The user's selection data is sent to the server and analyzed. The server also uses an emotion analysis engine to emotionally analyze the user's input data and dialogue content, obtaining emotional data.

[0418] Proposal of appropriate services and grants:

[0419] The server then proposes appropriate nursing care services and financial assistance based on the acquired user data and emotional data. For example, if the user is judged to be under high stress, it will prioritize relaxation services.

[0420] Regular check-ins and collaboration with care professionals:

[0421] The server periodically sends notifications to users, asking them about recent care status and changes, ensuring the user database is always up to date and sending the necessary information to care professionals to ensure coordination.

[0422] Examples of concrete examples and prompts

[0423] For example, if a user logs in and selects "home care," and then responds to subsequent questions by entering information such as family composition and income status, the server receives and analyzes this information. If the emotion analysis engine analyzes the user's text responses and recognizes a high level of stress, it will prioritize suggestions for relaxation services that will help reduce stress.

[0424] Example prompt sentence:

[0425] "Please tell us about the situation in which you are receiving care. (Please choose from home care, day care, facility care, etc.)"

[0426] “Please describe your current feelings regarding your caregiving situation. Are you feeling stressed, anxious, or calm?”

[0427] This system allows users to easily obtain the appropriate information and quickly receive the necessary assistance, and by using an emotion analysis engine, it also reduces the psychological burden on users.

[0428] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0429] Program processing flow

[0430] Step 1: User Registration and Login

[0431] User: Downloads the app from the app store and launches the installed app.

[0432] Device: The device displays an account creation screen and prompts the user to enter their name, contact information, care level, income status, etc. This inputs the user's personal data.

[0433] User: The user enters the required information and presses the "Register" button.

[0434] Terminal: The terminal sends the entered information to the server.

[0435] Server: The server stores the received data in a database, generates a notification of success of account creation, and sends it to the device.

[0436] Device: The device will display a message that the account was created successfully and will transition to the login screen.

[0437] Step 2: Conversational situational awareness with emotion recognition

[0438] Terminal: After the user logs in, the terminal displays the question "Please tell us about your care situation" and provides options (home care, day care, admission to a facility, etc.).

[0439] User: The user selects the appropriate option and presses the submit button.

[0440] Terminal: The terminal sends the selected answer to the server.

[0441] Server: The server receives the response data and stores it in a database. It also analyzes the user's text input data using a sentiment analysis engine to generate sentiment data.

[0442] Server: Stores the emotion data in a database and generates the next question, which is about family structure and specific care needs.

[0443] Terminal: The terminal displays the following question to the user:

[0444] User: The user enters the appropriate answer and presses the submit button. This process is repeated to gain a detailed understanding of the current situation.

[0445] Step 3: Propose the right service / subsidy and optimize based on emotions

[0446] Server: The server analyzes the accumulated user data and emotion data.

[0447] Server: Based on the analysis results, it generates a list of available support services and financial aid, including details and terms of use for each service.

[0448] Server: Optimizes the list of suggestions based on the emotional state. For example, if stress is judged to be high, relaxation services will be prioritized on the list.

[0449] On the device: Show the user an optimized list of suggestions.

[0450] Step 4: Service selection and procedure guide

[0451] User: The user selects the service they want to use from a list of suggestions.

[0452] Terminal: The terminal transmits information about the selected service to the server.

[0453] Server: The server lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[0454] Terminal: Displays the procedure guide to the user and provides download links for the required documents.

[0455] Step 5: Regular check-ins and collaboration with care professionals

[0456] Server: The server periodically (for example, monthly) sends notifications to check the user's status.

[0457] Device: The device receives the notification and displays a status question to the user.

[0458] User: The user answers questions about recent care status and changes and presses the send button.

[0459] Terminal: The terminal sends a response to the server.

[0460] Server: The server analyzes the latest status and emotion data, updates the database, and sends updates to care professionals as needed.

[0461] (Application example 2)

[0462] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0463] Conventional nursing care service suggestion systems not only have difficulty providing appropriate support that takes into account the user's emotional state, but also have difficulty responding quickly to unexpected emergencies. As a result, the psychological burden on the user increases, and problems arise in which the care support that should be provided is not sufficient. To solve this problem, a system is needed that can simultaneously propose optimal services that take into account the user's emotions and respond to emergencies.

[0464] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0465] In this invention, the server includes means for having the user input personal information such as care status and income status, means for transmitting the input information and the user's video data to the server, means for analyzing the information received within the server and proposing appropriate care services and subsidies, means for analyzing the user's emotions using an emotion recognition engine, means for displaying detailed information and procedure guides for the proposed care services and subsidies, means for sending a warning when an abnormal emotional state is detected, and means for periodically checking the user's status and updating data based on the status. This enables the server to propose optimal care services taking into account the user's emotional state and to respond quickly in emergencies.

[0466] "Care situation" is information that indicates the current state of a person who needs care and the environment in which care is provided. Specifically, it includes information about the type of care, such as home care, day care, or admission to a facility.

[0467] "Income status" refers to information that indicates the user's financial status. Specifically, it includes the type and amount of income, whether or not the user receives financial support, etc.

[0468] "Personal information" refers to information that identifies a user. Specifically, this includes basic information such as name, contact details, and care level.

[0469] The "emotion recognition engine" is software that analyzes the user's facial expressions and voice data to determine their emotional state. Specifically, it has the ability to recognize emotions such as stress, fear, and surprise.

[0470] "Video data" refers to video or image data that records a user's face or actions. Specifically, it includes video of a user captured by a camera.

[0471] "Nursing care services" refers to support and care provided to people who need nursing care. Specifically, it includes home care, day care, relaxation services, etc.

[0472] "Subsidies" are financial assistance provided by public or private organizations. Specifically, they include financial assistance to partially cover nursing care costs.

[0473] A "procedure guide" is a document that provides detailed instructions on how to apply for the proposed nursing care services and subsidies. Specifically, it includes information such as required documents, procedure locations, and contact details.

[0474] "Alerts" are messages sent to the user or emergency contacts to alert them, including notifications sent when an abnormal emotional state is detected.

[0475] "Users" are people who use the system to receive proposals for nursing care services and subsidies. Specifically, this includes elderly people who need nursing care and their families.

[0476] A "server" is a computer system that stores and analyzes data. Specifically, it processes information sent by users and has the function of suggesting services and issuing warnings.

[0477] As an embodiment of the present invention, we provide a multifunctional system for proposing nursing care services and implementing security measures. By combining it with an emotion recognition engine, the system takes into account the user's psychological state, enabling appropriate service proposals and rapid emergency response.

[0478] System configuration

[0479] 1. User Registration and Login

[0480] User: Download the system application from the app store. When launching the system for the first time, enter basic information such as name, contact details, care level, and income status to create an account.

[0481] Device: Sends the input information to the server and proceeds with the account creation process.

[0482] Server: Analyzes the received information and saves it in the database. It then sends a notification of success to the device, which then transitions to the login screen.

[0483] 2. Conversational Emotion Recognition and Current Situation Understanding

[0484] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, facility admission, etc.). The answer selected by the user is sent to the server.

[0485] Server: Analyzes the received answers and analyzes the user's emotions using an emotion recognition engine. The emotion data is stored in a database.

[0486] Terminal: The following questions (family structure, specific care needs, etc.) are displayed to the user, and the entered information is sent to the server. This process is repeated to obtain a detailed understanding of the user's current situation.

[0487] 3. Proposing appropriate services and subsidies

[0488] Server: Based on accumulated user data and emotion data, searches for available nursing care services and subsidies and generates a list.

[0489] Server: Optimizes suggested services and subsidies based on the user's emotional state. For example, if stress is judged to be high, it will prioritize suggested services related to psychological support and relaxation.

[0490] Terminal: Displays to the user a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[0491] 4. Service Selection and Procedures

[0492] User: Select the service they wish to use from the list of suggestions.

[0493] Terminal: Sends the selected service to the server.

[0494] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[0495] Terminal: Displays a procedural guide to the user, recommending the necessary actions, and providing download links for the necessary documents.

[0496] 5. Detecting and alerting abnormal emotional states

[0497] Device: The device periodically collects the user's facial expressions and voice using a camera and microphone, and sends the data to a server.

[0498] Server: Using an emotion recognition engine, the data is analyzed in real time to detect abnormal emotional states (stress, fear, surprise, etc.).

[0499] Server: If an abnormal emotional state is detected, it sends an alert to the user and emergency contacts.

[0500] 6. Regular status checks and cooperation with care managers

[0501] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[0502] Device: Receives notifications and displays status confirmation questions to the user. When the user answers questions about recent care status and changes, the device sends the information to the server.

[0503] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[0504] Hardware and software used

[0505] The hardware used includes devices such as smartphones and tablets, cameras, microphones, etc. The required software includes OpenCV (video analysis), the EmotionRecognition library (emotion analysis), Twilio (notification sending), and Amazon Web Services (server and database management).

[0506] Specific examples

[0507] For example, when a user is using the system, their face is captured via their smartphone camera, and the system uses the EmotionRecognition library to analyze the user's emotions in real time, and if stress or fear is detected, it uses Twilio to send an alert notification to emergency contacts.

[0508] Prompt Sentence Examples

[0509] An example of a prompt to input to a generative AI model is, "Create a program that uses an emotion recognition engine to analyze the user's emotions in real time. Include a function to immediately send a notification to the user and emergency contacts if abnormal emotions (fear, stress, surprise) are detected."

[0510] This will enable the system to propose appropriate care services that take into account the user's emotional state and to respond quickly in emergencies.

[0511] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0512] Step 1:

[0513] Users download the app from the app store and enter basic information such as their name, contact details, care level, and income status when they launch the app for the first time.

[0514] Input: Personal information from the user.

[0515] Output: The user's personal information sent to the server.

[0516] Operation: The terminal sends the entered information to the server, which stores the received information in a database.

[0517] Step 2:

[0518] The device notifies the user that the account was created successfully and takes them to the login screen.

[0519] Input: Server-generated account creation success notification.

[0520] Output: Screen transition to login screen.

[0521] Behavior: The device displays the notification received from the server and then presents the login screen to the user.

[0522] Step 3:

[0523] After logging in, the user answers the question, "Please tell us your care situation."

[0524] Input: The displayed question and answer options (home care, day care, institutional care, etc.).

[0525] Output: The user's answer.

[0526] Operation: The device sends the user's selected answers to the server, which then analyzes the received answers and stores them in a database.

[0527] Step 4:

[0528] The server uses an emotion recognition engine to analyze facial expressions and voice to recognize the user's emotions.

[0529] Input: Video and audio data sent by the user.

[0530] Output: Parsed emotion data.

[0531] Operation: The server analyzes the received video and audio data using the EmotionRecognition library and stores the emotional data in a database.

[0532] Step 5:

[0533] Based on the analysis results, the server generates the next questions (family composition, specific care needs, etc.) and sends them to the device.

[0534] Input: Analyzed user's care situation and emotion data.

[0535] Output: Next question.

[0536] Operation: Based on the analysis results, the server identifies the next information needed and sends data to display the question on the terminal.

[0537] Step 6:

[0538] The terminal displays the next question to the user, and the user enters and submits the answer.

[0539] Input: The next question sent by the server.

[0540] Output: The user's answer.

[0541] Operation: The device displays the question received from the server to the user, then sends the user's answer back to the server, repeating this process multiple times.

[0542] Step 7:

[0543] The server searches for available nursing care services and subsidies based on accumulated user data and emotional data, and generates a list.

[0544] Input: User data and emotion data.

[0545] Output: List of care services and subsidies.

[0546] Operation: The server searches the database, lists potential nursing care services and grants, and generates the list.

[0547] Step 8:

[0548] The server optimizes the proposed services and subsidies based on the user's emotional state and sends them to the terminal.

[0549] Input: List of care services and grants, and sentiment data.

[0550] Output: Optimized service and grant list.

[0551] How it works: The server prioritizes the list taking into account the emotion data and sends it to the device.

[0552] Step 9:

[0553] The terminal displays detailed information about the proposed services and subsidies, as well as a procedure guide, to the user.

[0554] Input: Optimized service grant list sent from the server.

[0555] Output: Detailed information on the service and grant and a procedure guide will be displayed.

[0556] Operation: The terminal displays the received list and procedure guide to the user, and shows how to proceed with the service selected by the user.

[0557] Step 10:

[0558] The device periodically collects the user's facial expressions and voice using a camera and microphone and sends the data to a server.

[0559] Input: Real-time user video and audio data.

[0560] Output: Sending data to the server.

[0561] Operation: The device periodically collects the user's emotional data and sends it to the server.

[0562] Step 11:

[0563] If the server detects an abnormal emotional state, it sends an alert to the user and emergency contacts.

[0564] Input: Real-time emotion data submitted by users.

[0565] Output: A warning message.

[0566] How it works: The server determines abnormal emotional states based on data parsed with the EmotionRecognition library and uses Twilio to send alerts to the user and emergency contacts.

[0567] Step 12:

[0568] The server periodically sends notifications to check the user's status, and the terminal displays questions to the user.

[0569] Input: Periodic notifications from the server.

[0570] Output: Notification and questions for the user.

[0571] Operation: The server sends notifications to the user via the terminal at regular intervals, such as monthly, prompting the user to check the latest status.

[0572] Step 13:

[0573] The device sends the user's response to the server, which then analyzes the latest situation data and emotion data and updates the database.

[0574] Input: The most recent answer from the user.

[0575] Output: Updated database information.

[0576] Operation: The device sends the user's latest status response to the server, which analyzes the response and updates the database. This information is also shared with the care manager.

[0577] This will enable optimal nursing care services to be proposed taking into account the user's emotional state, and enable rapid response in emergencies.

[0578] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0579] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0580] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0581] [Second embodiment]

[0582] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0583] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0584] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0585] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0586] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0587] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0588] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0589] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0590] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0591] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0592] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0593] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0594] As an embodiment of the present invention, a system and a program based on the following method are provided.

[0595] 1. User Registration and Login

[0596] Download and launch the app

[0597] User: First, the user downloads the app from the app store and launches it.

[0598] Create an account

[0599] Device: Displays an account creation screen, allowing users to enter information such as name, contact details, care level, and income status.

[0600] User: Enter the required information and press the "Register" button.

[0601] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[0602] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[0603] 2. Interactive current situation assessment

[0604] Show Questions

[0605] Terminal: After the user logs in, the device displays the question "Please tell us about your care situation" and offers options (home care, day care, admission to a facility, etc.).

[0606] User: Choose the appropriate option.

[0607] Terminal: Sends the selected answer to the server.

[0608] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[0609] Show next question

[0610] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[0611] Terminal: Display the next question to the user.

[0612] User: Enters the required information and submits. Repeat this process to gain a detailed understanding of the user's current situation.

[0613] 3. Proposing appropriate services and subsidies

[0614] Data analysis

[0615] Server: Based on the accumulated user data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[0616] View the list of suggestions

[0617] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[0618] 4. Service selection and procedure guide

[0619] Service Selection

[0620] User: Select the service they wish to use from the list of suggestions.

[0621] Terminal: Sends the selected service to the server.

[0622] Procedure guide generation

[0623] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[0624] Display procedure guide

[0625] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[0626] 5. Regular status checks and cooperation with care managers

[0627] Periodic notification

[0628] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[0629] Device: Receives notification and displays status questions to the user.

[0630] Check the situation

[0631] User: Answers questions about recent care status and changes.

[0632] Terminal: Sends the answer to the server.

[0633] Data updates and care manager collaboration

[0634] Server: Analyzes the latest status data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[0635] Specific examples

[0636] Mr. Yamada (the user) downloads the app and creates an account. He then enters his current care situation. For example, Mr. Yamada selects "home care" and also enters information such as his family composition and income. The server analyzes this information and suggests a list of home care services and subsidies to Mr. Yamada. When Mr. Yamada selects a home care service, the server displays details of the application procedure and the necessary documents to support the procedure. The server also periodically checks Mr. Yamada's care situation, updates the data based on new information, and works with the care manager to provide appropriate support.

[0637] This system allows users to easily obtain the right information and quickly receive the assistance they need.

[0638] The processing flow will be explained below.

[0639] 1. User Registration and Login

[0640] Step 1:

[0641] Device: The user downloads and launches the app.

[0642] Step 2:

[0643] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[0644] Step 3:

[0645] User: Enter the required information and press the "Register" button.

[0646] Step 4:

[0647] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[0648] Step 5:

[0649] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[0650] 2. Interactive current situation assessment

[0651] Step 1:

[0652] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, admission to a facility, etc.).

[0653] Step 2:

[0654] User: Select the appropriate option and submit.

[0655] Step 3:

[0656] Terminal: Sends the selected answer to the server.

[0657] Step 4:

[0658] Server: Receives the response, analyzes it, and saves the analysis results in a database.

[0659] Step 5:

[0660] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[0661] Step 6:

[0662] Terminal: Display the next question to the user.

[0663] Step 7:

[0664] User: Enter the required information and submit.

[0665] Step 8:

[0666] The device: sends the entered answers to the server. This process is repeated to obtain a detailed picture of the user's current situation.

[0667] 3. Proposing appropriate services and subsidies

[0668] Step 1:

[0669] Server: Based on the accumulated user data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[0670] Step 2:

[0671] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[0672] 4. Service selection and procedure guide

[0673] Step 1:

[0674] User: Select the service they wish to use from the list of suggestions.

[0675] Step 2:

[0676] Terminal: Sends the selected service to the server.

[0677] Step 3:

[0678] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[0679] Step 4:

[0680] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[0681] 5. Regular status checks and cooperation with care managers

[0682] Step 1:

[0683] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[0684] Step 2:

[0685] Device: Receives notification and displays status questions to the user.

[0686] Step 3:

[0687] User: Answers questions about recent care status and changes.

[0688] Step 4:

[0689] Terminal: Sends the answer to the server.

[0690] Step 5:

[0691] Server: Analyzes the latest status data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[0692] This allows users to easily obtain the right information and quickly get the help they need.

[0693] Example 1

[0694] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0695] With conventional nursing care support systems, it was difficult for users to obtain timely information about appropriate nursing care services and subsidies, and there was a lack of information on application procedures, making it difficult to receive the necessary support promptly.In addition, there was also the problem that support based on the user's latest situation was not provided due to a lack of regular status checks and appropriate coordination with care managers.

[0696] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0697] In this invention, the server includes means for downloading and launching an application, means for the user to input personal information, means for saving the input information in a database, means for displaying questions about the user's care status and collecting responses, means for transmitting the collected information to the server, means for analyzing the information received in the server and proposing appropriate services and subsidies based on the analysis results, means for displaying detailed information about the proposed services and subsidies and application procedures, means for periodically checking the user's status and updating the data based on the obtained information, means for providing necessary information to a care manager, means for generating questions about the care status using a generative AI model and presenting them to the user, and means for generating the next necessary question based on the user's answers. This enables users to obtain information about appropriate care services and subsidies in a timely manner, receive specific guidance on application procedures, and further receive prompt support tailored to their latest care status through regular status checks and collaboration with care managers.

[0698] An "Application" is a software program that a User installs and uses on a mobile or desktop device.

[0699] "Downloading" is the process of transferring data or applications over the internet or network to a user's device.

[0700] "Launch" is the process by which a user runs an application and enables its initial settings and functionality.

[0701] "User" refers to an individual who uses the system to obtain information on nursing care services and subsidies.

[0702] "Personal information" refers to information that can identify a specific individual, such as a user's name, contact information, care level, and income status.

[0703] A "database" is a system for systematically managing and storing specific data.

[0704] "Care status" is information that indicates the type and status of care services used by the user or their family.

[0705] "Questions" refer to items presented to gain a detailed understanding of the user's care situation and needs.

[0706] "Answer" refers to information provided by a User in response to a Question.

[0707] A "server" is a computer system that receives data from users, analyzes it, and provides appropriate information.

[0708] "Analysis" is the process of analyzing the input data and proposing the most suitable services and subsidies to users.

[0709] "Services" refers to specific programs and activities designed to provide care-related assistance and support.

[0710] "Subsidy" refers to financial assistance that can be received by users who meet certain conditions.

[0711] "Detailed information" refers to information such as the specific content of the service or subsidy, terms of provision, and procedures.

[0712] "Usage procedures" refers to the process of submitting documents and procedures required for users to receive services and subsidies.

[0713] The "Procedure Guide" is a detailed instruction manual that includes the information necessary for the usage procedure (required documents, procedure location, contact information, etc.).

[0714] "Periodic" means that the process is repeated at predetermined time intervals (for example, monthly).

[0715] "Status check" is a process for understanding the user's current care situation and any changes.

[0716] "Data update" is the process of updating existing data based on newly acquired information.

[0717] A "care manager" is a professional who manages the planning and implementation of nursing care services and provides the necessary support.

[0718] A "generative AI model" is an algorithm that uses artificial intelligence to generate appropriate questions and suggestions for users.

[0719] "Next Questions" are questions generated based on the user's answers to gather further information.

[0720] The present invention relates to a system for providing information on nursing care services and subsidies and for streamlining procedures for using the services. Specific embodiments for carrying out the present invention are described below.

[0721] System Overview

[0722] First, users download and launch a dedicated application onto their mobile or desktop device. When first launched, an account creation screen appears, where users enter personal information such as their name, contact details, care level, and income status. The entered information is sent from the device to a server via the Internet and stored in a database on the server.

[0723] Collection of User Information

[0724] After logging in, the device displays questions about the user's care situation. The questions include options such as "home care," "day care," and "facility admission." When the user selects an appropriate option, the answer is sent to the server, which analyzes the answer and stores it in a database.

[0725] Analysis of information and suggestions

[0726] The server analyzes the collected user information and proposes appropriate nursing care services and subsidies to the user. The proposal list includes detailed information such as the service name, summary, and terms of use. This list is sent to the terminal and displayed to the user.

[0727] Providing procedural guidance

[0728] The information required for the procedure to use the nursing care service selected by the user (e.g., required documents, procedure location, contact information, etc.) is listed on the server and generated as a procedure guide. This guide is displayed to the user via their device, and a download link is also provided to suggest specific steps to take.

[0729] Regular status checks

[0730] The server periodically (e.g., monthly) sends notifications to the user regarding their status. The device receives the notifications and displays status check questions to the user. When the user enters an answer, the answer is sent from the device to the server, where it is saved and analyzed as the latest status data.

[0731] Collaboration with care managers

[0732] Based on the analysis results, the system provides the care manager with the latest information as needed, allowing users to receive the most appropriate care services at the appropriate time.

[0733] Using generative AI models

[0734] This system uses a generative AI model to generate the next question based on the user's care situation. These questions are dynamically generated based on the user's answers, allowing for more detailed information to be gathered. Specifically, the following prompts are used:

[0735] "What are the next questions to ask if you choose home care?"

[0736] "Please tell me the procedure for using the home care service."

[0737] "Generate additional questions about recent caregiving situations."

[0738] Specific examples

[0739] For example, User A downloads a care app and creates an account. User A then selects "home care" and enters information such as family composition and income status. The server analyzes this information and proposes to User A a list of home care services and subsidies. When User A selects a home care service, details of the application procedure and necessary documents are displayed to support User A. The server also periodically checks User A's care status and shares the latest data with the care manager to provide appropriate support.

[0740] In this way, this system provides comprehensive support to users to easily obtain information on appropriate nursing care services and subsidies, and to efficiently complete the application procedures.

[0741] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0742] Step 1:

[0743] The user downloads and launches an application. This causes the application to run on the device. The input is the user's input actions when launching the application for the first time. The output is the display of the application's initial setup screen.

[0744] Step 2:

[0745] The user enters personal information such as name, contact details, care level, and income status on the account creation screen. The device presents this information as an input form and collects the input data. The input is the personal information entered by the user, and the output is the collected personal information.

[0746] Step 3:

[0747] The terminal sends the entered user information to the server. The server receives it and stores it in a database. The input of this step is the personal information sent from the terminal, and the output is the data stored in the server.

[0748] Step 4:

[0749] The server generates an initial question about the user's care situation and sends it to the terminal. The terminal displays the question. The input is the user information stored in the database, and the output is the generated question about the care situation.

[0750] Step 5:

[0751] The user answers questions about the displayed care situation. The device collects the user's answers and sends them to the server. The input is the user's answers about the care situation, and the output is the data sent from the device to the server.

[0752] Step 6:

[0753] The server analyzes the received answer and generates the next question. This generation uses a generative AI model. The generated question is then sent to the device. The input is the answer data from the user, and the output is the generated next question.

[0754] Step 7:

[0755] The terminal will again display the next question from the server to the user, and this will continue until the user enters an answer. The input is the new question from the server, and the output is the question displayed to the user.

[0756] Step 8:

[0757] The server analyzes the accumulated user data, searches for appropriate nursing care services and subsidies, and generates a list. The input is the user data accumulated in the database, and the output is a list of services and subsidies.

[0758] Step 9:

[0759] The server sends the generated list to the terminal, which then displays the list to the user. The input is the service list from the server, and the output is the list displayed to the user.

[0760] Step 10:

[0761] The user selects the service they want to use from the list. The terminal sends the selected service information to the server. The input is the user's selection, and the output is the data sent to the server.

[0762] Step 11:

[0763] The server lists the information required to use the selected service and generates a procedure guide. The input is the user's selection information and the output is the procedure guide.

[0764] Step 12:

[0765] The terminal displays a procedure guide to the user and suggests the necessary actions. It also provides download links for the necessary documents. The input is the procedure guide from the server, and the output is the guide displayed to the user.

[0766] Step 13:

[0767] The server periodically sends status check notifications to the terminal. The terminal receives the notifications and displays them to the user. The input is the notification data generated by the server, and the output is the notification displayed by the terminal.

[0768] Step 14:

[0769] The user answers questions about the recent care situation. The device sends the answers to the server. The input is the latest care situation provided by the user, and the output is the data sent to the server.

[0770] Step 15:

[0771] The server analyzes the latest status data and updates the database. If necessary, it sends information to the care manager. The input is the user's latest data, and the output is the updated database and information provided to the care manager.

[0772] (Application example 1)

[0773] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0774] The current nursing care system is limited to functions such as proposing nursing care services and subsidies, and does not consider individual menu suggestions or delivery service support according to the user's dietary preferences or restrictions. For this reason, there is a need to further reduce the burden on users receiving care and provide appropriate nutritional management.

[0775] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0776] In this invention, the server includes means for having the user input personal information such as care status, income status, etc., means for transmitting the input information to the server, means for analyzing the information received in the server and proposing appropriate care services and subsidies, means for displaying detailed information on the proposed care services and subsidies and a procedure guide, means for periodically checking the user's status and updating the data based on the status, means for having the user input information on dietary preferences and restrictions, means for proposing appropriate menus and dining facilities based on the input preference and restriction information, means for displaying detailed information on the proposed menus and dining facilities, and means for notifying the progress of delivery. This enables users receiving care to obtain information on care services and subsidies, as well as receive meal suggestions and delivery service support tailored to their dietary preferences and restrictions.

[0777] "User" refers to an individual who uses the system to input information and receive services.

[0778] "Care status" refers to information that indicates the user's current care environment and needs.

[0779] "Income status" refers to information that indicates a user's current income and financial situation.

[0780] "Personal Information" means information about a user, including name, contact information, care level, etc.

[0781] A "server" is a device that receives information input by a user, analyzes it, and stores the data.

[0782] "Menu" means the meal options from which a User can choose.

[0783] "Food and beverage establishment" refers to a facility such as a restaurant that provides meals to users.

[0784] "Preferences" refers to information about ingredients that a user likes or dislikes.

[0785] "Restrictions" refer to dietary restrictions based on a user's health or religious reasons.

[0786] "Delivery" refers to a service that delivers the meal selected by the user.

[0787] "Progress" refers to information indicating the current status of a delivery in the delivery process.

[0788] "Suggestion" means showing the user the most suitable services and menus based on the analyzed information.

[0789] A "procedure guide" is a guidebook that explains the procedures for users to use various services and menus.

[0790] "Regular status checks" refers to the process of checking the user's current status at regular intervals and updating the database.

[0791] "Dietary preferences and restrictions information" refers to information entered by the user regarding allergies and dietary preferences.

[0792] This invention is a system that inputs personal information such as a user's care status and income status and proposes appropriate services based on that information. Furthermore, this system is characterized by the fact that it also proposes food delivery services. Specific embodiments are described below.

[0793] The system uses a terminal for users to input information and a server that receives and analyzes the information. The server has the following functions:

[0794] A means for users to input personal information such as care status, income status, etc.

[0795] A means of sending input information to the server

[0796] A means of analyzing received information and proposing appropriate nursing care services and subsidies

[0797] A means to display detailed information and procedural guidance for proposed care services and subsidies

[0798] A means to periodically check in with users and update the data accordingly

[0799] A means for users to input information about their dietary preferences and restrictions

[0800] A means of suggesting appropriate menus and dining facilities based on input preferences and constraint information

[0801] A way to view suggested menus and detailed information about dining options

[0802] A means of communicating delivery progress

[0803] The specific processing procedure is as follows:

[0804] First, the user accesses the system using a smartphone app. The app provides a screen for the user to enter information about their care status, income, preferences, and restrictions. After the user enters this information and presses the "Submit" button, the information is sent to the server.

[0805] The server stores this information in a database and analyzes it using a generative AI model to suggest care services, subsidies, menus, and dining options that best fit the user's needs. The results are sent to the user's device and displayed on the screen.

[0806] An example of a suggested prompt would be:

[0807] "Tell us about your dietary preferences or restrictions today. Choose the appropriate option: vegetarian, gluten-free, low-calorie, etc."

[0808] When the user selects a suggested service or menu, detailed information and a procedure guide will be displayed, and the user will receive regular notifications on the delivery progress.

[0809] This system allows users to select and deliver meals in conjunction with their care support, enabling more comprehensive support. The main hardware used is the user's smartphone and a server (e.g., AWS EC2), while the software is a smartphone app (e.g., Kotlin) and a server-side database (e.g., MySQL).

[0810] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0811] Step 1:

[0812] The user downloads and launches the smartphone app, which displays an account creation screen where the user enters basic information such as name, contact details, caregiving status, and income status.

[0813] Input: Basic information such as user name, contact information, caregiving status, income status, etc.

[0814] Output: Account creation request sent to server

[0815] Step 2:

[0816] The server processes the received account creation request, stores the information in a database, and then sends a notification of successful account creation to the device.

[0817] Input: Account creation request

[0818] Data processing: Save the input information in a database (e.g. MySQL)

[0819] Output: A notification of successful account creation is sent to the device.

[0820] Step 3:

[0821] The user logs in at the login screen. If successful, the device displays the question, "Please tell us about your dietary preferences and restrictions today," and offers options (e.g., vegetarian, gluten-free, low-calorie).

[0822] Input: User login information, preferences and constraints options

[0823] Output: Preferences and constraints options are displayed on the terminal.

[0824] Step 4:

[0825] When a user selects their dietary preferences and restrictions, the information is sent to the server, which then analyzes the information and searches for appropriate menus and dining facilities.

[0826] Input: User preferences and constraints

[0827] Data computation: Using generative AI models based on preferences and constraints to find appropriate menus and dining options

[0828] Output: Search results (menus and restaurants) are generated and sent to the device.

[0829] Step 5:

[0830] The device displays a list of suggested menus and dining options to the user, who then selects the menu item they wish to order from the suggested list.

[0831] Input: Menus and dining establishments received from the server

[0832] Output: The suggested list is displayed in the terminal.

[0833] Step 6:

[0834] Once the user has made a menu selection, an order request is sent to the server, which processes the order request and sends the order to the relevant dining establishment.

[0835] Input: User's order request

[0836] Data Computing: Processing order requests and sending orders to the relevant food and beverage establishments

[0837] Output: Order acceptance notification is sent to the terminal

[0838] Step 7:

[0839] The server tracks the delivery progress and periodically sends progress notifications to the device, which the user can then check via the app.

[0840] Input: Delivery progress

[0841] Output: Progress notifications are sent to the terminal

[0842] Step 8:

[0843] The server periodically generates questions to check the user's status and sends them to the device. The user answers the questions and sends new information to the server.

[0844] Input: Periodic status check questions

[0845] Output: Status check questions are displayed on the terminal.

[0846] Data processing: Save and update new information from users to the database

[0847] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0848] As an embodiment of the present invention, a system and a program are provided that combine a conventional nursing care service suggestion system with an emotion engine that recognizes the user's emotions.

[0849] User Registration and Login

[0850] Download and launch the app

[0851] User: First, the user downloads the app from the app store and launches it.

[0852] Create an account

[0853] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[0854] User: Enter the required information and press the "Register" button.

[0855] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[0856] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[0857] Interactive situation analysis and emotion recognition

[0858] Show Questions

[0859] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, admission to a facility, etc.).

[0860] User: Select the appropriate option and submit.

[0861] Terminal: Sends the selected answer to the server.

[0862] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[0863] emotion recognition

[0864] Server: Analyzes the user's emotions using the emotion engine based on the user's input data and dialogue content. Stores the emotion data in a database.

[0865] Show next question

[0866] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[0867] Terminal: Display the next question to the user.

[0868] User: Enters the required information and submits. Repeat this process to gain a detailed understanding of the user's current situation.

[0869] Proposal of appropriate services and subsidies and optimization based on emotions

[0870] Data analysis

[0871] Server: Based on the accumulated user data and emotion data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[0872] Emotion-Based Optimization

[0873] Server: Optimizes suggested care services and subsidies based on the user's emotional state. For example, if stress levels are high, services related to psychological support and relaxation will be prioritized.

[0874] View the list of suggestions

[0875] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[0876] Service selection and procedure guide

[0877] Service Selection

[0878] User: Select the service they wish to use from the list of suggestions.

[0879] Terminal: Sends the selected service to the server.

[0880] Procedure guide generation

[0881] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[0882] Display procedure guide

[0883] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[0884] Regular status checks and cooperation with care managers

[0885] Periodic notification

[0886] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[0887] Device: Receives notification and displays status questions to the user.

[0888] Check the situation

[0889] User: Answers questions about recent care status and changes.

[0890] Terminal: Sends the answer to the server.

[0891] Data updates and care manager collaboration

[0892] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[0893] Specific examples

[0894] Yamada (the user) downloads the app and creates an account. He then enters his care situation and emotional state. For example, Yamada selects "home care" and also enters information such as his family structure and income. The server analyzes this information and suggests a list of home care services and subsidies to Yamada. Furthermore, the emotion engine recognizes a high level of stress from Yamada's responses and prioritizes suggestions for relaxation services that will help reduce stress. Once Yamada selects a home care service, the app displays details of the application procedure and the necessary documents to support the process. The app also regularly checks Yamada's care situation and emotional state, updates the data based on new information, and works with the care manager to provide appropriate support.

[0895] This system allows users to easily obtain the right information and quickly receive the assistance they need, while also reducing psychological burden through the use of an emotion engine.

[0896] The processing flow will be explained below.

[0897] User Registration and Login

[0898] Step 1:

[0899] User: The user downloads and launches the app.

[0900] Step 2:

[0901] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[0902] Step 3:

[0903] User: Enter the required information and press the "Register" button.

[0904] Step 4:

[0905] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[0906] Step 5:

[0907] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[0908] Interactive situation analysis and emotion recognition

[0909] Step 1:

[0910] Terminal: After the user logs in, the device displays the question "Please tell us about your care situation" and offers options (home care, day care, admission to a facility, etc.).

[0911] Step 2:

[0912] User: Select the appropriate option and submit.

[0913] Step 3:

[0914] Terminal: Sends the selected answer to the server.

[0915] Step 4:

[0916] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[0917] Step 5:

[0918] Server: Analyzes the user's emotions using the emotion engine based on the user's input data and dialogue content. Stores the emotion data in a database.

[0919] Step 6:

[0920] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[0921] Step 7:

[0922] Terminal: Display the next question to the user.

[0923] Step 8:

[0924] User: Enters the required information and submits. This process is repeated to capture a detailed current situation and emotional state.

[0925] Proposal of appropriate services and subsidies and optimization based on emotions

[0926] Step 1:

[0927] Server: Based on the accumulated user data and emotion data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[0928] Step 2:

[0929] Server: Optimizes the suggested nursing care services and subsidies based on the user's emotional state.

[0930] Step 3:

[0931] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[0932] Service selection and procedure guide

[0933] Step 1:

[0934] User: Select the service they wish to use from the list of suggestions.

[0935] Step 2:

[0936] Terminal: Sends the selected service to the server.

[0937] Step 3:

[0938] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[0939] Step 4:

[0940] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[0941] Regular status checks and cooperation with care managers

[0942] Step 1:

[0943] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[0944] Step 2:

[0945] Device: Receives notification and displays status questions to the user.

[0946] Step 3:

[0947] User: Answers questions about recent care status and changes.

[0948] Step 4:

[0949] Terminal: Sends the answer to the server.

[0950] Step 5:

[0951] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[0952] Example 2

[0953] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0954] Conventional nursing care service recommendation systems have the problem of not providing sufficient support because they do not take into account the user's emotional state. In addition, there is a lack of regular status checks and collaboration with care professionals, making it difficult to provide appropriate support based on the user's latest status.

[0955] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0956] In this invention, the server includes means for having the user input personal data such as status information and financial information, means for transmitting the input data to the server, means for analyzing the data received in the server and proposing appropriate support services and financial assistance, means for analyzing the user's emotional state using an emotion analysis engine and optimizing appropriate proposals, and means for periodically checking the user's status and updating the data based on the status. This makes it possible to propose optimal nursing care services and financial assistance taking into account the user's emotional state, and by regularly checking the status and collaborating with care professionals, appropriate support based on the latest status can be provided.

[0957] "Status information" refers to information relating to the user's health condition, care situation, living environment, and the like.

[0958] "Financial Information" means information about a user's financial situation, such as income, assets, and expenses.

[0959] "Personal Data" is information about you that is specific to you, such as status information or financial information.

[0960] A "server" is a computer system that receives, analyzes, and processes data sent by users.

[0961] The "emotion analysis engine" is software that analyzes emotions from the data and conversation content provided by users and uses the results to optimize support services and financial assistance proposals.

[0962] "Support services" are services such as nursing care, medical care, and life support provided to users.

[0963] "Financial assistance" refers to financial assistance such as subsidies and grants provided to users.

[0964] "Procedure Guide" is a guideline that shows the procedure for using the support services or financial assistance selected by the user.

[0965] A "care professional" is a professional with specialized knowledge of care who is responsible for providing care support to users.

[0966] The present invention is a system that proposes appropriate nursing care services and financial assistance based on the user's emotion analysis. This system is mainly composed of the user, a terminal, and a server. Specifically, the system uses the following hardware and software to process and calculate various data.

[0967] Hardware and software used

[0968] 1. User device: A smartphone or tablet device with iOS or Android applications installed.

[0969] 2. Server: A cloud-based database and analysis system, specifically using a cloud platform such as Amazon Web Services (AWS) or Microsoft Azure.

[0970] 3. Sentiment Analysis Engine: A natural language processing (NLP) model using the Python transformers library. This model is used to emotionally analyze the user's text input.

[0971] Data processing and calculation

[0972] User Registration and Login:

[0973] Users download the app from the app store and create an account after installing it. When creating an account, they enter information such as their name, contact details, care level, and income status. This data is sent from the device to the server and stored in a database.

[0974] Conversational situational awareness with emotion recognition:

[0975] When a user logs in, the device displays the question, "Please tell us about your care situation," and the user selects the appropriate option from the options (home care, day care, facility admission, etc.). The user's selection data is sent to the server and analyzed. The server also uses an emotion analysis engine to emotionally analyze the user's input data and dialogue content, obtaining emotional data.

[0976] Proposal of appropriate services and grants:

[0977] The server then proposes appropriate nursing care services and financial assistance based on the acquired user data and emotional data. For example, if the user is judged to be under high stress, it will prioritize relaxation services.

[0978] Regular check-ins and collaboration with care professionals:

[0979] The server periodically sends notifications to users, asking them about recent care status and changes, ensuring the user database is always up to date and sending the necessary information to care professionals to ensure coordination.

[0980] Examples of concrete examples and prompts

[0981] For example, if a user logs in and selects "home care," and then responds to subsequent questions by entering information such as family composition and income status, the server receives and analyzes this information. If the emotion analysis engine analyzes the user's text responses and recognizes a high level of stress, it will prioritize suggestions for relaxation services that will help reduce stress.

[0982] Example prompt sentence:

[0983] "Please tell us about the situation in which you are receiving care. (Please choose from home care, day care, facility care, etc.)"

[0984] “Please describe your current feelings regarding your caregiving situation. Are you feeling stressed, anxious, or calm?”

[0985] This system allows users to easily obtain the appropriate information and quickly receive the necessary assistance, and by using an emotion analysis engine, it also reduces the psychological burden on users.

[0986] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0987] Program processing flow

[0988] Step 1: User Registration and Login

[0989] User: Downloads the app from the app store and launches the installed app.

[0990] Device: The device displays an account creation screen and prompts the user to enter their name, contact information, care level, income status, etc. This inputs the user's personal data.

[0991] User: The user enters the required information and presses the "Register" button.

[0992] Terminal: The terminal sends the entered information to the server.

[0993] Server: The server stores the received data in a database, generates a notification of success of account creation, and sends it to the device.

[0994] Device: The device will display a message that the account was created successfully and will transition to the login screen.

[0995] Step 2: Conversational situational awareness with emotion recognition

[0996] Terminal: After the user logs in, the terminal displays the question "Please tell us about your care situation" and provides options (home care, day care, admission to a facility, etc.).

[0997] User: The user selects the appropriate option and presses the submit button.

[0998] Terminal: The terminal sends the selected answer to the server.

[0999] Server: The server receives the response data and stores it in a database. It also analyzes the user's text input data using a sentiment analysis engine to generate sentiment data.

[1000] Server: Stores the emotion data in a database and generates the next question, which is about family structure and specific care needs.

[1001] Terminal: The terminal displays the following question to the user:

[1002] User: The user enters the appropriate answer and presses the submit button. This process is repeated to gain a detailed understanding of the current situation.

[1003] Step 3: Propose the right service / subsidy and optimize based on emotions

[1004] Server: The server analyzes the accumulated user data and emotion data.

[1005] Server: Based on the analysis results, it generates a list of available support services and financial aid, including details and terms of use for each service.

[1006] Server: Optimizes the list of suggestions based on the emotional state. For example, if stress is judged to be high, relaxation services will be prioritized on the list.

[1007] On the device: Show the user an optimized list of suggestions.

[1008] Step 4: Service selection and procedure guide

[1009] User: The user selects the service they want to use from a list of suggestions.

[1010] Terminal: The terminal transmits information about the selected service to the server.

[1011] Server: The server lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1012] Terminal: Displays the procedure guide to the user and provides download links for the required documents.

[1013] Step 5: Regular check-ins and collaboration with care professionals

[1014] Server: The server periodically (for example, monthly) sends notifications to check the user's status.

[1015] Device: The device receives the notification and displays a status question to the user.

[1016] User: The user answers questions about recent care status and changes and presses the send button.

[1017] Terminal: The terminal sends a response to the server.

[1018] Server: The server analyzes the latest status and emotion data, updates the database, and sends updates to care professionals as needed.

[1019] (Application example 2)

[1020] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1021] Conventional nursing care service suggestion systems not only have difficulty providing appropriate support that takes into account the user's emotional state, but also have difficulty responding quickly to unexpected emergencies. As a result, the psychological burden on the user increases, and problems arise in which the care support that should be provided is not sufficient. To solve this problem, a system is needed that can simultaneously propose optimal services that take into account the user's emotions and respond to emergencies.

[1022] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1023] In this invention, the server includes means for having the user input personal information such as care status and income status, means for transmitting the input information and the user's video data to the server, means for analyzing the information received within the server and proposing appropriate care services and subsidies, means for analyzing the user's emotions using an emotion recognition engine, means for displaying detailed information and procedure guides for the proposed care services and subsidies, means for sending a warning when an abnormal emotional state is detected, and means for periodically checking the user's status and updating data based on the status. This enables the server to propose optimal care services taking into account the user's emotional state and to respond quickly in emergencies.

[1024] "Care situation" is information that indicates the current state of a person who needs care and the environment in which care is provided. Specifically, it includes information about the type of care, such as home care, day care, or admission to a facility.

[1025] "Income status" refers to information that indicates the user's financial status. Specifically, it includes the type and amount of income, whether or not the user receives financial support, etc.

[1026] "Personal information" refers to information that identifies a user. Specifically, this includes basic information such as name, contact details, and care level.

[1027] The "emotion recognition engine" is software that analyzes the user's facial expressions and voice data to determine their emotional state. Specifically, it has the ability to recognize emotions such as stress, fear, and surprise.

[1028] "Video data" refers to video or image data that records a user's face or actions. Specifically, it includes video of a user captured by a camera.

[1029] "Nursing care services" refers to support and care provided to people who need nursing care. Specifically, it includes home care, day care, relaxation services, etc.

[1030] "Subsidies" are financial assistance provided by public or private organizations. Specifically, they include financial assistance to partially cover nursing care costs.

[1031] A "procedure guide" is a document that provides detailed instructions on how to apply for the proposed nursing care services and subsidies. Specifically, it includes information such as required documents, procedure locations, and contact details.

[1032] "Alerts" are messages sent to the user or emergency contacts to alert them, including notifications sent when an abnormal emotional state is detected.

[1033] "Users" are people who use the system to receive proposals for nursing care services and subsidies. Specifically, this includes elderly people who need nursing care and their families.

[1034] A "server" is a computer system that stores and analyzes data. Specifically, it processes information sent by users and has the function of suggesting services and issuing warnings.

[1035] As an embodiment of the present invention, we provide a multifunctional system for proposing nursing care services and implementing security measures. By combining it with an emotion recognition engine, the system takes into account the user's psychological state, enabling appropriate service proposals and rapid emergency response.

[1036] System configuration

[1037] 1. User Registration and Login

[1038] User: Download the system application from the app store. When launching the system for the first time, enter basic information such as name, contact details, care level, and income status to create an account.

[1039] Device: Sends the input information to the server and proceeds with the account creation process.

[1040] Server: Analyzes the received information and saves it in the database. It then sends a notification of success to the device, which then transitions to the login screen.

[1041] 2. Conversational Emotion Recognition and Current Situation Understanding

[1042] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, facility admission, etc.). The answer selected by the user is sent to the server.

[1043] Server: Analyzes the received answers and analyzes the user's emotions using an emotion recognition engine. The emotion data is stored in a database.

[1044] Terminal: The following questions (family structure, specific care needs, etc.) are displayed to the user, and the entered information is sent to the server. This process is repeated to obtain a detailed understanding of the user's current situation.

[1045] 3. Proposing appropriate services and subsidies

[1046] Server: Based on accumulated user data and emotion data, searches for available nursing care services and subsidies and generates a list.

[1047] Server: Optimizes suggested services and subsidies based on the user's emotional state. For example, if stress is judged to be high, it will prioritize suggested services related to psychological support and relaxation.

[1048] Terminal: Displays to the user a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[1049] 4. Service Selection and Procedures

[1050] User: Select the service they wish to use from the list of suggestions.

[1051] Terminal: Sends the selected service to the server.

[1052] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1053] Terminal: Displays a procedural guide to the user, recommending the necessary actions, and providing download links for the necessary documents.

[1054] 5. Detecting and alerting abnormal emotional states

[1055] Device: The device periodically collects the user's facial expressions and voice using a camera and microphone, and sends the data to a server.

[1056] Server: Using an emotion recognition engine, the data is analyzed in real time to detect abnormal emotional states (stress, fear, surprise, etc.).

[1057] Server: If an abnormal emotional state is detected, it sends an alert to the user and emergency contacts.

[1058] 6. Regular status checks and cooperation with care managers

[1059] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[1060] Device: Receives notifications and displays status confirmation questions to the user. When the user answers questions about recent care status and changes, the device sends the information to the server.

[1061] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[1062] Hardware and software used

[1063] The hardware used includes devices such as smartphones and tablets, cameras, microphones, etc. The required software includes OpenCV (video analysis), the EmotionRecognition library (emotion analysis), Twilio (notification sending), and Amazon Web Services (server and database management).

[1064] Specific examples

[1065] For example, when a user is using the system, their face is captured via their smartphone camera, and the system uses the EmotionRecognition library to analyze the user's emotions in real time, and if stress or fear is detected, it uses Twilio to send an alert notification to emergency contacts.

[1066] Prompt Sentence Examples

[1067] An example of a prompt to input to a generative AI model is, "Create a program that uses an emotion recognition engine to analyze the user's emotions in real time. Include a function to immediately send a notification to the user and emergency contacts if abnormal emotions (fear, stress, surprise) are detected."

[1068] This will enable the system to propose appropriate care services that take into account the user's emotional state and to respond quickly in emergencies.

[1069] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1070] Step 1:

[1071] Users download the app from the app store and enter basic information such as their name, contact details, care level, and income status when they launch the app for the first time.

[1072] Input: Personal information from the user.

[1073] Output: The user's personal information sent to the server.

[1074] Operation: The terminal sends the entered information to the server, which stores the received information in a database.

[1075] Step 2:

[1076] The device notifies the user that the account was created successfully and takes them to the login screen.

[1077] Input: Server-generated account creation success notification.

[1078] Output: Screen transition to login screen.

[1079] Behavior: The device displays the notification received from the server and then presents the login screen to the user.

[1080] Step 3:

[1081] After logging in, the user answers the question, "Please tell us your care situation."

[1082] Input: The displayed question and answer options (home care, day care, institutional care, etc.).

[1083] Output: The user's answer.

[1084] Operation: The device sends the user's selected answers to the server, which then analyzes the received answers and stores them in a database.

[1085] Step 4:

[1086] The server uses an emotion recognition engine to analyze facial expressions and voice to recognize the user's emotions.

[1087] Input: Video and audio data sent by the user.

[1088] Output: Parsed emotion data.

[1089] Operation: The server analyzes the received video and audio data using the EmotionRecognition library and stores the emotional data in a database.

[1090] Step 5:

[1091] Based on the analysis results, the server generates the next questions (family composition, specific care needs, etc.) and sends them to the device.

[1092] Input: Analyzed user's care situation and emotion data.

[1093] Output: Next question.

[1094] Operation: Based on the analysis results, the server identifies the next information needed and sends data to display the question on the terminal.

[1095] Step 6:

[1096] The terminal displays the next question to the user, and the user enters and submits the answer.

[1097] Input: The next question sent by the server.

[1098] Output: The user's answer.

[1099] Operation: The device displays the question received from the server to the user, then sends the user's answer back to the server, repeating this process multiple times.

[1100] Step 7:

[1101] The server searches for available nursing care services and subsidies based on accumulated user data and emotional data, and generates a list.

[1102] Input: User data and emotion data.

[1103] Output: List of care services and subsidies.

[1104] Operation: The server searches the database, lists potential nursing care services and grants, and generates the list.

[1105] Step 8:

[1106] The server optimizes the proposed services and subsidies based on the user's emotional state and sends them to the terminal.

[1107] Input: List of care services and grants, and sentiment data.

[1108] Output: Optimized service and grant list.

[1109] How it works: The server prioritizes the list taking into account the emotion data and sends it to the device.

[1110] Step 9:

[1111] The terminal displays detailed information about the proposed services and subsidies, as well as a procedure guide, to the user.

[1112] Input: Optimized service grant list sent from the server.

[1113] Output: Detailed information on the service and grant and a procedure guide will be displayed.

[1114] Operation: The terminal displays the received list and procedure guide to the user, and shows how to proceed with the service selected by the user.

[1115] Step 10:

[1116] The device periodically collects the user's facial expressions and voice using a camera and microphone and sends the data to a server.

[1117] Input: Real-time user video and audio data.

[1118] Output: Sending data to the server.

[1119] Operation: The device periodically collects the user's emotional data and sends it to the server.

[1120] Step 11:

[1121] If the server detects an abnormal emotional state, it sends an alert to the user and emergency contacts.

[1122] Input: Real-time emotion data submitted by users.

[1123] Output: A warning message.

[1124] How it works: The server determines abnormal emotional states based on data parsed with the EmotionRecognition library and uses Twilio to send alerts to the user and emergency contacts.

[1125] Step 12:

[1126] The server periodically sends notifications to check the user's status, and the terminal displays questions to the user.

[1127] Input: Periodic notifications from the server.

[1128] Output: Notification and questions for the user.

[1129] Operation: The server sends notifications to the user via the terminal at regular intervals, such as monthly, prompting the user to check the latest status.

[1130] Step 13:

[1131] The device sends the user's response to the server, which then analyzes the latest situation data and emotion data and updates the database.

[1132] Input: The most recent answer from the user.

[1133] Output: Updated database information.

[1134] Operation: The device sends the user's latest status response to the server, which analyzes the response and updates the database. This information is also shared with the care manager.

[1135] This will enable optimal nursing care services to be proposed taking into account the user's emotional state, and enable rapid response in emergencies.

[1136] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1137] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1138] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1139] [Third embodiment]

[1140] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1141] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1142] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1143] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1144] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1145] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1146] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1147] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1148] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1149] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1150] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1151] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1152] As an embodiment of the present invention, a system and a program based on the following method are provided.

[1153] 1. User Registration and Login

[1154] Download and launch the app

[1155] User: First, the user downloads the app from the app store and launches it.

[1156] Create an account

[1157] Device: Displays an account creation screen, allowing users to enter information such as name, contact details, care level, and income status.

[1158] User: Enter the required information and press the "Register" button.

[1159] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[1160] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[1161] 2. Interactive current situation assessment

[1162] Show Questions

[1163] Terminal: After the user logs in, the device displays the question "Please tell us about your care situation" and offers options (home care, day care, admission to a facility, etc.).

[1164] User: Choose the appropriate option.

[1165] Terminal: Sends the selected answer to the server.

[1166] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[1167] Show next question

[1168] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[1169] Terminal: Display the next question to the user.

[1170] User: Enters the required information and submits. Repeat this process to gain a detailed understanding of the user's current situation.

[1171] 3. Proposing appropriate services and subsidies

[1172] Data analysis

[1173] Server: Based on the accumulated user data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[1174] View the list of suggestions

[1175] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[1176] 4. Service selection and procedure guide

[1177] Service Selection

[1178] User: Select the service they wish to use from the list of suggestions.

[1179] Terminal: Sends the selected service to the server.

[1180] Procedure guide generation

[1181] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1182] Display procedure guide

[1183] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[1184] 5. Regular status checks and cooperation with care managers

[1185] Periodic notification

[1186] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[1187] Device: Receives notification and displays status questions to the user.

[1188] Check the situation

[1189] User: Answers questions about recent care status and changes.

[1190] Terminal: Sends the answer to the server.

[1191] Data updates and care manager collaboration

[1192] Server: Analyzes the latest status data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[1193] Specific examples

[1194] Mr. Yamada (the user) downloads the app and creates an account. He then enters his current care situation. For example, Mr. Yamada selects "home care" and also enters information such as his family composition and income. The server analyzes this information and suggests a list of home care services and subsidies to Mr. Yamada. When Mr. Yamada selects a home care service, the server displays details of the application procedure and the necessary documents to support the procedure. The server also periodically checks Mr. Yamada's care situation, updates the data based on new information, and works with the care manager to provide appropriate support.

[1195] This system allows users to easily obtain the right information and quickly receive the assistance they need.

[1196] The processing flow will be explained below.

[1197] 1. User Registration and Login

[1198] Step 1:

[1199] Device: The user downloads and launches the app.

[1200] Step 2:

[1201] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[1202] Step 3:

[1203] User: Enter the required information and press the "Register" button.

[1204] Step 4:

[1205] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[1206] Step 5:

[1207] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[1208] 2. Interactive current situation assessment

[1209] Step 1:

[1210] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, admission to a facility, etc.).

[1211] Step 2:

[1212] User: Select the appropriate option and submit.

[1213] Step 3:

[1214] Terminal: Sends the selected answer to the server.

[1215] Step 4:

[1216] Server: Receives the response, analyzes it, and saves the analysis results in a database.

[1217] Step 5:

[1218] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[1219] Step 6:

[1220] Terminal: Display the next question to the user.

[1221] Step 7:

[1222] User: Enter the required information and submit.

[1223] Step 8:

[1224] The device: sends the entered answers to the server. This process is repeated to obtain a detailed picture of the user's current situation.

[1225] 3. Proposing appropriate services and subsidies

[1226] Step 1:

[1227] Server: Based on the accumulated user data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[1228] Step 2:

[1229] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[1230] 4. Service selection and procedure guide

[1231] Step 1:

[1232] User: Select the service they wish to use from the list of suggestions.

[1233] Step 2:

[1234] Terminal: Sends the selected service to the server.

[1235] Step 3:

[1236] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1237] Step 4:

[1238] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[1239] 5. Regular status checks and cooperation with care managers

[1240] Step 1:

[1241] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[1242] Step 2:

[1243] Device: Receives notification and displays status questions to the user.

[1244] Step 3:

[1245] User: Answers questions about recent care status and changes.

[1246] Step 4:

[1247] Terminal: Sends the answer to the server.

[1248] Step 5:

[1249] Server: Analyzes the latest status data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[1250] This allows users to easily obtain the right information and quickly get the help they need.

[1251] Example 1

[1252] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1253] With conventional nursing care support systems, it was difficult for users to obtain timely information about appropriate nursing care services and subsidies, and there was a lack of information on application procedures, making it difficult to receive the necessary support promptly.In addition, there was also the problem that support based on the user's latest situation was not provided due to a lack of regular status checks and appropriate coordination with care managers.

[1254] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1255] In this invention, the server includes means for downloading and launching an application, means for the user to input personal information, means for saving the input information in a database, means for displaying questions about the user's care status and collecting responses, means for transmitting the collected information to the server, means for analyzing the information received in the server and proposing appropriate services and subsidies based on the analysis results, means for displaying detailed information about the proposed services and subsidies and application procedures, means for periodically checking the user's status and updating the data based on the obtained information, means for providing necessary information to a care manager, means for generating questions about the care status using a generative AI model and presenting them to the user, and means for generating the next necessary question based on the user's answers. This enables users to obtain information about appropriate care services and subsidies in a timely manner, receive specific guidance on application procedures, and further receive prompt support tailored to their latest care status through regular status checks and collaboration with care managers.

[1256] An "Application" is a software program that a User installs and uses on a mobile or desktop device.

[1257] "Downloading" is the process of transferring data or applications over the internet or network to a user's device.

[1258] "Launch" is the process by which a user runs an application and enables its initial settings and functionality.

[1259] "User" refers to an individual who uses the system to obtain information on nursing care services and subsidies.

[1260] "Personal information" refers to information that can identify a specific individual, such as a user's name, contact information, care level, and income status.

[1261] A "database" is a system for systematically managing and storing specific data.

[1262] "Care status" is information that indicates the type and status of care services used by the user or their family.

[1263] "Questions" refer to items presented to gain a detailed understanding of the user's care situation and needs.

[1264] "Answer" refers to information provided by a User in response to a Question.

[1265] A "server" is a computer system that receives data from users, analyzes it, and provides appropriate information.

[1266] "Analysis" is the process of analyzing the input data and proposing the most suitable services and subsidies to users.

[1267] "Services" refers to specific programs and activities designed to provide care-related assistance and support.

[1268] "Subsidy" refers to financial assistance that can be received by users who meet certain conditions.

[1269] "Detailed information" refers to information such as the specific content of the service or subsidy, terms of provision, and procedures.

[1270] "Usage procedures" refers to the process of submitting documents and procedures required for users to receive services and subsidies.

[1271] The "Procedure Guide" is a detailed instruction manual that includes the information necessary for the usage procedure (required documents, procedure location, contact information, etc.).

[1272] "Periodic" means that the process is repeated at predetermined time intervals (for example, monthly).

[1273] "Status check" is a process for understanding the user's current care situation and any changes.

[1274] "Data update" is the process of updating existing data based on newly acquired information.

[1275] A "care manager" is a professional who manages the planning and implementation of nursing care services and provides the necessary support.

[1276] A "generative AI model" is an algorithm that uses artificial intelligence to generate appropriate questions and suggestions for users.

[1277] "Next Questions" are questions generated based on the user's answers to gather further information.

[1278] The present invention relates to a system for providing information on nursing care services and subsidies and for streamlining procedures for using the services. Specific embodiments for carrying out the present invention are described below.

[1279] System Overview

[1280] First, users download and launch a dedicated application onto their mobile or desktop device. When first launched, an account creation screen appears, where users enter personal information such as their name, contact details, care level, and income status. The entered information is sent from the device to a server via the Internet and stored in a database on the server.

[1281] Collection of User Information

[1282] After logging in, the device displays questions about the user's care situation. The questions include options such as "home care," "day care," and "facility admission." When the user selects an appropriate option, the answer is sent to the server, which analyzes the answer and stores it in a database.

[1283] Analysis of information and suggestions

[1284] The server analyzes the collected user information and proposes appropriate nursing care services and subsidies to the user. The proposal list includes detailed information such as the service name, summary, and terms of use. This list is sent to the terminal and displayed to the user.

[1285] Providing procedural guidance

[1286] The information required for the procedure to use the nursing care service selected by the user (e.g., required documents, procedure location, contact information, etc.) is listed on the server and generated as a procedure guide. This guide is displayed to the user via their device, and a download link is also provided to suggest specific steps to take.

[1287] Regular status checks

[1288] The server periodically (e.g., monthly) sends notifications to the user regarding their status. The device receives the notifications and displays status check questions to the user. When the user enters an answer, the answer is sent from the device to the server, where it is saved and analyzed as the latest status data.

[1289] Collaboration with care managers

[1290] Based on the analysis results, the system provides the care manager with the latest information as needed, allowing users to receive the most appropriate care services at the appropriate time.

[1291] Using generative AI models

[1292] This system uses a generative AI model to generate the next question based on the user's care situation. These questions are dynamically generated based on the user's answers, allowing for more detailed information to be gathered. Specifically, the following prompts are used:

[1293] "What are the next questions to ask if you choose home care?"

[1294] "Please tell me the procedure for using the home care service."

[1295] "Generate additional questions about recent caregiving situations."

[1296] Specific examples

[1297] For example, User A downloads a care app and creates an account. User A then selects "home care" and enters information such as family composition and income status. The server analyzes this information and proposes to User A a list of home care services and subsidies. When User A selects a home care service, details of the application procedure and necessary documents are displayed to support User A. The server also periodically checks User A's care status and shares the latest data with the care manager to provide appropriate support.

[1298] In this way, this system provides comprehensive support to users to easily obtain information on appropriate nursing care services and subsidies, and to efficiently complete the application procedures.

[1299] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1300] Step 1:

[1301] The user downloads and launches an application. This causes the application to run on the device. The input is the user's input actions when launching the application for the first time. The output is the display of the application's initial setup screen.

[1302] Step 2:

[1303] The user enters personal information such as name, contact details, care level, and income status on the account creation screen. The device presents this information as an input form and collects the input data. The input is the personal information entered by the user, and the output is the collected personal information.

[1304] Step 3:

[1305] The terminal sends the entered user information to the server. The server receives it and stores it in a database. The input of this step is the personal information sent from the terminal, and the output is the data stored in the server.

[1306] Step 4:

[1307] The server generates an initial question about the user's care situation and sends it to the terminal. The terminal displays the question. The input is the user information stored in the database, and the output is the generated question about the care situation.

[1308] Step 5:

[1309] The user answers questions about the displayed care situation. The device collects the user's answers and sends them to the server. The input is the user's answers about the care situation, and the output is the data sent from the device to the server.

[1310] Step 6:

[1311] The server analyzes the received answer and generates the next question. This generation uses a generative AI model. The generated question is then sent to the device. The input is the answer data from the user, and the output is the generated next question.

[1312] Step 7:

[1313] The terminal will again display the next question from the server to the user, and this will continue until the user enters an answer. The input is the new question from the server, and the output is the question displayed to the user.

[1314] Step 8:

[1315] The server analyzes the accumulated user data, searches for appropriate nursing care services and subsidies, and generates a list. The input is the user data accumulated in the database, and the output is a list of services and subsidies.

[1316] Step 9:

[1317] The server sends the generated list to the terminal, which then displays the list to the user. The input is the service list from the server, and the output is the list displayed to the user.

[1318] Step 10:

[1319] The user selects the service they want to use from the list. The terminal sends the selected service information to the server. The input is the user's selection, and the output is the data sent to the server.

[1320] Step 11:

[1321] The server lists the information required to use the selected service and generates a procedure guide. The input is the user's selection information and the output is the procedure guide.

[1322] Step 12:

[1323] The terminal displays a procedure guide to the user and suggests the necessary actions. It also provides download links for the necessary documents. The input is the procedure guide from the server, and the output is the guide displayed to the user.

[1324] Step 13:

[1325] The server periodically sends status check notifications to the terminal. The terminal receives the notifications and displays them to the user. The input is the notification data generated by the server, and the output is the notification displayed by the terminal.

[1326] Step 14:

[1327] The user answers questions about the recent care situation. The device sends the answers to the server. The input is the latest care situation provided by the user, and the output is the data sent to the server.

[1328] Step 15:

[1329] The server analyzes the latest status data and updates the database. If necessary, it sends information to the care manager. The input is the user's latest data, and the output is the updated database and information provided to the care manager.

[1330] (Application example 1)

[1331] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1332] The current nursing care system is limited to functions such as proposing nursing care services and subsidies, and does not consider individual menu suggestions or delivery service support according to the user's dietary preferences or restrictions. For this reason, there is a need to further reduce the burden on users receiving care and provide appropriate nutritional management.

[1333] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1334] In this invention, the server includes means for having the user input personal information such as care status, income status, etc., means for transmitting the input information to the server, means for analyzing the information received in the server and proposing appropriate care services and subsidies, means for displaying detailed information on the proposed care services and subsidies and a procedure guide, means for periodically checking the user's status and updating the data based on the status, means for having the user input information on dietary preferences and restrictions, means for proposing appropriate menus and dining facilities based on the input preference and restriction information, means for displaying detailed information on the proposed menus and dining facilities, and means for notifying the progress of delivery. This enables users receiving care to obtain information on care services and subsidies, as well as receive meal suggestions and delivery service support tailored to their dietary preferences and restrictions.

[1335] "User" refers to an individual who uses the system to input information and receive services.

[1336] "Care status" refers to information that indicates the user's current care environment and needs.

[1337] "Income status" refers to information that indicates a user's current income and financial situation.

[1338] "Personal Information" means information about a user, including name, contact information, care level, etc.

[1339] A "server" is a device that receives information input by a user, analyzes it, and stores the data.

[1340] "Menu" means the meal options from which a User can choose.

[1341] "Food and beverage establishment" refers to a facility such as a restaurant that provides meals to users.

[1342] "Preferences" refers to information about ingredients that a user likes or dislikes.

[1343] "Restrictions" refer to dietary restrictions based on a user's health or religious reasons.

[1344] "Delivery" refers to a service that delivers the meal selected by the user.

[1345] "Progress" refers to information indicating the current status of a delivery in the delivery process.

[1346] "Suggestion" means showing the user the most suitable services and menus based on the analyzed information.

[1347] A "procedure guide" is a guidebook that explains the procedures for users to use various services and menus.

[1348] "Regular status checks" refers to the process of checking the user's current status at regular intervals and updating the database.

[1349] "Dietary preferences and restrictions information" refers to information entered by the user regarding allergies and dietary preferences.

[1350] This invention is a system that inputs personal information such as a user's care status and income status and proposes appropriate services based on that information. Furthermore, this system is characterized by the fact that it also proposes food delivery services. Specific embodiments are described below.

[1351] The system uses a terminal for users to input information and a server that receives and analyzes the information. The server has the following functions:

[1352] A means for users to input personal information such as care status, income status, etc.

[1353] A means of sending input information to the server

[1354] A means of analyzing received information and proposing appropriate nursing care services and subsidies

[1355] A means to display detailed information and procedural guidance for proposed care services and subsidies

[1356] A means to periodically check in with users and update the data accordingly

[1357] A means for users to input information about their dietary preferences and restrictions

[1358] A means of suggesting appropriate menus and dining facilities based on input preferences and constraint information

[1359] A way to view suggested menus and detailed information about dining options

[1360] A means of communicating delivery progress

[1361] The specific processing procedure is as follows:

[1362] First, the user accesses the system using a smartphone app. The app provides a screen for the user to enter information about their care status, income, preferences, and restrictions. After the user enters this information and presses the "Submit" button, the information is sent to the server.

[1363] The server stores this information in a database and analyzes it using a generative AI model to suggest care services, subsidies, menus, and dining options that best fit the user's needs. The results are sent to the user's device and displayed on the screen.

[1364] An example of a suggested prompt would be:

[1365] "Tell us about your dietary preferences or restrictions today. Choose the appropriate option: vegetarian, gluten-free, low-calorie, etc."

[1366] When the user selects a suggested service or menu, detailed information and a procedure guide will be displayed, and the user will receive regular notifications on the delivery progress.

[1367] This system allows users to select and deliver meals in conjunction with their care support, enabling more comprehensive support. The main hardware used is the user's smartphone and a server (e.g., AWS EC2), while the software is a smartphone app (e.g., Kotlin) and a server-side database (e.g., MySQL).

[1368] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1369] Step 1:

[1370] The user downloads and launches the smartphone app, which displays an account creation screen where the user enters basic information such as name, contact details, caregiving status, and income status.

[1371] Input: Basic information such as user name, contact information, caregiving status, income status, etc.

[1372] Output: Account creation request sent to server

[1373] Step 2:

[1374] The server processes the received account creation request, stores the information in a database, and then sends a notification of successful account creation to the device.

[1375] Input: Account creation request

[1376] Data processing: Save the input information in a database (e.g. MySQL)

[1377] Output: A notification of successful account creation is sent to the device.

[1378] Step 3:

[1379] The user logs in at the login screen. If successful, the device displays the question, "Please tell us about your dietary preferences and restrictions today," and offers options (e.g., vegetarian, gluten-free, low-calorie).

[1380] Input: User login information, preferences and constraints options

[1381] Output: Preferences and constraints options are displayed on the terminal.

[1382] Step 4:

[1383] When a user selects their dietary preferences and restrictions, the information is sent to the server, which then analyzes the information and searches for appropriate menus and dining facilities.

[1384] Input: User preferences and constraints

[1385] Data computation: Using generative AI models based on preferences and constraints to find appropriate menus and dining options

[1386] Output: Search results (menus and restaurants) are generated and sent to the device.

[1387] Step 5:

[1388] The device displays a list of suggested menus and dining options to the user, who then selects the menu item they wish to order from the suggested list.

[1389] Input: Menus and dining establishments received from the server

[1390] Output: The suggested list is displayed in the terminal.

[1391] Step 6:

[1392] Once the user has made a menu selection, an order request is sent to the server, which processes the order request and sends the order to the relevant dining establishment.

[1393] Input: User's order request

[1394] Data Computing: Processing order requests and sending orders to the relevant food and beverage establishments

[1395] Output: Order acceptance notification is sent to the terminal

[1396] Step 7:

[1397] The server tracks the delivery progress and periodically sends progress notifications to the device, which the user can then check via the app.

[1398] Input: Delivery progress

[1399] Output: Progress notifications are sent to the terminal

[1400] Step 8:

[1401] The server periodically generates questions to check the user's status and sends them to the device. The user answers the questions and sends new information to the server.

[1402] Input: Periodic status check questions

[1403] Output: Status check questions are displayed on the terminal.

[1404] Data processing: Save and update new information from users to the database

[1405] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1406] As an embodiment of the present invention, a system and a program are provided that combine a conventional nursing care service suggestion system with an emotion engine that recognizes the user's emotions.

[1407] User Registration and Login

[1408] Download and launch the app

[1409] User: First, the user downloads the app from the app store and launches it.

[1410] Create an account

[1411] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[1412] User: Enter the required information and press the "Register" button.

[1413] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[1414] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[1415] Interactive situation analysis and emotion recognition

[1416] Show Questions

[1417] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, admission to a facility, etc.).

[1418] User: Select the appropriate option and submit.

[1419] Terminal: Sends the selected answer to the server.

[1420] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[1421] emotion recognition

[1422] Server: Analyzes the user's emotions using the emotion engine based on the user's input data and dialogue content. Stores the emotion data in a database.

[1423] Show next question

[1424] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[1425] Terminal: Display the next question to the user.

[1426] User: Enters the required information and submits. Repeat this process to gain a detailed understanding of the user's current situation.

[1427] Proposal of appropriate services and subsidies and optimization based on emotions

[1428] Data analysis

[1429] Server: Based on the accumulated user data and emotion data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[1430] Emotion-Based Optimization

[1431] Server: Optimizes suggested care services and subsidies based on the user's emotional state. For example, if stress levels are high, services related to psychological support and relaxation will be prioritized.

[1432] View the list of suggestions

[1433] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[1434] Service selection and procedure guide

[1435] Service Selection

[1436] User: Select the service they wish to use from the list of suggestions.

[1437] Terminal: Sends the selected service to the server.

[1438] Procedure guide generation

[1439] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1440] Display procedure guide

[1441] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[1442] Regular status checks and cooperation with care managers

[1443] Periodic notification

[1444] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[1445] Device: Receives notification and displays status questions to the user.

[1446] Check the situation

[1447] User: Answers questions about recent care status and changes.

[1448] Terminal: Sends the answer to the server.

[1449] Data updates and care manager collaboration

[1450] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[1451] Specific examples

[1452] Yamada (the user) downloads the app and creates an account. He then enters his care situation and emotional state. For example, Yamada selects "home care" and also enters information such as his family structure and income. The server analyzes this information and suggests a list of home care services and subsidies to Yamada. Furthermore, the emotion engine recognizes a high level of stress from Yamada's responses and prioritizes suggestions for relaxation services that will help reduce stress. Once Yamada selects a home care service, the app displays details of the application procedure and the necessary documents to support the process. The app also regularly checks Yamada's care situation and emotional state, updates the data based on new information, and works with the care manager to provide appropriate support.

[1453] This system allows users to easily obtain the right information and quickly receive the assistance they need, while also reducing psychological burden through the use of an emotion engine.

[1454] The processing flow will be explained below.

[1455] User Registration and Login

[1456] Step 1:

[1457] User: The user downloads and launches the app.

[1458] Step 2:

[1459] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[1460] Step 3:

[1461] User: Enter the required information and press the "Register" button.

[1462] Step 4:

[1463] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[1464] Step 5:

[1465] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[1466] Interactive situation analysis and emotion recognition

[1467] Step 1:

[1468] Terminal: After the user logs in, the device displays the question "Please tell us about your care situation" and offers options (home care, day care, admission to a facility, etc.).

[1469] Step 2:

[1470] User: Select the appropriate option and submit.

[1471] Step 3:

[1472] Terminal: Sends the selected answer to the server.

[1473] Step 4:

[1474] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[1475] Step 5:

[1476] Server: Analyzes the user's emotions using the emotion engine based on the user's input data and dialogue content. Stores the emotion data in a database.

[1477] Step 6:

[1478] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[1479] Step 7:

[1480] Terminal: Display the next question to the user.

[1481] Step 8:

[1482] User: Enters the required information and submits. This process is repeated to capture a detailed current situation and emotional state.

[1483] Proposal of appropriate services and subsidies and optimization based on emotions

[1484] Step 1:

[1485] Server: Based on the accumulated user data and emotion data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[1486] Step 2:

[1487] Server: Optimizes the suggested nursing care services and subsidies based on the user's emotional state.

[1488] Step 3:

[1489] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[1490] Service selection and procedure guide

[1491] Step 1:

[1492] User: Select the service they wish to use from the list of suggestions.

[1493] Step 2:

[1494] Terminal: Sends the selected service to the server.

[1495] Step 3:

[1496] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1497] Step 4:

[1498] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[1499] Regular status checks and cooperation with care managers

[1500] Step 1:

[1501] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[1502] Step 2:

[1503] Device: Receives notification and displays status questions to the user.

[1504] Step 3:

[1505] User: Answers questions about recent care status and changes.

[1506] Step 4:

[1507] Terminal: Sends the answer to the server.

[1508] Step 5:

[1509] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[1510] Example 2

[1511] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1512] Conventional nursing care service recommendation systems have the problem of not providing sufficient support because they do not take into account the user's emotional state. In addition, there is a lack of regular status checks and collaboration with care professionals, making it difficult to provide appropriate support based on the user's latest status.

[1513] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1514] In this invention, the server includes means for having the user input personal data such as status information and financial information, means for transmitting the input data to the server, means for analyzing the data received in the server and proposing appropriate support services and financial assistance, means for analyzing the user's emotional state using an emotion analysis engine and optimizing appropriate proposals, and means for periodically checking the user's status and updating the data based on the status. This makes it possible to propose optimal nursing care services and financial assistance taking into account the user's emotional state, and by regularly checking the status and collaborating with care professionals, appropriate support based on the latest status can be provided.

[1515] "Status information" refers to information relating to the user's health condition, care situation, living environment, and the like.

[1516] "Financial Information" means information about a user's financial situation, such as income, assets, and expenses.

[1517] "Personal Data" is information about you that is specific to you, such as status information or financial information.

[1518] A "server" is a computer system that receives, analyzes, and processes data sent by users.

[1519] The "emotion analysis engine" is software that analyzes emotions from the data and conversation content provided by users and uses the results to optimize support services and financial assistance proposals.

[1520] "Support services" are services such as nursing care, medical care, and life support provided to users.

[1521] "Financial assistance" refers to financial assistance such as subsidies and grants provided to users.

[1522] "Procedure Guide" is a guideline that shows the procedure for using the support services or financial assistance selected by the user.

[1523] A "care professional" is a professional with specialized knowledge of care who is responsible for providing care support to users.

[1524] The present invention is a system that proposes appropriate nursing care services and financial assistance based on the user's emotion analysis. This system is mainly composed of the user, a terminal, and a server. Specifically, the system uses the following hardware and software to process and calculate various data.

[1525] Hardware and software used

[1526] 1. User device: A smartphone or tablet device with iOS or Android applications installed.

[1527] 2. Server: A cloud-based database and analysis system, specifically using a cloud platform such as Amazon Web Services (AWS) or Microsoft Azure.

[1528] 3. Sentiment Analysis Engine: A natural language processing (NLP) model using the Python transformers library. This model is used to emotionally analyze the user's text input.

[1529] Data processing and calculation

[1530] User Registration and Login:

[1531] Users download the app from the app store and create an account after installing it. When creating an account, they enter information such as their name, contact details, care level, and income status. This data is sent from the device to the server and stored in a database.

[1532] Conversational situational awareness with emotion recognition:

[1533] When a user logs in, the device displays the question, "Please tell us about your care situation," and the user selects the appropriate option from the options (home care, day care, facility admission, etc.). The user's selection data is sent to the server and analyzed. The server also uses an emotion analysis engine to emotionally analyze the user's input data and dialogue content, obtaining emotional data.

[1534] Proposal of appropriate services and grants:

[1535] The server then proposes appropriate nursing care services and financial assistance based on the acquired user data and emotional data. For example, if the user is judged to be under high stress, it will prioritize relaxation services.

[1536] Regular check-ins and collaboration with care professionals:

[1537] The server periodically sends notifications to users, asking them about recent care status and changes, ensuring the user database is always up to date and sending the necessary information to care professionals to ensure coordination.

[1538] Examples of concrete examples and prompts

[1539] For example, if a user logs in and selects "home care," and then responds to subsequent questions by entering information such as family composition and income status, the server receives and analyzes this information. If the emotion analysis engine analyzes the user's text responses and recognizes a high level of stress, it will prioritize suggestions for relaxation services that will help reduce stress.

[1540] Example prompt sentence:

[1541] "Please tell us about the situation in which you are receiving care. (Please choose from home care, day care, facility care, etc.)"

[1542] “Please describe your current feelings regarding your caregiving situation. Are you feeling stressed, anxious, or calm?”

[1543] This system allows users to easily obtain the appropriate information and quickly receive the necessary assistance, and by using an emotion analysis engine, it also reduces the psychological burden on users.

[1544] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1545] Program processing flow

[1546] Step 1: User Registration and Login

[1547] User: Downloads the app from the app store and launches the installed app.

[1548] Device: The device displays an account creation screen and prompts the user to enter their name, contact information, care level, income status, etc. This inputs the user's personal data.

[1549] User: The user enters the required information and presses the "Register" button.

[1550] Terminal: The terminal sends the entered information to the server.

[1551] Server: The server stores the received data in a database, generates a notification of success of account creation, and sends it to the device.

[1552] Device: The device will display a message that the account was created successfully and will transition to the login screen.

[1553] Step 2: Conversational situational awareness with emotion recognition

[1554] Terminal: After the user logs in, the terminal displays the question "Please tell us about your care situation" and provides options (home care, day care, admission to a facility, etc.).

[1555] User: The user selects the appropriate option and presses the submit button.

[1556] Terminal: The terminal sends the selected answer to the server.

[1557] Server: The server receives the response data and stores it in a database. It also analyzes the user's text input data using a sentiment analysis engine to generate sentiment data.

[1558] Server: Stores the emotion data in a database and generates the next question, which is about family structure and specific care needs.

[1559] Terminal: The terminal displays the following question to the user:

[1560] User: The user enters the appropriate answer and presses the submit button. This process is repeated to gain a detailed understanding of the current situation.

[1561] Step 3: Propose the right service / subsidy and optimize based on emotions

[1562] Server: The server analyzes the accumulated user data and emotion data.

[1563] Server: Based on the analysis results, it generates a list of available support services and financial aid, including details and terms of use for each service.

[1564] Server: Optimizes the list of suggestions based on the emotional state. For example, if stress is judged to be high, relaxation services will be prioritized on the list.

[1565] On the device: Show the user an optimized list of suggestions.

[1566] Step 4: Service selection and procedure guide

[1567] User: The user selects the service they want to use from a list of suggestions.

[1568] Terminal: The terminal transmits information about the selected service to the server.

[1569] Server: The server lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1570] Terminal: Displays the procedure guide to the user and provides download links for the required documents.

[1571] Step 5: Regular check-ins and collaboration with care professionals

[1572] Server: The server periodically (for example, monthly) sends notifications to check the user's status.

[1573] Device: The device receives the notification and displays a status question to the user.

[1574] User: The user answers questions about recent care status and changes and presses the send button.

[1575] Terminal: The terminal sends a response to the server.

[1576] Server: The server analyzes the latest status and emotion data, updates the database, and sends updates to care professionals as needed.

[1577] (Application example 2)

[1578] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1579] Conventional nursing care service suggestion systems not only have difficulty providing appropriate support that takes into account the user's emotional state, but also have difficulty responding quickly to unexpected emergencies. As a result, the psychological burden on the user increases, and problems arise in which the care support that should be provided is not sufficient. To solve this problem, a system is needed that can simultaneously propose optimal services that take into account the user's emotions and respond to emergencies.

[1580] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1581] In this invention, the server includes means for having the user input personal information such as care status and income status, means for transmitting the input information and the user's video data to the server, means for analyzing the information received within the server and proposing appropriate care services and subsidies, means for analyzing the user's emotions using an emotion recognition engine, means for displaying detailed information and procedure guides for the proposed care services and subsidies, means for sending a warning when an abnormal emotional state is detected, and means for periodically checking the user's status and updating data based on the status. This enables the server to propose optimal care services taking into account the user's emotional state and to respond quickly in emergencies.

[1582] "Care situation" is information that indicates the current state of a person who needs care and the environment in which care is provided. Specifically, it includes information about the type of care, such as home care, day care, or admission to a facility.

[1583] "Income status" refers to information that indicates the user's financial status. Specifically, it includes the type and amount of income, whether or not the user receives financial support, etc.

[1584] "Personal information" refers to information that identifies a user. Specifically, this includes basic information such as name, contact details, and care level.

[1585] The "emotion recognition engine" is software that analyzes the user's facial expressions and voice data to determine their emotional state. Specifically, it has the ability to recognize emotions such as stress, fear, and surprise.

[1586] "Video data" refers to video or image data that records a user's face or actions. Specifically, it includes video of a user captured by a camera.

[1587] "Nursing care services" refers to support and care provided to people who need nursing care. Specifically, it includes home care, day care, relaxation services, etc.

[1588] "Subsidies" are financial assistance provided by public or private organizations. Specifically, they include financial assistance to partially cover nursing care costs.

[1589] A "procedure guide" is a document that provides detailed instructions on how to apply for the proposed nursing care services and subsidies. Specifically, it includes information such as required documents, procedure locations, and contact details.

[1590] "Alerts" are messages sent to the user or emergency contacts to alert them, including notifications sent when an abnormal emotional state is detected.

[1591] "Users" are people who use the system to receive proposals for nursing care services and subsidies. Specifically, this includes elderly people who need nursing care and their families.

[1592] A "server" is a computer system that stores and analyzes data. Specifically, it processes information sent by users and has the function of suggesting services and issuing warnings.

[1593] As an embodiment of the present invention, we provide a multifunctional system for proposing nursing care services and implementing security measures. By combining it with an emotion recognition engine, the system takes into account the user's psychological state, enabling appropriate service proposals and rapid emergency response.

[1594] System configuration

[1595] 1. User Registration and Login

[1596] User: Download the system application from the app store. When launching the system for the first time, enter basic information such as name, contact details, care level, and income status to create an account.

[1597] Device: Sends the input information to the server and proceeds with the account creation process.

[1598] Server: Analyzes the received information and saves it in the database. It then sends a notification of success to the device, which then transitions to the login screen.

[1599] 2. Conversational Emotion Recognition and Current Situation Understanding

[1600] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, facility admission, etc.). The answer selected by the user is sent to the server.

[1601] Server: Analyzes the received answers and analyzes the user's emotions using an emotion recognition engine. The emotion data is stored in a database.

[1602] Terminal: The following questions (family structure, specific care needs, etc.) are displayed to the user, and the entered information is sent to the server. This process is repeated to obtain a detailed understanding of the user's current situation.

[1603] 3. Proposing appropriate services and subsidies

[1604] Server: Based on accumulated user data and emotion data, searches for available nursing care services and subsidies and generates a list.

[1605] Server: Optimizes suggested services and subsidies based on the user's emotional state. For example, if stress is judged to be high, it will prioritize suggested services related to psychological support and relaxation.

[1606] Terminal: Displays to the user a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[1607] 4. Service Selection and Procedures

[1608] User: Select the service they wish to use from the list of suggestions.

[1609] Terminal: Sends the selected service to the server.

[1610] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1611] Terminal: Displays a procedural guide to the user, recommending the necessary actions, and providing download links for the necessary documents.

[1612] 5. Detecting and alerting abnormal emotional states

[1613] Device: The device periodically collects the user's facial expressions and voice using a camera and microphone, and sends the data to a server.

[1614] Server: Using an emotion recognition engine, the data is analyzed in real time to detect abnormal emotional states (stress, fear, surprise, etc.).

[1615] Server: If an abnormal emotional state is detected, it sends an alert to the user and emergency contacts.

[1616] 6. Regular status checks and cooperation with care managers

[1617] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[1618] Device: Receives notifications and displays status confirmation questions to the user. When the user answers questions about recent care status and changes, the device sends the information to the server.

[1619] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[1620] Hardware and software used

[1621] The hardware used includes devices such as smartphones and tablets, cameras, microphones, etc. The required software includes OpenCV (video analysis), the EmotionRecognition library (emotion analysis), Twilio (notification sending), and Amazon Web Services (server and database management).

[1622] Specific examples

[1623] For example, when a user is using the system, their face is captured via their smartphone camera, and the system uses the EmotionRecognition library to analyze the user's emotions in real time, and if stress or fear is detected, it uses Twilio to send an alert notification to emergency contacts.

[1624] Prompt Sentence Examples

[1625] An example of a prompt to input to a generative AI model is, "Create a program that uses an emotion recognition engine to analyze the user's emotions in real time. Include a function to immediately send a notification to the user and emergency contacts if abnormal emotions (fear, stress, surprise) are detected."

[1626] This will enable the system to propose appropriate care services that take into account the user's emotional state and to respond quickly in emergencies.

[1627] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1628] Step 1:

[1629] Users download the app from the app store and enter basic information such as their name, contact details, care level, and income status when they launch the app for the first time.

[1630] Input: Personal information from the user.

[1631] Output: The user's personal information sent to the server.

[1632] Operation: The terminal sends the entered information to the server, which stores the received information in a database.

[1633] Step 2:

[1634] The device notifies the user that the account was created successfully and takes them to the login screen.

[1635] Input: Server-generated account creation success notification.

[1636] Output: Screen transition to login screen.

[1637] Behavior: The device displays the notification received from the server and then presents the login screen to the user.

[1638] Step 3:

[1639] After logging in, the user answers the question, "Please tell us your care situation."

[1640] Input: The displayed question and answer options (home care, day care, institutional care, etc.).

[1641] Output: The user's answer.

[1642] Operation: The device sends the user's selected answers to the server, which then analyzes the received answers and stores them in a database.

[1643] Step 4:

[1644] The server uses an emotion recognition engine to analyze facial expressions and voice to recognize the user's emotions.

[1645] Input: Video and audio data sent by the user.

[1646] Output: Parsed emotion data.

[1647] Operation: The server analyzes the received video and audio data using the EmotionRecognition library and stores the emotional data in a database.

[1648] Step 5:

[1649] Based on the analysis results, the server generates the next questions (family composition, specific care needs, etc.) and sends them to the device.

[1650] Input: Analyzed user's care situation and emotion data.

[1651] Output: Next question.

[1652] Operation: Based on the analysis results, the server identifies the next information needed and sends data to display the question on the terminal.

[1653] Step 6:

[1654] The terminal displays the next question to the user, and the user enters and submits the answer.

[1655] Input: The next question sent by the server.

[1656] Output: The user's answer.

[1657] Operation: The device displays the question received from the server to the user, then sends the user's answer back to the server, repeating this process multiple times.

[1658] Step 7:

[1659] The server searches for available nursing care services and subsidies based on accumulated user data and emotional data, and generates a list.

[1660] Input: User data and emotion data.

[1661] Output: List of care services and subsidies.

[1662] Operation: The server searches the database, lists potential nursing care services and grants, and generates the list.

[1663] Step 8:

[1664] The server optimizes the proposed services and subsidies based on the user's emotional state and sends them to the terminal.

[1665] Input: List of care services and grants, and sentiment data.

[1666] Output: Optimized service and grant list.

[1667] How it works: The server prioritizes the list taking into account the emotion data and sends it to the device.

[1668] Step 9:

[1669] The terminal displays detailed information about the proposed services and subsidies, as well as a procedure guide, to the user.

[1670] Input: Optimized service grant list sent from the server.

[1671] Output: Detailed information on the service and grant and a procedure guide will be displayed.

[1672] Operation: The terminal displays the received list and procedure guide to the user, and shows how to proceed with the service selected by the user.

[1673] Step 10:

[1674] The device periodically collects the user's facial expressions and voice using a camera and microphone and sends the data to a server.

[1675] Input: Real-time user video and audio data.

[1676] Output: Sending data to the server.

[1677] Operation: The device periodically collects the user's emotional data and sends it to the server.

[1678] Step 11:

[1679] If the server detects an abnormal emotional state, it sends an alert to the user and emergency contacts.

[1680] Input: Real-time emotion data submitted by users.

[1681] Output: A warning message.

[1682] How it works: The server determines abnormal emotional states based on data parsed with the EmotionRecognition library and uses Twilio to send alerts to the user and emergency contacts.

[1683] Step 12:

[1684] The server periodically sends notifications to check the user's status, and the terminal displays questions to the user.

[1685] Input: Periodic notifications from the server.

[1686] Output: Notification and questions for the user.

[1687] Operation: The server sends notifications to the user via the terminal at regular intervals, such as monthly, prompting the user to check the latest status.

[1688] Step 13:

[1689] The device sends the user's response to the server, which then analyzes the latest situation data and emotion data and updates the database.

[1690] Input: The most recent answer from the user.

[1691] Output: Updated database information.

[1692] Operation: The device sends the user's latest status response to the server, which analyzes the response and updates the database. This information is also shared with the care manager.

[1693] This will enable optimal nursing care services to be proposed taking into account the user's emotional state, and enable rapid response in emergencies.

[1694] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1695] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1696] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1697] [Fourth embodiment]

[1698] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1699] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1700] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1701] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1702] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1703] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1704] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1705] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1706] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1707] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1708] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1709] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1710] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1711] As an embodiment of the present invention, a system and a program based on the following method are provided.

[1712] 1. User Registration and Login

[1713] Download and launch the app

[1714] User: First, the user downloads the app from the app store and launches it.

[1715] Create an account

[1716] Device: Displays an account creation screen, allowing users to enter information such as name, contact details, care level, and income status.

[1717] User: Enter the required information and press the "Register" button.

[1718] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[1719] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[1720] 2. Interactive current situation assessment

[1721] Show Questions

[1722] Terminal: After the user logs in, the device displays the question "Please tell us about your care situation" and offers options (home care, day care, admission to a facility, etc.).

[1723] User: Choose the appropriate option.

[1724] Terminal: Sends the selected answer to the server.

[1725] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[1726] Show next question

[1727] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[1728] Terminal: Display the next question to the user.

[1729] User: Enters the required information and submits. Repeat this process to gain a detailed understanding of the user's current situation.

[1730] 3. Proposing appropriate services and subsidies

[1731] Data analysis

[1732] Server: Based on the accumulated user data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[1733] View the list of suggestions

[1734] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[1735] 4. Service selection and procedure guide

[1736] Service Selection

[1737] User: Select the service they wish to use from the list of suggestions.

[1738] Terminal: Sends the selected service to the server.

[1739] Procedure guide generation

[1740] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1741] Display procedure guide

[1742] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[1743] 5. Regular status checks and cooperation with care managers

[1744] Periodic notification

[1745] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[1746] Device: Receives notification and displays status questions to the user.

[1747] Check the situation

[1748] User: Answers questions about recent care status and changes.

[1749] Terminal: Sends the answer to the server.

[1750] Data updates and care manager collaboration

[1751] Server: Analyzes the latest status data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[1752] Specific examples

[1753] Mr. Yamada (the user) downloads the app and creates an account. He then enters his current care situation. For example, Mr. Yamada selects "home care" and also enters information such as his family composition and income. The server analyzes this information and suggests a list of home care services and subsidies to Mr. Yamada. When Mr. Yamada selects a home care service, the server displays details of the application procedure and the necessary documents to support the procedure. The server also periodically checks Mr. Yamada's care situation, updates the data based on new information, and works with the care manager to provide appropriate support.

[1754] This system allows users to easily obtain the right information and quickly receive the assistance they need.

[1755] The processing flow will be explained below.

[1756] 1. User Registration and Login

[1757] Step 1:

[1758] Device: The user downloads and launches the app.

[1759] Step 2:

[1760] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[1761] Step 3:

[1762] User: Enter the required information and press the "Register" button.

[1763] Step 4:

[1764] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[1765] Step 5:

[1766] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[1767] 2. Interactive current situation assessment

[1768] Step 1:

[1769] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, admission to a facility, etc.).

[1770] Step 2:

[1771] User: Select the appropriate option and submit.

[1772] Step 3:

[1773] Terminal: Sends the selected answer to the server.

[1774] Step 4:

[1775] Server: Receives the response, analyzes it, and saves the analysis results in a database.

[1776] Step 5:

[1777] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[1778] Step 6:

[1779] Terminal: Display the next question to the user.

[1780] Step 7:

[1781] User: Enter the required information and submit.

[1782] Step 8:

[1783] The device: sends the entered answers to the server. This process is repeated to obtain a detailed picture of the user's current situation.

[1784] 3. Proposing appropriate services and subsidies

[1785] Step 1:

[1786] Server: Based on the accumulated user data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[1787] Step 2:

[1788] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[1789] 4. Service selection and procedure guide

[1790] Step 1:

[1791] User: Select the service they wish to use from the list of suggestions.

[1792] Step 2:

[1793] Terminal: Sends the selected service to the server.

[1794] Step 3:

[1795] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1796] Step 4:

[1797] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[1798] 5. Regular status checks and cooperation with care managers

[1799] Step 1:

[1800] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[1801] Step 2:

[1802] Device: Receives notification and displays status questions to the user.

[1803] Step 3:

[1804] User: Answers questions about recent care status and changes.

[1805] Step 4:

[1806] Terminal: Sends the answer to the server.

[1807] Step 5:

[1808] Server: Analyzes the latest status data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[1809] This allows users to easily obtain the right information and quickly get the help they need.

[1810] Example 1

[1811] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1812] With conventional nursing care support systems, it was difficult for users to obtain timely information about appropriate nursing care services and subsidies, and there was a lack of information on application procedures, making it difficult to receive the necessary support promptly.In addition, there was also the problem that support based on the user's latest situation was not provided due to a lack of regular status checks and appropriate coordination with care managers.

[1813] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1814] In this invention, the server includes means for downloading and launching an application, means for the user to input personal information, means for saving the input information in a database, means for displaying questions about the user's care status and collecting responses, means for transmitting the collected information to the server, means for analyzing the information received in the server and proposing appropriate services and subsidies based on the analysis results, means for displaying detailed information about the proposed services and subsidies and application procedures, means for periodically checking the user's status and updating the data based on the obtained information, means for providing necessary information to a care manager, means for generating questions about the care status using a generative AI model and presenting them to the user, and means for generating the next necessary question based on the user's answers. This enables users to obtain information about appropriate care services and subsidies in a timely manner, receive specific guidance on application procedures, and further receive prompt support tailored to their latest care status through regular status checks and collaboration with care managers.

[1815] An "Application" is a software program that a User installs and uses on a mobile or desktop device.

[1816] "Downloading" is the process of transferring data or applications over the internet or network to a user's device.

[1817] "Launch" is the process by which a user runs an application and enables its initial settings and functionality.

[1818] "User" refers to an individual who uses the system to obtain information on nursing care services and subsidies.

[1819] "Personal information" refers to information that can identify a specific individual, such as a user's name, contact information, care level, and income status.

[1820] A "database" is a system for systematically managing and storing specific data.

[1821] "Care status" is information that indicates the type and status of care services used by the user or their family.

[1822] "Questions" refer to items presented to gain a detailed understanding of the user's care situation and needs.

[1823] "Answer" refers to information provided by a User in response to a Question.

[1824] A "server" is a computer system that receives data from users, analyzes it, and provides appropriate information.

[1825] "Analysis" is the process of analyzing the input data and proposing the most suitable services and subsidies to users.

[1826] "Services" refers to specific programs and activities designed to provide care-related assistance and support.

[1827] "Subsidy" refers to financial assistance that can be received by users who meet certain conditions.

[1828] "Detailed information" refers to information such as the specific content of the service or subsidy, terms of provision, and procedures.

[1829] "Usage procedures" refers to the process of submitting documents and procedures required for users to receive services and subsidies.

[1830] The "Procedure Guide" is a detailed instruction manual that includes the information necessary for the usage procedure (required documents, procedure location, contact information, etc.).

[1831] "Periodic" means that the process is repeated at predetermined time intervals (for example, monthly).

[1832] "Status check" is a process for understanding the user's current care situation and any changes.

[1833] "Data update" is the process of updating existing data based on newly acquired information.

[1834] A "care manager" is a professional who manages the planning and implementation of nursing care services and provides the necessary support.

[1835] A "generative AI model" is an algorithm that uses artificial intelligence to generate appropriate questions and suggestions for users.

[1836] "Next Questions" are questions generated based on the user's answers to gather further information.

[1837] The present invention relates to a system for providing information on nursing care services and subsidies and for streamlining procedures for using the services. Specific embodiments for carrying out the present invention are described below.

[1838] System Overview

[1839] First, users download and launch a dedicated application onto their mobile or desktop device. When first launched, an account creation screen appears, where users enter personal information such as their name, contact details, care level, and income status. The entered information is sent from the device to a server via the Internet and stored in a database on the server.

[1840] Collection of User Information

[1841] After logging in, the device displays questions about the user's care situation. The questions include options such as "home care," "day care," and "facility admission." When the user selects an appropriate option, the answer is sent to the server, which analyzes the answer and stores it in a database.

[1842] Analysis of information and suggestions

[1843] The server analyzes the collected user information and proposes appropriate nursing care services and subsidies to the user. The proposal list includes detailed information such as the service name, summary, and terms of use. This list is sent to the terminal and displayed to the user.

[1844] Providing procedural guidance

[1845] The information required for the procedure to use the nursing care service selected by the user (e.g., required documents, procedure location, contact information, etc.) is listed on the server and generated as a procedure guide. This guide is displayed to the user via their device, and a download link is also provided to suggest specific steps to take.

[1846] Regular status checks

[1847] The server periodically (e.g., monthly) sends notifications to the user regarding their status. The device receives the notifications and displays status check questions to the user. When the user enters an answer, the answer is sent from the device to the server, where it is saved and analyzed as the latest status data.

[1848] Collaboration with care managers

[1849] Based on the analysis results, the system provides the care manager with the latest information as needed, allowing users to receive the most appropriate care services at the appropriate time.

[1850] Using generative AI models

[1851] This system uses a generative AI model to generate the next question based on the user's care situation. These questions are dynamically generated based on the user's answers, allowing for more detailed information to be gathered. Specifically, the following prompts are used:

[1852] "What are the next questions to ask if you choose home care?"

[1853] "Please tell me the procedure for using the home care service."

[1854] "Generate additional questions about recent caregiving situations."

[1855] Specific examples

[1856] For example, User A downloads a care app and creates an account. User A then selects "home care" and enters information such as family composition and income status. The server analyzes this information and proposes to User A a list of home care services and subsidies. When User A selects a home care service, details of the application procedure and necessary documents are displayed to support User A. The server also periodically checks User A's care status and shares the latest data with the care manager to provide appropriate support.

[1857] In this way, this system provides comprehensive support to users to easily obtain information on appropriate nursing care services and subsidies, and to efficiently complete the application procedures.

[1858] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1859] Step 1:

[1860] The user downloads and launches an application. This causes the application to run on the device. The input is the user's input actions when launching the application for the first time. The output is the display of the application's initial setup screen.

[1861] Step 2:

[1862] The user enters personal information such as name, contact details, care level, and income status on the account creation screen. The device presents this information as an input form and collects the input data. The input is the personal information entered by the user, and the output is the collected personal information.

[1863] Step 3:

[1864] The terminal sends the entered user information to the server. The server receives it and stores it in a database. The input of this step is the personal information sent from the terminal, and the output is the data stored in the server.

[1865] Step 4:

[1866] The server generates an initial question about the user's care situation and sends it to the terminal. The terminal displays the question. The input is the user information stored in the database, and the output is the generated question about the care situation.

[1867] Step 5:

[1868] The user answers questions about the displayed care situation. The device collects the user's answers and sends them to the server. The input is the user's answers about the care situation, and the output is the data sent from the device to the server.

[1869] Step 6:

[1870] The server analyzes the received answer and generates the next question. This generation uses a generative AI model. The generated question is then sent to the device. The input is the answer data from the user, and the output is the generated next question.

[1871] Step 7:

[1872] The terminal will again display the next question from the server to the user, and this will continue until the user enters an answer. The input is the new question from the server, and the output is the question displayed to the user.

[1873] Step 8:

[1874] The server analyzes the accumulated user data, searches for appropriate nursing care services and subsidies, and generates a list. The input is the user data accumulated in the database, and the output is a list of services and subsidies.

[1875] Step 9:

[1876] The server sends the generated list to the terminal, which then displays the list to the user. The input is the service list from the server, and the output is the list displayed to the user.

[1877] Step 10:

[1878] The user selects the service they want to use from the list. The terminal sends the selected service information to the server. The input is the user's selection, and the output is the data sent to the server.

[1879] Step 11:

[1880] The server lists the information required to use the selected service and generates a procedure guide. The input is the user's selection information and the output is the procedure guide.

[1881] Step 12:

[1882] The terminal displays a procedure guide to the user and suggests the necessary actions. It also provides download links for the necessary documents. The input is the procedure guide from the server, and the output is the guide displayed to the user.

[1883] Step 13:

[1884] The server periodically sends status check notifications to the terminal. The terminal receives the notifications and displays them to the user. The input is the notification data generated by the server, and the output is the notification displayed by the terminal.

[1885] Step 14:

[1886] The user answers questions about the recent care situation. The device sends the answers to the server. The input is the latest care situation provided by the user, and the output is the data sent to the server.

[1887] Step 15:

[1888] The server analyzes the latest status data and updates the database. If necessary, it sends information to the care manager. The input is the user's latest data, and the output is the updated database and information provided to the care manager.

[1889] (Application example 1)

[1890] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1891] The current nursing care system is limited to functions such as proposing nursing care services and subsidies, and does not consider individual menu suggestions or delivery service support according to the user's dietary preferences or restrictions. For this reason, there is a need to further reduce the burden on users receiving care and provide appropriate nutritional management.

[1892] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1893] In this invention, the server includes means for having the user input personal information such as care status, income status, etc., means for transmitting the input information to the server, means for analyzing the information received in the server and proposing appropriate care services and subsidies, means for displaying detailed information on the proposed care services and subsidies and a procedure guide, means for periodically checking the user's status and updating the data based on the status, means for having the user input information on dietary preferences and restrictions, means for proposing appropriate menus and dining facilities based on the input preference and restriction information, means for displaying detailed information on the proposed menus and dining facilities, and means for notifying the progress of delivery. This enables users receiving care to obtain information on care services and subsidies, as well as receive meal suggestions and delivery service support tailored to their dietary preferences and restrictions.

[1894] "User" refers to an individual who uses the system to input information and receive services.

[1895] "Care status" refers to information that indicates the user's current care environment and needs.

[1896] "Income status" refers to information that indicates a user's current income and financial situation.

[1897] "Personal Information" means information about a user, including name, contact information, care level, etc.

[1898] A "server" is a device that receives information input by a user, analyzes it, and stores the data.

[1899] "Menu" means the meal options from which a User can choose.

[1900] "Food and beverage establishment" refers to a facility such as a restaurant that provides meals to users.

[1901] "Preferences" refers to information about ingredients that a user likes or dislikes.

[1902] "Restrictions" refer to dietary restrictions based on a user's health or religious reasons.

[1903] "Delivery" refers to a service that delivers the meal selected by the user.

[1904] "Progress" refers to information indicating the current status of a delivery in the delivery process.

[1905] "Suggestion" means showing the user the most suitable services and menus based on the analyzed information.

[1906] A "procedure guide" is a guidebook that explains the procedures for users to use various services and menus.

[1907] "Regular status checks" refers to the process of checking the user's current status at regular intervals and updating the database.

[1908] "Dietary preferences and restrictions information" refers to information entered by the user regarding allergies and dietary preferences.

[1909] This invention is a system that inputs personal information such as a user's care status and income status and proposes appropriate services based on that information. Furthermore, this system is characterized by the fact that it also proposes food delivery services. Specific embodiments are described below.

[1910] The system uses a terminal for users to input information and a server that receives and analyzes the information. The server has the following functions:

[1911] A means for users to input personal information such as care status, income status, etc.

[1912] A means of sending input information to the server

[1913] A means of analyzing received information and proposing appropriate nursing care services and subsidies

[1914] A means to display detailed information and procedural guidance for proposed care services and subsidies

[1915] A means to periodically check in with users and update the data accordingly

[1916] A means for users to input information about their dietary preferences and restrictions

[1917] A means of suggesting appropriate menus and dining facilities based on input preferences and constraint information

[1918] A way to view suggested menus and detailed information about dining options

[1919] A means of communicating delivery progress

[1920] The specific processing procedure is as follows:

[1921] First, the user accesses the system using a smartphone app. The app provides a screen for the user to enter information about their care status, income, preferences, and restrictions. After the user enters this information and presses the "Submit" button, the information is sent to the server.

[1922] The server stores this information in a database and analyzes it using a generative AI model to suggest care services, subsidies, menus, and dining options that best fit the user's needs. The results are sent to the user's device and displayed on the screen.

[1923] An example of a suggested prompt would be:

[1924] "Tell us about your dietary preferences or restrictions today. Choose the appropriate option: vegetarian, gluten-free, low-calorie, etc."

[1925] When the user selects a suggested service or menu, detailed information and a procedure guide will be displayed, and the user will receive regular notifications on the delivery progress.

[1926] This system allows users to select and deliver meals in conjunction with their care support, enabling more comprehensive support. The main hardware used is the user's smartphone and a server (e.g., AWS EC2), while the software is a smartphone app (e.g., Kotlin) and a server-side database (e.g., MySQL).

[1927] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1928] Step 1:

[1929] The user downloads and launches the smartphone app, which displays an account creation screen where the user enters basic information such as name, contact details, caregiving status, and income status.

[1930] Input: Basic information such as user name, contact information, caregiving status, income status, etc.

[1931] Output: Account creation request sent to server

[1932] Step 2:

[1933] The server processes the received account creation request, stores the information in a database, and then sends a notification of successful account creation to the device.

[1934] Input: Account creation request

[1935] Data processing: Save the input information in a database (e.g. MySQL)

[1936] Output: A notification of successful account creation is sent to the device.

[1937] Step 3:

[1938] The user logs in at the login screen. If successful, the device displays the question, "Please tell us about your dietary preferences and restrictions today," and offers options (e.g., vegetarian, gluten-free, low-calorie).

[1939] Input: User login information, preferences and constraints options

[1940] Output: Preferences and constraints options are displayed on the terminal.

[1941] Step 4:

[1942] When a user selects their dietary preferences and restrictions, the information is sent to the server, which then analyzes the information and searches for appropriate menus and dining facilities.

[1943] Input: User preferences and constraints

[1944] Data computation: Using generative AI models based on preferences and constraints to find appropriate menus and dining options

[1945] Output: Search results (menus and restaurants) are generated and sent to the device.

[1946] Step 5:

[1947] The device displays a list of suggested menus and dining options to the user, who then selects the menu item they wish to order from the suggested list.

[1948] Input: Menus and dining establishments received from the server

[1949] Output: The suggested list is displayed in the terminal.

[1950] Step 6:

[1951] Once the user has made a menu selection, an order request is sent to the server, which processes the order request and sends the order to the relevant dining establishment.

[1952] Input: User's order request

[1953] Data Computing: Processing order requests and sending orders to the relevant food and beverage establishments

[1954] Output: Order acceptance notification is sent to the terminal

[1955] Step 7:

[1956] The server tracks the delivery progress and periodically sends progress notifications to the device, which the user can then check via the app.

[1957] Input: Delivery progress

[1958] Output: Progress notifications are sent to the terminal

[1959] Step 8:

[1960] The server periodically generates questions to check the user's status and sends them to the device. The user answers the questions and sends new information to the server.

[1961] Input: Periodic status check questions

[1962] Output: Status check questions are displayed on the terminal.

[1963] Data processing: Save and update new information from users to the database

[1964] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1965] As an embodiment of the present invention, a system and a program are provided that combine a conventional nursing care service suggestion system with an emotion engine that recognizes the user's emotions.

[1966] User Registration and Login

[1967] Download and launch the app

[1968] User: First, the user downloads the app from the app store and launches it.

[1969] Create an account

[1970] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[1971] User: Enter the required information and press the "Register" button.

[1972] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[1973] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[1974] Interactive situation analysis and emotion recognition

[1975] Show Questions

[1976] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, admission to a facility, etc.).

[1977] User: Select the appropriate option and submit.

[1978] Terminal: Sends the selected answer to the server.

[1979] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[1980] emotion recognition

[1981] Server: Analyzes the user's emotions using the emotion engine based on the user's input data and dialogue content. Stores the emotion data in a database.

[1982] Show next question

[1983] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[1984] Terminal: Display the next question to the user.

[1985] User: Enters the required information and submits. Repeat this process to gain a detailed understanding of the user's current situation.

[1986] Proposal of appropriate services and subsidies and optimization based on emotions

[1987] Data analysis

[1988] Server: Based on the accumulated user data and emotion data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[1989] Emotion-Based Optimization

[1990] Server: Optimizes suggested care services and subsidies based on the user's emotional state. For example, if stress levels are high, services related to psychological support and relaxation will be prioritized.

[1991] View the list of suggestions

[1992] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[1993] Service selection and procedure guide

[1994] Service Selection

[1995] User: Select the service they wish to use from the list of suggestions.

[1996] Terminal: Sends the selected service to the server.

[1997] Procedure guide generation

[1998] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[1999] Display procedure guide

[2000] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[2001] Regular status checks and cooperation with care managers

[2002] Periodic notification

[2003] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[2004] Device: Receives notification and displays status questions to the user.

[2005] Check the situation

[2006] User: Answers questions about recent care status and changes.

[2007] Terminal: Sends the answer to the server.

[2008] Data updates and care manager collaboration

[2009] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[2010] Specific examples

[2011] Yamada (the user) downloads the app and creates an account. He then enters his care situation and emotional state. For example, Yamada selects "home care" and also enters information such as his family structure and income. The server analyzes this information and suggests a list of home care services and subsidies to Yamada. Furthermore, the emotion engine recognizes a high level of stress from Yamada's responses and prioritizes suggestions for relaxation services that will help reduce stress. Once Yamada selects a home care service, the app displays details of the application procedure and the necessary documents to support the process. The app also regularly checks Yamada's care situation and emotional state, updates the data based on new information, and works with the care manager to provide appropriate support.

[2012] This system allows users to easily obtain the right information and quickly receive the assistance they need, while also reducing psychological burden through the use of an emotion engine.

[2013] The processing flow will be explained below.

[2014] User Registration and Login

[2015] Step 1:

[2016] User: The user downloads and launches the app.

[2017] Step 2:

[2018] Device: Displays the account creation screen and asks the user to enter information such as name, contact details, care level, and income status.

[2019] Step 3:

[2020] User: Enter the required information and press the "Register" button.

[2021] Step 4:

[2022] Server: Saves the input information in the database, creates the account, and sends a notification of success to the device.

[2023] Step 5:

[2024] Device: A message will be displayed indicating that the account was created successfully, and the user will be taken to the login screen.

[2025] Interactive situation analysis and emotion recognition

[2026] Step 1:

[2027] Terminal: After the user logs in, the device displays the question "Please tell us about your care situation" and offers options (home care, day care, admission to a facility, etc.).

[2028] Step 2:

[2029] User: Select the appropriate option and submit.

[2030] Step 3:

[2031] Terminal: Sends the selected answer to the server.

[2032] Step 4:

[2033] Server: Receives the response, analyzes it, and stores the analysis results in a database.

[2034] Step 5:

[2035] Server: Analyzes the user's emotions using the emotion engine based on the user's input data and dialogue content. Stores the emotion data in a database.

[2036] Step 6:

[2037] Server: Generates the next questions (family structure, specific care needs, etc.) and sends them to the device.

[2038] Step 7:

[2039] Terminal: Display the next question to the user.

[2040] Step 8:

[2041] User: Enters the required information and submits. This process is repeated to capture a detailed current situation and emotional state.

[2042] Proposal of appropriate services and subsidies and optimization based on emotions

[2043] Step 1:

[2044] Server: Based on the accumulated user data and emotion data, the server searches for available nursing care services and subsidies and generates a list, including the service name, summary, conditions, etc.

[2045] Step 2:

[2046] Server: Optimizes the suggested nursing care services and subsidies based on the user's emotional state.

[2047] Step 3:

[2048] Terminal: Presents the user with a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[2049] Service selection and procedure guide

[2050] Step 1:

[2051] User: Select the service they wish to use from the list of suggestions.

[2052] Step 2:

[2053] Terminal: Sends the selected service to the server.

[2054] Step 3:

[2055] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[2056] Step 4:

[2057] Terminal: Providing a procedural guide to the user, recommending the necessary actions, and providing download links for required documents.

[2058] Regular status checks and cooperation with care managers

[2059] Step 1:

[2060] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[2061] Step 2:

[2062] Device: Receives notification and displays status questions to the user.

[2063] Step 3:

[2064] User: Answers questions about recent care status and changes.

[2065] Step 4:

[2066] Terminal: Sends the answer to the server.

[2067] Step 5:

[2068] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[2069] Example 2

[2070] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2071] Conventional nursing care service recommendation systems have the problem of not providing sufficient support because they do not take into account the user's emotional state. In addition, there is a lack of regular status checks and collaboration with care professionals, making it difficult to provide appropriate support based on the user's latest status.

[2072] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2073] In this invention, the server includes means for having the user input personal data such as status information and financial information, means for transmitting the input data to the server, means for analyzing the data received in the server and proposing appropriate support services and financial assistance, means for analyzing the user's emotional state using an emotion analysis engine and optimizing appropriate proposals, and means for periodically checking the user's status and updating the data based on the status. This makes it possible to propose optimal nursing care services and financial assistance taking into account the user's emotional state, and by regularly checking the status and collaborating with care professionals, appropriate support based on the latest status can be provided.

[2074] "Status information" refers to information relating to the user's health condition, care situation, living environment, and the like.

[2075] "Financial Information" means information about a user's financial situation, such as income, assets, and expenses.

[2076] "Personal Data" is information about you that is specific to you, such as status information or financial information.

[2077] A "server" is a computer system that receives, analyzes, and processes data sent by users.

[2078] The "emotion analysis engine" is software that analyzes emotions from the data and conversation content provided by users and uses the results to optimize support services and financial assistance proposals.

[2079] "Support services" are services such as nursing care, medical care, and life support provided to users.

[2080] "Financial assistance" refers to financial assistance such as subsidies and grants provided to users.

[2081] "Procedure Guide" is a guideline that shows the procedure for using the support services or financial assistance selected by the user.

[2082] A "care professional" is a professional with specialized knowledge of care who is responsible for providing care support to users.

[2083] The present invention is a system that proposes appropriate nursing care services and financial assistance based on the user's emotion analysis. This system is mainly composed of the user, a terminal, and a server. Specifically, the system uses the following hardware and software to process and calculate various data.

[2084] Hardware and software used

[2085] 1. User device: A smartphone or tablet device with iOS or Android applications installed.

[2086] 2. Server: A cloud-based database and analysis system, specifically using a cloud platform such as Amazon Web Services (AWS) or Microsoft Azure.

[2087] 3. Sentiment Analysis Engine: A natural language processing (NLP) model using the Python transformers library. This model is used to emotionally analyze the user's text input.

[2088] Data processing and calculation

[2089] User Registration and Login:

[2090] Users download the app from the app store and create an account after installing it. When creating an account, they enter information such as their name, contact details, care level, and income status. This data is sent from the device to the server and stored in a database.

[2091] Conversational situational awareness with emotion recognition:

[2092] When a user logs in, the device displays the question, "Please tell us about your care situation," and the user selects the appropriate option from the options (home care, day care, facility admission, etc.). The user's selection data is sent to the server and analyzed. The server also uses an emotion analysis engine to emotionally analyze the user's input data and dialogue content, obtaining emotional data.

[2093] Proposal of appropriate services and grants:

[2094] The server then proposes appropriate nursing care services and financial assistance based on the acquired user data and emotional data. For example, if the user is judged to be under high stress, it will prioritize relaxation services.

[2095] Regular check-ins and collaboration with care professionals:

[2096] The server periodically sends notifications to users, asking them about recent care status and changes, ensuring the user database is always up to date and sending the necessary information to care professionals to ensure coordination.

[2097] Examples of concrete examples and prompts

[2098] For example, if a user logs in and selects "home care," and then responds to subsequent questions by entering information such as family composition and income status, the server receives and analyzes this information. If the emotion analysis engine analyzes the user's text responses and recognizes a high level of stress, it will prioritize suggestions for relaxation services that will help reduce stress.

[2099] Example prompt sentence:

[2100] "Please tell us about the situation in which you are receiving care. (Please choose from home care, day care, facility care, etc.)"

[2101] “Please describe your current feelings regarding your caregiving situation. Are you feeling stressed, anxious, or calm?”

[2102] This system allows users to easily obtain the appropriate information and quickly receive the necessary assistance, and by using an emotion analysis engine, it also reduces the psychological burden on users.

[2103] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2104] Program processing flow

[2105] Step 1: User Registration and Login

[2106] User: Downloads the app from the app store and launches the installed app.

[2107] Device: The device displays an account creation screen and prompts the user to enter their name, contact information, care level, income status, etc. This inputs the user's personal data.

[2108] User: The user enters the required information and presses the "Register" button.

[2109] Terminal: The terminal sends the entered information to the server.

[2110] Server: The server stores the received data in a database, generates a notification of success of account creation, and sends it to the device.

[2111] Device: The device will display a message that the account was created successfully and will transition to the login screen.

[2112] Step 2: Conversational situational awareness with emotion recognition

[2113] Terminal: After the user logs in, the terminal displays the question "Please tell us about your care situation" and provides options (home care, day care, admission to a facility, etc.).

[2114] User: The user selects the appropriate option and presses the submit button.

[2115] Terminal: The terminal sends the selected answer to the server.

[2116] Server: The server receives the response data and stores it in a database. It also analyzes the user's text input data using a sentiment analysis engine to generate sentiment data.

[2117] Server: Stores the emotion data in a database and generates the next question, which is about family structure and specific care needs.

[2118] Terminal: The terminal displays the following question to the user:

[2119] User: The user enters the appropriate answer and presses the submit button. This process is repeated to gain a detailed understanding of the current situation.

[2120] Step 3: Propose the right service / subsidy and optimize based on emotions

[2121] Server: The server analyzes the accumulated user data and emotion data.

[2122] Server: Based on the analysis results, it generates a list of available support services and financial aid, including details and terms of use for each service.

[2123] Server: Optimizes the list of suggestions based on the emotional state. For example, if stress is judged to be high, relaxation services will be prioritized on the list.

[2124] On the device: Show the user an optimized list of suggestions.

[2125] Step 4: Service selection and procedure guide

[2126] User: The user selects the service they want to use from a list of suggestions.

[2127] Terminal: The terminal transmits information about the selected service to the server.

[2128] Server: The server lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[2129] Terminal: Displays the procedure guide to the user and provides download links for the required documents.

[2130] Step 5: Regular check-ins and collaboration with care professionals

[2131] Server: The server periodically (for example, monthly) sends notifications to check the user's status.

[2132] Device: The device receives the notification and displays a status question to the user.

[2133] User: The user answers questions about recent care status and changes and presses the send button.

[2134] Terminal: The terminal sends a response to the server.

[2135] Server: The server analyzes the latest status and emotion data, updates the database, and sends updates to care professionals as needed.

[2136] (Application example 2)

[2137] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2138] Conventional nursing care service suggestion systems not only have difficulty providing appropriate support that takes into account the user's emotional state, but also have difficulty responding quickly to unexpected emergencies. As a result, the psychological burden on the user increases, and problems arise in which the care support that should be provided is not sufficient. To solve this problem, a system is needed that can simultaneously propose optimal services that take into account the user's emotions and respond to emergencies.

[2139] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2140] In this invention, the server includes means for having the user input personal information such as care status and income status, means for transmitting the input information and the user's video data to the server, means for analyzing the information received within the server and proposing appropriate care services and subsidies, means for analyzing the user's emotions using an emotion recognition engine, means for displaying detailed information and procedure guides for the proposed care services and subsidies, means for sending a warning when an abnormal emotional state is detected, and means for periodically checking the user's status and updating data based on the status. This enables the server to propose optimal care services taking into account the user's emotional state and to respond quickly in emergencies.

[2141] "Care situation" is information that indicates the current state of a person who needs care and the environment in which care is provided. Specifically, it includes information about the type of care, such as home care, day care, or admission to a facility.

[2142] "Income status" refers to information that indicates the user's financial status. Specifically, it includes the type and amount of income, whether or not the user receives financial support, etc.

[2143] "Personal information" refers to information that identifies a user. Specifically, this includes basic information such as name, contact details, and care level.

[2144] The "emotion recognition engine" is software that analyzes the user's facial expressions and voice data to determine their emotional state. Specifically, it has the ability to recognize emotions such as stress, fear, and surprise.

[2145] "Video data" refers to video or image data that records a user's face or actions. Specifically, it includes video of a user captured by a camera.

[2146] "Nursing care services" refers to support and care provided to people who need nursing care. Specifically, it includes home care, day care, relaxation services, etc.

[2147] "Subsidies" are financial assistance provided by public or private organizations. Specifically, they include financial assistance to partially cover nursing care costs.

[2148] A "procedure guide" is a document that provides detailed instructions on how to apply for the proposed nursing care services and subsidies. Specifically, it includes information such as required documents, procedure locations, and contact details.

[2149] "Alerts" are messages sent to the user or emergency contacts to alert them, including notifications sent when an abnormal emotional state is detected.

[2150] "Users" are people who use the system to receive proposals for nursing care services and subsidies. Specifically, this includes elderly people who need nursing care and their families.

[2151] A "server" is a computer system that stores and analyzes data. Specifically, it processes information sent by users and has the function of suggesting services and issuing warnings.

[2152] As an embodiment of the present invention, we provide a multifunctional system for proposing nursing care services and implementing security measures. By combining it with an emotion recognition engine, the system takes into account the user's psychological state, enabling appropriate service proposals and rapid emergency response.

[2153] System configuration

[2154] 1. User Registration and Login

[2155] User: Download the system application from the app store. When launching the system for the first time, enter basic information such as name, contact details, care level, and income status to create an account.

[2156] Device: Sends the input information to the server and proceeds with the account creation process.

[2157] Server: Analyzes the received information and saves it in the database. It then sends a notification of success to the device, which then transitions to the login screen.

[2158] 2. Conversational Emotion Recognition and Current Situation Understanding

[2159] Terminal: After logging in, the user is asked, "Please tell us about your care situation," and is given options (home care, day care, facility admission, etc.). The answer selected by the user is sent to the server.

[2160] Server: Analyzes the received answers and analyzes the user's emotions using an emotion recognition engine. The emotion data is stored in a database.

[2161] Terminal: The following questions (family structure, specific care needs, etc.) are displayed to the user, and the entered information is sent to the server. This process is repeated to obtain a detailed understanding of the user's current situation.

[2162] 3. Proposing appropriate services and subsidies

[2163] Server: Based on accumulated user data and emotion data, searches for available nursing care services and subsidies and generates a list.

[2164] Server: Optimizes suggested services and subsidies based on the user's emotional state. For example, if stress is judged to be high, it will prioritize suggested services related to psychological support and relaxation.

[2165] Terminal: Displays to the user a list of proposed services and grants, including detailed information about each service and instructions on how to use it.

[2166] 4. Service Selection and Procedures

[2167] User: Select the service they wish to use from the list of suggestions.

[2168] Terminal: Sends the selected service to the server.

[2169] Server: Lists the information required to use the selected service (required documents, procedure location, contact information, etc.) and generates a procedure guide.

[2170] Terminal: Displays a procedural guide to the user, recommending the necessary actions, and providing download links for the necessary documents.

[2171] 5. Detecting and alerting abnormal emotional states

[2172] Device: The device periodically collects the user's facial expressions and voice using a camera and microphone, and sends the data to a server.

[2173] Server: Using an emotion recognition engine, the data is analyzed in real time to detect abnormal emotional states (stress, fear, surprise, etc.).

[2174] Server: If an abnormal emotional state is detected, it sends an alert to the user and emergency contacts.

[2175] 6. Regular status checks and cooperation with care managers

[2176] Server: Sends notifications periodically (for example, monthly) to check the user's status.

[2177] Device: Receives notifications and displays status confirmation questions to the user. When the user answers questions about recent care status and changes, the device sends the information to the server.

[2178] Server: Analyzes the latest status and emotion data, updates the database as needed, and sends necessary information to the care manager depending on the situation.

[2179] Hardware and software used

[2180] The hardware used includes devices such as smartphones and tablets, cameras, microphones, etc. The required software includes OpenCV (video analysis), the EmotionRecognition library (emotion analysis), Twilio (notification sending), and Amazon Web Services (server and database management).

[2181] Specific examples

[2182] For example, when a user is using the system, their face is captured via their smartphone camera, and the system uses the EmotionRecognition library to analyze the user's emotions in real time, and if stress or fear is detected, it uses Twilio to send an alert notification to emergency contacts.

[2183] Prompt Sentence Examples

[2184] An example of a prompt to input to a generative AI model is, "Create a program that uses an emotion recognition engine to analyze the user's emotions in real time. Include a function to immediately send a notification to the user and emergency contacts if abnormal emotions (fear, stress, surprise) are detected."

[2185] This will enable the system to propose appropriate care services that take into account the user's emotional state and to respond quickly in emergencies.

[2186] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2187] Step 1:

[2188] Users download the app from the app store and enter basic information such as their name, contact details, care level, and income status when they launch the app for the first time.

[2189] Input: Personal information from the user.

[2190] Output: The user's personal information sent to the server.

[2191] Operation: The terminal sends the entered information to the server, which stores the received information in a database.

[2192] Step 2:

[2193] The device notifies the user that the account was created successfully and takes them to the login screen.

[2194] Input: Server-generated account creation success notification.

[2195] Output: Screen transition to login screen.

[2196] Behavior: The device displays the notification received from the server and then presents the login screen to the user.

[2197] Step 3:

[2198] After logging in, the user answers the question, "Please tell us your care situation."

[2199] Input: The displayed question and answer options (home care, day care, institutional care, etc.).

[2200] Output: The user's answer.

[2201] Operation: The device sends the user's selected answers to the server, which then analyzes the received answers and stores them in a database.

[2202] Step 4:

[2203] The server uses an emotion recognition engine to analyze facial expressions and voice to recognize the user's emotions.

[2204] Input: Video and audio data sent by the user.

[2205] Output: Parsed emotion data.

[2206] Operation: The server analyzes the received video and audio data using the EmotionRecognition library and stores the emotional data in a database.

[2207] Step 5:

[2208] Based on the analysis results, the server generates the next questions (family composition, specific care needs, etc.) and sends them to the device.

[2209] Input: Analyzed user's care situation and emotion data.

[2210] Output: Next question.

[2211] Operation: Based on the analysis results, the server identifies the next information needed and sends data to display the question on the terminal.

[2212] Step 6:

[2213] The terminal displays the next question to the user, and the user enters and submits the answer.

[2214] Input: The next question sent by the server.

[2215] Output: The user's answer.

[2216] Operation: The device displays the question received from the server to the user, then sends the user's answer back to the server, repeating this process multiple times.

[2217] Step 7:

[2218] The server searches for available nursing care services and subsidies based on accumulated user data and emotional data, and generates a list.

[2219] Input: User data and emotion data.

[2220] Output: List of care services and subsidies.

[2221] Operation: The server searches the database, lists potential nursing care services and grants, and generates the list.

[2222] Step 8:

[2223] The server optimizes the proposed services and subsidies based on the user's emotional state and sends them to the terminal.

[2224] Input: List of care services and grants, and sentiment data.

[2225] Output: Optimized service and grant list.

[2226] How it works: The server prioritizes the list taking into account the emotion data and sends it to the device.

[2227] Step 9:

[2228] The terminal displays detailed information about the proposed services and subsidies, as well as a procedure guide, to the user.

[2229] Input: Optimized service grant list sent from the server.

[2230] Output: Detailed information on the service and grant and a procedure guide will be displayed.

[2231] Operation: The terminal displays the received list and procedure guide to the user, and shows how to proceed with the service selected by the user.

[2232] Step 10:

[2233] The device periodically collects the user's facial expressions and voice using a camera and microphone and sends the data to a server.

[2234] Input: Real-time user video and audio data.

[2235] Output: Sending data to the server.

[2236] Operation: The device periodically collects the user's emotional data and sends it to the server.

[2237] Step 11:

[2238] If the server detects an abnormal emotional state, it sends an alert to the user and emergency contacts.

[2239] Input: Real-time emotion data submitted by users.

[2240] Output: A warning message.

[2241] How it works: The server determines abnormal emotional states based on data parsed with the EmotionRecognition library and uses Twilio to send alerts to the user and emergency contacts.

[2242] Step 12:

[2243] The server periodically sends notifications to check the user's status, and the terminal displays questions to the user.

[2244] Input: Periodic notifications from the server.

[2245] Output: Notification and questions for the user.

[2246] Operation: The server sends notifications to the user via the terminal at regular intervals, such as monthly, prompting the user to check the latest status.

[2247] Step 13:

[2248] The device sends the user's response to the server, which then analyzes the latest situation data and emotion data and updates the database.

[2249] Input: The most recent answer from the user.

[2250] Output: Updated database information.

[2251] Operation: The device sends the user's latest status response to the server, which analyzes the response and updates the database. This information is also shared with the care manager.

[2252] This will enable optimal nursing care services to be proposed taking into account the user's emotional state, and enable rapid response in emergencies.

[2253] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2254] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2255] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2256] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2257] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2258] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2259] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion...

Claims

1. A means for users to input personal information such as care status, income status, etc.; means for transmitting the input information to a server; A means of analyzing the information received within the server and proposing appropriate nursing care services and subsidies; A means to display detailed information and procedural guides for proposed nursing care services and subsidies; and means for periodically checking the user's status and updating the data based on the status.

2. The system according to claim 1, further comprising means for listing information required for procedures for using the care service selected by the user and generating a procedure guide.

3. The system of claim 1, further comprising means for coordinating with a care manager to provide and update information based on the user's latest care situation.

Images