System

Abstract

A system is provided.SOLUTION: The system includes an information providing means for a family performing nursing care, a reminding means for a person to be cared, a means for monitoring a health condition by integrating and linking data of the family and the person to be cared, a means for performing emergency notification when abnormality is detected, and a means for distributing a nursing care support tool.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] As Japan's super-aging society progresses, the demand for home care is increasing, but there is a shortage of caregivers (mainly family members) to shoulder the burden. Furthermore, when providing home care, caregivers often have difficulty accessing appropriate information and support, resulting in increased exhaustion and psychological stress. Care recipients also face difficulties receiving appropriate reminders and psychological support in their daily lives, which can lead to feelings of isolation and health management problems. Therefore, it is necessary to provide a comprehensive support system to improve the quality of life for both families and care recipients. [Means for solving the problem]

[0005] This invention provides a system for supporting family members providing care and those receiving care. Specifically, the system includes a means for providing information to family members providing care, a means for reminding the care recipient, a means for integrating and linking data on the family members and the care recipient to monitor their health status, a means for issuing emergency notifications when an abnormality is detected, and a means for distributing care support tools. This system enables caregivers to receive necessary information and support in a timely manner, and provides care recipients with support in their daily lives and psychological stability, thereby improving the quality of life for both parties.

[0006] "Family caregiver" refers to the household member responsible for providing home care, who is primarily responsible for planning, managing, and providing care.

[0007] "Information provision means" refers to mechanisms for providing family caregivers with information such as tips, guidelines, support programs, fundraising methods, and instruction on caregiving techniques necessary for providing care.

[0008] "Persons receiving care" refers to elderly or disabled people who have difficulty carrying out daily activities independently and require nursing care support.

[0009] "Reminder measures" refer to systems that notify care recipients to remember to take their medication, eat, and perform other activities necessary for daily living.

[0010] "Data integration and linkage" refers to the process of integrating and linking data collected between caregivers and care recipients on a single platform.

[0011] "Means for monitoring health status" refers to a system for monitoring and analyzing health information such as body temperature, blood pressure, and heart rate of the person receiving care in real time.

[0012] "Means for sending emergency notifications when abnormalities are detected" refers to a system that promptly sends an alert to family members and experts if an abnormality is detected in the health condition of the person being cared for during monitoring.

[0013] "Means for delivering care support tools" refers to a system that provides psychological support for those receiving care and content for daily entertainment (such as story readings, music playback, brain training games, etc.). [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] Overall system overview

[0036] The present invention relates to a system for supporting family members providing care and those receiving care. This system includes a means for providing information to family members providing care, a means for reminding those receiving care, a means for integrating and linking data on the family members and those receiving care to monitor their health status, a means for issuing emergency notifications when an abnormality is detected, and a means for distributing care support tools.

[0037] System configuration

[0038] 1. User Authentication

[0039] The user enters their ID and password on the login screen.

[0040] The terminal temporarily stores the entered authentication information and sends it to the server.

[0041] The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen.

[0042] 2. Information provision

[0043] The server retrieves family care tips and support program information from a database and sends it to the terminal.

[0044] The terminal displays the received information on a user interface, allowing the user to view detailed information.

[0045] 3. Reminders and psychological support

[0046] The server generates reminders for the care recipient to take medication and eat meals and sends them to the device at the specified time.

[0047] The device will notify the user of the reminder via audio or visual notification so that they can check it.

[0048] The server also generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients and delivers them to the devices.

[0049] 4. Data Collection and Management

[0050] Users fill out an input form with daily data related to their health and care.

[0051] The terminal temporarily stores the input data and sends it to the server.

[0052] The server stores the received data in a database and encrypts and protects it.

[0053] 5. Data integration and monitoring

[0054] The server integrates all data from family members and those receiving care, and monitors their health status in real time.

[0055] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[0056] Specific examples

[0057] 1. User Authentication

[0058] Family member A launches the application and enters their ID and password on the login screen.

[0059] The device sends the ID and password to the server, and after successful authentication, the server obtains Family A's care history and information about the person being cared for.

[0060] 2. Providing nursing care information

[0061] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" for Family A and sends it to the terminal.

[0062] The device will notify Family A, and when they click on Details, the information will be displayed.

[0063] 3. Care recipient reminder

[0064] The server generates a message reminding "care recipient B" to take his / her medication at 9:00 AM and sends it to the terminal.

[0065] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[0066] 4. Entertainment content distribution

[0067] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[0068] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[0069] 5. Data integration and monitoring

[0070] The server monitors the health data (e.g., blood pressure, heart rate, etc.) of family member A and care recipient B in real time.

[0071] If blood pressure suddenly changes, the server will send an emergency notification to Family A and the registered doctor to prompt them to take the necessary action.

[0072] In this way, this system can comprehensively provide information, reminders, psychological support, data linkage, and health monitoring to improve the quality of life of both caregivers and those receiving care.

[0073] The processing flow will be explained below.

[0074] Program processing steps

[0075] User Authentication

[0076] Step 1:

[0077] The user accesses the login screen and enters their ID and password.

[0078] Step 2:

[0079] The terminal temporarily stores the entered authentication information and sends it to the server as an HTTP request.

[0080] Step 3:

[0081] The server checks the received authentication information against a database to determine whether authentication is successful.

[0082] Step 4:

[0083] If the authentication is successful, the server obtains the user's profile data and sends it to the terminal.

[0084] Step 5:

[0085] The device displays the user's home screen based on the received profile data.

[0086] Information provision

[0087] Step 1:

[0088] The server retrieves family care tips and support program information from a database.

[0089] Step 2:

[0090] The server selects the acquired information and sends it to the terminal.

[0091] Step 3:

[0092] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[0093] Reminders and psychological support

[0094] Step 1:

[0095] The server generates medication and meal reminders for the care recipient.

[0096] Step 2:

[0097] At the specified time, the server sends a reminder to the device.

[0098] Step 3:

[0099] The device will notify the user (care recipient) of the reminder via audio or visual notification so that they can check it.

[0100] Step 4:

[0101] The server generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients.

[0102] Step 5:

[0103] The server transmits the generated entertainment content to the terminal.

[0104] Step 6:

[0105] The terminal plays the received content on the user interface and supports the user (care recipient) in their operations.

[0106] Data Collection and Management

[0107] Step 1:

[0108] Users fill out an input form with daily health and care data.

[0109] Step 2:

[0110] The terminal temporarily stores the input data and sends it to the server.

[0111] Step 3:

[0112] The server stores the received data in a database and encrypts and protects it.

[0113] Data integration and monitoring

[0114] Step 1:

[0115] The server consolidates all data on family members and care recipients.

[0116] Step 2:

[0117] The server monitors the integrated data in real time.

[0118] Step 3:

[0119] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[0120] Step 4:

[0121] The server stores a log of emergency notifications in a database for later analysis.

[0122] Specific examples

[0123] Step 1:

[0124] Family member A launches the application and enters their ID and password on the login screen.

[0125] Step 2:

[0126] The terminal sends the ID and password to the server.

[0127] Step 3:

[0128] The server successfully authenticates and obtains Family A's care history and information about the person being cared for.

[0129] Step 4:

[0130] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" to Family A and sends it to the terminal.

[0131] Step 5:

[0132] The device notifies Family A and displays detailed information.

[0133] Step 6:

[0134] The server generates a message reminding care recipient B to take his / her medication at 9:00 AM and sends it to the terminal.

[0135] Step 7:

[0136] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[0137] Step 8:

[0138] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[0139] Step 9:

[0140] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[0141] Step 10:

[0142] The server monitors the health data of Family Member A and Care Recipient B in real time, and if an abnormality is detected, it sends an emergency notification to Family Member A and the registered doctor.

[0143] Example 1

[0144] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0145] In modern society, family members providing care must manage a large amount of information and monitor the health status of those receiving care. However, this information is dispersed and cannot be managed centrally, which presents a challenge. In addition, there are limited means to provide appropriate reminders and psychological support to care recipients, so a comprehensive system to improve the quality of care is needed.

[0146] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0147] In this invention, the server includes: means for providing information to family members providing care; means for reminding the care recipient; means for integrating and linking data of the family members and the care recipient to monitor their health status; means for issuing an emergency notification when an abnormality is detected; means for distributing care support tools; means for comparing user authentication information with a database and acquiring and displaying the user's profile data if authentication is successful; means for generating a reminder message at a specified time and sending it to the terminal; means including a generative AI model for generating psychological support content; means for encrypting and storing user-entered data in a database; and means for monitoring health data in real time and sending an appropriate emergency notification when an abnormality is detected. This enables comprehensive support for both family members providing care and the care recipient.

[0148] "Information provision means" refers to means that provide family members who provide care with tips on caregiving, support programs, fundraising methods, instruction on caregiving techniques, etc.

[0149] "Reminder means" are means for providing care recipients with reminders to take their medicine and when to eat, as well as for delivering entertainment content.

[0150] "Means for integrating and linking data to monitor health status" refers to a means for integrating all data from family members and those receiving care, and monitoring their health status in real time.

[0151] The "means for sending an emergency notification when an abnormality is detected" is a means for sending an emergency notification to family members and appropriate professionals when an abnormality is detected during data monitoring.

[0152] The "means for delivering care support tools" refers to a means for delivering necessary care support tools to family members providing care and the person receiving care.

[0153] "Means for comparing user authentication information with a database, and obtaining and displaying user profile data if authentication is successful" refers to a means for a user to enter login information, for the server to compare it with a database for authentication, and for obtaining and displaying user profile data on the terminal if authentication is successful.

[0154] The "means for generating a remind message at a specified time and transmitting it to a terminal" is a means for generating a remind message and transmitting it to a terminal at a specified time.

[0155] "Means including a generative AI model that generates psychological support content" refers to means including an AI model for generating content such as story reading, music playback, and brain training games as psychological support for care recipients.

[0156] "Means for encrypting and storing user-entered data in a database" refers to means for encrypting data entered by a user and safely storing it in a database.

[0157] "Means for monitoring health data in real time and sending appropriate emergency notifications when abnormalities are detected" means means for analyzing and monitoring health data in real time and sending appropriate emergency notifications to family members and registered professionals when abnormalities are detected.

[0158] MODE FOR CARRYING OUT THE INVENTION

[0159] The present invention relates to a system for supporting a family member who provides care and a person receiving care. How the present invention can be implemented will be described below in detail.

[0160] User Authentication

[0161] A user starts an application and enters their ID and password on the login screen. The device temporarily stores the entered authentication information and sends it to the server using a secure encryption protocol (e.g., HTTPS). The server compares the received authentication information with the authentication information stored in a database (e.g., MySQL).

[0162] If the authentication is successful, the server retrieves the user's profile data from the database and sends it to the terminal, which displays the data on the user interface.

[0163] Information provision

[0164] The server retrieves care tips and support program information from a database (e.g., PostgreSQL) and sends it to the device as an HTTP response. The device parses the JSON data, displays it in a user interface, and allows the user to click for more information.

[0165] For example, when Family Member A logs in to the application, the server sends data suggesting "home rehabilitation methods" and "local nursing care support programs," and the device notifies them of this.

[0166] Reminders and psychological support

[0167] The server uses a Cron job to generate a reminder message at the specified time and send it to the device, which then notifies the user of the reminder via audio and visual notifications at the specified time.

[0168] The server also generates psychological support content using a generative AI model (e.g., GPT-4) and delivers it to the device, which then plays the content and asks the user to rate it.

[0169] As a specific example, the server generates a message reminding "care recipient B" to take his / her medicine at 9:00 AM, and the device notifies him / her of this. Also, based on the request of care recipient B, the server generates and plays "fairy tale reading" content.

[0170] Data Collection and Management

[0171] Users enter their health and care information into the application's input form. The device temporarily stores the input data and sends it to the server using HTTPS.

[0172] The server encrypts the data and stores it securely in a database (e.g. MongoDB).

[0173] Data integration and monitoring

[0174] The server uses Python data analysis libraries to consolidate all data and monitor health status in real time. If an anomaly is detected, the server uses SMTP to send an emergency notification to the appropriate specialist.

[0175] For example, the server monitors the blood pressure and heart rate of family member A and care recipient B, and sends an emergency notification if there is a sudden change in blood pressure.

[0176] Prompt Sentence Examples

[0177] The following prompts can be used to provide the necessary information for the generative AI model:

[0178] "Please provide the following information:

[0179] 1. List of family care support programs

[0180] 2. Content that provides psychological support to care recipients (e.g., story readings, music, brain training games, etc.)

[0181] 3. Procedures for inputting data on the health status of care recipients and monitoring the analysis results in real time.

[0182] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0183] Program processing flow

[0184] Step 1: Handling user authentication

[0185] When a user launches the application and enters their ID and password on the login screen, the device temporarily stores the entered authentication information, encrypts it using the HTTPS protocol, and sends it to the server.

[0186] Input: User ID and password

[0187] Data processing: User input is temporarily stored and encrypted using the HTTPS protocol

[0188] Output: Encrypted credentials

[0189] The server queries the database to verify the authentication information received, and if authentication is successful, retrieves the user's profile data and sends it to the device.

[0190] Input: Encrypted credentials

[0191] Data operations: querying the database and comparing with authentication information

[0192] Output: User profile data

[0193] The terminal displays the received user profile data on a user interface.

[0194] Input: User profile data

[0195] Data processing: Analysis of user data, formatting of display

[0196] Output: Displayed user profile

[0197] Step 2: Processing the submission

[0198] The server executes queries to retrieve information about care (tips, assistance programs, etc.) from a database.

[0199] Input: Request information

[0200] Data operations: querying the database

[0201] Output: Nursing care information data

[0202] The server formats the acquired information into JSON format and sends it to the terminal.

[0203] Input: Nursing care information data

[0204] Data processing: Formatting to JSON format

[0205] Output: Formatted care information

[0206] The terminal parses the received JSON data and displays it in an interactive user interface.

[0207] Input: Formatted care information

[0208] Data processing: Analysis and display format construction

[0209] Output: Displayed care information

[0210] Step 3: Handle reminders

[0211] The server generates reminder messages based on a pre-set schedule.

[0212] Input: Remind schedule information

[0213] Data calculation: Schedule-based reminder message generation

[0214] Output: The generated reminder message

[0215] The server sends the generated remind message to the terminal at the specified time.

[0216] Input: The generated reminder message

[0217] Data processing: message format and timing specification

[0218] Output: Reminder message sent

[0219] The device will receive reminder messages and notify you with audio and visual notifications.

[0220] Input: Reminder message sent

[0221] Data Processing: Audio and Visual Settings

[0222] Output: Reminders notified

[0223] Step 4: Handling psychological support

[0224] The user inputs a request. The terminal saves the request data and sends it to the server.

[0225] Input: User request data

[0226] Data processing: saving and sending request data

[0227] Output: Request data sent

[0228] The server uses a generative AI model (e.g., GPT-4) to generate psychological support content based on the request.

[0229] Input: Request data

[0230] Data Computation: Content Generation with Generative AI Models

[0231] Output: Generated support content

[0232] The server transmits the generated content to the terminal.

[0233] Input: Generated support content

[0234] Data Processing: Content Formatting and Delivery

[0235] Output: Submitted support content

[0236] The terminal plays back the received content and displays a message on the user interface requesting a rating.

[0237] Input: Submitted support content

[0238] Data processing: playback and evaluation interface display

[0239] Output: Played content and rating interface

[0240] Step 5: Data collection and management

[0241] The user fills in the input form with health information and care data.

[0242] Input: User's health and care data

[0243] Data processing: Saving input data

[0244] Output: Stored health and care data

[0245] The terminal temporarily stores the entered data and sends it to the server using the HTTPS protocol.

[0246] Input: Saved data

[0247] Data processing: data encryption and transmission

[0248] Output: Transmitted health and care data

[0249] The server encrypts the data it receives and stores it securely in a database.

[0250] Input: Submitted health and care data

[0251] Data calculation: Encryption and storage in database

[0252] Output: Encrypted database entries

[0253] Step 6: Data integration and monitoring process

[0254] The server uses a Python data analysis library to integrate all data and perform analysis and monitoring in real time.

[0255] Input: Integrated data

[0256] Data calculation: Real-time analysis

[0257] Output: Health status analysis results

[0258] If an anomaly is detected, the server uses the SMTP protocol to send an urgent notification to the appropriate specialist.

[0259] Input: Analysis results (outliers)

[0260] Data Computing: Generating and sending emergency notifications

[0261] Output: Urgent notifications sent

[0262] (Application example 1)

[0263] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0264] Previous nursing care support systems had the problem of lacking the means to provide timely information about nursing care support services and rehabilitation offered at local brick-and-mortar stores to family members and care recipients, and to provide appropriate reminders. Furthermore, there was a lack of a system in place to centrally manage the history of nursing care service usage at brick-and-mortar stores and health data, and to quickly respond if an abnormality was detected. These issues made it difficult for family members providing care and those receiving care to receive adequate support.

[0265] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0266] In this invention, the server includes a means for providing information to family members providing care, a means for providing nursing care support services at physical stores and reservation reminders for rehabilitation, and a means for integrating and linking data on family members and care recipients to monitor their health status. This solves the conventional problem, enabling family members providing care and care recipients to timely use nursing care support services provided at local physical stores, and enabling necessary reminders and emergency responses based on properly managed health data.

[0267] "Family caregivers" are those who provide physical support and are involved in assisting the care recipient with daily living.

[0268] A "care recipient" is someone who requires assistance and care in daily life.

[0269] "Information provision means" refers to a system that provides family members who provide care with tips related to caregiving, support programs, fundraising methods, instruction on caregiving techniques, nearby care support services and rehabilitation methods, and information on support services and events offered at physical stores.

[0270] The "reminder method" is a system that notifies care recipients when to take their medication and when to eat, as well as sending them timely reminders to make appointments for rehabilitation or counseling at physical stores.

[0271] "Means for integrating and linking data to monitor health status" refers to a system that consolidates and manages health data and nursing care service usage history of family members and those receiving care, and monitors their health status in real time.

[0272] "Means for emergency notification when abnormalities are detected" refers to a system that immediately notifies family members or medical professionals if an abnormality is detected in health data during monitoring.

[0273] "Means for delivering care support tools" refers to a system that provides applications and resources useful for caregiving to family members who are providing care.

[0274] "Means for inputting, saving, and transmitting nursing care service usage history and health data at physical stores" refers to a system that records usage information for nursing care services provided at physical stores and health measurement results, and saves and transmits them on a server.

[0275] A system for implementing the present invention includes a program and related hardware and software for providing comprehensive support to family members who provide care and those receiving care.

[0276] 1. Hardware and Software Configuration

[0277] Hardware: Smartphones, servers, network infrastructure, health data collection devices (blood pressure monitors, heart rate monitors, etc.)

[0278] Software: Python, Requests library, timer processing library, cloud database (e.g. AWS DynamoDB)

[0279] 2. User Authentication

[0280] As a user authentication procedure, the family member providing care enters their ID and password using a smartphone, and the server temporarily stores the authentication information. The authentication information is then sent to the server, which verifies the information and obtains the user's profile data. If authentication is successful, the initial screen is displayed.

[0281] 3. Providing information on nursing care support

[0282] The server retrieves from the database information for family members providing care, such as tips on caregiving, support programs, fundraising methods, instruction on caregiving techniques, as well as information on nearby care support services and rehabilitation methods, and information on support services and events offered at brick-and-mortar stores, and sends this information to the smartphone device, allowing users to view the information they need at any time.

[0283] 4. Reminders and psychological support

[0284] The server generates reminders for care recipients to take their medication or eat meals, and sends them to their smartphones at the specified times. It also sends appointment reminders for rehabilitation or counseling sessions at physical stores. The device notifies the user of these reminders via audio and visual means, allowing them to be checked. Furthermore, to provide psychological support to care recipients, the server generates entertainment content such as story readings, music playback, and brain training games, and delivers them to the smartphone.

[0285] 5. Data Collection and Management

[0286] Users enter their health information and daily care data into an input form on their smartphone. The device temporarily stores the entered data and sends it to the server. The server then stores the received data in a cloud database and encrypts and protects it. In this way, the history of nursing care service use at physical stores and health data are managed centrally.

[0287] 6. Data integration and monitoring

[0288] The server integrates all data of family members and care recipients and monitors their health status in real time. If an abnormality is detected in the health data, the server sends an emergency notification to the caregiver and appropriate professionals to prompt them to take the necessary action.

[0289] Specific examples

[0290] If a care recipient has a rehabilitation appointment at a local care support center, the family can use the app to receive reminders and take the care recipient at the appropriate time. Furthermore, by entering blood pressure and heart rate measurements taken at a physical store into the app, the data is later sent to a server, and if any abnormalities are detected, the family or doctor will be immediately notified.

[0291] Example prompts to input to the generative AI model

[0292] Information about services offered at nearby care support centers is obtained and notified to the user.

[0293] Send notifications to remind you of your next rehabilitation appointment.

[0294] Health data of the care recipient is entered and sent to the server.

[0295] Health data will be monitored in physical stores, and families will be notified if any abnormalities are detected.

[0296] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0297] Step 1:

[0298] User Authentication

[0299] Summary: A user logs into a smartphone app.

[0300] Input: User inputs ID and password.

[0301] Processing: The terminal sends the entered authentication information (ID and password) to the server. The server receives the authentication information and verifies it against the information in the database.

[0302] Output: If authentication is successful, the user's profile data is returned and the welcome screen is displayed on the terminal. If authentication is unsuccessful, an error message is displayed.

[0303] Step 2:

[0304] Providing nursing care support information

[0305] Overview: Provides care-related information to families.

[0306] Input: A request is made to the server to retrieve from its internal database information on caregiving tips, assistance programs, funding options, caregiving skills instruction, and nearby care support and rehabilitation services.

[0307] Processing: Based on the request, the server retrieves the necessary information from the database and sends it to the terminal.

[0308] Output: The terminal displays the received information to the user, allowing the user to view detailed information.

[0309] Step 3:

[0310] Reminder notifications

[0311] Summary: Sends reminders to care recipients.

[0312] Input: Medication, diet, and in-store rehabilitation and counseling appointment information.

[0313] Processing: The server generates a reminder at the specified time and sends a reminder notification to the device.

[0314] Output: The device will notify the user of the reminder via audio and visual notifications, allowing them to be acknowledged.

[0315] Step 4:

[0316] Entertainment content distribution

[0317] Overview: Provides entertainment content as psychological support to care recipients.

[0318] Input: Care recipient's request for psychological support.

[0319] Processing: The server generates entertainment content such as story reading, music playback, and brain training games and delivers it to the device.

[0320] Output: The device plays the content to the care recipient and then displays an interface asking for their evaluation.

[0321] Step 5:

[0322] Data Collection and Management

[0323] Overview: Collects and manages health data and nursing care service usage history.

[0324] Input: Health and care data input by family members and care recipients.

[0325] Processing: The device temporarily stores the entered data and sends it to the server, which stores it in a cloud database and encrypts and protects it.

[0326] Output: The server and terminals can refer to the saved data.

[0327] Step 6:

[0328] Data integration and monitoring

[0329] Overview: Integrates collected data to monitor health status in real time.

[0330] Input: Health data of family members and care recipients.

[0331] Processing: The server will consolidate all data and monitor health data in real time. If any abnormality is detected, it will send an emergency notification immediately.

[0332] Output: If an abnormality is detected in the health data, an emergency notification will be sent to family members and appropriate professionals.

[0333] Through these steps, caregivers and those receiving care can access care support services provided at local brick-and-mortar stores in a timely manner, and necessary reminders and emergency responses can be provided based on properly managed health data.

[0334] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0335] Overall system overview

[0336] This invention relates to a system for supporting family members providing care and those receiving care. This system includes a means for providing information to family members providing care, a means for reminding the care recipient, a means for integrating and linking data on the family members and the care recipient to monitor their health status, a means for issuing emergency notifications when an abnormality is detected, and a means for delivering care support tools. Furthermore, by incorporating an emotion engine, the system can recognize the user's emotional state in real time and respond accordingly.

[0337] System configuration

[0338] 1. User Authentication

[0339] The user enters their ID and password on the login screen.

[0340] The terminal temporarily stores the entered authentication information and sends it to the server.

[0341] The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen.

[0342] 2. Information provision

[0343] The server retrieves family care tips and support program information from a database and sends it to the terminal.

[0344] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[0345] 3. Reminders and psychological support

[0346] The server generates reminders for the care recipient to take medication and eat meals and sends them to the device at the specified time.

[0347] The device will notify the user (care recipient) of reminders via audio and visual means so that they can be checked.

[0348] The server also generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients and delivers them to the devices.

[0349] 4. Data Collection and Management

[0350] Users fill out an input form with daily data related to their health and care.

[0351] The terminal temporarily stores the input data and sends it to the server.

[0352] The server stores the received data in a database and encrypts and protects it.

[0353] 5. Data integration and monitoring

[0354] The server integrates all data from family members and those receiving care, and monitors their health status in real time.

[0355] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[0356] 6. Emotion engine integration

[0357] The server uses an emotion engine to analyze the user's voice data and facial expression data.

[0358] The emotion engine determines the user's current emotional state and transmits this to the server.

[0359] The server provides appropriate psychological support and entertainment content depending on the identified emotional state.

[0360] Specific examples

[0361] 1. User Authentication

[0362] Family member A launches the application and enters their ID and password on the login screen.

[0363] The device sends the ID and password to the server, and after successful authentication, the server obtains Family A's care history and information about the person being cared for.

[0364] 2. Providing nursing care information

[0365] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" for Family A and sends it to the terminal.

[0366] The device will notify Family A, and when they click on Details, the information will be displayed.

[0367] 3. Care recipient reminder

[0368] The server generates a message reminding "care recipient B" to take his / her medication at 9:00 AM and sends it to the terminal.

[0369] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[0370] 4. Entertainment content distribution

[0371] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[0372] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[0373] 5. Data integration and monitoring

[0374] The server monitors the health data (e.g., blood pressure, heart rate, etc.) of family member A and care recipient B in real time.

[0375] If blood pressure suddenly changes, the server will send an emergency notification to Family A and the registered doctor to prompt them to take the necessary action.

[0376] 6. Emotion engine integration

[0377] While care recipient B is using the entertainment content, the server uses an emotion engine to analyze B's voice and facial expression data to identify his / her emotional state.

[0378] For example, if care recipient B is in a "sad" emotional state, the server dynamically selects content to provide "soothing music" or "encouraging messages" and sends it to the terminal.

[0379] In this way, this system can comprehensively provide information, reminders, psychological support, data linkage, health monitoring, and adaptive responses using an emotion engine to improve the quality of life of both caregivers and care recipients.

[0380] The processing flow will be explained below.

[0381] Program processing steps

[0382] User Authentication

[0383] Step 1:

[0384] The user accesses the login screen and enters their ID and password.

[0385] Step 2:

[0386] The terminal temporarily stores the entered authentication information and sends it to the server as an HTTP request.

[0387] Step 3:

[0388] The server checks the received authentication information against a database to determine whether authentication is successful.

[0389] Step 4:

[0390] If the authentication is successful, the server obtains the user's profile data and sends it to the terminal.

[0391] Step 5:

[0392] The device displays the user's home screen based on the received profile data.

[0393] Information provision

[0394] Step 1:

[0395] The server retrieves family care tips and support program information from a database.

[0396] Step 2:

[0397] The server selects the acquired information and sends it to the terminal.

[0398] Step 3:

[0399] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[0400] Reminders and psychological support

[0401] Step 1:

[0402] The server generates medication and meal reminders for the care recipient.

[0403] Step 2:

[0404] At the specified time, the server sends a reminder to the device.

[0405] Step 3:

[0406] The device will notify the user (care recipient) of the reminder via audio or visual notification so that they can check it.

[0407] Step 4:

[0408] The server generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients.

[0409] Step 5:

[0410] The server transmits the generated entertainment content to the terminal.

[0411] Step 6:

[0412] The terminal plays the received content on the user interface and supports the user (care recipient) in their operations.

[0413] Data Collection and Management

[0414] Step 1:

[0415] Users fill out an input form with daily health and care data.

[0416] Step 2:

[0417] The terminal temporarily stores the input data and sends it to the server.

[0418] Step 3:

[0419] The server stores the received data in a database and encrypts and protects it.

[0420] Data integration and monitoring

[0421] Step 1:

[0422] The server consolidates all data on family members and care recipients.

[0423] Step 2:

[0424] The server monitors the integrated data in real time.

[0425] Step 3:

[0426] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[0427] Step 4:

[0428] The server stores a log of emergency notifications in a database for later analysis.

[0429] Emotion engine integration

[0430] Step 1:

[0431] While the care recipient is using the entertainment content, the terminal collects voice data and facial expression data of the care recipient.

[0432] Step 2:

[0433] The terminal transmits the collected voice data and facial expression data to the server in real time.

[0434] Step 3:

[0435] The server uses an emotion engine to analyze the received voice data and facial expression data to identify the emotional state of the care recipient.

[0436] Step 4:

[0437] The server selects adaptive psychological support and entertainment content based on the identified emotional state.

[0438] Step 5:

[0439] For example, if the care recipient is in a "sad" emotional state, the server generates "soothing music" or "encouraging messages" and sends them to the terminal.

[0440] Step 6:

[0441] The device plays the received psychological support and entertainment content and provides it to the person being cared for.

[0442] Specific examples

[0443] Step 1:

[0444] Family member A launches the application and enters their ID and password on the login screen.

[0445] Step 2:

[0446] The terminal sends the ID and password to the server.

[0447] Step 3:

[0448] The server successfully authenticates and obtains Family A's care history and information about the person being cared for.

[0449] Step 4:

[0450] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" to Family A and sends it to the terminal.

[0451] Step 5:

[0452] The device notifies Family A and displays detailed information.

[0453] Step 6:

[0454] The server generates a message reminding care recipient B to take his / her medication at 9:00 AM and sends it to the terminal.

[0455] Step 7:

[0456] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[0457] Step 8:

[0458] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[0459] Step 9:

[0460] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[0461] Step 10:

[0462] While the entertainment content is being used, the terminal collects voice and facial expression data of care recipient B and transmits it to the server.

[0463] Step 11:

[0464] The server uses an emotion engine to analyze the emotional state of care recipient B and detects the emotional state of "sadness."

[0465] Step 12:

[0466] The server generates "soothing music" according to the user's emotional state and sends it to the device.

[0467] Step 13:

[0468] The device plays soothing music and provides it to care recipient B.

[0469] Example 2

[0470] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0471] As our society ages, systems to support both family members providing care and those receiving care are becoming increasingly important. However, current care support systems lack functionality and user-friendliness, particularly in terms of real-time health monitoring, psychological support, emergency response when abnormalities are detected, and emotion analysis functions. This has led to issues such as a decline in the quality of care and a heavy burden on both family members providing care and those receiving care.

[0472] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for performing user authentication, a means for providing information to the family member providing care, a means for reminding the care recipient, a means for integrating and linking data on the family member and the care recipient to monitor their health status, a means for making an emergency notification when an abnormality is detected, a means for providing psychological support using emotion analysis means, and a means for delivering care support tools and entertainment content. This improves the quality of life of the family member providing care and the care recipient, and enables multifunctional and user-friendly care support.

[0473] "Means for user authentication" refers to the function of verifying the ID and password of a user accessing the system and authenticating that the user is a legitimate user.

[0474] "Information provision means for families providing care" is a function that provides families with information such as tips on caregiving, support programs, fundraising methods, and caregiving techniques.

[0475] "Reminder method for care recipients" is a function that sends reminders at specified times to ensure that care recipients remember to take their medication or eat.

[0476] "Means for integrating and linking data on family members and those receiving care to monitor their health status" refers to a function that aggregates data on the health status of family members and those receiving care and monitors it in real time.

[0477] "Means for sending emergency notifications when abnormalities are detected" is a function that sends emergency notifications to family members and experts when an abnormality is detected based on health status data.

[0478] The "means for providing psychological support using emotion analysis means" is a function that analyzes voice and facial expression data to identify the user's emotional state and provides psychological support according to that state.

[0479] "Means for delivering nursing care support tools and entertainment content" refers to a function that provides support tools necessary for nursing care and entertainment content intended to provide psychological support to those receiving care.

[0480] Overall system overview

[0481] The present invention provides a system for supporting family members who provide care and those receiving care. This system provides comprehensive support by combining multiple means. Each means will be described below.

[0482] User Authentication Embodiments

[0483] The user launches the care support application and enters their ID and password on the login screen. The device (smartphone, tablet, etc.) temporarily saves the entered authentication information and sends it to the server using the HTTPS protocol. The server checks the information against a database using a secure hash algorithm (SHA-256) to confirm whether authentication is successful. If authentication is successful, the server retrieves the user's profile data from the database and returns it to the device.

[0484] Form of providing care information

[0485] The server retrieves care-related information from a database (e.g., MongoDB), formats it in JSON format, and sends it to the device. When the user selects "care information" from the application menu, the device sends a request for care information to the server. The device visually displays the received information on the user interface, allowing the user to view it in detail.

[0486] Reminders and psychological support

[0487] The user sets reminder schedules for the care recipient's medication and meals using the application's built-in calendar function. The device sends the settings to the server, which stores this information in a database. The server generates reminders at the specified time and sends them to the device via push notification. The device notifies the user of the reminder via audio and visual means so that they can be confirmed. In addition, the server generates psychological support content, such as story readings and music playback, and distributes it to the device.

[0488] Data collection and management practices

[0489] Users enter their daily health information (e.g., blood pressure, heart rate, dietary habits) through an input form. The device temporarily stores the entered data and transmits it to the server periodically or in real time. The server stores the received data in a database and protects the data privacy using AES encryption.

[0490] Data linkage and monitoring implementation examples

[0491] The server monitors the aggregated data of family members and care recipients in real time using a streaming platform such as Apache Kafka. If an abnormality is detected in the health data, such as a sudden change in blood pressure, the server generates an emergency notification and sends it to family members and specialists via push notification or SMS notification (e.g., Twilio).

[0492] Embodiment of Emotion Engine Integration

[0493] The device collects the voice and facial expression data of the care recipient and sends it to the server. The server analyzes the data using an emotion analysis engine (e.g., IBM Watson Tone Analyzer) to identify the user's emotional state. Depending on the identified emotional state, the server generates appropriate psychological support or entertainment content and sends it to the device. For example, if the care recipient is in a "sad" emotional state, the server instructs the device to provide soothing music or an encouraging message.

[0494] Examples of specific examples and prompts

[0495] Specific examples

[0496] Family member A starts the care support app on their smartphone and enters their ID and password on the login screen. After successful authentication, the server sends and displays Family member A's care history and information about the care recipient on the smartphone. Family member A then sets a "medication reminder for 9:00 AM" for care recipient B, and the server saves the information. The server generates a reminder at the specified time and sends a notification to the smartphone. The smartphone then sends a voice notification to remind care recipient B to take their medication.

[0497] Prompt Sentence Examples

[0498] "Provide appropriate support based on the care recipient's emotional state."

[0499] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0500] Step 1:

[0501] Entering user credentials

[0502] The user simply launches the care support application and enters their ID and password on the login screen.

[0503] Input: ID, password

[0504] Output: Authentication request data

[0505] Specific operation: Enter ID and password into the input fields on the application login screen.

[0506] Step 2:

[0507] Sending authentication information

[0508] The device temporarily stores the entered ID and password and sends them to the server using the HTTPS protocol.

[0509] Input: Authentication request data

[0510] Output: Authentication information sent to the server

[0511] How it works: Authentication information is sent from the device to the server, using a secure protocol (HTTPS).

[0512] Step 3:

[0513] Credentials validation

[0514] The server checks the received ID and password against a database to confirm whether authentication is possible.

[0515] Input: Received authentication information

[0516] Output: Authentication result (success or failure)

[0517] Specific operation: The server side checks the ID and password against the authentication information stored in the database to see if they match. The check uses the SHA-256 algorithm.

[0518] Step 4:

[0519] Returning authentication results

[0520] If authentication is successful, the server retrieves the user's profile data from the database and sends it back to the device. If authentication fails, it returns an error message.

[0521] Input: Authentication result (success or failure)

[0522] Output: Profile data or error message

[0523] Specific operation: If authentication is successful, the user's profile data is sent to the device and the initial screen is displayed. If authentication is unsuccessful, an error screen is displayed.

[0524] Step 5:

[0525] Request for care information

[0526] The user selects "Care Information" from the application menu.

[0527] Input: User's care information request

[0528] Output: Nursing care information request data

[0529] Specific operation: A request is generated by selecting "care information" from the menu.

[0530] Step 6:

[0531] Obtaining nursing care information

[0532] The server retrieves information about care from the database, formats it into JSON format, and sends it to the terminal.

[0533] Input: Nursing care information request data

[0534] Output: Nursing care information (JSON format)

[0535] Specific operation: The server side retrieves information about care from the database and formats the data as necessary.

[0536] Step 7:

[0537] Displaying care information

[0538] The terminal displays the received care information on the user interface, allowing the user to view it in detail.

[0539] Input: Nursing care information (JSON format)

[0540] output: Nursing care information displayed on the user interface

[0541] Specific operation: The acquired care information is visually displayed on the user interface on the terminal, allowing details to be viewed.

[0542] Step 8:

[0543] Setting a reminder schedule

[0544] Users can set reminder schedules for their care recipients using the application's built-in calendar function.

[0545] Input: Reminder schedule information (medication time, meal time)

[0546] Output: Remind schedule setting data

[0547] What it does: Set a reminder schedule within the application and save it.

[0548] Step 9:

[0549] Save reminder schedule

[0550] The device sends the set reminder schedule to the server, which stores it in a database.

[0551] Input: Reminder schedule setting data

[0552] Output: Reminder schedule saved in the database

[0553] Specific operation: Remind schedule data is sent from the device to the server and stored in a database on the server side.

[0554] Step 10:

[0555] Generate reminder notifications

[0556] The server will generate a reminder notification at the configured time.

[0557] Input: Reminder schedules stored in the database

[0558] Output: Reminder notification data

[0559] Specific operation: Generates a reminder notification at the specified time based on the schedule stored on the server side.

[0560] Step 11:

[0561] Sending reminders

[0562] The server then sends the generated reminder notification to the device.

[0563] Input: Reminder notification data

[0564] Output: Reminder notifications sent

[0565] Specific operation: Notification data generated on the server side is sent to the terminal.

[0566] Step 12:

[0567] Displaying reminder notifications

[0568] The device will notify the user (care recipient) of the reminder via audio or visual notification at the specified time, so that they can check it.

[0569] Input: Reminder sent

[0570] Output: Reminders notified

[0571] Specific operation: The device will notify you by voice or other means and display a reminder.

[0572] Step 13:

[0573] Providing psychological support content

[0574] The server generates psychological support content such as story readings and music playback and delivers it to the device.

[0575] Input: Request for psychological support

[0576] Output: Generated psychological support content

[0577] Specific operations: Generate story reading files, music files, etc. and send them to the device.

[0578] Step 14:

[0579] Playback of psychological support content

[0580] The device plays the delivered psychological support content to the person being cared for.

[0581] Input: Psychological support content

[0582] Output: Played psychological support content

[0583] Specific operation: Plays audio files etc. on the terminal, allowing the user to listen to the content.

[0584] Step 15:

[0585] Entering health data

[0586] Users enter their health information (e.g., blood pressure, heart rate) through an input form.

[0587] Input: Health information data

[0588] Output: Input health data

[0589] Specific action: Enter daily health information using the application's input form.

[0590] Step 16:

[0591] Sending health data

[0592] The device sends the entered health data to a server periodically or in real time.

[0593] Input: Entered health data

[0594] Output: Transmitted health data

[0595] Specific operation: Health data is sent to a server periodically or in real time.

[0596] Step 17:

[0597] Health data storage and encryption

[0598] The server stores the received health data in a database and protects the data using AES encryption.

[0599] Input: Submitted health data

[0600] Output: A database containing the encrypted data.

[0601] How it works: Health data is stored in a database and secured with AES encryption.

[0602] Step 18:

[0603] Data integration and real-time monitoring

[0604] The server monitors integrated data of family members and those receiving care in real time.

[0605] Input: Various data to be integrated (health information, reminder data, etc.)

[0606] Output: Real-time updated consolidated data

[0607] Specific operation: The integrated data is updated and monitored in real time using a streaming platform (e.g., Apache Kafka).

[0608] Step 19:

[0609] Anomaly detection and emergency notification

[0610] If an abnormality is detected, for example a sudden change in blood pressure, the server generates an emergency notification and sends it to family members and specialists via push or SMS notification.

[0611] Input: Real-time updated consolidated data

[0612] Output: Emergency notification data

[0613] Specific behavior: When an anomaly is detected, an emergency notification is generated and sent.

[0614] Step 20:

[0615] Collecting Emotional Data

[0616] The device collects the voice and facial expression data of the person being cared for and sends it to the server.

[0617] Input: Voice data, facial expression data

[0618] Output: Collected emotion data

[0619] Specific operation: The device uses a microphone and camera to collect voice and facial expression data.

[0620] Step 21:

[0621] Emotion analysis

[0622] The server uses an emotion analysis engine to analyze the transmitted voice and facial expression data to identify the user's emotional state.

[0623] Input: Collected emotion data

[0624] Output: Parsed emotional state

[0625] Specific operation: Performs sentiment analysis using a sentiment analysis engine (e.g., IBM Watson Tone Analyzer).

[0626] Step 22:

[0627] Adaptive content delivery

[0628] The server generates appropriate psychological support and entertainment content based on the analyzed emotional state and sends it to the device.

[0629] Input: Parsed emotional state

[0630] Output: Adaptive Content

[0631] Specific operation: Generate content (such as soothing music or encouraging messages) according to the emotional state and send it to the device.

[0632] In this way, the entire system provides comprehensive care support through user authentication, information provision, reminders, data collection and management, data linkage and monitoring, and sentiment analysis.

[0633] (Application example 2)

[0634] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0635] Supporting care recipients and their families requires appropriate information provision, reminders, health monitoring, and emergency notifications. Furthermore, psychological support and dietary suggestions tailored to the care recipient's emotional state are also necessary. Few existing systems comprehensively provide these functions, and in particular, they lack the ability to dynamically respond to emotional states and monitor dietary intake. Therefore, there is a need for a comprehensive system that can improve the health and quality of life of care recipients.

[0636] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0637] In this invention, the server includes a means for providing information to family members providing care, a means for reminding the care recipient, a means for integrating and linking data on the family members and the care recipient to monitor their health status, a means for making an emergency notification when an abnormality is detected, a means for distributing care support tools, a means for detecting emotional states using emotion analysis means and providing appropriate psychological intervention and dietary suggestions according to the emotional state, and a means for collecting data on dietary intake and integrating it into health monitoring. This enables comprehensive and dynamic support for both the family members providing care and the care recipient.

[0638] "Information tools" are tools that provide tips on caregiving, assistance programs, fundraising methods, instruction on caregiving skills, nutritional information, and allergy-friendly dietary information.

[0639] "Reminder means" are means for providing medication and meal reminders, as well as delivering entertainment content and reminding you to eat on schedule.

[0640] "Data integration and linkage means" refers to a means of integrating and linking data from family members and care recipients to monitor their health status.

[0641] The "emergency notification means" is a means for issuing an emergency notification when an abnormality is detected.

[0642] The "care support tool distribution means" is a means for distributing the care support tool.

[0643] The "emotion analysis means" is a means for detecting the user's emotional state and providing appropriate psychological intervention and dietary suggestions according to that emotional state.

[0644] A "dietary intake data collection instrument" is a means for collecting data on dietary intake and integrating it into health monitoring.

[0645] The present invention is a system for supporting a family member providing care and a care recipient, and includes the following components.

[0646] 1. User Authentication

[0647] The user logs in to the application by entering their ID and password. The device temporarily stores this authentication information and sends it to the server. The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen. The authentication process uses the HTTP POST method, and SSL / TLS is used as a secure communication method.

[0648] 2. Information provision

[0649] The server retrieves information from the database about care tips, support programs, fundraising methods, instruction on care techniques, nutritional information, and allergy-friendly dietary information, and sends it to the terminal. The terminal displays the received information on a user interface, allowing the user to view detailed information. For example, the user can receive information such as "home rehabilitation methods."

[0650] 3. Reminders and psychological support

[0651] The server generates reminders for medication and meals and sends them to the device at the specified time. The device notifies the user of the reminders through audio and visual means, allowing them to be confirmed. The server also generates entertainment content (e.g., story reading and music playback) and delivers it to the device. This reminder function provides punctuality support for both family members and care recipients.

[0652] 4. Data Collection and Management

[0653] The user fills in a form with daily data related to dietary intake, health information, and care. The device temporarily stores the data and sends it to the server. The server then stores the received data in a database and encrypts and protects it. For example, a care recipient may want to enter the time and content of a particular meal.

[0654] 5. Data integration and monitoring

[0655] The server integrates all data of family members and care recipients, monitors their health status in real time, and if the server detects any abnormality, such as a sudden change in blood pressure, it will send an emergency notification to family members and registered medical professionals.

[0656] 6. Sentiment Analysis and Adaptive Response

[0657] The server uses an emotion engine (e.g., the EmotionEngine library) to analyze the user's voice and facial expression data and identify the user's current emotional state. Depending on the user's emotional state, for example, if the user is feeling stressed, the server selects content that suggests relaxing meals or music and sends it to the device.

[0658] Specific examples

[0659] If the care recipient is feeling stressed, the emotion engine analyzes their emotions and the server suggests relaxing herbal tea or light meals. These suggestions are displayed on the device, and the user can make orders or take action based on them.

[0660] Example prompt sentence:

[0661] The user ID: user_id is "example_user" and the password is "example_password".

[0662] First, authenticate the user.

[0663] Next, we will suggest a nutritionally balanced meal plan.

[0664] If the user's emotion is analyzed as "stressed," suggest a relaxing meal.

[0665] This system is implemented using devices such as smartphones, tablets, and head-mounted displays, and software such as Python, the Requests library, the EmotionEngine library, and a RESTful API, enabling comprehensive and dynamic support for both family members providing care and those receiving care.

[0666] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0667] Step 1:

[0668] User authentication (input: ID and password, output: profile data)

[0669] The user starts the application and enters their ID and password. The device temporarily stores this authentication information and sends it to the server using the HTTP POST method. The server verifies the authentication information against a database, and if authentication is successful, it obtains the user's profile data and sends it to the device. The device then displays the obtained profile data on the initial screen.

[0670] Step 2:

[0671] Information provision (input: user ID, output: nursing care information, nutritional information, allergy information)

[0672] The server retrieves information from the database, including tips on caregiving, assistance programs, fundraising methods, instruction on caregiving techniques, nutritional information, and allergy-friendly dietary information. The retrieved information is sent to the device as an HTTP response. The device receives this information and displays it on the user interface. The user can then view detailed information, such as "home rehabilitation methods" and "meal plans."

[0673] Step 3:

[0674] Reminders and psychological support (input: reminder setting data, output: reminder message, entertainment content)

[0675] The server generates medication and meal reminders based on the reminder times set by the user and sends HTTP messages to the device at the specified times. The device notifies the user by audio or visual notification, allowing the user to confirm the reminder. The server also generates entertainment content (e.g., story reading or music playback) in response to the user's request and delivers it to the device.

[0676] Step 4:

[0677] Data collection and management (input: health data, dietary intake data, output: storage in database)

[0678] The user enters their dietary intake and health information using the application's input form. The device temporarily stores the input data and sends it to the server using the HTTP POST method. The server stores the received data in a database and protects it with encryption. This records the time and content of specific meals consumed by the care recipient.

[0679] Step 5:

[0680] Data integration and monitoring (input: integrated data, output: anomaly detection and notification)

[0681] The server integrates all data of family members and care recipients and monitors their health status in real time. If an abnormality (such as a sudden change in blood pressure) is detected as a result of data analysis, the server sends an emergency notification to family members and registered medical professionals. This communication uses the HTTP POST method and emergency communication protocol.

[0682] Step 6:

[0683] Emotion analysis and adaptive response (input: voice data, facial expression data, output: emotional state and adaptive content)

[0684] The server analyzes the user's voice and facial expression data using a generative AI model (e.g., the EmotionEngine library) to identify their emotional state. Depending on their emotional state, the server generates content that provides appropriate psychological interventions and dietary suggestions and sends it to the device. For example, if the server determines that the user is feeling stressed, it suggests relaxing meals and music.

[0685] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0686] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0687] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0688] [Second embodiment]

[0689] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0690] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0691] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0692] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0693] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0694] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0695] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0696] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0697] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0698] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0699] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0700] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0701] Overall system overview

[0702] The present invention relates to a system for supporting family members providing care and those receiving care. This system includes a means for providing information to family members providing care, a means for reminding those receiving care, a means for integrating and linking data on the family members and those receiving care to monitor their health status, a means for issuing emergency notifications when an abnormality is detected, and a means for distributing care support tools.

[0703] System configuration

[0704] 1. User Authentication

[0705] The user enters their ID and password on the login screen.

[0706] The terminal temporarily stores the entered authentication information and sends it to the server.

[0707] The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen.

[0708] 2. Information provision

[0709] The server retrieves family care tips and support program information from a database and sends it to the terminal.

[0710] The terminal displays the received information on a user interface, allowing the user to view detailed information.

[0711] 3. Reminders and psychological support

[0712] The server generates reminders for the care recipient to take medication and eat meals and sends them to the device at the specified time.

[0713] The device will notify the user of the reminder via audio or visual notification so that they can check it.

[0714] The server also generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients and delivers them to the devices.

[0715] 4. Data Collection and Management

[0716] Users fill out an input form with daily data related to their health and care.

[0717] The terminal temporarily stores the input data and sends it to the server.

[0718] The server stores the received data in a database and encrypts and protects it.

[0719] 5. Data integration and monitoring

[0720] The server integrates all data from family members and those receiving care, and monitors their health status in real time.

[0721] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[0722] Specific examples

[0723] 1. User Authentication

[0724] Family member A launches the application and enters their ID and password on the login screen.

[0725] The device sends the ID and password to the server, and after successful authentication, the server obtains Family A's care history and information about the person being cared for.

[0726] 2. Providing nursing care information

[0727] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" for Family A and sends it to the terminal.

[0728] The device will notify Family A, and when they click on Details, the information will be displayed.

[0729] 3. Care recipient reminder

[0730] The server generates a message reminding "care recipient B" to take his / her medication at 9:00 AM and sends it to the terminal.

[0731] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[0732] 4. Entertainment content distribution

[0733] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[0734] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[0735] 5. Data integration and monitoring

[0736] The server monitors the health data (e.g., blood pressure, heart rate, etc.) of family member A and care recipient B in real time.

[0737] If blood pressure suddenly changes, the server will send an emergency notification to Family A and the registered doctor to prompt them to take the necessary action.

[0738] In this way, this system can comprehensively provide information, reminders, psychological support, data linkage, and health monitoring to improve the quality of life of both caregivers and those receiving care.

[0739] The processing flow will be explained below.

[0740] Program processing steps

[0741] User Authentication

[0742] Step 1:

[0743] The user accesses the login screen and enters their ID and password.

[0744] Step 2:

[0745] The terminal temporarily stores the entered authentication information and sends it to the server as an HTTP request.

[0746] Step 3:

[0747] The server checks the received authentication information against a database to determine whether authentication is successful.

[0748] Step 4:

[0749] If the authentication is successful, the server obtains the user's profile data and sends it to the terminal.

[0750] Step 5:

[0751] The device displays the user's home screen based on the received profile data.

[0752] Information provision

[0753] Step 1:

[0754] The server retrieves family care tips and support program information from a database.

[0755] Step 2:

[0756] The server selects the acquired information and sends it to the terminal.

[0757] Step 3:

[0758] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[0759] Reminders and psychological support

[0760] Step 1:

[0761] The server generates medication and meal reminders for the care recipient.

[0762] Step 2:

[0763] At the specified time, the server sends a reminder to the device.

[0764] Step 3:

[0765] The device will notify the user (care recipient) of the reminder via audio or visual notification so that they can check it.

[0766] Step 4:

[0767] The server generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients.

[0768] Step 5:

[0769] The server transmits the generated entertainment content to the terminal.

[0770] Step 6:

[0771] The terminal plays the received content on the user interface and supports the user (care recipient) in their operations.

[0772] Data Collection and Management

[0773] Step 1:

[0774] Users fill out an input form with daily health and care data.

[0775] Step 2:

[0776] The terminal temporarily stores the input data and sends it to the server.

[0777] Step 3:

[0778] The server stores the received data in a database and encrypts and protects it.

[0779] Data integration and monitoring

[0780] Step 1:

[0781] The server consolidates all data on family members and care recipients.

[0782] Step 2:

[0783] The server monitors the integrated data in real time.

[0784] Step 3:

[0785] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[0786] Step 4:

[0787] The server stores a log of emergency notifications in a database for later analysis.

[0788] Specific examples

[0789] Step 1:

[0790] Family member A launches the application and enters their ID and password on the login screen.

[0791] Step 2:

[0792] The terminal sends the ID and password to the server.

[0793] Step 3:

[0794] The server successfully authenticates and obtains Family A's care history and information about the person being cared for.

[0795] Step 4:

[0796] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" to Family A and sends it to the terminal.

[0797] Step 5:

[0798] The device notifies Family A and displays detailed information.

[0799] Step 6:

[0800] The server generates a message reminding care recipient B to take his / her medication at 9:00 AM and sends it to the terminal.

[0801] Step 7:

[0802] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[0803] Step 8:

[0804] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[0805] Step 9:

[0806] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[0807] Step 10:

[0808] The server monitors the health data of Family Member A and Care Recipient B in real time, and if an abnormality is detected, it sends an emergency notification to Family Member A and the registered doctor.

[0809] Example 1

[0810] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0811] In modern society, family members providing care must manage a large amount of information and monitor the health status of those receiving care. However, this information is dispersed and cannot be managed centrally, which presents a challenge. In addition, there are limited means to provide appropriate reminders and psychological support to care recipients, so a comprehensive system to improve the quality of care is needed.

[0812] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0813] In this invention, the server includes: means for providing information to family members providing care; means for reminding the care recipient; means for integrating and linking data of the family members and the care recipient to monitor their health status; means for issuing an emergency notification when an abnormality is detected; means for distributing care support tools; means for comparing user authentication information with a database and acquiring and displaying the user's profile data if authentication is successful; means for generating a reminder message at a specified time and sending it to the terminal; means including a generative AI model for generating psychological support content; means for encrypting and storing user-entered data in a database; and means for monitoring health data in real time and sending an appropriate emergency notification when an abnormality is detected. This enables comprehensive support for both family members providing care and the care recipient.

[0814] "Information provision means" refers to means that provide family members who provide care with tips on caregiving, support programs, fundraising methods, instruction on caregiving techniques, etc.

[0815] "Reminder means" are means for providing care recipients with reminders to take their medicine and when to eat, as well as for delivering entertainment content.

[0816] "Means for integrating and linking data to monitor health status" refers to a means for integrating all data from family members and those receiving care, and monitoring their health status in real time.

[0817] The "means for sending an emergency notification when an abnormality is detected" is a means for sending an emergency notification to family members and appropriate professionals when an abnormality is detected during data monitoring.

[0818] The "means for delivering care support tools" refers to a means for delivering necessary care support tools to family members providing care and the person receiving care.

[0819] "Means for comparing user authentication information with a database, and obtaining and displaying user profile data if authentication is successful" refers to a means for a user to enter login information, for the server to compare it with a database for authentication, and for obtaining and displaying user profile data on the terminal if authentication is successful.

[0820] The "means for generating a remind message at a specified time and transmitting it to a terminal" is a means for generating a remind message and transmitting it to a terminal at a specified time.

[0821] "Means including a generative AI model that generates psychological support content" refers to means including an AI model for generating content such as story reading, music playback, and brain training games as psychological support for care recipients.

[0822] "Means for encrypting and storing user-entered data in a database" refers to means for encrypting data entered by a user and safely storing it in a database.

[0823] "Means for monitoring health data in real time and sending appropriate emergency notifications when abnormalities are detected" means means for analyzing and monitoring health data in real time and sending appropriate emergency notifications to family members and registered professionals when abnormalities are detected.

[0824] MODE FOR CARRYING OUT THE INVENTION

[0825] The present invention relates to a system for supporting a family member who provides care and a person receiving care. How the present invention can be implemented will be described below in detail.

[0826] User Authentication

[0827] A user starts an application and enters their ID and password on the login screen. The device temporarily stores the entered authentication information and sends it to the server using a secure encryption protocol (e.g., HTTPS). The server compares the received authentication information with the authentication information stored in a database (e.g., MySQL).

[0828] If the authentication is successful, the server retrieves the user's profile data from the database and sends it to the terminal, which displays the data on the user interface.

[0829] Information provision

[0830] The server retrieves care tips and support program information from a database (e.g., PostgreSQL) and sends it to the device as an HTTP response. The device parses the JSON data, displays it in a user interface, and allows the user to click for more information.

[0831] For example, when Family Member A logs in to the application, the server sends data suggesting "home rehabilitation methods" and "local nursing care support programs," and the device notifies them of this.

[0832] Reminders and psychological support

[0833] The server uses a Cron job to generate a reminder message at the specified time and send it to the device, which then notifies the user of the reminder via audio and visual notifications at the specified time.

[0834] The server also generates psychological support content using a generative AI model (e.g., GPT-4) and delivers it to the device, which then plays the content and asks the user to rate it.

[0835] As a specific example, the server generates a message reminding "care recipient B" to take his / her medicine at 9:00 AM, and the device notifies him / her of this. Also, based on the request of care recipient B, the server generates and plays "fairy tale reading" content.

[0836] Data Collection and Management

[0837] Users enter their health and care information into the application's input form. The device temporarily stores the input data and sends it to the server using HTTPS.

[0838] The server encrypts the data and stores it securely in a database (e.g. MongoDB).

[0839] Data integration and monitoring

[0840] The server uses Python data analysis libraries to consolidate all data and monitor health status in real time. If an anomaly is detected, the server uses SMTP to send an emergency notification to the appropriate specialist.

[0841] For example, the server monitors the blood pressure and heart rate of family member A and care recipient B, and sends an emergency notification if there is a sudden change in blood pressure.

[0842] Prompt Sentence Examples

[0843] The following prompts can be used to provide the necessary information for the generative AI model:

[0844] "Please provide the following information:

[0845] 1. List of family care support programs

[0846] 2. Content that provides psychological support to care recipients (e.g., story readings, music, brain training games, etc.)

[0847] 3. Procedures for inputting data on the health status of care recipients and monitoring the analysis results in real time.

[0848] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0849] Program processing flow

[0850] Step 1: Handling user authentication

[0851] When a user launches the application and enters their ID and password on the login screen, the device temporarily stores the entered authentication information, encrypts it using the HTTPS protocol, and sends it to the server.

[0852] Input: User ID and password

[0853] Data processing: User input is temporarily stored and encrypted using the HTTPS protocol

[0854] Output: Encrypted credentials

[0855] The server queries the database to verify the authentication information received, and if authentication is successful, retrieves the user's profile data and sends it to the device.

[0856] Input: Encrypted credentials

[0857] Data operations: querying the database and comparing with authentication information

[0858] Output: User profile data

[0859] The terminal displays the received user profile data on a user interface.

[0860] Input: User profile data

[0861] Data processing: Analysis of user data, formatting of display

[0862] Output: Displayed user profile

[0863] Step 2: Processing the submission

[0864] The server executes queries to retrieve information about care (tips, assistance programs, etc.) from a database.

[0865] Input: Request information

[0866] Data operations: querying the database

[0867] Output: Nursing care information data

[0868] The server formats the acquired information into JSON format and sends it to the terminal.

[0869] Input: Nursing care information data

[0870] Data processing: Formatting to JSON format

[0871] Output: Formatted care information

[0872] The terminal parses the received JSON data and displays it in an interactive user interface.

[0873] Input: Formatted care information

[0874] Data processing: Analysis and display format construction

[0875] Output: Displayed care information

[0876] Step 3: Handle reminders

[0877] The server generates reminder messages based on a pre-set schedule.

[0878] Input: Remind schedule information

[0879] Data calculation: Schedule-based reminder message generation

[0880] Output: The generated reminder message

[0881] The server sends the generated remind message to the terminal at the specified time.

[0882] Input: The generated reminder message

[0883] Data processing: message format and timing specification

[0884] Output: Reminder message sent

[0885] The device will receive reminder messages and notify you with audio and visual notifications.

[0886] Input: Reminder message sent

[0887] Data Processing: Audio and Visual Settings

[0888] Output: Reminders notified

[0889] Step 4: Handling psychological support

[0890] The user inputs a request. The terminal saves the request data and sends it to the server.

[0891] Input: User request data

[0892] Data processing: saving and sending request data

[0893] Output: Request data sent

[0894] The server uses a generative AI model (e.g., GPT-4) to generate psychological support content based on the request.

[0895] Input: Request data

[0896] Data Computation: Content Generation with Generative AI Models

[0897] Output: Generated support content

[0898] The server transmits the generated content to the terminal.

[0899] Input: Generated support content

[0900] Data Processing: Content Formatting and Delivery

[0901] Output: Submitted support content

[0902] The terminal plays back the received content and displays a message on the user interface requesting a rating.

[0903] Input: Submitted support content

[0904] Data processing: playback and evaluation interface display

[0905] Output: Played content and rating interface

[0906] Step 5: Data collection and management

[0907] The user fills in the input form with health information and care data.

[0908] Input: User's health and care data

[0909] Data processing: Saving input data

[0910] Output: Stored health and care data

[0911] The terminal temporarily stores the entered data and sends it to the server using the HTTPS protocol.

[0912] Input: Saved data

[0913] Data processing: data encryption and transmission

[0914] Output: Transmitted health and care data

[0915] The server encrypts the data it receives and stores it securely in a database.

[0916] Input: Submitted health and care data

[0917] Data calculation: Encryption and storage in database

[0918] Output: Encrypted database entries

[0919] Step 6: Data integration and monitoring process

[0920] The server uses a Python data analysis library to integrate all data and perform analysis and monitoring in real time.

[0921] Input: Integrated data

[0922] Data calculation: Real-time analysis

[0923] Output: Health status analysis results

[0924] If an anomaly is detected, the server uses the SMTP protocol to send an urgent notification to the appropriate specialist.

[0925] Input: Analysis results (outliers)

[0926] Data Computing: Generating and sending emergency notifications

[0927] Output: Urgent notifications sent

[0928] (Application example 1)

[0929] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0930] Previous nursing care support systems had the problem of lacking the means to provide timely information about nursing care support services and rehabilitation offered at local brick-and-mortar stores to family members and care recipients, and to provide appropriate reminders. Furthermore, there was a lack of a system in place to centrally manage the history of nursing care service usage at brick-and-mortar stores and health data, and to quickly respond if an abnormality was detected. These issues made it difficult for family members providing care and those receiving care to receive adequate support.

[0931] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0932] In this invention, the server includes a means for providing information to family members providing care, a means for providing nursing care support services at physical stores and reservation reminders for rehabilitation, and a means for integrating and linking data on family members and care recipients to monitor their health status. This solves the conventional problem, enabling family members providing care and care recipients to timely use nursing care support services provided at local physical stores, and enabling necessary reminders and emergency responses based on properly managed health data.

[0933] "Family caregivers" are those who provide physical support and are involved in assisting the care recipient with daily living.

[0934] A "care recipient" is someone who requires assistance and care in daily life.

[0935] "Information provision means" refers to a system that provides family members who provide care with tips related to caregiving, support programs, fundraising methods, instruction on caregiving techniques, nearby care support services and rehabilitation methods, and information on support services and events offered at physical stores.

[0936] The "reminder method" is a system that notifies care recipients when to take their medication and when to eat, as well as sending them timely reminders to make appointments for rehabilitation or counseling at physical stores.

[0937] "Means for integrating and linking data to monitor health status" refers to a system that consolidates and manages health data and nursing care service usage history of family members and those receiving care, and monitors their health status in real time.

[0938] "Means for emergency notification when abnormalities are detected" refers to a system that immediately notifies family members or medical professionals if an abnormality is detected in health data during monitoring.

[0939] "Means for delivering care support tools" refers to a system that provides applications and resources useful for caregiving to family members who are providing care.

[0940] "Means for inputting, saving, and transmitting nursing care service usage history and health data at physical stores" refers to a system that records usage information for nursing care services provided at physical stores and health measurement results, and saves and transmits them on a server.

[0941] A system for implementing the present invention includes a program and related hardware and software for providing comprehensive support to family members who provide care and those receiving care.

[0942] 1. Hardware and Software Configuration

[0943] Hardware: Smartphones, servers, network infrastructure, health data collection devices (blood pressure monitors, heart rate monitors, etc.)

[0944] Software: Python, Requests library, timer processing library, cloud database (e.g. AWS DynamoDB)

[0945] 2. User Authentication

[0946] As a user authentication procedure, the family member providing care enters their ID and password using a smartphone, and the server temporarily stores the authentication information. The authentication information is then sent to the server, which verifies the information and obtains the user's profile data. If authentication is successful, the initial screen is displayed.

[0947] 3. Providing information on nursing care support

[0948] The server retrieves from the database information for family members providing care, such as tips on caregiving, support programs, fundraising methods, instruction on caregiving techniques, as well as information on nearby care support services and rehabilitation methods, and information on support services and events offered at brick-and-mortar stores, and sends this information to the smartphone device, allowing users to view the information they need at any time.

[0949] 4. Reminders and psychological support

[0950] The server generates reminders for care recipients to take their medication or eat meals, and sends them to their smartphones at the specified times. It also sends appointment reminders for rehabilitation or counseling sessions at physical stores. The device notifies the user of these reminders via audio and visual means, allowing them to be checked. Furthermore, to provide psychological support to care recipients, the server generates entertainment content such as story readings, music playback, and brain training games, and delivers them to the smartphone.

[0951] 5. Data Collection and Management

[0952] Users enter their health information and daily care data into an input form on their smartphone. The device temporarily stores the entered data and sends it to the server. The server then stores the received data in a cloud database and encrypts and protects it. In this way, the history of nursing care service use at physical stores and health data are managed centrally.

[0953] 6. Data integration and monitoring

[0954] The server integrates all data of family members and care recipients and monitors their health status in real time. If an abnormality is detected in the health data, the server sends an emergency notification to the caregiver and appropriate professionals to prompt them to take the necessary action.

[0955] Specific examples

[0956] If a care recipient has a rehabilitation appointment at a local care support center, the family can use the app to receive reminders and take the care recipient at the appropriate time. Furthermore, by entering blood pressure and heart rate measurements taken at a physical store into the app, the data is later sent to a server, and if any abnormalities are detected, the family or doctor will be immediately notified.

[0957] Example prompts to input to the generative AI model

[0958] Information about services offered at nearby care support centers is obtained and notified to the user.

[0959] Send notifications to remind you of your next rehabilitation appointment.

[0960] Health data of the care recipient is entered and sent to the server.

[0961] Health data will be monitored in physical stores, and families will be notified if any abnormalities are detected.

[0962] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0963] Step 1:

[0964] User Authentication

[0965] Summary: A user logs into a smartphone app.

[0966] Input: User inputs ID and password.

[0967] Processing: The terminal sends the entered authentication information (ID and password) to the server. The server receives the authentication information and verifies it against the information in the database.

[0968] Output: If authentication is successful, the user's profile data is returned and the welcome screen is displayed on the terminal. If authentication is unsuccessful, an error message is displayed.

[0969] Step 2:

[0970] Providing nursing care support information

[0971] Overview: Provides care-related information to families.

[0972] Input: A request is made to the server to retrieve from its internal database information on caregiving tips, assistance programs, funding options, caregiving skills instruction, and nearby care support and rehabilitation services.

[0973] Processing: Based on the request, the server retrieves the necessary information from the database and sends it to the terminal.

[0974] Output: The terminal displays the received information to the user, allowing the user to view detailed information.

[0975] Step 3:

[0976] Reminder notifications

[0977] Summary: Sends reminders to care recipients.

[0978] Input: Medication, diet, and in-store rehabilitation and counseling appointment information.

[0979] Processing: The server generates a reminder at the specified time and sends a reminder notification to the device.

[0980] Output: The device will notify the user of the reminder via audio and visual notifications, allowing them to be acknowledged.

[0981] Step 4:

[0982] Entertainment content distribution

[0983] Overview: Provides entertainment content as psychological support to care recipients.

[0984] Input: Care recipient's request for psychological support.

[0985] Processing: The server generates entertainment content such as story reading, music playback, and brain training games and delivers it to the device.

[0986] Output: The device plays the content to the care recipient and then displays an interface asking for their evaluation.

[0987] Step 5:

[0988] Data Collection and Management

[0989] Overview: Collects and manages health data and nursing care service usage history.

[0990] Input: Health and care data input by family members and care recipients.

[0991] Processing: The device temporarily stores the entered data and sends it to the server, which stores it in a cloud database and encrypts and protects it.

[0992] Output: The server and terminals can refer to the saved data.

[0993] Step 6:

[0994] Data integration and monitoring

[0995] Overview: Integrates collected data to monitor health status in real time.

[0996] Input: Health data of family members and care recipients.

[0997] Processing: The server will consolidate all data and monitor health data in real time. If any abnormality is detected, it will send an emergency notification immediately.

[0998] Output: If an abnormality is detected in the health data, an emergency notification will be sent to family members and appropriate professionals.

[0999] Through these steps, caregivers and those receiving care can access care support services provided at local brick-and-mortar stores in a timely manner, and necessary reminders and emergency responses can be provided based on properly managed health data.

[1000] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1001] Overall system overview

[1002] This invention relates to a system for supporting family members providing care and those receiving care. This system includes a means for providing information to family members providing care, a means for reminding the care recipient, a means for integrating and linking data on the family members and the care recipient to monitor their health status, a means for issuing emergency notifications when an abnormality is detected, and a means for delivering care support tools. Furthermore, by incorporating an emotion engine, the system can recognize the user's emotional state in real time and respond accordingly.

[1003] System configuration

[1004] 1. User Authentication

[1005] The user enters their ID and password on the login screen.

[1006] The terminal temporarily stores the entered authentication information and sends it to the server.

[1007] The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen.

[1008] 2. Information provision

[1009] The server retrieves family care tips and support program information from a database and sends it to the terminal.

[1010] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[1011] 3. Reminders and psychological support

[1012] The server generates reminders for the care recipient to take medication and eat meals and sends them to the device at the specified time.

[1013] The device will notify the user (care recipient) of reminders via audio and visual means so that they can be checked.

[1014] The server also generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients and delivers them to the devices.

[1015] 4. Data Collection and Management

[1016] Users fill out an input form with daily data related to their health and care.

[1017] The terminal temporarily stores the input data and sends it to the server.

[1018] The server stores the received data in a database and encrypts and protects it.

[1019] 5. Data integration and monitoring

[1020] The server integrates all data from family members and those receiving care, and monitors their health status in real time.

[1021] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[1022] 6. Emotion engine integration

[1023] The server uses an emotion engine to analyze the user's voice data and facial expression data.

[1024] The emotion engine determines the user's current emotional state and transmits this to the server.

[1025] The server provides appropriate psychological support and entertainment content depending on the identified emotional state.

[1026] Specific examples

[1027] 1. User Authentication

[1028] Family member A launches the application and enters their ID and password on the login screen.

[1029] The device sends the ID and password to the server, and after successful authentication, the server obtains Family A's care history and information about the person being cared for.

[1030] 2. Providing nursing care information

[1031] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" for Family A and sends it to the terminal.

[1032] The device will notify Family A, and when they click on Details, the information will be displayed.

[1033] 3. Care recipient reminder

[1034] The server generates a message reminding "care recipient B" to take his / her medication at 9:00 AM and sends it to the terminal.

[1035] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[1036] 4. Entertainment content distribution

[1037] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[1038] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[1039] 5. Data integration and monitoring

[1040] The server monitors the health data (e.g., blood pressure, heart rate, etc.) of family member A and care recipient B in real time.

[1041] If blood pressure suddenly changes, the server will send an emergency notification to Family A and the registered doctor to prompt them to take the necessary action.

[1042] 6. Emotion engine integration

[1043] While care recipient B is using the entertainment content, the server uses an emotion engine to analyze B's voice and facial expression data to identify his / her emotional state.

[1044] For example, if care recipient B is in a "sad" emotional state, the server dynamically selects content to provide "soothing music" or "encouraging messages" and sends it to the terminal.

[1045] In this way, this system can comprehensively provide information, reminders, psychological support, data linkage, health monitoring, and adaptive responses using an emotion engine to improve the quality of life of both caregivers and care recipients.

[1046] The processing flow will be explained below.

[1047] Program processing steps

[1048] User Authentication

[1049] Step 1:

[1050] The user accesses the login screen and enters their ID and password.

[1051] Step 2:

[1052] The terminal temporarily stores the entered authentication information and sends it to the server as an HTTP request.

[1053] Step 3:

[1054] The server checks the received authentication information against a database to determine whether authentication is successful.

[1055] Step 4:

[1056] If the authentication is successful, the server obtains the user's profile data and sends it to the terminal.

[1057] Step 5:

[1058] The device displays the user's home screen based on the received profile data.

[1059] Information provision

[1060] Step 1:

[1061] The server retrieves family care tips and support program information from a database.

[1062] Step 2:

[1063] The server selects the acquired information and sends it to the terminal.

[1064] Step 3:

[1065] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[1066] Reminders and psychological support

[1067] Step 1:

[1068] The server generates medication and meal reminders for the care recipient.

[1069] Step 2:

[1070] At the specified time, the server sends a reminder to the device.

[1071] Step 3:

[1072] The device will notify the user (care recipient) of the reminder via audio or visual notification so that they can check it.

[1073] Step 4:

[1074] The server generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients.

[1075] Step 5:

[1076] The server transmits the generated entertainment content to the terminal.

[1077] Step 6:

[1078] The terminal plays the received content on the user interface and supports the user (care recipient) in their operations.

[1079] Data Collection and Management

[1080] Step 1:

[1081] Users fill out an input form with daily health and care data.

[1082] Step 2:

[1083] The terminal temporarily stores the input data and sends it to the server.

[1084] Step 3:

[1085] The server stores the received data in a database and encrypts and protects it.

[1086] Data integration and monitoring

[1087] Step 1:

[1088] The server consolidates all data on family members and care recipients.

[1089] Step 2:

[1090] The server monitors the integrated data in real time.

[1091] Step 3:

[1092] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[1093] Step 4:

[1094] The server stores a log of emergency notifications in a database for later analysis.

[1095] Emotion engine integration

[1096] Step 1:

[1097] While the care recipient is using the entertainment content, the terminal collects voice data and facial expression data of the care recipient.

[1098] Step 2:

[1099] The terminal transmits the collected voice data and facial expression data to the server in real time.

[1100] Step 3:

[1101] The server uses an emotion engine to analyze the received voice data and facial expression data to identify the emotional state of the care recipient.

[1102] Step 4:

[1103] The server selects adaptive psychological support and entertainment content based on the identified emotional state.

[1104] Step 5:

[1105] For example, if the care recipient is in a "sad" emotional state, the server generates "soothing music" or "encouraging messages" and sends them to the terminal.

[1106] Step 6:

[1107] The device plays the received psychological support and entertainment content and provides it to the person being cared for.

[1108] Specific examples

[1109] Step 1:

[1110] Family member A launches the application and enters their ID and password on the login screen.

[1111] Step 2:

[1112] The terminal sends the ID and password to the server.

[1113] Step 3:

[1114] The server successfully authenticates and obtains Family A's care history and information about the person being cared for.

[1115] Step 4:

[1116] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" to Family A and sends it to the terminal.

[1117] Step 5:

[1118] The device notifies Family A and displays detailed information.

[1119] Step 6:

[1120] The server generates a message reminding care recipient B to take his / her medication at 9:00 AM and sends it to the terminal.

[1121] Step 7:

[1122] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[1123] Step 8:

[1124] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[1125] Step 9:

[1126] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[1127] Step 10:

[1128] While the entertainment content is being used, the terminal collects voice and facial expression data of care recipient B and transmits it to the server.

[1129] Step 11:

[1130] The server uses an emotion engine to analyze the emotional state of care recipient B and detects the emotional state of "sadness."

[1131] Step 12:

[1132] The server generates "soothing music" according to the user's emotional state and sends it to the device.

[1133] Step 13:

[1134] The device plays soothing music and provides it to care recipient B.

[1135] Example 2

[1136] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1137] As our society ages, systems to support both family members providing care and those receiving care are becoming increasingly important. However, current care support systems lack functionality and user-friendliness, particularly in terms of real-time health monitoring, psychological support, emergency response when abnormalities are detected, and emotion analysis functions. This has led to issues such as a decline in the quality of care and a heavy burden on both family members providing care and those receiving care.

[1138] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for performing user authentication, a means for providing information to the family member providing care, a means for reminding the care recipient, a means for integrating and linking data on the family member and the care recipient to monitor their health status, a means for making an emergency notification when an abnormality is detected, a means for providing psychological support using emotion analysis means, and a means for delivering care support tools and entertainment content. This improves the quality of life of the family member providing care and the care recipient, and enables multifunctional and user-friendly care support.

[1139] "Means for user authentication" refers to the function of verifying the ID and password of a user accessing the system and authenticating that the user is a legitimate user.

[1140] "Information provision means for families providing care" is a function that provides families with information such as tips on caregiving, support programs, fundraising methods, and caregiving techniques.

[1141] "Reminder method for care recipients" is a function that sends reminders at specified times to ensure that care recipients remember to take their medication or eat.

[1142] "Means for integrating and linking data on family members and those receiving care to monitor their health status" refers to a function that aggregates data on the health status of family members and those receiving care and monitors it in real time.

[1143] "Means for sending emergency notifications when abnormalities are detected" is a function that sends emergency notifications to family members and experts when an abnormality is detected based on health status data.

[1144] The "means for providing psychological support using emotion analysis means" is a function that analyzes voice and facial expression data to identify the user's emotional state and provides psychological support according to that state.

[1145] "Means for delivering nursing care support tools and entertainment content" refers to a function that provides support tools necessary for nursing care and entertainment content intended to provide psychological support to those receiving care.

[1146] Overall system overview

[1147] The present invention provides a system for supporting family members who provide care and those receiving care. This system provides comprehensive support by combining multiple means. Each means will be described below.

[1148] User Authentication Embodiments

[1149] The user launches the care support application and enters their ID and password on the login screen. The device (smartphone, tablet, etc.) temporarily saves the entered authentication information and sends it to the server using the HTTPS protocol. The server checks the information against a database using a secure hash algorithm (SHA-256) to confirm whether authentication is successful. If authentication is successful, the server retrieves the user's profile data from the database and returns it to the device.

[1150] Form of providing care information

[1151] The server retrieves care-related information from a database (e.g., MongoDB), formats it in JSON format, and sends it to the device. When the user selects "care information" from the application menu, the device sends a request for care information to the server. The device visually displays the received information on the user interface, allowing the user to view it in detail.

[1152] Reminders and psychological support

[1153] The user sets reminder schedules for the care recipient's medication and meals using the application's built-in calendar function. The device sends the settings to the server, which stores this information in a database. The server generates reminders at the specified time and sends them to the device via push notification. The device notifies the user of the reminder via audio and visual means so that they can be confirmed. In addition, the server generates psychological support content, such as story readings and music playback, and distributes it to the device.

[1154] Data collection and management practices

[1155] Users enter their daily health information (e.g., blood pressure, heart rate, dietary habits) through an input form. The device temporarily stores the entered data and transmits it to the server periodically or in real time. The server stores the received data in a database and protects the data privacy using AES encryption.

[1156] Data linkage and monitoring implementation examples

[1157] The server monitors the aggregated data of family members and care recipients in real time using a streaming platform such as Apache Kafka. If an abnormality is detected in the health data, such as a sudden change in blood pressure, the server generates an emergency notification and sends it to family members and specialists via push notification or SMS notification (e.g., Twilio).

[1158] Embodiment of Emotion Engine Integration

[1159] The device collects the voice and facial expression data of the care recipient and sends it to the server. The server analyzes the data using an emotion analysis engine (e.g., IBM Watson Tone Analyzer) to identify the user's emotional state. Depending on the identified emotional state, the server generates appropriate psychological support or entertainment content and sends it to the device. For example, if the care recipient is in a "sad" emotional state, the server instructs the device to provide soothing music or an encouraging message.

[1160] Examples of specific examples and prompts

[1161] Specific examples

[1162] Family member A starts the care support app on their smartphone and enters their ID and password on the login screen. After successful authentication, the server sends and displays Family member A's care history and information about the care recipient on the smartphone. Family member A then sets a "medication reminder for 9:00 AM" for care recipient B, and the server saves the information. The server generates a reminder at the specified time and sends a notification to the smartphone. The smartphone then sends a voice notification to remind care recipient B to take their medication.

[1163] Prompt Sentence Examples

[1164] "Provide appropriate support based on the care recipient's emotional state."

[1165] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1166] Step 1:

[1167] Entering user credentials

[1168] The user simply launches the care support application and enters their ID and password on the login screen.

[1169] Input: ID, password

[1170] Output: Authentication request data

[1171] Specific operation: Enter ID and password into the input fields on the application login screen.

[1172] Step 2:

[1173] Sending authentication information

[1174] The device temporarily stores the entered ID and password and sends them to the server using the HTTPS protocol.

[1175] Input: Authentication request data

[1176] Output: Authentication information sent to the server

[1177] How it works: Authentication information is sent from the device to the server, using a secure protocol (HTTPS).

[1178] Step 3:

[1179] Credentials validation

[1180] The server checks the received ID and password against a database to confirm whether authentication is possible.

[1181] Input: Received authentication information

[1182] Output: Authentication result (success or failure)

[1183] Specific operation: The server side checks the ID and password against the authentication information stored in the database to see if they match. The check uses the SHA-256 algorithm.

[1184] Step 4:

[1185] Returning authentication results

[1186] If authentication is successful, the server retrieves the user's profile data from the database and sends it back to the device. If authentication fails, it returns an error message.

[1187] Input: Authentication result (success or failure)

[1188] Output: Profile data or error message

[1189] Specific operation: If authentication is successful, the user's profile data is sent to the device and the initial screen is displayed. If authentication is unsuccessful, an error screen is displayed.

[1190] Step 5:

[1191] Request for care information

[1192] The user selects "Care Information" from the application menu.

[1193] Input: User's care information request

[1194] Output: Nursing care information request data

[1195] Specific operation: A request is generated by selecting "care information" from the menu.

[1196] Step 6:

[1197] Obtaining nursing care information

[1198] The server retrieves information about care from the database, formats it into JSON format, and sends it to the terminal.

[1199] Input: Nursing care information request data

[1200] Output: Nursing care information (JSON format)

[1201] Specific operation: The server side retrieves information about care from the database and formats the data as necessary.

[1202] Step 7:

[1203] Displaying care information

[1204] The terminal displays the received care information on the user interface, allowing the user to view it in detail.

[1205] Input: Nursing care information (JSON format)

[1206] output: Nursing care information displayed on the user interface

[1207] Specific operation: The acquired care information is visually displayed on the user interface on the terminal, allowing details to be viewed.

[1208] Step 8:

[1209] Setting a reminder schedule

[1210] Users can set reminder schedules for their care recipients using the application's built-in calendar function.

[1211] Input: Reminder schedule information (medication time, meal time)

[1212] Output: Remind schedule setting data

[1213] What it does: Set a reminder schedule within the application and save it.

[1214] Step 9:

[1215] Save reminder schedule

[1216] The device sends the set reminder schedule to the server, which stores it in a database.

[1217] Input: Reminder schedule setting data

[1218] Output: Reminder schedule saved in the database

[1219] Specific operation: Remind schedule data is sent from the device to the server and stored in a database on the server side.

[1220] Step 10:

[1221] Generate reminder notifications

[1222] The server will generate a reminder notification at the configured time.

[1223] Input: Reminder schedules stored in the database

[1224] Output: Reminder notification data

[1225] Specific operation: Generates a reminder notification at the specified time based on the schedule stored on the server side.

[1226] Step 11:

[1227] Sending reminders

[1228] The server then sends the generated reminder notification to the device.

[1229] Input: Reminder notification data

[1230] Output: Reminder notifications sent

[1231] Specific operation: Notification data generated on the server side is sent to the terminal.

[1232] Step 12:

[1233] Displaying reminder notifications

[1234] The device will notify the user (care recipient) of the reminder via audio or visual notification at the specified time, so that they can check it.

[1235] Input: Reminder sent

[1236] Output: Reminders notified

[1237] Specific operation: The device will notify you by voice or other means and display a reminder.

[1238] Step 13:

[1239] Providing psychological support content

[1240] The server generates psychological support content such as story readings and music playback and delivers it to the device.

[1241] Input: Request for psychological support

[1242] Output: Generated psychological support content

[1243] Specific operations: Generate story reading files, music files, etc. and send them to the device.

[1244] Step 14:

[1245] Playback of psychological support content

[1246] The device plays the delivered psychological support content to the person being cared for.

[1247] Input: Psychological support content

[1248] Output: Played psychological support content

[1249] Specific operation: Plays audio files etc. on the terminal, allowing the user to listen to the content.

[1250] Step 15:

[1251] Entering health data

[1252] Users enter their health information (e.g., blood pressure, heart rate) through an input form.

[1253] Input: Health information data

[1254] Output: Input health data

[1255] Specific action: Enter daily health information using the application's input form.

[1256] Step 16:

[1257] Sending health data

[1258] The device sends the entered health data to a server periodically or in real time.

[1259] Input: Entered health data

[1260] Output: Transmitted health data

[1261] Specific operation: Health data is sent to a server periodically or in real time.

[1262] Step 17:

[1263] Health data storage and encryption

[1264] The server stores the received health data in a database and protects the data using AES encryption.

[1265] Input: Submitted health data

[1266] Output: A database containing the encrypted data.

[1267] How it works: Health data is stored in a database and secured with AES encryption.

[1268] Step 18:

[1269] Data integration and real-time monitoring

[1270] The server monitors integrated data of family members and those receiving care in real time.

[1271] Input: Various data to be integrated (health information, reminder data, etc.)

[1272] Output: Real-time updated consolidated data

[1273] Specific operation: The integrated data is updated and monitored in real time using a streaming platform (e.g., Apache Kafka).

[1274] Step 19:

[1275] Anomaly detection and emergency notification

[1276] If an abnormality is detected, for example a sudden change in blood pressure, the server generates an emergency notification and sends it to family members and specialists via push or SMS notification.

[1277] Input: Real-time updated consolidated data

[1278] Output: Emergency notification data

[1279] Specific behavior: When an anomaly is detected, an emergency notification is generated and sent.

[1280] Step 20:

[1281] Collecting Emotional Data

[1282] The device collects the voice and facial expression data of the person being cared for and sends it to the server.

[1283] Input: Voice data, facial expression data

[1284] Output: Collected emotion data

[1285] Specific operation: The device uses a microphone and camera to collect voice and facial expression data.

[1286] Step 21:

[1287] Emotion analysis

[1288] The server uses an emotion analysis engine to analyze the transmitted voice and facial expression data to identify the user's emotional state.

[1289] Input: Collected emotion data

[1290] Output: Parsed emotional state

[1291] Specific operation: Performs sentiment analysis using a sentiment analysis engine (e.g., IBM Watson Tone Analyzer).

[1292] Step 22:

[1293] Adaptive content delivery

[1294] The server generates appropriate psychological support and entertainment content based on the analyzed emotional state and sends it to the device.

[1295] Input: Parsed emotional state

[1296] Output: Adaptive Content

[1297] Specific operation: Generate content (such as soothing music or encouraging messages) according to the emotional state and send it to the device.

[1298] In this way, the entire system provides comprehensive care support through user authentication, information provision, reminders, data collection and management, data linkage and monitoring, and sentiment analysis.

[1299] (Application example 2)

[1300] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1301] Supporting care recipients and their families requires appropriate information provision, reminders, health monitoring, and emergency notifications. Furthermore, psychological support and dietary suggestions tailored to the care recipient's emotional state are also necessary. Few existing systems comprehensively provide these functions, and in particular, they lack the ability to dynamically respond to emotional states and monitor dietary intake. Therefore, there is a need for a comprehensive system that can improve the health and quality of life of care recipients.

[1302] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1303] In this invention, the server includes a means for providing information to family members providing care, a means for reminding the care recipient, a means for integrating and linking data on the family members and the care recipient to monitor their health status, a means for making an emergency notification when an abnormality is detected, a means for distributing care support tools, a means for detecting emotional states using emotion analysis means and providing appropriate psychological intervention and dietary suggestions according to the emotional state, and a means for collecting data on dietary intake and integrating it into health monitoring. This enables comprehensive and dynamic support for both the family members providing care and the care recipient.

[1304] "Information tools" are tools that provide tips on caregiving, assistance programs, fundraising methods, instruction on caregiving skills, nutritional information, and allergy-friendly dietary information.

[1305] "Reminder means" are means for providing medication and meal reminders, as well as delivering entertainment content and reminding you to eat on schedule.

[1306] "Data integration and linkage means" refers to a means of integrating and linking data from family members and care recipients to monitor their health status.

[1307] The "emergency notification means" is a means for issuing an emergency notification when an abnormality is detected.

[1308] The "care support tool distribution means" is a means for distributing the care support tool.

[1309] The "emotion analysis means" is a means for detecting the user's emotional state and providing appropriate psychological intervention and dietary suggestions according to that emotional state.

[1310] A "dietary intake data collection instrument" is a means for collecting data on dietary intake and integrating it into health monitoring.

[1311] The present invention is a system for supporting a family member providing care and a care recipient, and includes the following components.

[1312] 1. User Authentication

[1313] The user logs in to the application by entering their ID and password. The device temporarily stores this authentication information and sends it to the server. The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen. The authentication process uses the HTTP POST method, and SSL / TLS is used as a secure communication method.

[1314] 2. Information provision

[1315] The server retrieves information from the database about care tips, support programs, fundraising methods, instruction on care techniques, nutritional information, and allergy-friendly dietary information, and sends it to the terminal. The terminal displays the received information on a user interface, allowing the user to view detailed information. For example, the user can receive information such as "home rehabilitation methods."

[1316] 3. Reminders and psychological support

[1317] The server generates reminders for medication and meals and sends them to the device at the specified time. The device notifies the user of the reminders through audio and visual means, allowing them to be confirmed. The server also generates entertainment content (e.g., story reading and music playback) and delivers it to the device. This reminder function provides punctuality support for both family members and care recipients.

[1318] 4. Data Collection and Management

[1319] The user fills in a form with daily data related to dietary intake, health information, and care. The device temporarily stores the data and sends it to the server. The server then stores the received data in a database and encrypts and protects it. For example, a care recipient may want to enter the time and content of a particular meal.

[1320] 5. Data integration and monitoring

[1321] The server integrates all data of family members and care recipients, monitors their health status in real time, and if the server detects any abnormality, such as a sudden change in blood pressure, it will send an emergency notification to family members and registered medical professionals.

[1322] 6. Sentiment Analysis and Adaptive Response

[1323] The server uses an emotion engine (e.g., the EmotionEngine library) to analyze the user's voice and facial expression data and identify the user's current emotional state. Depending on the user's emotional state, for example, if the user is feeling stressed, the server selects content that suggests relaxing meals or music and sends it to the device.

[1324] Specific examples

[1325] If the care recipient is feeling stressed, the emotion engine analyzes their emotions and the server suggests relaxing herbal tea or light meals. These suggestions are displayed on the device, and the user can make orders or take action based on them.

[1326] Example prompt sentence:

[1327] The user ID: user_id is "example_user" and the password is "example_password".

[1328] First, authenticate the user.

[1329] Next, we will suggest a nutritionally balanced meal plan.

[1330] If the user's emotion is analyzed as "stressed," suggest a relaxing meal.

[1331] This system is implemented using devices such as smartphones, tablets, and head-mounted displays, and software such as Python, the Requests library, the EmotionEngine library, and a RESTful API, enabling comprehensive and dynamic support for both family members providing care and those receiving care.

[1332] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1333] Step 1:

[1334] User authentication (input: ID and password, output: profile data)

[1335] The user starts the application and enters their ID and password. The device temporarily stores this authentication information and sends it to the server using the HTTP POST method. The server verifies the authentication information against a database, and if authentication is successful, it obtains the user's profile data and sends it to the device. The device then displays the obtained profile data on the initial screen.

[1336] Step 2:

[1337] Information provision (input: user ID, output: nursing care information, nutritional information, allergy information)

[1338] The server retrieves information from the database, including tips on caregiving, assistance programs, fundraising methods, instruction on caregiving techniques, nutritional information, and allergy-friendly dietary information. The retrieved information is sent to the device as an HTTP response. The device receives this information and displays it on the user interface. The user can then view detailed information, such as "home rehabilitation methods" and "meal plans."

[1339] Step 3:

[1340] Reminders and psychological support (input: reminder setting data, output: reminder message, entertainment content)

[1341] The server generates medication and meal reminders based on the reminder times set by the user and sends HTTP messages to the device at the specified times. The device notifies the user by audio or visual notification, allowing the user to confirm the reminder. The server also generates entertainment content (e.g., story reading or music playback) in response to the user's request and delivers it to the device.

[1342] Step 4:

[1343] Data collection and management (input: health data, dietary intake data, output: storage in database)

[1344] The user enters their dietary intake and health information using the application's input form. The device temporarily stores the input data and sends it to the server using the HTTP POST method. The server stores the received data in a database and protects it with encryption. This records the time and content of specific meals consumed by the care recipient.

[1345] Step 5:

[1346] Data integration and monitoring (input: integrated data, output: anomaly detection and notification)

[1347] The server integrates all data of family members and care recipients and monitors their health status in real time. If an abnormality (such as a sudden change in blood pressure) is detected as a result of data analysis, the server sends an emergency notification to family members and registered medical professionals. This communication uses the HTTP POST method and emergency communication protocol.

[1348] Step 6:

[1349] Emotion analysis and adaptive response (input: voice data, facial expression data, output: emotional state and adaptive content)

[1350] The server analyzes the user's voice and facial expression data using a generative AI model (e.g., the EmotionEngine library) to identify their emotional state. Depending on their emotional state, the server generates content that provides appropriate psychological interventions and dietary suggestions and sends it to the device. For example, if the server determines that the user is feeling stressed, it suggests relaxing meals and music.

[1351] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1352] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1353] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1354] [Third embodiment]

[1355] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1356] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1357] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1358] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1359] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1360] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1361] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1362] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1363] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1364] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1365] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1366] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1367] Overall system overview

[1368] The present invention relates to a system for supporting family members providing care and those receiving care. This system includes a means for providing information to family members providing care, a means for reminding those receiving care, a means for integrating and linking data on the family members and those receiving care to monitor their health status, a means for issuing emergency notifications when an abnormality is detected, and a means for distributing care support tools.

[1369] System configuration

[1370] 1. User Authentication

[1371] The user enters their ID and password on the login screen.

[1372] The terminal temporarily stores the entered authentication information and sends it to the server.

[1373] The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen.

[1374] 2. Information provision

[1375] The server retrieves family care tips and support program information from a database and sends it to the terminal.

[1376] The terminal displays the received information on a user interface, allowing the user to view detailed information.

[1377] 3. Reminders and psychological support

[1378] The server generates reminders for the care recipient to take medication and eat meals and sends them to the device at the specified time.

[1379] The device will notify the user of the reminder via audio or visual notification so that they can check it.

[1380] The server also generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients and delivers them to the devices.

[1381] 4. Data Collection and Management

[1382] Users fill out an input form with daily data related to their health and care.

[1383] The terminal temporarily stores the input data and sends it to the server.

[1384] The server stores the received data in a database and encrypts and protects it.

[1385] 5. Data integration and monitoring

[1386] The server integrates all data from family members and those receiving care, and monitors their health status in real time.

[1387] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[1388] Specific examples

[1389] 1. User Authentication

[1390] Family member A launches the application and enters their ID and password on the login screen.

[1391] The device sends the ID and password to the server, and after successful authentication, the server obtains Family A's care history and information about the person being cared for.

[1392] 2. Providing nursing care information

[1393] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" for Family A and sends it to the terminal.

[1394] The device will notify Family A, and when they click on Details, the information will be displayed.

[1395] 3. Care recipient reminder

[1396] The server generates a message reminding "care recipient B" to take his / her medication at 9:00 AM and sends it to the terminal.

[1397] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[1398] 4. Entertainment content distribution

[1399] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[1400] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[1401] 5. Data integration and monitoring

[1402] The server monitors the health data (e.g., blood pressure, heart rate, etc.) of family member A and care recipient B in real time.

[1403] If blood pressure suddenly changes, the server will send an emergency notification to Family A and the registered doctor to prompt them to take the necessary action.

[1404] In this way, this system can comprehensively provide information, reminders, psychological support, data linkage, and health monitoring to improve the quality of life of both caregivers and those receiving care.

[1405] The processing flow will be explained below.

[1406] Program processing steps

[1407] User Authentication

[1408] Step 1:

[1409] The user accesses the login screen and enters their ID and password.

[1410] Step 2:

[1411] The terminal temporarily stores the entered authentication information and sends it to the server as an HTTP request.

[1412] Step 3:

[1413] The server checks the received authentication information against a database to determine whether authentication is successful.

[1414] Step 4:

[1415] If the authentication is successful, the server obtains the user's profile data and sends it to the terminal.

[1416] Step 5:

[1417] The device displays the user's home screen based on the received profile data.

[1418] Information provision

[1419] Step 1:

[1420] The server retrieves family care tips and support program information from a database.

[1421] Step 2:

[1422] The server selects the acquired information and sends it to the terminal.

[1423] Step 3:

[1424] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[1425] Reminders and psychological support

[1426] Step 1:

[1427] The server generates medication and meal reminders for the care recipient.

[1428] Step 2:

[1429] At the specified time, the server sends a reminder to the device.

[1430] Step 3:

[1431] The device will notify the user (care recipient) of the reminder via audio or visual notification so that they can check it.

[1432] Step 4:

[1433] The server generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients.

[1434] Step 5:

[1435] The server transmits the generated entertainment content to the terminal.

[1436] Step 6:

[1437] The terminal plays the received content on the user interface and supports the user (care recipient) in their operations.

[1438] Data Collection and Management

[1439] Step 1:

[1440] Users fill out an input form with daily health and care data.

[1441] Step 2:

[1442] The terminal temporarily stores the input data and sends it to the server.

[1443] Step 3:

[1444] The server stores the received data in a database and encrypts and protects it.

[1445] Data integration and monitoring

[1446] Step 1:

[1447] The server consolidates all data on family members and care recipients.

[1448] Step 2:

[1449] The server monitors the integrated data in real time.

[1450] Step 3:

[1451] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[1452] Step 4:

[1453] The server stores a log of emergency notifications in a database for later analysis.

[1454] Specific examples

[1455] Step 1:

[1456] Family member A launches the application and enters their ID and password on the login screen.

[1457] Step 2:

[1458] The terminal sends the ID and password to the server.

[1459] Step 3:

[1460] The server successfully authenticates and obtains Family A's care history and information about the person being cared for.

[1461] Step 4:

[1462] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" to Family A and sends it to the terminal.

[1463] Step 5:

[1464] The device notifies Family A and displays detailed information.

[1465] Step 6:

[1466] The server generates a message reminding care recipient B to take his / her medication at 9:00 AM and sends it to the terminal.

[1467] Step 7:

[1468] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[1469] Step 8:

[1470] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[1471] Step 9:

[1472] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[1473] Step 10:

[1474] The server monitors the health data of Family Member A and Care Recipient B in real time, and if an abnormality is detected, it sends an emergency notification to Family Member A and the registered doctor.

[1475] Example 1

[1476] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1477] In modern society, family members providing care must manage a large amount of information and monitor the health status of those receiving care. However, this information is dispersed and cannot be managed centrally, which presents a challenge. In addition, there are limited means to provide appropriate reminders and psychological support to care recipients, so a comprehensive system to improve the quality of care is needed.

[1478] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1479] In this invention, the server includes: means for providing information to family members providing care; means for reminding the care recipient; means for integrating and linking data of the family members and the care recipient to monitor their health status; means for issuing an emergency notification when an abnormality is detected; means for distributing care support tools; means for comparing user authentication information with a database and acquiring and displaying the user's profile data if authentication is successful; means for generating a reminder message at a specified time and sending it to the terminal; means including a generative AI model for generating psychological support content; means for encrypting and storing user-entered data in a database; and means for monitoring health data in real time and sending an appropriate emergency notification when an abnormality is detected. This enables comprehensive support for both family members providing care and the care recipient.

[1480] "Information provision means" refers to means that provide family members who provide care with tips on caregiving, support programs, fundraising methods, instruction on caregiving techniques, etc.

[1481] "Reminder means" are means for providing care recipients with reminders to take their medicine and when to eat, as well as for delivering entertainment content.

[1482] "Means for integrating and linking data to monitor health status" refers to a means for integrating all data from family members and those receiving care, and monitoring their health status in real time.

[1483] The "means for sending an emergency notification when an abnormality is detected" is a means for sending an emergency notification to family members and appropriate professionals when an abnormality is detected during data monitoring.

[1484] The "means for delivering care support tools" refers to a means for delivering necessary care support tools to family members providing care and the person receiving care.

[1485] "Means for comparing user authentication information with a database, and obtaining and displaying user profile data if authentication is successful" refers to a means for a user to enter login information, for the server to compare it with a database for authentication, and for obtaining and displaying user profile data on the terminal if authentication is successful.

[1486] The "means for generating a remind message at a specified time and transmitting it to a terminal" is a means for generating a remind message and transmitting it to a terminal at a specified time.

[1487] "Means including a generative AI model that generates psychological support content" refers to means including an AI model for generating content such as story reading, music playback, and brain training games as psychological support for care recipients.

[1488] "Means for encrypting and storing user-entered data in a database" refers to means for encrypting data entered by a user and safely storing it in a database.

[1489] "Means for monitoring health data in real time and sending appropriate emergency notifications when abnormalities are detected" means means for analyzing and monitoring health data in real time and sending appropriate emergency notifications to family members and registered professionals when abnormalities are detected.

[1490] MODE FOR CARRYING OUT THE INVENTION

[1491] The present invention relates to a system for supporting a family member who provides care and a person receiving care. How the present invention can be implemented will be described below in detail.

[1492] User Authentication

[1493] A user starts an application and enters their ID and password on the login screen. The device temporarily stores the entered authentication information and sends it to the server using a secure encryption protocol (e.g., HTTPS). The server compares the received authentication information with the authentication information stored in a database (e.g., MySQL).

[1494] If the authentication is successful, the server retrieves the user's profile data from the database and sends it to the terminal, which displays the data on the user interface.

[1495] Information provision

[1496] The server retrieves care tips and support program information from a database (e.g., PostgreSQL) and sends it to the device as an HTTP response. The device parses the JSON data, displays it in a user interface, and allows the user to click for more information.

[1497] For example, when Family Member A logs in to the application, the server sends data suggesting "home rehabilitation methods" and "local nursing care support programs," and the device notifies them of this.

[1498] Reminders and psychological support

[1499] The server uses a Cron job to generate a reminder message at the specified time and send it to the device, which then notifies the user of the reminder via audio and visual notifications at the specified time.

[1500] The server also generates psychological support content using a generative AI model (e.g., GPT-4) and delivers it to the device, which then plays the content and asks the user to rate it.

[1501] As a specific example, the server generates a message reminding "care recipient B" to take his / her medicine at 9:00 AM, and the device notifies him / her of this. Also, based on the request of care recipient B, the server generates and plays "fairy tale reading" content.

[1502] Data Collection and Management

[1503] Users enter their health and care information into the application's input form. The device temporarily stores the input data and sends it to the server using HTTPS.

[1504] The server encrypts the data and stores it securely in a database (e.g. MongoDB).

[1505] Data integration and monitoring

[1506] The server uses Python data analysis libraries to consolidate all data and monitor health status in real time. If an anomaly is detected, the server uses SMTP to send an emergency notification to the appropriate specialist.

[1507] For example, the server monitors the blood pressure and heart rate of family member A and care recipient B, and sends an emergency notification if there is a sudden change in blood pressure.

[1508] Prompt Sentence Examples

[1509] The following prompts can be used to provide the necessary information for the generative AI model:

[1510] "Please provide the following information:

[1511] 1. List of family care support programs

[1512] 2. Content that provides psychological support to care recipients (e.g., story readings, music, brain training games, etc.)

[1513] 3. Procedures for inputting data on the health status of care recipients and monitoring the analysis results in real time.

[1514] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1515] Program processing flow

[1516] Step 1: Handling user authentication

[1517] When a user launches the application and enters their ID and password on the login screen, the device temporarily stores the entered authentication information, encrypts it using the HTTPS protocol, and sends it to the server.

[1518] Input: User ID and password

[1519] Data processing: User input is temporarily stored and encrypted using the HTTPS protocol

[1520] Output: Encrypted credentials

[1521] The server queries the database to verify the authentication information received, and if authentication is successful, retrieves the user's profile data and sends it to the device.

[1522] Input: Encrypted credentials

[1523] Data operations: querying the database and comparing with authentication information

[1524] Output: User profile data

[1525] The terminal displays the received user profile data on a user interface.

[1526] Input: User profile data

[1527] Data processing: Analysis of user data, formatting of display

[1528] Output: Displayed user profile

[1529] Step 2: Processing the submission

[1530] The server executes queries to retrieve information about care (tips, assistance programs, etc.) from a database.

[1531] Input: Request information

[1532] Data operations: querying the database

[1533] Output: Nursing care information data

[1534] The server formats the acquired information into JSON format and sends it to the terminal.

[1535] Input: Nursing care information data

[1536] Data processing: Formatting to JSON format

[1537] Output: Formatted care information

[1538] The terminal parses the received JSON data and displays it in an interactive user interface.

[1539] Input: Formatted care information

[1540] Data processing: Analysis and display format construction

[1541] Output: Displayed care information

[1542] Step 3: Handle reminders

[1543] The server generates reminder messages based on a pre-set schedule.

[1544] Input: Remind schedule information

[1545] Data calculation: Schedule-based reminder message generation

[1546] Output: The generated reminder message

[1547] The server sends the generated remind message to the terminal at the specified time.

[1548] Input: The generated reminder message

[1549] Data processing: message format and timing specification

[1550] Output: Reminder message sent

[1551] The device will receive reminder messages and notify you with audio and visual notifications.

[1552] Input: Reminder message sent

[1553] Data Processing: Audio and Visual Settings

[1554] Output: Reminders notified

[1555] Step 4: Handling psychological support

[1556] The user inputs a request. The terminal saves the request data and sends it to the server.

[1557] Input: User request data

[1558] Data processing: saving and sending request data

[1559] Output: Request data sent

[1560] The server uses a generative AI model (e.g., GPT-4) to generate psychological support content based on the request.

[1561] Input: Request data

[1562] Data Computation: Content Generation with Generative AI Models

[1563] Output: Generated support content

[1564] The server transmits the generated content to the terminal.

[1565] Input: Generated support content

[1566] Data Processing: Content Formatting and Delivery

[1567] Output: Submitted support content

[1568] The terminal plays back the received content and displays a message on the user interface requesting a rating.

[1569] Input: Submitted support content

[1570] Data processing: playback and evaluation interface display

[1571] Output: Played content and rating interface

[1572] Step 5: Data collection and management

[1573] The user fills in the input form with health information and care data.

[1574] Input: User's health and care data

[1575] Data processing: Saving input data

[1576] Output: Stored health and care data

[1577] The terminal temporarily stores the entered data and sends it to the server using the HTTPS protocol.

[1578] Input: Saved data

[1579] Data processing: data encryption and transmission

[1580] Output: Transmitted health and care data

[1581] The server encrypts the data it receives and stores it securely in a database.

[1582] Input: Submitted health and care data

[1583] Data calculation: Encryption and storage in database

[1584] Output: Encrypted database entries

[1585] Step 6: Data integration and monitoring process

[1586] The server uses a Python data analysis library to integrate all data and perform analysis and monitoring in real time.

[1587] Input: Integrated data

[1588] Data calculation: Real-time analysis

[1589] Output: Health status analysis results

[1590] If an anomaly is detected, the server uses the SMTP protocol to send an urgent notification to the appropriate specialist.

[1591] Input: Analysis results (outliers)

[1592] Data Computing: Generating and sending emergency notifications

[1593] Output: Urgent notifications sent

[1594] (Application example 1)

[1595] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1596] Previous nursing care support systems had the problem of lacking the means to provide timely information about nursing care support services and rehabilitation offered at local brick-and-mortar stores to family members and care recipients, and to provide appropriate reminders. Furthermore, there was a lack of a system in place to centrally manage the history of nursing care service usage at brick-and-mortar stores and health data, and to quickly respond if an abnormality was detected. These issues made it difficult for family members providing care and those receiving care to receive adequate support.

[1597] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1598] In this invention, the server includes a means for providing information to family members providing care, a means for providing nursing care support services at physical stores and reservation reminders for rehabilitation, and a means for integrating and linking data on family members and care recipients to monitor their health status. This solves the conventional problem, enabling family members providing care and care recipients to timely use nursing care support services provided at local physical stores, and enabling necessary reminders and emergency responses based on properly managed health data.

[1599] "Family caregivers" are those who provide physical support and are involved in assisting the care recipient with daily living.

[1600] A "care recipient" is someone who requires assistance and care in daily life.

[1601] "Information provision means" refers to a system that provides family members who provide care with tips related to caregiving, support programs, fundraising methods, instruction on caregiving techniques, nearby care support services and rehabilitation methods, and information on support services and events offered at physical stores.

[1602] The "reminder method" is a system that notifies care recipients when to take their medication and when to eat, as well as sending them timely reminders to make appointments for rehabilitation or counseling at physical stores.

[1603] "Means for integrating and linking data to monitor health status" refers to a system that consolidates and manages health data and nursing care service usage history of family members and those receiving care, and monitors their health status in real time.

[1604] "Means for emergency notification when abnormalities are detected" refers to a system that immediately notifies family members or medical professionals if an abnormality is detected in health data during monitoring.

[1605] "Means for delivering care support tools" refers to a system that provides applications and resources useful for caregiving to family members who are providing care.

[1606] "Means for inputting, saving, and transmitting nursing care service usage history and health data at physical stores" refers to a system that records usage information for nursing care services provided at physical stores and health measurement results, and saves and transmits them on a server.

[1607] A system for implementing the present invention includes a program and related hardware and software for providing comprehensive support to family members who provide care and those receiving care.

[1608] 1. Hardware and Software Configuration

[1609] Hardware: Smartphones, servers, network infrastructure, health data collection devices (blood pressure monitors, heart rate monitors, etc.)

[1610] Software: Python, Requests library, timer processing library, cloud database (e.g. AWS DynamoDB)

[1611] 2. User Authentication

[1612] As a user authentication procedure, the family member providing care enters their ID and password using a smartphone, and the server temporarily stores the authentication information. The authentication information is then sent to the server, which verifies the information and obtains the user's profile data. If authentication is successful, the initial screen is displayed.

[1613] 3. Providing information on nursing care support

[1614] The server retrieves from the database information for family members providing care, such as tips on caregiving, support programs, fundraising methods, instruction on caregiving techniques, as well as information on nearby care support services and rehabilitation methods, and information on support services and events offered at brick-and-mortar stores, and sends this information to the smartphone device, allowing users to view the information they need at any time.

[1615] 4. Reminders and psychological support

[1616] The server generates reminders for care recipients to take their medication or eat meals, and sends them to their smartphones at the specified times. It also sends appointment reminders for rehabilitation or counseling sessions at physical stores. The device notifies the user of these reminders via audio and visual means, allowing them to be checked. Furthermore, to provide psychological support to care recipients, the server generates entertainment content such as story readings, music playback, and brain training games, and delivers them to the smartphone.

[1617] 5. Data Collection and Management

[1618] Users enter their health information and daily care data into an input form on their smartphone. The device temporarily stores the entered data and sends it to the server. The server then stores the received data in a cloud database and encrypts and protects it. In this way, the history of nursing care service use at physical stores and health data are managed centrally.

[1619] 6. Data integration and monitoring

[1620] The server integrates all data of family members and care recipients and monitors their health status in real time. If an abnormality is detected in the health data, the server sends an emergency notification to the caregiver and appropriate professionals to prompt them to take the necessary action.

[1621] Specific examples

[1622] If a care recipient has a rehabilitation appointment at a local care support center, the family can use the app to receive reminders and take the care recipient at the appropriate time. Furthermore, by entering blood pressure and heart rate measurements taken at a physical store into the app, the data is later sent to a server, and if any abnormalities are detected, the family or doctor will be immediately notified.

[1623] Example prompts to input to the generative AI model

[1624] Information about services offered at nearby care support centers is obtained and notified to the user.

[1625] Send notifications to remind you of your next rehabilitation appointment.

[1626] Health data of the care recipient is entered and sent to the server.

[1627] Health data will be monitored in physical stores, and families will be notified if any abnormalities are detected.

[1628] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1629] Step 1:

[1630] User Authentication

[1631] Summary: A user logs into a smartphone app.

[1632] Input: User inputs ID and password.

[1633] Processing: The terminal sends the entered authentication information (ID and password) to the server. The server receives the authentication information and verifies it against the information in the database.

[1634] Output: If authentication is successful, the user's profile data is returned and the welcome screen is displayed on the terminal. If authentication is unsuccessful, an error message is displayed.

[1635] Step 2:

[1636] Providing nursing care support information

[1637] Overview: Provides care-related information to families.

[1638] Input: A request is made to the server to retrieve from its internal database information on caregiving tips, assistance programs, funding options, caregiving skills instruction, and nearby care support and rehabilitation services.

[1639] Processing: Based on the request, the server retrieves the necessary information from the database and sends it to the terminal.

[1640] Output: The terminal displays the received information to the user, allowing the user to view detailed information.

[1641] Step 3:

[1642] Reminder notifications

[1643] Summary: Sends reminders to care recipients.

[1644] Input: Medication, diet, and in-store rehabilitation and counseling appointment information.

[1645] Processing: The server generates a reminder at the specified time and sends a reminder notification to the device.

[1646] Output: The device will notify the user of the reminder via audio and visual notifications, allowing them to be acknowledged.

[1647] Step 4:

[1648] Entertainment content distribution

[1649] Overview: Provides entertainment content as psychological support to care recipients.

[1650] Input: Care recipient's request for psychological support.

[1651] Processing: The server generates entertainment content such as story reading, music playback, and brain training games and delivers it to the device.

[1652] Output: The device plays the content to the care recipient and then displays an interface asking for their evaluation.

[1653] Step 5:

[1654] Data Collection and Management

[1655] Overview: Collects and manages health data and nursing care service usage history.

[1656] Input: Health and care data input by family members and care recipients.

[1657] Processing: The device temporarily stores the entered data and sends it to the server, which stores it in a cloud database and encrypts and protects it.

[1658] Output: The server and terminals can refer to the saved data.

[1659] Step 6:

[1660] Data integration and monitoring

[1661] Overview: Integrates collected data to monitor health status in real time.

[1662] Input: Health data of family members and care recipients.

[1663] Processing: The server will consolidate all data and monitor health data in real time. If any abnormality is detected, it will send an emergency notification immediately.

[1664] Output: If an abnormality is detected in the health data, an emergency notification will be sent to family members and appropriate professionals.

[1665] Through these steps, caregivers and those receiving care can access care support services provided at local brick-and-mortar stores in a timely manner, and necessary reminders and emergency responses can be provided based on properly managed health data.

[1666] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1667] Overall system overview

[1668] This invention relates to a system for supporting family members providing care and those receiving care. This system includes a means for providing information to family members providing care, a means for reminding the care recipient, a means for integrating and linking data on the family members and the care recipient to monitor their health status, a means for issuing emergency notifications when an abnormality is detected, and a means for delivering care support tools. Furthermore, by incorporating an emotion engine, the system can recognize the user's emotional state in real time and respond accordingly.

[1669] System configuration

[1670] 1. User Authentication

[1671] The user enters their ID and password on the login screen.

[1672] The terminal temporarily stores the entered authentication information and sends it to the server.

[1673] The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen.

[1674] 2. Information provision

[1675] The server retrieves family care tips and support program information from a database and sends it to the terminal.

[1676] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[1677] 3. Reminders and psychological support

[1678] The server generates reminders for the care recipient to take medication and eat meals and sends them to the device at the specified time.

[1679] The device will notify the user (care recipient) of reminders via audio and visual means so that they can be checked.

[1680] The server also generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients and delivers them to the devices.

[1681] 4. Data Collection and Management

[1682] Users fill out an input form with daily data related to their health and care.

[1683] The terminal temporarily stores the input data and sends it to the server.

[1684] The server stores the received data in a database and encrypts and protects it.

[1685] 5. Data integration and monitoring

[1686] The server integrates all data from family members and those receiving care, and monitors their health status in real time.

[1687] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[1688] 6. Emotion engine integration

[1689] The server uses an emotion engine to analyze the user's voice data and facial expression data.

[1690] The emotion engine determines the user's current emotional state and transmits this to the server.

[1691] The server provides appropriate psychological support and entertainment content depending on the identified emotional state.

[1692] Specific examples

[1693] 1. User Authentication

[1694] Family member A launches the application and enters their ID and password on the login screen.

[1695] The device sends the ID and password to the server, and after successful authentication, the server obtains Family A's care history and information about the person being cared for.

[1696] 2. Providing nursing care information

[1697] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" for Family A and sends it to the terminal.

[1698] The device will notify Family A, and when they click on Details, the information will be displayed.

[1699] 3. Care recipient reminder

[1700] The server generates a message reminding "care recipient B" to take his / her medication at 9:00 AM and sends it to the terminal.

[1701] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[1702] 4. Entertainment content distribution

[1703] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[1704] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[1705] 5. Data integration and monitoring

[1706] The server monitors the health data (e.g., blood pressure, heart rate, etc.) of family member A and care recipient B in real time.

[1707] If blood pressure suddenly changes, the server will send an emergency notification to Family A and the registered doctor to prompt them to take the necessary action.

[1708] 6. Emotion engine integration

[1709] While care recipient B is using the entertainment content, the server uses an emotion engine to analyze B's voice and facial expression data to identify his / her emotional state.

[1710] For example, if care recipient B is in a "sad" emotional state, the server dynamically selects content to provide "soothing music" or "encouraging messages" and sends it to the terminal.

[1711] In this way, this system can comprehensively provide information, reminders, psychological support, data linkage, health monitoring, and adaptive responses using an emotion engine to improve the quality of life of both caregivers and care recipients.

[1712] The processing flow will be explained below.

[1713] Program processing steps

[1714] User Authentication

[1715] Step 1:

[1716] The user accesses the login screen and enters their ID and password.

[1717] Step 2:

[1718] The terminal temporarily stores the entered authentication information and sends it to the server as an HTTP request.

[1719] Step 3:

[1720] The server checks the received authentication information against a database to determine whether authentication is successful.

[1721] Step 4:

[1722] If the authentication is successful, the server obtains the user's profile data and sends it to the terminal.

[1723] Step 5:

[1724] The device displays the user's home screen based on the received profile data.

[1725] Information provision

[1726] Step 1:

[1727] The server retrieves family care tips and support program information from a database.

[1728] Step 2:

[1729] The server selects the acquired information and sends it to the terminal.

[1730] Step 3:

[1731] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[1732] Reminders and psychological support

[1733] Step 1:

[1734] The server generates medication and meal reminders for the care recipient.

[1735] Step 2:

[1736] At the specified time, the server sends a reminder to the device.

[1737] Step 3:

[1738] The device will notify the user (care recipient) of the reminder via audio or visual notification so that they can check it.

[1739] Step 4:

[1740] The server generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients.

[1741] Step 5:

[1742] The server transmits the generated entertainment content to the terminal.

[1743] Step 6:

[1744] The terminal plays the received content on the user interface and supports the user (care recipient) in their operations.

[1745] Data Collection and Management

[1746] Step 1:

[1747] Users fill out an input form with daily health and care data.

[1748] Step 2:

[1749] The terminal temporarily stores the input data and sends it to the server.

[1750] Step 3:

[1751] The server stores the received data in a database and encrypts and protects it.

[1752] Data integration and monitoring

[1753] Step 1:

[1754] The server consolidates all data on family members and care recipients.

[1755] Step 2:

[1756] The server monitors the integrated data in real time.

[1757] Step 3:

[1758] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[1759] Step 4:

[1760] The server stores a log of emergency notifications in a database for later analysis.

[1761] Emotion engine integration

[1762] Step 1:

[1763] While the care recipient is using the entertainment content, the terminal collects voice data and facial expression data of the care recipient.

[1764] Step 2:

[1765] The terminal transmits the collected voice data and facial expression data to the server in real time.

[1766] Step 3:

[1767] The server uses an emotion engine to analyze the received voice data and facial expression data to identify the emotional state of the care recipient.

[1768] Step 4:

[1769] The server selects adaptive psychological support and entertainment content based on the identified emotional state.

[1770] Step 5:

[1771] For example, if the care recipient is in a "sad" emotional state, the server generates "soothing music" or "encouraging messages" and sends them to the terminal.

[1772] Step 6:

[1773] The device plays the received psychological support and entertainment content and provides it to the person being cared for.

[1774] Specific examples

[1775] Step 1:

[1776] Family member A launches the application and enters their ID and password on the login screen.

[1777] Step 2:

[1778] The terminal sends the ID and password to the server.

[1779] Step 3:

[1780] The server successfully authenticates and obtains Family A's care history and information about the person being cared for.

[1781] Step 4:

[1782] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" to Family A and sends it to the terminal.

[1783] Step 5:

[1784] The device notifies Family A and displays detailed information.

[1785] Step 6:

[1786] The server generates a message reminding care recipient B to take his / her medication at 9:00 AM and sends it to the terminal.

[1787] Step 7:

[1788] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[1789] Step 8:

[1790] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[1791] Step 9:

[1792] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[1793] Step 10:

[1794] While the entertainment content is being used, the terminal collects voice and facial expression data of care recipient B and transmits it to the server.

[1795] Step 11:

[1796] The server uses an emotion engine to analyze the emotional state of care recipient B and detects the emotional state of "sadness."

[1797] Step 12:

[1798] The server generates "soothing music" according to the user's emotional state and sends it to the device.

[1799] Step 13:

[1800] The device plays soothing music and provides it to care recipient B.

[1801] Example 2

[1802] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1803] As our society ages, systems to support both family members providing care and those receiving care are becoming increasingly important. However, current care support systems lack functionality and user-friendliness, particularly in terms of real-time health monitoring, psychological support, emergency response when abnormalities are detected, and emotion analysis functions. This has led to issues such as a decline in the quality of care and a heavy burden on both family members providing care and those receiving care.

[1804] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for performing user authentication, a means for providing information to the family member providing care, a means for reminding the care recipient, a means for integrating and linking data on the family member and the care recipient to monitor their health status, a means for making an emergency notification when an abnormality is detected, a means for providing psychological support using emotion analysis means, and a means for delivering care support tools and entertainment content. This improves the quality of life of the family member providing care and the care recipient, and enables multifunctional and user-friendly care support.

[1805] "Means for user authentication" refers to the function of verifying the ID and password of a user accessing the system and authenticating that the user is a legitimate user.

[1806] "Information provision means for families providing care" is a function that provides families with information such as tips on caregiving, support programs, fundraising methods, and caregiving techniques.

[1807] "Reminder method for care recipients" is a function that sends reminders at specified times to ensure that care recipients remember to take their medication or eat.

[1808] "Means for integrating and linking data on family members and those receiving care to monitor their health status" refers to a function that aggregates data on the health status of family members and those receiving care and monitors it in real time.

[1809] "Means for sending emergency notifications when abnormalities are detected" is a function that sends emergency notifications to family members and experts when an abnormality is detected based on health status data.

[1810] The "means for providing psychological support using emotion analysis means" is a function that analyzes voice and facial expression data to identify the user's emotional state and provides psychological support according to that state.

[1811] "Means for delivering nursing care support tools and entertainment content" refers to a function that provides support tools necessary for nursing care and entertainment content intended to provide psychological support to those receiving care.

[1812] Overall system overview

[1813] The present invention provides a system for supporting family members who provide care and those receiving care. This system provides comprehensive support by combining multiple means. Each means will be described below.

[1814] User Authentication Embodiments

[1815] The user launches the care support application and enters their ID and password on the login screen. The device (smartphone, tablet, etc.) temporarily saves the entered authentication information and sends it to the server using the HTTPS protocol. The server checks the information against a database using a secure hash algorithm (SHA-256) to confirm whether authentication is successful. If authentication is successful, the server retrieves the user's profile data from the database and returns it to the device.

[1816] Form of providing care information

[1817] The server retrieves care-related information from a database (e.g., MongoDB), formats it in JSON format, and sends it to the device. When the user selects "care information" from the application menu, the device sends a request for care information to the server. The device visually displays the received information on the user interface, allowing the user to view it in detail.

[1818] Reminders and psychological support

[1819] The user sets reminder schedules for the care recipient's medication and meals using the application's built-in calendar function. The device sends the settings to the server, which stores this information in a database. The server generates reminders at the specified time and sends them to the device via push notification. The device notifies the user of the reminder via audio and visual means so that they can be confirmed. In addition, the server generates psychological support content, such as story readings and music playback, and distributes it to the device.

[1820] Data collection and management practices

[1821] Users enter their daily health information (e.g., blood pressure, heart rate, dietary habits) through an input form. The device temporarily stores the entered data and transmits it to the server periodically or in real time. The server stores the received data in a database and protects the data privacy using AES encryption.

[1822] Data linkage and monitoring implementation examples

[1823] The server monitors the aggregated data of family members and care recipients in real time using a streaming platform such as Apache Kafka. If an abnormality is detected in the health data, such as a sudden change in blood pressure, the server generates an emergency notification and sends it to family members and specialists via push notification or SMS notification (e.g., Twilio).

[1824] Embodiment of Emotion Engine Integration

[1825] The device collects the voice and facial expression data of the care recipient and sends it to the server. The server analyzes the data using an emotion analysis engine (e.g., IBM Watson Tone Analyzer) to identify the user's emotional state. Depending on the identified emotional state, the server generates appropriate psychological support or entertainment content and sends it to the device. For example, if the care recipient is in a "sad" emotional state, the server instructs the device to provide soothing music or an encouraging message.

[1826] Examples of specific examples and prompts

[1827] Specific examples

[1828] Family member A starts the care support app on their smartphone and enters their ID and password on the login screen. After successful authentication, the server sends and displays Family member A's care history and information about the care recipient on the smartphone. Family member A then sets a "medication reminder for 9:00 AM" for care recipient B, and the server saves the information. The server generates a reminder at the specified time and sends a notification to the smartphone. The smartphone then sends a voice notification to remind care recipient B to take their medication.

[1829] Prompt Sentence Examples

[1830] "Provide appropriate support based on the care recipient's emotional state."

[1831] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1832] Step 1:

[1833] Entering user credentials

[1834] The user simply launches the care support application and enters their ID and password on the login screen.

[1835] Input: ID, password

[1836] Output: Authentication request data

[1837] Specific operation: Enter ID and password into the input fields on the application login screen.

[1838] Step 2:

[1839] Sending authentication information

[1840] The device temporarily stores the entered ID and password and sends them to the server using the HTTPS protocol.

[1841] Input: Authentication request data

[1842] Output: Authentication information sent to the server

[1843] How it works: Authentication information is sent from the device to the server, using a secure protocol (HTTPS).

[1844] Step 3:

[1845] Credentials validation

[1846] The server checks the received ID and password against a database to confirm whether authentication is possible.

[1847] Input: Received authentication information

[1848] Output: Authentication result (success or failure)

[1849] Specific operation: The server side checks the ID and password against the authentication information stored in the database to see if they match. The check uses the SHA-256 algorithm.

[1850] Step 4:

[1851] Returning authentication results

[1852] If authentication is successful, the server retrieves the user's profile data from the database and sends it back to the device. If authentication fails, it returns an error message.

[1853] Input: Authentication result (success or failure)

[1854] Output: Profile data or error message

[1855] Specific operation: If authentication is successful, the user's profile data is sent to the device and the initial screen is displayed. If authentication is unsuccessful, an error screen is displayed.

[1856] Step 5:

[1857] Request for care information

[1858] The user selects "Care Information" from the application menu.

[1859] Input: User's care information request

[1860] Output: Nursing care information request data

[1861] Specific operation: A request is generated by selecting "care information" from the menu.

[1862] Step 6:

[1863] Obtaining nursing care information

[1864] The server retrieves information about care from the database, formats it into JSON format, and sends it to the terminal.

[1865] Input: Nursing care information request data

[1866] Output: Nursing care information (JSON format)

[1867] Specific operation: The server side retrieves information about care from the database and formats the data as necessary.

[1868] Step 7:

[1869] Displaying care information

[1870] The terminal displays the received care information on the user interface, allowing the user to view it in detail.

[1871] Input: Nursing care information (JSON format)

[1872] output: Nursing care information displayed on the user interface

[1873] Specific operation: The acquired care information is visually displayed on the user interface on the terminal, allowing details to be viewed.

[1874] Step 8:

[1875] Setting a reminder schedule

[1876] Users can set reminder schedules for their care recipients using the application's built-in calendar function.

[1877] Input: Reminder schedule information (medication time, meal time)

[1878] Output: Remind schedule setting data

[1879] What it does: Set a reminder schedule within the application and save it.

[1880] Step 9:

[1881] Save reminder schedule

[1882] The device sends the set reminder schedule to the server, which stores it in a database.

[1883] Input: Reminder schedule setting data

[1884] Output: Reminder schedule saved in the database

[1885] Specific operation: Remind schedule data is sent from the device to the server and stored in a database on the server side.

[1886] Step 10:

[1887] Generate reminder notifications

[1888] The server will generate a reminder notification at the configured time.

[1889] Input: Reminder schedules stored in the database

[1890] Output: Reminder notification data

[1891] Specific operation: Generates a reminder notification at the specified time based on the schedule stored on the server side.

[1892] Step 11:

[1893] Sending reminders

[1894] The server then sends the generated reminder notification to the device.

[1895] Input: Reminder notification data

[1896] Output: Reminder notifications sent

[1897] Specific operation: Notification data generated on the server side is sent to the terminal.

[1898] Step 12:

[1899] Displaying reminder notifications

[1900] The device will notify the user (care recipient) of the reminder via audio or visual notification at the specified time, so that they can check it.

[1901] Input: Reminder sent

[1902] Output: Reminders notified

[1903] Specific operation: The device will notify you by voice or other means and display a reminder.

[1904] Step 13:

[1905] Providing psychological support content

[1906] The server generates psychological support content such as story readings and music playback and delivers it to the device.

[1907] Input: Request for psychological support

[1908] Output: Generated psychological support content

[1909] Specific operations: Generate story reading files, music files, etc. and send them to the device.

[1910] Step 14:

[1911] Playback of psychological support content

[1912] The device plays the delivered psychological support content to the person being cared for.

[1913] Input: Psychological support content

[1914] Output: Played psychological support content

[1915] Specific operation: Plays audio files etc. on the terminal, allowing the user to listen to the content.

[1916] Step 15:

[1917] Entering health data

[1918] Users enter their health information (e.g., blood pressure, heart rate) through an input form.

[1919] Input: Health information data

[1920] Output: Input health data

[1921] Specific action: Enter daily health information using the application's input form.

[1922] Step 16:

[1923] Sending health data

[1924] The device sends the entered health data to a server periodically or in real time.

[1925] Input: Entered health data

[1926] Output: Transmitted health data

[1927] Specific operation: Health data is sent to a server periodically or in real time.

[1928] Step 17:

[1929] Health data storage and encryption

[1930] The server stores the received health data in a database and protects the data using AES encryption.

[1931] Input: Submitted health data

[1932] Output: A database containing the encrypted data.

[1933] How it works: Health data is stored in a database and secured with AES encryption.

[1934] Step 18:

[1935] Data integration and real-time monitoring

[1936] The server monitors integrated data of family members and those receiving care in real time.

[1937] Input: Various data to be integrated (health information, reminder data, etc.)

[1938] Output: Real-time updated consolidated data

[1939] Specific operation: The integrated data is updated and monitored in real time using a streaming platform (e.g., Apache Kafka).

[1940] Step 19:

[1941] Anomaly detection and emergency notification

[1942] If an abnormality is detected, for example a sudden change in blood pressure, the server generates an emergency notification and sends it to family members and specialists via push or SMS notification.

[1943] Input: Real-time updated consolidated data

[1944] Output: Emergency notification data

[1945] Specific behavior: When an anomaly is detected, an emergency notification is generated and sent.

[1946] Step 20:

[1947] Collecting Emotional Data

[1948] The device collects the voice and facial expression data of the person being cared for and sends it to the server.

[1949] Input: Voice data, facial expression data

[1950] Output: Collected emotion data

[1951] Specific operation: The device uses a microphone and camera to collect voice and facial expression data.

[1952] Step 21:

[1953] Emotion analysis

[1954] The server uses an emotion analysis engine to analyze the transmitted voice and facial expression data to identify the user's emotional state.

[1955] Input: Collected emotion data

[1956] Output: Parsed emotional state

[1957] Specific operation: Performs sentiment analysis using a sentiment analysis engine (e.g., IBM Watson Tone Analyzer).

[1958] Step 22:

[1959] Adaptive content delivery

[1960] The server generates appropriate psychological support and entertainment content based on the analyzed emotional state and sends it to the device.

[1961] Input: Parsed emotional state

[1962] Output: Adaptive Content

[1963] Specific operation: Generate content (such as soothing music or encouraging messages) according to the emotional state and send it to the device.

[1964] In this way, the entire system provides comprehensive care support through user authentication, information provision, reminders, data collection and management, data linkage and monitoring, and sentiment analysis.

[1965] (Application example 2)

[1966] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1967] Supporting care recipients and their families requires appropriate information provision, reminders, health monitoring, and emergency notifications. Furthermore, psychological support and dietary suggestions tailored to the care recipient's emotional state are also necessary. Few existing systems comprehensively provide these functions, and in particular, they lack the ability to dynamically respond to emotional states and monitor dietary intake. Therefore, there is a need for a comprehensive system that can improve the health and quality of life of care recipients.

[1968] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1969] In this invention, the server includes a means for providing information to family members providing care, a means for reminding the care recipient, a means for integrating and linking data on the family members and the care recipient to monitor their health status, a means for making an emergency notification when an abnormality is detected, a means for distributing care support tools, a means for detecting emotional states using emotion analysis means and providing appropriate psychological intervention and dietary suggestions according to the emotional state, and a means for collecting data on dietary intake and integrating it into health monitoring. This enables comprehensive and dynamic support for both the family members providing care and the care recipient.

[1970] "Information tools" are tools that provide tips on caregiving, assistance programs, fundraising methods, instruction on caregiving skills, nutritional information, and allergy-friendly dietary information.

[1971] "Reminder means" are means for providing medication and meal reminders, as well as delivering entertainment content and reminding you to eat on schedule.

[1972] "Data integration and linkage means" refers to a means of integrating and linking data from family members and care recipients to monitor their health status.

[1973] The "emergency notification means" is a means for issuing an emergency notification when an abnormality is detected.

[1974] The "care support tool distribution means" is a means for distributing the care support tool.

[1975] The "emotion analysis means" is a means for detecting the user's emotional state and providing appropriate psychological intervention and dietary suggestions according to that emotional state.

[1976] A "dietary intake data collection instrument" is a means for collecting data on dietary intake and integrating it into health monitoring.

[1977] The present invention is a system for supporting a family member providing care and a care recipient, and includes the following components.

[1978] 1. User Authentication

[1979] The user logs in to the application by entering their ID and password. The device temporarily stores this authentication information and sends it to the server. The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen. The authentication process uses the HTTP POST method, and SSL / TLS is used as a secure communication method.

[1980] 2. Information provision

[1981] The server retrieves information from the database about care tips, support programs, fundraising methods, instruction on care techniques, nutritional information, and allergy-friendly dietary information, and sends it to the terminal. The terminal displays the received information on a user interface, allowing the user to view detailed information. For example, the user can receive information such as "home rehabilitation methods."

[1982] 3. Reminders and psychological support

[1983] The server generates reminders for medication and meals and sends them to the device at the specified time. The device notifies the user of the reminders through audio and visual means, allowing them to be confirmed. The server also generates entertainment content (e.g., story reading and music playback) and delivers it to the device. This reminder function provides punctuality support for both family members and care recipients.

[1984] 4. Data Collection and Management

[1985] The user fills in a form with daily data related to dietary intake, health information, and care. The device temporarily stores the data and sends it to the server. The server then stores the received data in a database and encrypts and protects it. For example, a care recipient may want to enter the time and content of a particular meal.

[1986] 5. Data integration and monitoring

[1987] The server integrates all data of family members and care recipients, monitors their health status in real time, and if the server detects any abnormality, such as a sudden change in blood pressure, it will send an emergency notification to family members and registered medical professionals.

[1988] 6. Sentiment Analysis and Adaptive Response

[1989] The server uses an emotion engine (e.g., the EmotionEngine library) to analyze the user's voice and facial expression data and identify the user's current emotional state. Depending on the user's emotional state, for example, if the user is feeling stressed, the server selects content that suggests relaxing meals or music and sends it to the device.

[1990] Specific examples

[1991] If the care recipient is feeling stressed, the emotion engine analyzes their emotions and the server suggests relaxing herbal tea or light meals. These suggestions are displayed on the device, and the user can make orders or take action based on them.

[1992] Example prompt sentence:

[1993] The user ID: user_id is "example_user" and the password is "example_password".

[1994] First, authenticate the user.

[1995] Next, we will suggest a nutritionally balanced meal plan.

[1996] If the user's emotion is analyzed as "stressed," suggest a relaxing meal.

[1997] This system is implemented using devices such as smartphones, tablets, and head-mounted displays, and software such as Python, the Requests library, the EmotionEngine library, and a RESTful API, enabling comprehensive and dynamic support for both family members providing care and those receiving care.

[1998] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1999] Step 1:

[2000] User authentication (input: ID and password, output: profile data)

[2001] The user starts the application and enters their ID and password. The device temporarily stores this authentication information and sends it to the server using the HTTP POST method. The server verifies the authentication information against a database, and if authentication is successful, it obtains the user's profile data and sends it to the device. The device then displays the obtained profile data on the initial screen.

[2002] Step 2:

[2003] Information provision (input: user ID, output: nursing care information, nutritional information, allergy information)

[2004] The server retrieves information from the database, including tips on caregiving, assistance programs, fundraising methods, instruction on caregiving techniques, nutritional information, and allergy-friendly dietary information. The retrieved information is sent to the device as an HTTP response. The device receives this information and displays it on the user interface. The user can then view detailed information, such as "home rehabilitation methods" and "meal plans."

[2005] Step 3:

[2006] Reminders and psychological support (input: reminder setting data, output: reminder message, entertainment content)

[2007] The server generates medication and meal reminders based on the reminder times set by the user and sends HTTP messages to the device at the specified times. The device notifies the user by audio or visual notification, allowing the user to confirm the reminder. The server also generates entertainment content (e.g., story reading or music playback) in response to the user's request and delivers it to the device.

[2008] Step 4:

[2009] Data collection and management (input: health data, dietary intake data, output: storage in database)

[2010] The user enters their dietary intake and health information using the application's input form. The device temporarily stores the input data and sends it to the server using the HTTP POST method. The server stores the received data in a database and protects it with encryption. This records the time and content of specific meals consumed by the care recipient.

[2011] Step 5:

[2012] Data integration and monitoring (input: integrated data, output: anomaly detection and notification)

[2013] The server integrates all data of family members and care recipients and monitors their health status in real time. If an abnormality (such as a sudden change in blood pressure) is detected as a result of data analysis, the server sends an emergency notification to family members and registered medical professionals. This communication uses the HTTP POST method and emergency communication protocol.

[2014] Step 6:

[2015] Emotion analysis and adaptive response (input: voice data, facial expression data, output: emotional state and adaptive content)

[2016] The server analyzes the user's voice and facial expression data using a generative AI model (e.g., the EmotionEngine library) to identify their emotional state. Depending on their emotional state, the server generates content that provides appropriate psychological interventions and dietary suggestions and sends it to the device. For example, if the server determines that the user is feeling stressed, it suggests relaxing meals and music.

[2017] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2018] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2019] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2020] [Fourth embodiment]

[2021] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2022] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2023] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2024] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2025] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2026] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2027] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2028] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2029] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2030] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2031] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2032] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2033] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2034] Overall system overview

[2035] The present invention relates to a system for supporting family members providing care and those receiving care. This system includes a means for providing information to family members providing care, a means for reminding those receiving care, a means for integrating and linking data on the family members and those receiving care to monitor their health status, a means for issuing emergency notifications when an abnormality is detected, and a means for distributing care support tools.

[2036] System configuration

[2037] 1. User Authentication

[2038] The user enters their ID and password on the login screen.

[2039] The terminal temporarily stores the entered authentication information and sends it to the server.

[2040] The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen.

[2041] 2. Information provision

[2042] The server retrieves family care tips and support program information from a database and sends it to the terminal.

[2043] The terminal displays the received information on a user interface, allowing the user to view detailed information.

[2044] 3. Reminders and psychological support

[2045] The server generates reminders for the care recipient to take medication and eat meals and sends them to the device at the specified time.

[2046] The device will notify the user of the reminder via audio or visual notification so that they can check it.

[2047] The server also generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients and delivers them to the devices.

[2048] 4. Data Collection and Management

[2049] Users fill out an input form with daily data related to their health and care.

[2050] The terminal temporarily stores the input data and sends it to the server.

[2051] The server stores the received data in a database and encrypts and protects it.

[2052] 5. Data integration and monitoring

[2053] The server integrates all data from family members and those receiving care, and monitors their health status in real time.

[2054] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[2055] Specific examples

[2056] 1. User Authentication

[2057] Family member A launches the application and enters their ID and password on the login screen.

[2058] The device sends the ID and password to the server, and after successful authentication, the server obtains Family A's care history and information about the person being cared for.

[2059] 2. Providing nursing care information

[2060] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" for Family A and sends it to the terminal.

[2061] The device will notify Family A, and when they click on Details, the information will be displayed.

[2062] 3. Care recipient reminder

[2063] The server generates a message reminding "care recipient B" to take his / her medication at 9:00 AM and sends it to the terminal.

[2064] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[2065] 4. Entertainment content distribution

[2066] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[2067] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[2068] 5. Data integration and monitoring

[2069] The server monitors the health data (e.g., blood pressure, heart rate, etc.) of family member A and care recipient B in real time.

[2070] If blood pressure suddenly changes, the server will send an emergency notification to Family A and the registered doctor to prompt them to take the necessary action.

[2071] In this way, this system can comprehensively provide information, reminders, psychological support, data linkage, and health monitoring to improve the quality of life of both caregivers and those receiving care.

[2072] The processing flow will be explained below.

[2073] Program processing steps

[2074] User Authentication

[2075] Step 1:

[2076] The user accesses the login screen and enters their ID and password.

[2077] Step 2:

[2078] The terminal temporarily stores the entered authentication information and sends it to the server as an HTTP request.

[2079] Step 3:

[2080] The server checks the received authentication information against a database to determine whether authentication is successful.

[2081] Step 4:

[2082] If the authentication is successful, the server obtains the user's profile data and sends it to the terminal.

[2083] Step 5:

[2084] The device displays the user's home screen based on the received profile data.

[2085] Information provision

[2086] Step 1:

[2087] The server retrieves family care tips and support program information from a database.

[2088] Step 2:

[2089] The server selects the acquired information and sends it to the terminal.

[2090] Step 3:

[2091] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[2092] Reminders and psychological support

[2093] Step 1:

[2094] The server generates medication and meal reminders for the care recipient.

[2095] Step 2:

[2096] At the specified time, the server sends a reminder to the device.

[2097] Step 3:

[2098] The device will notify the user (care recipient) of the reminder via audio or visual notification so that they can check it.

[2099] Step 4:

[2100] The server generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients.

[2101] Step 5:

[2102] The server transmits the generated entertainment content to the terminal.

[2103] Step 6:

[2104] The terminal plays the received content on the user interface and supports the user (care recipient) in their operations.

[2105] Data Collection and Management

[2106] Step 1:

[2107] Users fill out an input form with daily health and care data.

[2108] Step 2:

[2109] The terminal temporarily stores the input data and sends it to the server.

[2110] Step 3:

[2111] The server stores the received data in a database and encrypts and protects it.

[2112] Data integration and monitoring

[2113] Step 1:

[2114] The server consolidates all data on family members and care recipients.

[2115] Step 2:

[2116] The server monitors the integrated data in real time.

[2117] Step 3:

[2118] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[2119] Step 4:

[2120] The server stores a log of emergency notifications in a database for later analysis.

[2121] Specific examples

[2122] Step 1:

[2123] Family member A launches the application and enters their ID and password on the login screen.

[2124] Step 2:

[2125] The terminal sends the ID and password to the server.

[2126] Step 3:

[2127] The server successfully authenticates and obtains Family A's care history and information about the person being cared for.

[2128] Step 4:

[2129] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" to Family A and sends it to the terminal.

[2130] Step 5:

[2131] The device notifies Family A and displays detailed information.

[2132] Step 6:

[2133] The server generates a message reminding care recipient B to take his / her medication at 9:00 AM and sends it to the terminal.

[2134] Step 7:

[2135] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[2136] Step 8:

[2137] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[2138] Step 9:

[2139] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[2140] Step 10:

[2141] The server monitors the health data of Family Member A and Care Recipient B in real time, and if an abnormality is detected, it sends an emergency notification to Family Member A and the registered doctor.

[2142] Example 1

[2143] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2144] In modern society, family members providing care must manage a large amount of information and monitor the health status of those receiving care. However, this information is dispersed and cannot be managed centrally, which presents a challenge. In addition, there are limited means to provide appropriate reminders and psychological support to care recipients, so a comprehensive system to improve the quality of care is needed.

[2145] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2146] In this invention, the server includes: means for providing information to family members providing care; means for reminding the care recipient; means for integrating and linking data of the family members and the care recipient to monitor their health status; means for issuing an emergency notification when an abnormality is detected; means for distributing care support tools; means for comparing user authentication information with a database and acquiring and displaying the user's profile data if authentication is successful; means for generating a reminder message at a specified time and sending it to the terminal; means including a generative AI model for generating psychological support content; means for encrypting and storing user-entered data in a database; and means for monitoring health data in real time and sending an appropriate emergency notification when an abnormality is detected. This enables comprehensive support for both family members providing care and the care recipient.

[2147] "Information provision means" refers to means that provide family members who provide care with tips on caregiving, support programs, fundraising methods, instruction on caregiving techniques, etc.

[2148] "Reminder means" are means for providing care recipients with reminders to take their medicine and when to eat, as well as for delivering entertainment content.

[2149] "Means for integrating and linking data to monitor health status" refers to a means for integrating all data from family members and those receiving care, and monitoring their health status in real time.

[2150] The "means for sending an emergency notification when an abnormality is detected" is a means for sending an emergency notification to family members and appropriate professionals when an abnormality is detected during data monitoring.

[2151] The "means for delivering care support tools" refers to a means for delivering necessary care support tools to family members providing care and the person receiving care.

[2152] "Means for comparing user authentication information with a database, and obtaining and displaying user profile data if authentication is successful" refers to a means for a user to enter login information, for the server to compare it with a database for authentication, and for obtaining and displaying user profile data on the terminal if authentication is successful.

[2153] The "means for generating a remind message at a specified time and transmitting it to a terminal" is a means for generating a remind message and transmitting it to a terminal at a specified time.

[2154] "Means including a generative AI model that generates psychological support content" refers to means including an AI model for generating content such as story reading, music playback, and brain training games as psychological support for care recipients.

[2155] "Means for encrypting and storing user-entered data in a database" refers to means for encrypting data entered by a user and safely storing it in a database.

[2156] "Means for monitoring health data in real time and sending appropriate emergency notifications when abnormalities are detected" means means for analyzing and monitoring health data in real time and sending appropriate emergency notifications to family members and registered professionals when abnormalities are detected.

[2157] MODE FOR CARRYING OUT THE INVENTION

[2158] The present invention relates to a system for supporting a family member who provides care and a person receiving care. How the present invention can be implemented will be described below in detail.

[2159] User Authentication

[2160] A user starts an application and enters their ID and password on the login screen. The device temporarily stores the entered authentication information and sends it to the server using a secure encryption protocol (e.g., HTTPS). The server compares the received authentication information with the authentication information stored in a database (e.g., MySQL).

[2161] If the authentication is successful, the server retrieves the user's profile data from the database and sends it to the terminal, which displays the data on the user interface.

[2162] Information provision

[2163] The server retrieves care tips and support program information from a database (e.g., PostgreSQL) and sends it to the device as an HTTP response. The device parses the JSON data, displays it in a user interface, and allows the user to click for more information.

[2164] For example, when Family Member A logs in to the application, the server sends data suggesting "home rehabilitation methods" and "local nursing care support programs," and the device notifies them of this.

[2165] Reminders and psychological support

[2166] The server uses a Cron job to generate a reminder message at the specified time and send it to the device, which then notifies the user of the reminder via audio and visual notifications at the specified time.

[2167] The server also generates psychological support content using a generative AI model (e.g., GPT-4) and delivers it to the device, which then plays the content and asks the user to rate it.

[2168] As a specific example, the server generates a message reminding "care recipient B" to take his / her medicine at 9:00 AM, and the device notifies him / her of this. Also, based on the request of care recipient B, the server generates and plays "fairy tale reading" content.

[2169] Data Collection and Management

[2170] Users enter their health and care information into the application's input form. The device temporarily stores the input data and sends it to the server using HTTPS.

[2171] The server encrypts the data and stores it securely in a database (e.g. MongoDB).

[2172] Data integration and monitoring

[2173] The server uses Python data analysis libraries to consolidate all data and monitor health status in real time. If an anomaly is detected, the server uses SMTP to send an emergency notification to the appropriate specialist.

[2174] For example, the server monitors the blood pressure and heart rate of family member A and care recipient B, and sends an emergency notification if there is a sudden change in blood pressure.

[2175] Prompt Sentence Examples

[2176] The following prompts can be used to provide the necessary information for the generative AI model:

[2177] "Please provide the following information:

[2178] 1. List of family care support programs

[2179] 2. Content that provides psychological support to care recipients (e.g., story readings, music, brain training games, etc.)

[2180] 3. Procedures for inputting data on the health status of care recipients and monitoring the analysis results in real time.

[2181] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2182] Program processing flow

[2183] Step 1: Handling user authentication

[2184] When a user launches the application and enters their ID and password on the login screen, the device temporarily stores the entered authentication information, encrypts it using the HTTPS protocol, and sends it to the server.

[2185] Input: User ID and password

[2186] Data processing: User input is temporarily stored and encrypted using the HTTPS protocol

[2187] Output: Encrypted credentials

[2188] The server queries the database to verify the authentication information received, and if authentication is successful, retrieves the user's profile data and sends it to the device.

[2189] Input: Encrypted credentials

[2190] Data operations: querying the database and comparing with authentication information

[2191] Output: User profile data

[2192] The terminal displays the received user profile data on a user interface.

[2193] Input: User profile data

[2194] Data processing: Analysis of user data, formatting of display

[2195] Output: Displayed user profile

[2196] Step 2: Processing the submission

[2197] The server executes queries to retrieve information about care (tips, assistance programs, etc.) from a database.

[2198] Input: Request information

[2199] Data operations: querying the database

[2200] Output: Nursing care information data

[2201] The server formats the acquired information into JSON format and sends it to the terminal.

[2202] Input: Nursing care information data

[2203] Data processing: Formatting to JSON format

[2204] Output: Formatted care information

[2205] The terminal parses the received JSON data and displays it in an interactive user interface.

[2206] Input: Formatted care information

[2207] Data processing: Analysis and display format construction

[2208] Output: Displayed care information

[2209] Step 3: Handle reminders

[2210] The server generates reminder messages based on a pre-set schedule.

[2211] Input: Remind schedule information

[2212] Data calculation: Schedule-based reminder message generation

[2213] Output: The generated reminder message

[2214] The server sends the generated remind message to the terminal at the specified time.

[2215] Input: The generated reminder message

[2216] Data processing: message format and timing specification

[2217] Output: Reminder message sent

[2218] The device will receive reminder messages and notify you with audio and visual notifications.

[2219] Input: Reminder message sent

[2220] Data Processing: Audio and Visual Settings

[2221] Output: Reminders notified

[2222] Step 4: Handling psychological support

[2223] The user inputs a request. The terminal saves the request data and sends it to the server.

[2224] Input: User request data

[2225] Data processing: saving and sending request data

[2226] Output: Request data sent

[2227] The server uses a generative AI model (e.g., GPT-4) to generate psychological support content based on the request.

[2228] Input: Request data

[2229] Data Computation: Content Generation with Generative AI Models

[2230] Output: Generated support content

[2231] The server transmits the generated content to the terminal.

[2232] Input: Generated support content

[2233] Data Processing: Content Formatting and Delivery

[2234] Output: Submitted support content

[2235] The terminal plays back the received content and displays a message on the user interface requesting a rating.

[2236] Input: Submitted support content

[2237] Data processing: playback and evaluation interface display

[2238] Output: Played content and rating interface

[2239] Step 5: Data collection and management

[2240] The user fills in the input form with health information and care data.

[2241] Input: User's health and care data

[2242] Data processing: Saving input data

[2243] Output: Stored health and care data

[2244] The terminal temporarily stores the entered data and sends it to the server using the HTTPS protocol.

[2245] Input: Saved data

[2246] Data processing: data encryption and transmission

[2247] Output: Transmitted health and care data

[2248] The server encrypts the data it receives and stores it securely in a database.

[2249] Input: Submitted health and care data

[2250] Data calculation: Encryption and storage in database

[2251] Output: Encrypted database entries

[2252] Step 6: Data integration and monitoring process

[2253] The server uses a Python data analysis library to integrate all data and perform analysis and monitoring in real time.

[2254] Input: Integrated data

[2255] Data calculation: Real-time analysis

[2256] Output: Health status analysis results

[2257] If an anomaly is detected, the server uses the SMTP protocol to send an urgent notification to the appropriate specialist.

[2258] Input: Analysis results (outliers)

[2259] Data Computing: Generating and sending emergency notifications

[2260] Output: Urgent notifications sent

[2261] (Application example 1)

[2262] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2263] Previous nursing care support systems had the problem of lacking the means to provide timely information about nursing care support services and rehabilitation offered at local brick-and-mortar stores to family members and care recipients, and to provide appropriate reminders. Furthermore, there was a lack of a system in place to centrally manage the history of nursing care service usage at brick-and-mortar stores and health data, and to quickly respond if an abnormality was detected. These issues made it difficult for family members providing care and those receiving care to receive adequate support.

[2264] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2265] In this invention, the server includes a means for providing information to family members providing care, a means for providing nursing care support services at physical stores and reservation reminders for rehabilitation, and a means for integrating and linking data on family members and care recipients to monitor their health status. This solves the conventional problem, enabling family members providing care and care recipients to timely use nursing care support services provided at local physical stores, and enabling necessary reminders and emergency responses based on properly managed health data.

[2266] "Family caregivers" are those who provide physical support and are involved in assisting the care recipient with daily living.

[2267] A "care recipient" is someone who requires assistance and care in daily life.

[2268] "Information provision means" refers to a system that provides family members who provide care with tips related to caregiving, support programs, fundraising methods, instruction on caregiving techniques, nearby care support services and rehabilitation methods, and information on support services and events offered at physical stores.

[2269] The "reminder method" is a system that notifies care recipients when to take their medication and when to eat, as well as sending them timely reminders to make appointments for rehabilitation or counseling at physical stores.

[2270] "Means for integrating and linking data to monitor health status" refers to a system that consolidates and manages health data and nursing care service usage history of family members and those receiving care, and monitors their health status in real time.

[2271] "Means for emergency notification when abnormalities are detected" refers to a system that immediately notifies family members or medical professionals if an abnormality is detected in health data during monitoring.

[2272] "Means for delivering care support tools" refers to a system that provides applications and resources useful for caregiving to family members who are providing care.

[2273] "Means for inputting, saving, and transmitting nursing care service usage history and health data at physical stores" refers to a system that records usage information for nursing care services provided at physical stores and health measurement results, and saves and transmits them on a server.

[2274] A system for implementing the present invention includes a program and related hardware and software for providing comprehensive support to family members who provide care and those receiving care.

[2275] 1. Hardware and Software Configuration

[2276] Hardware: Smartphones, servers, network infrastructure, health data collection devices (blood pressure monitors, heart rate monitors, etc.)

[2277] Software: Python, Requests library, timer processing library, cloud database (e.g. AWS DynamoDB)

[2278] 2. User Authentication

[2279] As a user authentication procedure, the family member providing care enters their ID and password using a smartphone, and the server temporarily stores the authentication information. The authentication information is then sent to the server, which verifies the information and obtains the user's profile data. If authentication is successful, the initial screen is displayed.

[2280] 3. Providing information on nursing care support

[2281] The server retrieves from the database information for family members providing care, such as tips on caregiving, support programs, fundraising methods, instruction on caregiving techniques, as well as information on nearby care support services and rehabilitation methods, and information on support services and events offered at brick-and-mortar stores, and sends this information to the smartphone device, allowing users to view the information they need at any time.

[2282] 4. Reminders and psychological support

[2283] The server generates reminders for care recipients to take their medication or eat meals, and sends them to their smartphones at the specified times. It also sends appointment reminders for rehabilitation or counseling sessions at physical stores. The device notifies the user of these reminders via audio and visual means, allowing them to be checked. Furthermore, to provide psychological support to care recipients, the server generates entertainment content such as story readings, music playback, and brain training games, and delivers them to the smartphone.

[2284] 5. Data Collection and Management

[2285] Users enter their health information and daily care data into an input form on their smartphone. The device temporarily stores the entered data and sends it to the server. The server then stores the received data in a cloud database and encrypts and protects it. In this way, the history of nursing care service use at physical stores and health data are managed centrally.

[2286] 6. Data integration and monitoring

[2287] The server integrates all data of family members and care recipients and monitors their health status in real time. If an abnormality is detected in the health data, the server sends an emergency notification to the caregiver and appropriate professionals to prompt them to take the necessary action.

[2288] Specific examples

[2289] If a care recipient has a rehabilitation appointment at a local care support center, the family can use the app to receive reminders and take the care recipient at the appropriate time. Furthermore, by entering blood pressure and heart rate measurements taken at a physical store into the app, the data is later sent to a server, and if any abnormalities are detected, the family or doctor will be immediately notified.

[2290] Example prompts to input to the generative AI model

[2291] Information about services offered at nearby care support centers is obtained and notified to the user.

[2292] Send notifications to remind you of your next rehabilitation appointment.

[2293] Health data of the care recipient is entered and sent to the server.

[2294] Health data will be monitored in physical stores, and families will be notified if any abnormalities are detected.

[2295] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2296] Step 1:

[2297] User Authentication

[2298] Summary: A user logs into a smartphone app.

[2299] Input: User inputs ID and password.

[2300] Processing: The terminal sends the entered authentication information (ID and password) to the server. The server receives the authentication information and verifies it against the information in the database.

[2301] Output: If authentication is successful, the user's profile data is returned and the welcome screen is displayed on the terminal. If authentication is unsuccessful, an error message is displayed.

[2302] Step 2:

[2303] Providing nursing care support information

[2304] Overview: Provides care-related information to families.

[2305] Input: A request is made to the server to retrieve from its internal database information on caregiving tips, assistance programs, funding options, caregiving skills instruction, and nearby care support and rehabilitation services.

[2306] Processing: Based on the request, the server retrieves the necessary information from the database and sends it to the terminal.

[2307] Output: The terminal displays the received information to the user, allowing the user to view detailed information.

[2308] Step 3:

[2309] Reminder notifications

[2310] Summary: Sends reminders to care recipients.

[2311] Input: Medication, diet, and in-store rehabilitation and counseling appointment information.

[2312] Processing: The server generates a reminder at the specified time and sends a reminder notification to the device.

[2313] Output: The device will notify the user of the reminder via audio and visual notifications, allowing them to be acknowledged.

[2314] Step 4:

[2315] Entertainment content distribution

[2316] Overview: Provides entertainment content as psychological support to care recipients.

[2317] Input: Care recipient's request for psychological support.

[2318] Processing: The server generates entertainment content such as story reading, music playback, and brain training games and delivers it to the device.

[2319] Output: The device plays the content to the care recipient and then displays an interface asking for their evaluation.

[2320] Step 5:

[2321] Data Collection and Management

[2322] Overview: Collects and manages health data and nursing care service usage history.

[2323] Input: Health and care data input by family members and care recipients.

[2324] Processing: The device temporarily stores the entered data and sends it to the server, which stores it in a cloud database and encrypts and protects it.

[2325] Output: The server and terminals can refer to the saved data.

[2326] Step 6:

[2327] Data integration and monitoring

[2328] Overview: Integrates collected data to monitor health status in real time.

[2329] Input: Health data of family members and care recipients.

[2330] Processing: The server will consolidate all data and monitor health data in real time. If any abnormality is detected, it will send an emergency notification immediately.

[2331] Output: If an abnormality is detected in the health data, an emergency notification will be sent to family members and appropriate professionals.

[2332] Through these steps, caregivers and those receiving care can access care support services provided at local brick-and-mortar stores in a timely manner, and necessary reminders and emergency responses can be provided based on properly managed health data.

[2333] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2334] Overall system overview

[2335] This invention relates to a system for supporting family members providing care and those receiving care. This system includes a means for providing information to family members providing care, a means for reminding the care recipient, a means for integrating and linking data on the family members and the care recipient to monitor their health status, a means for issuing emergency notifications when an abnormality is detected, and a means for delivering care support tools. Furthermore, by incorporating an emotion engine, the system can recognize the user's emotional state in real time and respond accordingly.

[2336] System configuration

[2337] 1. User Authentication

[2338] The user enters their ID and password on the login screen.

[2339] The terminal temporarily stores the entered authentication information and sends it to the server.

[2340] The server verifies the authentication information, and if authentication is successful, retrieves the user's profile data and displays the initial screen.

[2341] 2. Information provision

[2342] The server retrieves family care tips and support program information from a database and sends it to the terminal.

[2343] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[2344] 3. Reminders and psychological support

[2345] The server generates reminders for the care recipient to take medication and eat meals and sends them to the device at the specified time.

[2346] The device will notify the user (care recipient) of reminders via audio and visual means so that they can be checked.

[2347] The server also generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients and delivers them to the devices.

[2348] 4. Data Collection and Management

[2349] Users fill out an input form with daily data related to their health and care.

[2350] The terminal temporarily stores the input data and sends it to the server.

[2351] The server stores the received data in a database and encrypts and protects it.

[2352] 5. Data integration and monitoring

[2353] The server integrates all data from family members and those receiving care, and monitors their health status in real time.

[2354] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[2355] 6. Emotion engine integration

[2356] The server uses an emotion engine to analyze the user's voice data and facial expression data.

[2357] The emotion engine determines the user's current emotional state and transmits this to the server.

[2358] The server provides appropriate psychological support and entertainment content depending on the identified emotional state.

[2359] Specific examples

[2360] 1. User Authentication

[2361] Family member A launches the application and enters their ID and password on the login screen.

[2362] The device sends the ID and password to the server, and after successful authentication, the server obtains Family A's care history and information about the person being cared for.

[2363] 2. Providing nursing care information

[2364] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" for Family A and sends it to the terminal.

[2365] The device will notify Family A, and when they click on Details, the information will be displayed.

[2366] 3. Care recipient reminder

[2367] The server generates a message reminding "care recipient B" to take his / her medication at 9:00 AM and sends it to the terminal.

[2368] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[2369] 4. Entertainment content distribution

[2370] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[2371] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[2372] 5. Data integration and monitoring

[2373] The server monitors the health data (e.g., blood pressure, heart rate, etc.) of family member A and care recipient B in real time.

[2374] If blood pressure suddenly changes, the server will send an emergency notification to Family A and the registered doctor to prompt them to take the necessary action.

[2375] 6. Emotion engine integration

[2376] While care recipient B is using the entertainment content, the server uses an emotion engine to analyze B's voice and facial expression data to identify his / her emotional state.

[2377] For example, if care recipient B is in a "sad" emotional state, the server dynamically selects content to provide "soothing music" or "encouraging messages" and sends it to the terminal.

[2378] In this way, this system can comprehensively provide information, reminders, psychological support, data linkage, health monitoring, and adaptive responses using an emotion engine to improve the quality of life of both caregivers and care recipients.

[2379] The processing flow will be explained below.

[2380] Program processing steps

[2381] User Authentication

[2382] Step 1:

[2383] The user accesses the login screen and enters their ID and password.

[2384] Step 2:

[2385] The terminal temporarily stores the entered authentication information and sends it to the server as an HTTP request.

[2386] Step 3:

[2387] The server checks the received authentication information against a database to determine whether authentication is successful.

[2388] Step 4:

[2389] If the authentication is successful, the server obtains the user's profile data and sends it to the terminal.

[2390] Step 5:

[2391] The device displays the user's home screen based on the received profile data.

[2392] Information provision

[2393] Step 1:

[2394] The server retrieves family care tips and support program information from a database.

[2395] Step 2:

[2396] The server selects the acquired information and sends it to the terminal.

[2397] Step 3:

[2398] The terminal displays the received information on a user interface, allowing the user (family member) to view detailed information.

[2399] Reminders and psychological support

[2400] Step 1:

[2401] The server generates medication and meal reminders for the care recipient.

[2402] Step 2:

[2403] At the specified time, the server sends a reminder to the device.

[2404] Step 3:

[2405] The device will notify the user (care recipient) of the reminder via audio or visual notification so that they can check it.

[2406] Step 4:

[2407] The server generates entertainment content such as story reading, music playback, and brain training games to provide psychological support to the care recipients.

[2408] Step 5:

[2409] The server transmits the generated entertainment content to the terminal.

[2410] Step 6:

[2411] The terminal plays the received content on the user interface and supports the user (care recipient) in their operations.

[2412] Data Collection and Management

[2413] Step 1:

[2414] Users fill out an input form with daily health and care data.

[2415] Step 2:

[2416] The terminal temporarily stores the input data and sends it to the server.

[2417] Step 3:

[2418] The server stores the received data in a database and encrypts and protects it.

[2419] Data integration and monitoring

[2420] Step 1:

[2421] The server consolidates all data on family members and care recipients.

[2422] Step 2:

[2423] The server monitors the integrated data in real time.

[2424] Step 3:

[2425] If an abnormality is detected, the server sends an emergency notification to the family and appropriate professionals.

[2426] Step 4:

[2427] The server stores a log of emergency notifications in a database for later analysis.

[2428] Emotion engine integration

[2429] Step 1:

[2430] While the care recipient is using the entertainment content, the terminal collects voice data and facial expression data of the care recipient.

[2431] Step 2:

[2432] The terminal transmits the collected voice data and facial expression data to the server in real time.

[2433] Step 3:

[2434] The server uses an emotion engine to analyze the received voice data and facial expression data to identify the emotional state of the care recipient.

[2435] Step 4:

[2436] The server selects adaptive psychological support and entertainment content based on the identified emotional state.

[2437] Step 5:

[2438] For example, if the care recipient is in a "sad" emotional state, the server generates "soothing music" or "encouraging messages" and sends them to the terminal.

[2439] Step 6:

[2440] The device plays the received psychological support and entertainment content and provides it to the person being cared for.

[2441] Specific examples

[2442] Step 1:

[2443] Family member A launches the application and enters their ID and password on the login screen.

[2444] Step 2:

[2445] The terminal sends the ID and password to the server.

[2446] Step 3:

[2447] The server successfully authenticates and obtains Family A's care history and information about the person being cared for.

[2448] Step 4:

[2449] The server retrieves information from the database suggesting "home rehabilitation methods" and "local nursing care support programs" to Family A and sends it to the terminal.

[2450] Step 5:

[2451] The device notifies Family A and displays detailed information.

[2452] Step 6:

[2453] The server generates a message reminding care recipient B to take his / her medication at 9:00 AM and sends it to the terminal.

[2454] Step 7:

[2455] The device will send a voice notification at 9:00 AM to inform care recipient B that it is time to take his / her medication.

[2456] Step 8:

[2457] The server generates a "fairy tale reading" based on the request of care recipient B and sends it to the terminal as an audio file.

[2458] Step 9:

[2459] The device plays the story to care recipient B and displays an interface asking for an evaluation after the reading is finished.

[2460] Step 10:

[2461] While the entertainment content is being used, the terminal collects voice and facial expression data of care recipient B and transmits it to the server.

[2462] Step 11:

[2463] The server uses an emotion engine to analyze the emotional state of care recipient B and detects the emotional state of "sadness."

[2464] Step 12:

[2465] The server generates "soothing music" according to the user's emotional state and sends it to the device.

[2466] Step 13:

[2467] The device plays soothing music and provides it to care recipient B.

[2468] Example 2

[2469] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2470] As our society ages, systems to support both family members providing care and those receiving care are becoming increasingly important. However, current care support systems lack functionality and user-friendliness, particularly in terms of real-time health monitoring, psychological support, emergency response when abnormalities are detected, and emotion analysis functions. This has led to issues such as a decline in the quality of care and a heavy burden on both family members providing care and those receiving care.

[2471] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for performing user authentication, a means for providing information to the family member providing care, a means for reminding the care recipient, a means for integrating and linking data on the family member and the care recipient to monitor their health status, a means for making an emergency notification when an abnormality is detected, a means for providing psychological support using emotion analysis means, and a means for delivering care support tools and entertainment content. This improves the quality of life of the family member providing care and the care recipient, and enables multifunctional and user-friendly care support.

[2472] "Means for user authentication" refers to the function of verifying the ID and password of a user accessing the system and authenticating that the user is a legitimate user.

[2473] "Information provision means for families providing care" is a function that provides families with information such as tips on caregiving, support programs, fundraising methods, and caregiving techniques.

[2474] "Reminder method for care recipients" is a function that sends reminders at specified times to ensure that care recipients remember to take their medication or eat.

[2475] "Means for integrating and linking data on family members and those receiving care to monitor their health status" refers to a function that aggregates data on the health status of family members and those receiving care and monitors it in real time.

[2476] "Means for sending emergency notifications when abnormalities are detected" is a function that sends emergency notifications to family members and experts when an abnormality is detected based on health status data.

[2477] The "means for providing psychological support using emotion analysis means" is a function that analyzes voice and facial expression data to identify the user's emotional state and provides psychological support according to that state.

[2478] "Means for delivering nursing care support tools and entertainment content" refers to a function that provides support tools necessary for nursing care and entertainment content intended to provide psychological support to those receiving care.

[2479] Overall system overview

[2480] The present invention provides a system for supporting family members who provide care and those receiving care. This system provides comprehensive support by combining multiple means. Each means will be described below.

[2481] User Authentication Embodiments

[2482] The user launches the care support application and enters their ID and password on the login screen. The device (smartphone, tablet, etc.) temporarily saves the entered authentication information and sends it to the server using the HTTPS protocol. The server checks the information against a database using a secure hash algorithm (SHA-2...

Claims

1. A means of providing information to family members who provide care; A reminder means for the care recipient; A means of integrating and linking data on family members and those receiving care to monitor their health status; A means for sending an emergency notification when an abnormality is detected; A means of delivering care support tools; A system including:

2. 2. The system according to claim 1, wherein the information providing means provides tips on caregiving, support programs, fundraising methods, and guidance on caregiving techniques.

3. 10. The system of claim 1, wherein the reminder means provides medication and meal reminders and further delivers entertainment content.

Images