System

Abstract

A system is provided.SOLUTION: A care system including a data management means for managing health information and preference information of an elderly person, an AI algorithm means for analyzing the health information and preference information, a notification means for notifying the elderly person and a carer thereof based on a result of analysis, a conversation means for having a conversation with the elderly person according to a predetermined conversation template and feeding back conversation contents as data, and an alert means for transmitting an alert to a carer or a specialist in an emergency.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] As our society ages, the increasing physical and mental burden of caring for the elderly is a major issue. There is a particular need to reduce the burden on caregivers and the psychological burden on those receiving care. There is also a need to make the time that elderly people spend alone more meaningful and to address issues of loneliness and safety. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems with a system that includes a data management means for managing the health and preference information of elderly people, an AI algorithm means for analyzing the health and preference information, a notification means for notifying the elderly people and their caregivers based on the analysis results, a conversation means for engaging in a dialogue with the elderly people according to a predetermined conversation template and providing feedback on the content of the dialogue, and an alert means for sending an alert to a caregiver or specialist in the event of an emergency. This system facilitates daily health management and medication management for elderly people, reducing the burden on caregivers. Furthermore, the system allows elderly people to feel as if they are talking to a friend, thereby improving their psychological satisfaction.

[0006] "Data management means" refers to a function that centrally collects, stores, and manages health information and preference information of elderly people.

[0007] "AI algorithmic means" refers to artificial intelligence-based functions that analyze collected health and preference information and generate appropriate results or instructions.

[0008] "Notification means" is a function that appropriately notifies the elderly person and their caregiver of the analysis results and instructions.

[0009] The "conversation means" is a function that converses with the elderly person according to a predetermined conversation template, records the content of the conversation as data, and provides feedback.

[0010] "Alert means" is a function that sends a warning or notification to a caregiver or professional in the event of an emergency.

[0011] The term "elderly" generally refers to people in the age group who require care.

[0012] "Caregiver" refers to a family member, friend or professional caregiver who is responsible for caring for an older person.

[0013] "Health information" refers to all data related to the physical condition and vital signs of elderly people.

[0014] "Preference information" refers to data about topics, activities, and hobbies preferred by seniors. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The present invention relates to a care system that utilizes AI to reduce the burden on elderly people and their caregivers. The following describes in detail the embodiments of the system based on the claims.

[0037] System configuration and basic operation

[0038] This system operates in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver).

[0039] Server Roles

[0040] The server has a data management system that centrally manages the health and preference information of elderly people. Specifically, it performs the following functions:

[0041] 1. Data Collection and Storage:

[0042] The server collects the elderly person's physical condition data (heart rate, blood pressure, etc.) and preference information and stores it in a database. The user (caregiver) can input new health information and medication schedules.

[0043] Examples:

[0044] The caregiver enters Mr. A's new medication schedule and recent medical checkup results through a web interface, and the server stores the information in a database.

[0045] 2. Data Analysis:

[0046] The server analyzes the collected data using AI algorithms and generates an alert if an anomaly is detected based on the analysis results.

[0047] Examples:

[0048] The server analyzes elderly person A's recent blood pressure data in real time, and if it detects an abnormal value, it immediately sends an alert to the caregiver.

[0049] 3. Conversation template generation:

[0050] The server generates appropriate conversation templates based on the elderly person's preferences, thereby providing conversation content that the elderly person will find enjoyable.

[0051] Examples:

[0052] The server recognizes from elderly person B's preference information that he likes talking about summer festivals, generates a conversation template about summer festivals, and sends it to the terminal.

[0053] Device Role

[0054] The device uses data and conversation templates obtained from the server to engage in everyday conversations with the elderly and support their health management.

[0055] 1. Data Receipt and Notification:

[0056] The device receives notifications and alerts from the server and conveys them appropriately to the elderly. It also has the function of collecting the elderly's health data and sending it to the server.

[0057] Examples:

[0058] The device receives a notification from the server that it is time for elderly person C to take his / her medicine, and when it reaches 2 p.m., it issues a voice message saying, "Please take your medicine."

[0059] 2. Conversational Relationships:

[0060] The device then converses with the elderly person according to a conversation template sent from the server. The content of the conversation is then sent back to the server, allowing for history management.

[0061] Examples:

[0062] Elderly person D enjoys a conversation with the device about "old summer festivals," and the response data is fed back to the server.

[0063] User Roles

[0064] The user (caregiver or elderly person) responds to the system's notifications and alerts and enters the required information.

[0065] 1. Enter your information:

[0066] Caregivers enter new health information and medication schedules into the system, and seniors report their health status to a terminal.

[0067] Examples:

[0068] The caregiver enters the new health check results of elderly person E into the server's management screen.

[0069] Elderly person E reports to the device, "I feel good today."

[0070] 2. Notification and Alert Response:

[0071] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, such as contacting experts.

[0072] Examples:

[0073] An alert for elderly person F's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[0074] summary

[0075] The system of the present invention is a multifunctional care system that links a server, a terminal, and a user to manage the health of the elderly and improve their psychological satisfaction. This system appropriately manages and analyzes the elderly's health information and preference information, reducing the burden on caregivers while providing an environment in which the elderly can live safely and enjoyably.

[0076] The processing flow will be explained below.

[0077] Step 1:

[0078] The server stores the health and preference information of the elderly person received from the user (caregiver) in a database. For example, when a caregiver inputs a new medication schedule for elderly person A through the web interface, the information is sent to the server and stored.

[0079] Step 2:

[0080] The device periodically receives health data from the server and collects health information as needed. The device measures the blood pressure of elderly person B and sends the data to the server. The server analyzes the received data, and the health data is stored in a database on the server side.

[0081] Step 3:

[0082] The server analyzes the received health data using an AI algorithm to determine whether there are any abnormalities. For example, if the server analyzes the blood pressure data of elderly person B and detects an abnormal value, it generates an alert. The server then sends the alert to the caregiver's smartphone using a notification method.

[0083] Step 4:

[0084] The server generates a conversation template based on the analyzed health data. For example, it recognizes from elderly person C's preference information that he likes "old stories" and generates a conversation template related to that content. The generated template is then sent to the device.

[0085] Step 5:

[0086] The device starts a conversation with the elderly person according to the conversation template received from the server. Elderly person C is asked by the device, "Would you like to hear a story about a summer festival from long ago?" When Elderly person C responds "Yes," the response data is sent from the device to the server.

[0087] Step 6:

[0088] The device periodically notifies the elderly person based on notifications from the server. For example, the device may notify elderly person D by voice, "It's 2 p.m. Please take your medicine." Voice recognition confirms that elderly person D has taken their medicine, and the device then sends this information to the server.

[0089] Step 7:

[0090] The server analyzes the conversation content and health information sent from the device and updates the elderly person's preference information and health status. The preference information is updated based on the data of Elderly C's response, "I like summer festivals." The updated information is used to generate future conversation templates and for health management.

[0091] Step 8:

[0092] The user (caregiver) receives an emergency alert notification and takes the necessary action. For example, if a caregiver receives an alert on their smartphone about an abnormal blood pressure of elderly person E, the caregiver will contact a specialist and arrange for an emergency response.

[0093] Example 1

[0094] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0095] In an aging society, there is a need to reduce the burden on caregivers while maintaining the health and psychological satisfaction of the elderly. However, conventional nursing care systems lack centralized management of health information, making it difficult to detect abnormalities and respond to emergencies in real time. Furthermore, they lacked mechanisms for providing conversation content that the elderly can enjoy. These issues must be resolved.

[0096] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0097] In this invention, the server includes a data management unit for managing the elderly's health information and preference information; a collection and storage unit for collecting the health information and preference information and storing it in a database; an AI algorithm unit for analyzing the health information and preference information; an alert generation unit for detecting abnormalities and generating alerts based on the analysis results; a notification unit for notifying the elderly and their caregivers of the analysis results and alerts; a conversation unit for engaging in a dialogue with the elderly according to a conversation template generated based on the elderly's preference information and providing feedback on the content of the dialogue as data; a health status monitoring unit for periodically analyzing the elderly's health data in real time and generating an emergency alert if an abnormal value is detected; and an emergency notification unit for sending an alert to a caregiver or specialist in the event of an emergency. This allows for the real-time management and analysis of the elderly's health information and preference information, enabling immediate response when an abnormality occurs. Furthermore, providing conversation content that the elderly enjoys can increase their psychological satisfaction.

[0098] The "data management means" refers to a system and method for centrally managing health information and preference information of elderly people.

[0099] "Collection and storage means" refers to the function for collecting health information and preference information of the elderly and storing it in a database.

[0100] "AI algorithm means" refers to an algorithm that analyzes collected health and preference information to detect abnormalities and identify patterns.

[0101] The "alert generation means" is a function for generating an alert when an abnormality is detected based on the analysis results.

[0102] "Notification means" refers to a system and method for appropriately notifying elderly people and their caregivers of analysis results and alerts.

[0103] The "conversation means" is a function for having a conversation with the elderly person in accordance with a conversation template generated based on the elderly person's preference information, and feeding back the content of that conversation as data.

[0104] The "health status monitoring means" is a function that periodically analyzes the health data of elderly people in real time and generates emergency alerts if abnormal values ​​are detected.

[0105] "Emergency notification means" is a function that sends an alert to caregivers or experts in the event of an emergency, urging them to respond promptly.

[0106] MODE FOR CARRYING OUT THE INVENTION

[0107] The present invention is a system for managing health information and preference information of elderly people and providing care support using that information. This system operates in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver). Detailed embodiments of the system are described below.

[0108] Server Roles

[0109] The server implements the following methods:

[0110] 1. Data Management Measures:

[0111] The server centrally manages the health and preference information of the elderly, preventing loss or duplication of information and enabling efficient management.

[0112] 2. Collection and storage methods:

[0113] The server receives the elderly person's physical condition data (heart rate, blood pressure, etc.) sent from the terminal and health information entered by the caregiver via a web interface, and stores it in a database.

[0114] Examples:

[0115] Blood pressure data measured by the elderly person using a terminal is sent to a server.

[0116] Caregivers enter their senior's medication schedule through a web interface, and the information is stored in a database.

[0117] 3. AI algorithm means:

[0118] The server analyzes the collected health and preference information using AI algorithms, which allows it to detect abnormalities and recognize patterns.

[0119] 4. Alert generation method:

[0120] The server generates an alert when an abnormality is detected based on the analysis results. This alert is promptly communicated to the user via the notification means and emergency notification means described below.

[0121] 5. Means of notification:

[0122] The server has the function of notifying the elderly person and their caregiver of analysis results and alerts.

[0123] Examples:

[0124] When it is nearly time for the elderly person to take their medicine, the server sends a notification to the terminal and an audio notification is given.

[0125] 6. Means of communication:

[0126] The server then engages in a dialogue with the elderly person according to a conversation template generated based on the elderly person's preferences. The content of this dialogue is fed back as data and stored on the server.

[0127] 7. Health monitoring measures:

[0128] The server periodically analyzes the elderly person's health data in real time and generates emergency alerts if it detects abnormal values.

[0129] 8. Emergency notification means:

[0130] The server sends alerts to caregivers or professionals in the event of an emergency, facilitating a rapid response.

[0131] Device Role

[0132] The terminal implements the following functions:

[0133] 1. Data reception and notification function:

[0134] The device receives notifications and alerts from the server and conveys them appropriately to the elderly. It also collects the elderly's physical condition data and sends it to the server.

[0135] Examples:

[0136] At 2 p.m., the device will notify you with a voice message saying, "Please take your medicine."

[0137] 2. Conversational features:

[0138] The device converses with the elderly person according to a conversation template provided by the server, and the content of this conversation is sent to the server and managed as a history.

[0139] Examples:

[0140] The elderly person enjoys a conversation with the device about "old summer festivals," and the conversation data is sent to the server.

[0141] User (caregiver / elderly) role

[0142] The user performs the following operations through the system:

[0143] 1. Enter your information:

[0144] Caregivers enter new health information and medication schedules into the system, and seniors report their health status to a terminal.

[0145] Examples:

[0146] The caregiver enters the elderly person's new health check results into the server's management screen.

[0147] An elderly person reports to the device, "I feel good today."

[0148] 2. Notification and Alert Response:

[0149] Users receive notifications and emergency alerts from the system and take appropriate action.

[0150] Examples:

[0151] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[0152] Prompt Sentence Examples

[0153] "Generate conversation templates about summer festivals based on elderly people's preferences."

[0154] The above is a detailed description of the mode for carrying out the present invention.

[0155] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0156] Step 1:

[0157] Data collection

[0158] The server receives the elderly person's physical condition data (e.g., heart rate, blood pressure data) from the device, as well as health and preference information entered by the caregiver through a web interface.

[0159] Input: Elderly person's physical condition data, caregiver's input data

[0160] Specific behavior:

[0161] Elderly people measure their heart rate using a device and send the data to a server.

[0162] Caregivers enter new medication schedules for seniors through a web interface.

[0163] Output: Received health and preference information

[0164] Step 2:

[0165] Data storage

[0166] The server stores the collected health and preference information in a database.

[0167] Input: Received health and preference information

[0168] Specific behavior:

[0169] The server adds the elderly person's latest blood pressure data to the database.

[0170] The server registers the medication schedule entered by the caregiver in a database.

[0171] Output: Health and preference information stored in a database

[0172] Step 3:

[0173] Data analysis

[0174] The server analyzes the stored health and preference information using AI algorithms to detect abnormalities and recognize patterns.

[0175] Input: Health and preference information stored in a database

[0176] Specific behavior:

[0177] The server analyzes the elderly person's blood pressure data from the past week and detects abnormal values.

[0178] Output: Analysis results

[0179] Step 4:

[0180] Alert Generation

[0181] Based on the analysis results, the server generates an alert if an abnormality is detected.

[0182] Input: Analysis results

[0183] Specific behavior:

[0184] The server detects abnormalities in an elderly person's blood pressure and immediately generates an alert to caregivers.

[0185] Output: Generated alerts

[0186] Step 5:

[0187] notification

[0188] The server notifies the elderly person and their caregiver of the analysis results and any generated alerts.

[0189] Input: Analysis results, generated alerts

[0190] Specific behavior:

[0191] The server sends information to the terminal to notify the elderly person that it is time to take their medicine at 2 p.m.

[0192] The server sends an alert to the caregiver about the elderly person's abnormal blood pressure.

[0193] Output: Notifications and alerts sent

[0194] Step 6:

[0195] Conversation template generation

[0196] The server generates a conversation template based on the preference information of the elderly person.

[0197] Input: Elderly person's preference information

[0198] Specific behavior:

[0199] Based on the information that elderly people like summer festivals, the server generates a conversation template about summer festivals.

[0200] Output: Generated conversation template

[0201] Step 7:

[0202] Conversational features

[0203] The device then converses with the elderly person according to the generated conversation template. The content of this conversation is then sent back to the server and managed as a history.

[0204] Input: Generated conversation template

[0205] Specific behavior:

[0206] Elderly people enjoy conversations about summer festivals with their devices, and the content of their conversations is fed back to the server.

[0207] Output: Feedback of the dialogue

[0208] Step 8:

[0209] Enter information

[0210] Caregivers and seniors enter new health information and condition reports into the system.

[0211] Input: New health information, condition report

[0212] Specific behavior:

[0213] The caregiver enters new medical results into the system.

[0214] An elderly person reports to the device, "I feel good today."

[0215] Output: New health information and condition report entered

[0216] Step 9:

[0217] emergency notification

[0218] The server sends alerts to caregivers or professionals in the event of an emergency, urging them to take prompt action.

[0219] Input: Outlier detection results

[0220] Specific behavior:

[0221] Abnormal blood pressure in elderly people is detected and the server immediately sends an emergency alert to specialists.

[0222] Output: Emergency alert sent

[0223] (Application example 1)

[0224] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0225] In an aging society, the number of elderly people shopping in physical stores is increasing. However, these elderly people need to manage their health and often find shopping in unfamiliar stores inconvenient. Conventional care systems are designed for use at home and do not support elderly people in physical stores. Therefore, there is a need for a system that provides an environment where elderly people can shop safely and comfortably in physical stores, monitors their health status in real time, and provides the necessary support.

[0226] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0227] In this invention, the server includes a data management means for managing the elderly's health information and preference information, an AI algorithm means for analyzing the health information and preference information, a notification means for notifying the elderly and their caregiver based on the analysis results, a conversation means for engaging in a dialogue with the elderly according to a predetermined conversation template and feeding back the content of the dialogue as data, an alert means for sending an alert to the caregiver or specialist in an emergency, and a navigation means for monitoring the elderly's health condition in real time in a physical store, sending an alert to store staff when an abnormality is detected, providing product and promotion information based on the elderly's preference information, and providing in-store navigation functions. This makes it possible to provide a comfortable and efficient shopping experience by monitoring the elderly's health condition in real time even in a physical store and responding immediately to any abnormalities.

[0228] The "data management means" is a device or system for centrally collecting, storing, and managing health information and preference information of elderly people.

[0229] "AI algorithm means" refers to artificial intelligence technology that analyzes collected health and preference information to detect abnormalities and recognize patterns.

[0230] The "notification means" is a device or function for providing information to the elderly person and their caregiver based on the analyzed results.

[0231] The "conversation means" is a device or system that has the function of having a conversation with the elderly person according to a designated conversation template and feeding back the content of that conversation as data.

[0232] An "alert means" is a device or system that issues a warning or notification to the elder's caregiver or professional in the event of an emergency.

[0233] A "navigation means" is a device or system that has the function of providing merchandise and promotional information based on the preferences of elderly people in a physical store and guiding them within the store.

[0234] This invention is a system that provides an environment where elderly people can shop safely and comfortably in physical stores, monitors their health status in real time, and provides necessary support. This system mainly works in cooperation with three parties: a server, terminals (devices such as smart glasses and smartphones), and users (elderly people and store staff).

[0235] System configuration and basic operation

[0236] Server Roles

[0237] The server's main role is to centrally manage the health and preference information of the elderly and analyze the collected data. Specifically, it provides the following functions:

[0238] 1. Data Management Measures:

[0239] The server collects the elderly person's health information (heart rate, blood pressure, etc.) and preference information and stores it in a database. For example, the data is updated when caregivers or store staff input newly collected health information or a list of preferred products.

[0240] 2. AI algorithm means:

[0241] The server analyzes the collected data using AI technologies such as TensorFlow, and if an anomaly is detected, an alert is generated immediately and a notification is sent.

[0242] 3. Conversation template generation:

[0243] The server generates appropriate conversation templates based on the elderly person's preferences and sends them to the device, providing topics of interest to the elderly (e.g., "old summer festivals") and helping them enjoy shopping.

[0244] 4. Navigation methods:

[0245] The server provides in-store product information and promotion information and generates in-store navigation instructions to help seniors shop efficiently in physical stores.

[0246] Device Role

[0247] The device uses data and conversation templates provided by the server to engage in everyday conversations with the elderly, supporting health management and navigation within the store.

[0248] 1. Data Receipt and Notification:

[0249] The device receives notifications and alerts from the server and relays them appropriately to the elderly. The device also has the function of collecting the elderly's health data and sending it to the server. For example, the smart glasses use medical sensors to measure heart rate and blood pressure, and if any abnormalities are detected, they immediately notify store staff.

[0250] 2. Interactive navigation:

[0251] The device guides the elderly through the store based on their voice commands. For example, if an elderly person asks, "Where is the tea section?", the navigation function will guide them to the appropriate section.

[0252] 3. Conversational Relationships:

[0253] The device then converses with the elderly according to a conversation template from the server. The content of the conversation is then fed back to the server, enabling history management. For example, the elderly can have a conversation about "old summer festivals."

[0254] User Roles

[0255] The user (elderly person or store staff) responds to notifications and alerts from the system and enters the necessary information.

[0256] 1. Enter your information:

[0257] Store staff can input new health and preference information into the system, and seniors can also report their own physical condition on the terminal.

[0258] 2. Notification and Alert Response:

[0259] Users can check notifications and emergency alerts from the system and take appropriate action, such as providing prompt assistance to elderly people or contacting experts in the event of an emergency.

[0260] Examples and prompts

[0261] 1. Example:

[0262] An elderly person wears smart glasses and walks around a physical store. Their heart rate rises, and the server detects the abnormality. An alert is immediately sent to store staff. Meanwhile, the elderly person asks the smart glasses, "Where is the tea section?" and the navigation function provides directions to the section.

[0263] 2. Example prompt:

[0264] An elderly customer is wearing smart glasses and walking around the store. When their heart rate rises, an abnormality detection alert is sent to store staff. When the customer asks the smart glasses, "Where is the tea section?", the glasses navigate the way to the tea section.

[0265] In this way, the system of the present invention provides multifunctional support necessary for health management and a comfortable shopping experience for the elderly through collaboration between the server, terminal, and user.

[0266] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0267] Step 1:

[0268] An elderly person arrives at a physical store and puts on smart glasses. The smart glasses use sensors to measure the elderly person's heart rate and blood pressure in real time and send the data to a server. The input is the biometric data obtained from the smart glasses' sensors. The output is that this biometric data is sent to the server.

[0269] Step 2:

[0270] The server stores the received biometric data in a database and begins analysis using an AI algorithm. The AI ​​algorithm uses TensorFlow to perform analysis to detect abnormal values. The input is the biometric data sent from the smart glasses. The output is the analysis result, indicating whether or not an abnormality has been detected.

[0271] Step 3:

[0272] If the server detects an abnormality based on the analysis results, it immediately generates an alert and sends a notification to the store staff's tablet. The input is the analysis result of the AI ​​algorithm. The output is an alert notification to the store staff. For example, if the heart rate rises abnormally, the staff will be notified that "an elderly customer's heart rate is abnormally high."

[0273] Step 4:

[0274] Store staff check the alerts sent to them on the tablet and take the necessary action. For example, they may directly check on the elderly person's health status or contact a medical institution. The input is the alert notification sent from the server. The output is the staff's response action.

[0275] Step 5:

[0276] When searching for a product in a store, the elderly person asks a question to the smart glasses by voice. For example, "Where is the tea section?" This voice data is processed by the device and sent to the server. The input is the elderly person's voice command. The output is the voice data sent to the server.

[0277] Step 6:

[0278] The server analyzes the voice data and generates appropriate navigation instructions. Based on voice recognition technology and the elderly person's preference information, it identifies the appropriate sales area within the store. The input is the elderly person's voice instruction data. The output is navigation information.

[0279] Step 7:

[0280] The terminal provides navigation information provided by the server to the elderly visually or audibly. For example, a "guide arrow to the tea section" is displayed on the smart glasses display. The input is the navigation information. The output is the visual and audio instructions provided to the elderly.

[0281] Step 8:

[0282] When the elderly person follows the navigation and finds the product they are looking for, they report the information to the terminal. For example, they may report by voice, "I found tea." This report data is sent back to the server and stored in the database. The input is the elderly person's report data. The output is feedback data stored on the server.

[0283] In this way, the input data at each step is appropriately processed and output to the next step, allowing the entire process to be executed in a coordinated manner.

[0284] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0285] The present invention relates to a care system that utilizes AI in elderly care and combines it with an emotion engine to achieve more advanced health management and psychological support. The following describes in detail the embodiments of this system based on the claims.

[0286] System configuration and basic operation

[0287] This system works in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver), and uses an emotion engine to recognize the emotions of the elderly person and respond accordingly.

[0288] Server Roles

[0289] The server has a data management system that centrally manages health and preference information for elderly people. In addition, it performs the following functions using an emotion engine.

[0290] 1. Data Collection and Storage:

[0291] The server collects the elderly's physical condition data (heart rate, blood pressure, etc.) and preference information and stores them in a database. Emotion data is also stored in the same way.

[0292] Examples:

[0293] The caregiver enters Mr. A's new medication schedule and recent medical checkup results through a web interface, and the server stores the information in a database.

[0294] The server collects the emotional data of elderly person A and stores it in a database.

[0295] 2. Data Analysis:

[0296] The server analyzes the collected data using AI algorithms and an emotion engine, and generates alerts based on the analysis results if there are any anomalies or necessary actions.

[0297] Examples:

[0298] The server analyzes elderly person B's blood pressure data and generates an alert if it detects an abnormal value.

[0299] The server analyzes the emotional data of elderly person B, and if it detects a state of stress, it generates a conversation template to help him relax.

[0300] 3. Conversation template generation:

[0301] The server generates appropriate conversation templates based on the elderly person's preference information and emotional data, providing content that the elderly person will enjoy and conversations that suit their emotions at the time.

[0302] Examples:

[0303] The server recognizes from elderly person C's preference information that he likes "stories about old travels," and if the emotion engine indicates that his current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the device.

[0304] Device Role

[0305] The device uses data from the server and conversation templates to engage in daily conversations with the elderly, supporting their health management. It also recognizes and responds to the elderly's emotions through an emotion engine.

[0306] 1. Data Receipt and Notification:

[0307] The device receives notifications, alerts, and conversation templates from the server and communicates them appropriately to the elderly. It also uses an emotion engine to recognize the elderly's emotions.

[0308] Examples:

[0309] The device receives a notification from the server that it is time for elderly person D to take his / her medicine, and when it reaches 2 p.m., it issues a voice message saying, "Please take your medicine."

[0310] The device analyzes the facial expressions and voice of elderly person D and recognizes that he is tired.

[0311] 2. Conversational Relationships:

[0312] The device starts a conversation with the elderly person according to the conversation template received from the server, collects emotion data during the conversation, and transmits it to the server.

[0313] Examples:

[0314] The device asks elderly person E, "Tell me a story about your travels from the past," and sends the response and emotional data to the server.

[0315] User Roles

[0316] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs necessary information, and receives and responds to feedback from the emotion engine.

[0317] 1. Enter your information:

[0318] Caregivers enter new health information and medication schedules into the system, and seniors report their physical condition and emotions to the device.

[0319] Examples:

[0320] The caregiver enters the new health check results of elderly person F into the server's management screen.

[0321] Elderly person F reports to the device, "I'm tired today."

[0322] 2. Notification and Alert Response:

[0323] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, such as contacting experts.

[0324] Examples:

[0325] An abnormal blood pressure alert for elderly person G is sent to the device, and the caregiver contacts a specialist and arranges for emergency response.

[0326] The device recognizes that elderly person G is feeling lonely, and the caregiver responds by providing support to address the emotion.

[0327] summary

[0328] The system of the present invention is a multifunctional care system that, by combining an emotion engine, can provide more advanced health management and psychological support for the elderly. This system appropriately manages and analyzes the elderly's health information, preference information, and emotion data, reducing the burden on caregivers while providing an environment in which the elderly can live happily and safely.

[0329] The processing flow will be explained below.

[0330] Step 1:

[0331] The server stores the health and preference information of the elderly person received from the user (caregiver) in a database. Specifically, when the caregiver inputs Elderly Person A's new medication schedule or the results of a recent health checkup through the web interface, the information is sent to the server and stored in the database.

[0332] Step 2:

[0333] The device periodically receives health data from the server and collects health information as needed. For example, the device measures the blood pressure of elderly person B and sends the data to the server. The server stores the received data in a database.

[0334] Step 3:

[0335] The server analyzes the received health data using an AI algorithm and monitors for abnormalities. For example, if the server analyzes the blood pressure data of elderly person B and detects an abnormal value, it generates an alert and sends it to the caregiver's smartphone.

[0336] Step 4:

[0337] The server uses an emotion engine to generate conversation templates based on the elderly person's preference information and past conversation history. For example, if it recognizes from the preference information of elderly person C that he likes to talk about travel, and the emotion engine detects that he is in an "enjoyed" state, it will generate a conversation template on that topic.

[0338] Step 5:

[0339] The device starts a conversation with the elderly person based on the conversation template received from the server. Specifically, the device asks Elderly Person C, "Tell me about your recent trip." When the elderly person responds, the content is sent from the device to the server.

[0340] Step 6:

[0341] The device analyzes the voice and facial expressions of the elderly person and uses an emotion engine to recognize their emotions. For example, when elderly person D speaks to the device, the device recognizes the emotion "happy" from the tone of voice and facial expression, and sends that data to the server.

[0342] Step 7:

[0343] The server updates health and preference information based on the emotion data sent from the device. For example, if elderly person D is recognized as "happy," that information is added to the preference data and used to generate future conversation templates.

[0344] Step 8:

[0345] The device will then appropriately convey notifications and alerts received from the server to the elderly. For example, the device may notify Elderly Person E by voice, "It's 2 p.m. Please take your medicine," and confirm that Elderly Person E has taken their medicine.

[0346] Step 9:

[0347] The user (caregiver) receives emergency alerts from the system and takes appropriate action. For example, if a caregiver receives an alert on their smartphone about an abnormal blood pressure for elderly person F, they can contact a specialist and arrange for an emergency response.

[0348] Example 2

[0349] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0350] Health management and psychological support for the elderly require prompt and appropriate responses according to their individual conditions and emotions. However, conventional systems do not adequately collect and analyze vital signs and emotional data of the elderly, placing a heavy burden on caregivers and making it insufficient to provide an environment where the elderly can live safely. Furthermore, a system that can respond quickly in emergencies is also needed.

[0351] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0352] In this invention, the server includes a data management means for managing the elderly person's vital data and hobby information, an artificial intelligence algorithm means for analyzing the vital data and hobby information, a notification means for notifying the elderly person and their caregiver based on the analysis results, a conversation means for engaging in a dialogue with the elderly person according to a predetermined conversation template, collecting the elderly person's emotional data, and feeding back the content of the dialogue as data, an emotion recognition means for recognizing the elderly person's emotional data and instructing the caregiver or the elderly person on the necessary response, and an alert means for sending an alert to the caregiver or a specialist in the event of an emergency. This not only enables more advanced and rapid health management and psychological support for the elderly, but also reduces the burden on caregivers and provides an environment in which the elderly can live with peace of mind.

[0353] "Vital data" refers to biometric information such as an elderly person's heart rate, blood pressure, and body temperature.

[0354] "Hobby information" refers to activities that the elderly like or are interested in, especially information related to their daily lives and leisure time.

[0355] "Data management means" refers to systems and functions that collect vital data and hobby information of elderly people and store and manage them in a centralized manner.

[0356] "Artificial intelligence algorithm means" refers to AI technology that analyzes collected data and assesses the health and emotional state of the elderly.

[0357] "Notification means" refers to systems and functions that convey appropriate information and alerts to elderly people and caregivers based on analysis results.

[0358] "Conversation means" refers to a system or function that engages in a conversation with the elderly person according to a predetermined conversation template and provides feedback on the content of that conversation.

[0359] "Emotion recognition means" refers to a system or function that recognizes the emotional state of an elderly person using their facial expressions, voice, movements, etc., and takes necessary action based on that.

[0360] "Alert means" refers to a system or feature that warns or notifies a caregiver or professional in the event of an emergency.

[0361] The system according to the present invention provides health management and psychological support for the elderly by effectively managing and analyzing their health information and emotional data through collaboration between a server, a terminal, and a user (elderly person or caregiver). A specific embodiment of this system is shown below.

[0362] Server Roles

[0363] The server has a data management means for centrally managing vital data and hobby information of elderly people, and also utilizes an artificial intelligence algorithm means to perform the following functions:

[0364] 1. Data Collection and Storage:

[0365] The server receives the elderly person's vital data and hobby information from the terminal and stores them in a database. The elderly person's emotional data is also stored in the same way.

[0366] Examples:

[0367] Caregivers use a web interface to enter their senior's new medication schedule and medical checkup results, and the server stores the information in a database.

[0368] The server collects the elderly's emotional data and stores it in a database.

[0369] 2. Data Analysis:

[0370] The server analyzes the collected data using an artificial intelligence algorithm, and if an abnormality or necessary action is detected based on the analysis results, an alert is generated and linked to the notification system.

[0371] Examples:

[0372] The server analyzes the blood pressure data of elderly people and generates an alert if it detects abnormal values.

[0373] The server analyzes the elderly person's emotional data using an artificial intelligence algorithm, and if it detects a state of stress, it generates a conversation template to help them relax.

[0374] 3. Conversation template generation:

[0375] The server uses an emotion engine to generate appropriate conversation templates based on the elderly person's hobby information and emotional data, providing content that the elderly will enjoy and conversations that suit their emotions at the time.

[0376] Examples:

[0377] The server recognizes from the elderly person's hobby information that they like "old travel stories," and if the emotion engine indicates that their current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the terminal.

[0378] Device Role

[0379] The device receives notifications, alerts, and conversation templates from the server, interacts with the elderly on a daily basis, and supports their health management. It also recognizes the elderly's emotions through emotion recognition and responds accordingly.

[0380] 1. Data Receipt and Notification:

[0381] The device receives notifications, alerts, and conversation templates from the server and conveys them appropriately to the elderly. It also recognizes the elderly's emotions using emotion recognition means.

[0382] Examples:

[0383] The device receives notifications from the server about when it is time for the elderly person to take their medicine, and when the time comes at 2 p.m., it issues a voice message saying, "Please take your medicine."

[0384] The device analyzes the elderly person's facial expressions and voice and recognizes that they are tired.

[0385] 2. Conversational Relationships:

[0386] The device starts a conversation with the elderly person according to the conversation template received from the server, collects emotion data during the conversation, and transmits it to the server.

[0387] Examples:

[0388] The device asks the elderly person, "Tell me a story about your travels from the past," and sends the response and emotional data to the server.

[0389] User Roles

[0390] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs necessary information, and receives and responds to feedback from emotion recognition means.

[0391] 1. Enter your information:

[0392] Caregivers enter new health information and medication schedules into the system, and seniors report their physical and emotional state to the device.

[0393] Examples:

[0394] The caregiver enters the elderly person's new health check results into the server's management screen.

[0395] An elderly person reports to the device, "I'm tired today."

[0396] 2. Notification and Alert Response:

[0397] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, contacting experts or taking necessary measures.

[0398] Examples:

[0399] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[0400] The device recognizes when an elderly person is feeling lonely, and the caregiver responds by providing support.

[0401] In this system, data analysis by a generative AI model and an emotion engine work together to comprehensively manage the health and emotional state of the elderly, thereby reducing the burden on caregivers and providing an environment in which the elderly can live with peace of mind.

[0402] Example prompt sentence:

[0403] "An elderly person recently started taking new medication, and the elderly person's caregiver entered the elderly person's medication schedule and recent medical checkup results through a web interface. This information is stored on a server, and health data is collected. If an abnormality is discovered when this data is analyzed, how will the server respond?"

[0404] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0405] Step 1:

[0406] Information entry and collection

[0407] User Action:

[0408] The user (caregiver or elderly person) inputs the necessary health information and emotional state into a device or web interface. The caregiver inputs the elderly person's health check results and new medication schedule. The elderly person reports on their physical condition and emotions.

[0409] Specific behavior:

[0410] Caregivers enter new medication schedules and health checkup results for their elderly relatives through a web interface, and the data is sent to a server via a terminal.

[0411] The elderly person reports to the device by voice, "I'm tired today," and the report data is also sent to the server via the device.

[0412] Input: Health information and emotional information of elderly people

[0413] Output: Information entered into the terminal is sent to the server

[0414] Step 2:

[0415] Data transmission and storage

[0416] Terminal behavior:

[0417] The terminal sends the information entered by the user to the server, which stores the received data in a database.

[0418] Specific behavior:

[0419] The terminal transmits the medication schedule and health check results entered by the caregiver to the server.

[0420] The device sends the elderly person's emotional data to a server, which then stores the data in a database.

[0421] Input: Health information and emotional information entered into the device

[0422] Output: The received data is saved in the server database.

[0423] Step 3:

[0424] Data Analysis and Alert Generation

[0425] Server behavior:

[0426] The server analyzes the stored data using artificial intelligence algorithms, and generates an alert if an anomaly is detected based on the results of the data analysis.

[0427] Specific behavior:

[0428] The server analyzes the blood pressure data of elderly people, and if it detects abnormal values, it generates an alert and connects to a notification system.

[0429] The server uses an artificial intelligence algorithm to analyze the elderly person's emotional data, and if it detects a high stress state, it generates a conversation template to help them relax.

[0430] Input: Health information and emotional information stored in the database

[0431] Output: Alert when an anomaly is detected, conversation template based on the analysis results

[0432] Step 4:

[0433] Conversation template generation

[0434] Server behavior:

[0435] The server uses an emotion engine to generate appropriate conversation templates based on the elderly person's hobby information and emotion data, and the generated conversation templates are sent to the device.

[0436] Specific behavior:

[0437] The server recognizes from the elderly person's hobby information that they like "old travel stories," and if the emotion engine indicates that their current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the terminal.

[0438] Input: Elderly people's hobby information, emotion data

[0439] Output: Generated conversation template

[0440] Step 5:

[0441] Notifications and conversation initiation

[0442] Terminal behavior:

[0443] The device receives notifications and conversation templates from the server and conveys them to the elderly via voice and screen display. A conversation with the elderly begins, and the device records the content of the conversation.

[0444] Specific behavior:

[0445] The device receives a notification from the server that it is time for the elderly person to take their medicine, and when it reaches 2 p.m., it tells them in a voice message to "take your medicine."

[0446] Based on the conversation template received from the server, the device asks the elderly person, "Tell me a story about your travels from the past," and begins the conversation.

[0447] Input: Notifications from the server, conversation templates

[0448] Output: Notification to the elderly person and start of dialogue

[0449] Step 6:

[0450] Emotion Recognition and Feedback Collection

[0451] Terminal behavior:

[0452] The device analyzes the elderly person's facial expressions and voice to recognize their emotions, and sends the emotional data collected during the conversation to a server.

[0453] Specific behavior:

[0454] The device recognizes that an elderly person is tired based on their facial expressions and voice.

[0455] The device asks the elderly people to tell stories about their past travels and sends their responses and emotional data to the server.

[0456] Input: Emotional data of elderly people, dialogue content

[0457] Output: Emotion recognition results, data sent to server

[0458] Step 7:

[0459] Alert Response and Enforcement

[0460] User Action:

[0461] Users receive notifications and alerts from the system and take appropriate action, especially in emergencies, contacting experts or taking necessary measures.

[0462] Specific behavior:

[0463] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[0464] The device recognizes when an elderly person is feeling lonely, and the caregiver responds by providing support.

[0465] Input: Notifications and alerts from the system

[0466] Output: Caregiver and professional response

[0467] (Application example 2)

[0468] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0469] In recent years, the demand for nursing care has increased along with the rapid aging of the population. However, conventional nursing care systems have had difficulty in properly understanding the emotions and health status of elderly people in real time and providing support in an interactive format. In addition, there is a lack of specific support to ensure a safe shopping experience for elderly people in physical stores. In order for elderly people to live independently, they need to be able to maintain their health and gain mental security while receiving appropriate support while shopping in physical stores.

[0470] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0471] In this invention, the server includes a data management means for managing the elderly's health information and preference information, an AI algorithm means for analyzing the health information and preference information, a notification means for notifying the elderly and their caregivers based on the analysis results, a conversation means for having a conversation with the elderly according to a predetermined conversation template and feeding back the content of the conversation as data, an alert means for sending an alert to a caregiver or expert in an emergency, and a conversation support means for providing real-time support in a physical store based on the elderly's emotional and health information. This allows the elderly's emotional and health status to be monitored while shopping in a physical store, enabling appropriate support and safety to be ensured.

[0472] "Health information and preference information" refers to data indicating the physical health status of an elderly person (e.g., heart rate, blood pressure, body temperature, etc.) and information regarding personal preferences and hobbies.

[0473] "Data management means" refers to a system that has the function of centrally managing and storing the above health information and preference information.

[0474] "AI algorithm means" refers to artificial intelligence technology that analyzes collected health and preference information and assesses the condition of elderly people.

[0475] "Notification means" refers to a means for notifying the elderly person or their caregiver of important information or alerts based on the analyzed results.

[0476] The "conversation means" is a means having a function of having a conversation with an elderly person according to a predetermined conversation template and feeding back the content of the conversation as data.

[0477] An "alert means" is a means for alerting a caregiver or professional in the event of an emergency, to prompt a prompt response.

[0478] A "brick and mortar store" is a physical store such as a supermarket or pharmacy.

[0479] "Interactive support tools" are tools for providing real-time support based on the emotions and health information of seniors within physical stores.

[0480] The present invention relates to a care system that realizes health management and psychological support for elderly people. Hereinafter, embodiments of this system will be described in detail based on the claims.

[0481] System configuration and basic operation

[0482] This system works in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver), and uses an emotion engine to recognize the emotions of the elderly and respond accordingly.

[0483] Server Roles

[0484] The server performs the following functions:

[0485] 1. Data Management Measures:

[0486] The server has a database that centrally manages the elderly's health information and preference information. Health information includes heart rate, blood pressure, body temperature, etc., and preference information includes information on daily activities and hobbies.

[0487] 2. AI algorithm means:

[0488] The server uses AI algorithms to analyze the collected health and preference information. If abnormal values ​​or patterns are detected, an alert is generated to the appropriate experts. It also uses an emotion engine to recognize emotions such as stress and joy.

[0489] 3. Means of notification:

[0490] It is a means of notifying the elderly and their caregivers of important information based on the results of data analysis. For example, if the server detects an abnormal blood pressure value, it will send an alert to the caregiver.

[0491] 4. Conversation template generation:

[0492] The server generates appropriate conversation templates based on the elderly person's preferences and emotional data. For example, if an elderly person feels nostalgic, it provides a template about a past trip.

[0493] The server can use a cloud-based system, such as Amazon Web Services (AWS).

[0494] Device Role

[0495] The device receives data and conversation templates from the server, engages in daily conversations with the elderly, and provides real-time support based on the elderly's emotional and health information in physical stores.

[0496] 1. Data Receipt and Notification:

[0497] The device receives notifications, alerts, and conversation templates from the server and communicates them appropriately to the elderly. For example, if the device detects that the elderly is tired using smart glasses, it displays a message encouraging them to take a break.

[0498] 2. Conversational Relationships:

[0499] The device communicates with the elderly person according to the conversation template received from the server, and transmits emotional data collected during the conversation to the server.

[0500] The terminal can be a smart eyeglasses (e.g., Google Glass) or a smart frame device.

[0501] User Roles

[0502] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs the necessary information, and appropriately utilizes support at the physical store.

[0503] 1. Enter your information:

[0504] Caregivers enter new health information and medication schedules into the system, and seniors report feedback about their physical condition and emotions to the device.

[0505] 2. Notification and Alert Response:

[0506] Users receive notifications and emergency alerts from the system and take appropriate action, especially contacting experts in case of an emergency.

[0507] Specific examples

[0508] For example, while an elderly person is shopping in a brick-and-mortar store, smart glasses could notify them that their heart rate is elevated and they need to take a short break, or assist them when choosing a specific medication at a pharmacy by saying, "This medication may affect your blood pressure, so please check with your doctor."

[0509] Prompt Sentence Examples

[0510] Here are some example prompts to input to a generative AI model:

[0511] "We are considering a smart glasses application that provides real-time support to elderly people while they shop in physical stores, based on their health and emotional data. Please generate an appropriate conversation template based on the following environment settings and data."

[0512] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0513] Step 1:

[0514] The server collects the elderly person's health and preference information from the device and stores it in a database. In this step, the health data collected by the device, such as heart rate, blood pressure, and body temperature, as well as preference information about daily activities and hobbies, are sent to the server. The server then converts this data into a format that is easy to analyze and stores it.

[0515] Step 2:

[0516] The server then analyzes the stored health and preference information using an AI algorithm. In this step, the AI ​​algorithm analyzes the health data and detects outliers and trends. For example, if there is significant fluctuation in heart rate, an alert is generated. The server also analyzes the elderly person's preferences and emotional tendencies based on the preference information, and recognizes their emotions using an emotion engine.

[0517] Step 3:

[0518] The server generates notifications and alerts based on the analysis results. In this step, notifications are sent to caregivers and seniors upon detection of abnormal values ​​or specific emotional states. For example, if the server detects an abnormal blood pressure value, it will send an alert to the caregiver saying, "The senior's blood pressure is abnormal. Please check it immediately."

[0519] Step 4:

[0520] The server generates an appropriate conversation template based on the elderly person's preference information and emotional data. In this step, the generative AI model is used to create a conversation template that is appropriate for the elderly person's emotions and situation based on the prompt sentence. For example, for an elderly person who is feeling nostalgic, a conversation template that uses stories of old travels is generated.

[0521] Step 5:

[0522] The device receives notifications, alerts, and conversation templates from the server and conveys them appropriately to the elderly. In this step, the received information is provided to the elderly through audio and visual means via smart glasses or smart frame devices. For example, a notification message such as "Please take your medicine at 3 p.m." may be displayed. A conversation may also begin by asking, "Tell me about your travels."

[0523] Step 6:

[0524] The device converses with the elderly person, collecting emotional data during the conversation and feeding it back to the server. In this step, the voice and facial expression data provided by the elderly person is analyzed to recognize emotions. This data is then sent to the server for use in future analyses and conversation template generation. For example, if an elderly person says, "Today was fun," this is fed back to the server as the emotion of "joy."

[0525] Step 7:

[0526] The user responds to notifications and alerts from the system and inputs the necessary information. In this step, the caregiver enters new health information and medication schedules into the system. The elderly person also reports their physical condition and emotions to the terminal. For example, if the caregiver enters "The new medication time is 2 p.m.", the system manages and notifies the user of that information.

[0527] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0528] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0529] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0530] [Second embodiment]

[0531] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0532] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0533] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0534] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0535] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0536] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0537] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0538] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0539] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0540] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0541] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0542] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0543] The present invention relates to a care system that utilizes AI to reduce the burden on elderly people and their caregivers. The following describes in detail the embodiments of the system based on the claims.

[0544] System configuration and basic operation

[0545] This system operates in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver).

[0546] Server Roles

[0547] The server has a data management system that centrally manages the health and preference information of elderly people. Specifically, it performs the following functions:

[0548] 1. Data Collection and Storage:

[0549] The server collects the elderly person's physical condition data (heart rate, blood pressure, etc.) and preference information and stores it in a database. The user (caregiver) can input new health information and medication schedules.

[0550] Examples:

[0551] The caregiver enters Mr. A's new medication schedule and recent medical checkup results through a web interface, and the server stores the information in a database.

[0552] 2. Data Analysis:

[0553] The server analyzes the collected data using AI algorithms and generates an alert if an anomaly is detected based on the analysis results.

[0554] Examples:

[0555] The server analyzes elderly person A's recent blood pressure data in real time, and if it detects an abnormal value, it immediately sends an alert to the caregiver.

[0556] 3. Conversation template generation:

[0557] The server generates appropriate conversation templates based on the elderly person's preferences, thereby providing conversation content that the elderly person will find enjoyable.

[0558] Examples:

[0559] The server recognizes from elderly person B's preference information that he likes talking about summer festivals, generates a conversation template about summer festivals, and sends it to the terminal.

[0560] Device Role

[0561] The device uses data and conversation templates obtained from the server to engage in everyday conversations with the elderly and support their health management.

[0562] 1. Data Receipt and Notification:

[0563] The device receives notifications and alerts from the server and conveys them appropriately to the elderly. It also has the function of collecting the elderly's health data and sending it to the server.

[0564] Examples:

[0565] The device receives a notification from the server that it is time for elderly person C to take his / her medicine, and when it reaches 2 p.m., it issues a voice message saying, "Please take your medicine."

[0566] 2. Conversational Relationships:

[0567] The device then converses with the elderly person according to a conversation template sent from the server. The content of the conversation is then sent back to the server, allowing for history management.

[0568] Examples:

[0569] Elderly person D enjoys a conversation with the device about "old summer festivals," and the response data is fed back to the server.

[0570] User Roles

[0571] The user (caregiver or elderly person) responds to the system's notifications and alerts and enters the required information.

[0572] 1. Enter your information:

[0573] Caregivers enter new health information and medication schedules into the system, and seniors report their health status to a terminal.

[0574] Examples:

[0575] The caregiver enters the new health check results of elderly person E into the server's management screen.

[0576] Elderly person E reports to the device, "I feel good today."

[0577] 2. Notification and Alert Response:

[0578] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, such as contacting experts.

[0579] Examples:

[0580] An alert for elderly person F's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[0581] summary

[0582] The system of the present invention is a multifunctional care system that links a server, a terminal, and a user to manage the health of the elderly and improve their psychological satisfaction. This system appropriately manages and analyzes the elderly's health information and preference information, reducing the burden on caregivers while providing an environment in which the elderly can live safely and enjoyably.

[0583] The processing flow will be explained below.

[0584] Step 1:

[0585] The server stores the health and preference information of the elderly person received from the user (caregiver) in a database. For example, when a caregiver inputs a new medication schedule for elderly person A through the web interface, the information is sent to the server and stored.

[0586] Step 2:

[0587] The device periodically receives health data from the server and collects health information as needed. The device measures the blood pressure of elderly person B and sends the data to the server. The server analyzes the received data, and the health data is stored in a database on the server side.

[0588] Step 3:

[0589] The server analyzes the received health data using an AI algorithm to determine whether there are any abnormalities. For example, if the server analyzes the blood pressure data of elderly person B and detects an abnormal value, it generates an alert. The server then sends the alert to the caregiver's smartphone using a notification method.

[0590] Step 4:

[0591] The server generates a conversation template based on the analyzed health data. For example, it recognizes from elderly person C's preference information that he likes "old stories" and generates a conversation template related to that content. The generated template is then sent to the device.

[0592] Step 5:

[0593] The device starts a conversation with the elderly person according to the conversation template received from the server. Elderly person C is asked by the device, "Would you like to hear a story about a summer festival from long ago?" When Elderly person C responds "Yes," the response data is sent from the device to the server.

[0594] Step 6:

[0595] The device periodically notifies the elderly person based on notifications from the server. For example, the device may notify elderly person D by voice, "It's 2 p.m. Please take your medicine." Voice recognition confirms that elderly person D has taken their medicine, and the device then sends this information to the server.

[0596] Step 7:

[0597] The server analyzes the conversation content and health information sent from the device and updates the elderly person's preference information and health status. The preference information is updated based on the data of Elderly C's response, "I like summer festivals." The updated information is used to generate future conversation templates and for health management.

[0598] Step 8:

[0599] The user (caregiver) receives an emergency alert notification and takes the necessary action. For example, if a caregiver receives an alert on their smartphone about an abnormal blood pressure of elderly person E, the caregiver will contact a specialist and arrange for an emergency response.

[0600] Example 1

[0601] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0602] In an aging society, there is a need to reduce the burden on caregivers while maintaining the health and psychological satisfaction of the elderly. However, conventional nursing care systems lack centralized management of health information, making it difficult to detect abnormalities and respond to emergencies in real time. Furthermore, they lacked mechanisms for providing conversation content that the elderly can enjoy. These issues must be resolved.

[0603] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0604] In this invention, the server includes a data management unit for managing the elderly's health information and preference information; a collection and storage unit for collecting the health information and preference information and storing it in a database; an AI algorithm unit for analyzing the health information and preference information; an alert generation unit for detecting abnormalities and generating alerts based on the analysis results; a notification unit for notifying the elderly and their caregivers of the analysis results and alerts; a conversation unit for engaging in a dialogue with the elderly according to a conversation template generated based on the elderly's preference information and providing feedback on the content of the dialogue as data; a health status monitoring unit for periodically analyzing the elderly's health data in real time and generating an emergency alert if an abnormal value is detected; and an emergency notification unit for sending an alert to a caregiver or specialist in the event of an emergency. This allows for the real-time management and analysis of the elderly's health information and preference information, enabling immediate response when an abnormality occurs. Furthermore, providing conversation content that the elderly enjoys can increase their psychological satisfaction.

[0605] The "data management means" refers to a system and method for centrally managing health information and preference information of elderly people.

[0606] "Collection and storage means" refers to the function for collecting health information and preference information of the elderly and storing it in a database.

[0607] "AI algorithm means" refers to an algorithm that analyzes collected health and preference information to detect abnormalities and identify patterns.

[0608] The "alert generation means" is a function for generating an alert when an abnormality is detected based on the analysis results.

[0609] "Notification means" refers to a system and method for appropriately notifying elderly people and their caregivers of analysis results and alerts.

[0610] The "conversation means" is a function for having a conversation with the elderly person in accordance with a conversation template generated based on the elderly person's preference information, and feeding back the content of that conversation as data.

[0611] The "health status monitoring means" is a function that periodically analyzes the health data of elderly people in real time and generates emergency alerts if abnormal values ​​are detected.

[0612] "Emergency notification means" is a function that sends an alert to caregivers or experts in the event of an emergency, urging them to respond promptly.

[0613] MODE FOR CARRYING OUT THE INVENTION

[0614] The present invention is a system for managing health information and preference information of elderly people and providing care support using that information. This system operates in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver). Detailed embodiments of the system are described below.

[0615] Server Roles

[0616] The server implements the following methods:

[0617] 1. Data Management Measures:

[0618] The server centrally manages the health and preference information of the elderly, preventing loss or duplication of information and enabling efficient management.

[0619] 2. Collection and storage methods:

[0620] The server receives the elderly person's physical condition data (heart rate, blood pressure, etc.) sent from the terminal and health information entered by the caregiver via a web interface, and stores it in a database.

[0621] Examples:

[0622] Blood pressure data measured by the elderly person using a terminal is sent to a server.

[0623] Caregivers enter their senior's medication schedule through a web interface, and the information is stored in a database.

[0624] 3. AI algorithm means:

[0625] The server analyzes the collected health and preference information using AI algorithms, which allows it to detect abnormalities and recognize patterns.

[0626] 4. Alert generation method:

[0627] The server generates an alert when an abnormality is detected based on the analysis results. This alert is promptly communicated to the user via the notification means and emergency notification means described below.

[0628] 5. Means of notification:

[0629] The server has the function of notifying the elderly person and their caregiver of analysis results and alerts.

[0630] Examples:

[0631] When it is nearly time for the elderly person to take their medicine, the server sends a notification to the terminal and an audio notification is given.

[0632] 6. Means of communication:

[0633] The server then engages in a dialogue with the elderly person according to a conversation template generated based on the elderly person's preferences. The content of this dialogue is fed back as data and stored on the server.

[0634] 7. Health monitoring measures:

[0635] The server periodically analyzes the elderly person's health data in real time and generates emergency alerts if it detects abnormal values.

[0636] 8. Emergency notification means:

[0637] The server sends alerts to caregivers or professionals in the event of an emergency, facilitating a rapid response.

[0638] Device Role

[0639] The terminal implements the following functions:

[0640] 1. Data reception and notification function:

[0641] The device receives notifications and alerts from the server and conveys them appropriately to the elderly. It also collects the elderly's physical condition data and sends it to the server.

[0642] Examples:

[0643] At 2 p.m., the device will notify you with a voice message saying, "Please take your medicine."

[0644] 2. Conversational features:

[0645] The device converses with the elderly person according to a conversation template provided by the server, and the content of this conversation is sent to the server and managed as a history.

[0646] Examples:

[0647] The elderly person enjoys a conversation with the device about "old summer festivals," and the conversation data is sent to the server.

[0648] User (caregiver / elderly) role

[0649] The user performs the following operations through the system:

[0650] 1. Enter your information:

[0651] Caregivers enter new health information and medication schedules into the system, and seniors report their health status to a terminal.

[0652] Examples:

[0653] The caregiver enters the elderly person's new health check results into the server's management screen.

[0654] An elderly person reports to the device, "I feel good today."

[0655] 2. Notification and Alert Response:

[0656] Users receive notifications and emergency alerts from the system and take appropriate action.

[0657] Examples:

[0658] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[0659] Prompt Sentence Examples

[0660] "Generate conversation templates about summer festivals based on elderly people's preferences."

[0661] The above is a detailed description of the mode for carrying out the present invention.

[0662] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0663] Step 1:

[0664] Data collection

[0665] The server receives the elderly person's physical condition data (e.g., heart rate, blood pressure data) from the device, as well as health and preference information entered by the caregiver through a web interface.

[0666] Input: Elderly person's physical condition data, caregiver's input data

[0667] Specific behavior:

[0668] Elderly people measure their heart rate using a device and send the data to a server.

[0669] Caregivers enter new medication schedules for seniors through a web interface.

[0670] Output: Received health and preference information

[0671] Step 2:

[0672] Data storage

[0673] The server stores the collected health and preference information in a database.

[0674] Input: Received health and preference information

[0675] Specific behavior:

[0676] The server adds the elderly person's latest blood pressure data to the database.

[0677] The server registers the medication schedule entered by the caregiver in a database.

[0678] Output: Health and preference information stored in a database

[0679] Step 3:

[0680] Data analysis

[0681] The server analyzes the stored health and preference information using AI algorithms to detect abnormalities and recognize patterns.

[0682] Input: Health and preference information stored in a database

[0683] Specific behavior:

[0684] The server analyzes the elderly person's blood pressure data from the past week and detects abnormal values.

[0685] Output: Analysis results

[0686] Step 4:

[0687] Alert Generation

[0688] Based on the analysis results, the server generates an alert if an abnormality is detected.

[0689] Input: Analysis results

[0690] Specific behavior:

[0691] The server detects abnormalities in an elderly person's blood pressure and immediately generates an alert to caregivers.

[0692] Output: Generated alerts

[0693] Step 5:

[0694] notification

[0695] The server notifies the elderly person and their caregiver of the analysis results and any generated alerts.

[0696] Input: Analysis results, generated alerts

[0697] Specific behavior:

[0698] The server sends information to the terminal to notify the elderly person that it is time to take their medicine at 2 p.m.

[0699] The server sends an alert to the caregiver about the elderly person's abnormal blood pressure.

[0700] Output: Notifications and alerts sent

[0701] Step 6:

[0702] Conversation template generation

[0703] The server generates a conversation template based on the preference information of the elderly person.

[0704] Input: Elderly person's preference information

[0705] Specific behavior:

[0706] Based on the information that elderly people like summer festivals, the server generates a conversation template about summer festivals.

[0707] Output: Generated conversation template

[0708] Step 7:

[0709] Conversational features

[0710] The device then converses with the elderly person according to the generated conversation template. The content of this conversation is then sent back to the server and managed as a history.

[0711] Input: Generated conversation template

[0712] Specific behavior:

[0713] Elderly people enjoy conversations about summer festivals with their devices, and the content of their conversations is fed back to the server.

[0714] Output: Feedback of the dialogue

[0715] Step 8:

[0716] Enter information

[0717] Caregivers and seniors enter new health information and condition reports into the system.

[0718] Input: New health information, condition report

[0719] Specific behavior:

[0720] The caregiver enters new medical results into the system.

[0721] An elderly person reports to the device, "I feel good today."

[0722] Output: New health information and condition report entered

[0723] Step 9:

[0724] emergency notification

[0725] The server sends alerts to caregivers or professionals in the event of an emergency, urging them to take prompt action.

[0726] Input: Outlier detection results

[0727] Specific behavior:

[0728] Abnormal blood pressure in elderly people is detected and the server immediately sends an emergency alert to specialists.

[0729] Output: Emergency alert sent

[0730] (Application example 1)

[0731] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0732] In an aging society, the number of elderly people shopping in physical stores is increasing. However, these elderly people need to manage their health and often find shopping in unfamiliar stores inconvenient. Conventional care systems are designed for use at home and do not support elderly people in physical stores. Therefore, there is a need for a system that provides an environment where elderly people can shop safely and comfortably in physical stores, monitors their health status in real time, and provides the necessary support.

[0733] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0734] In this invention, the server includes a data management means for managing the elderly's health information and preference information, an AI algorithm means for analyzing the health information and preference information, a notification means for notifying the elderly and their caregiver based on the analysis results, a conversation means for engaging in a dialogue with the elderly according to a predetermined conversation template and feeding back the content of the dialogue as data, an alert means for sending an alert to the caregiver or specialist in an emergency, and a navigation means for monitoring the elderly's health condition in real time in a physical store, sending an alert to store staff when an abnormality is detected, providing product and promotion information based on the elderly's preference information, and providing in-store navigation functions. This makes it possible to provide a comfortable and efficient shopping experience by monitoring the elderly's health condition in real time even in a physical store and responding immediately to any abnormalities.

[0735] The "data management means" is a device or system for centrally collecting, storing, and managing health information and preference information of elderly people.

[0736] "AI algorithm means" refers to artificial intelligence technology that analyzes collected health and preference information to detect abnormalities and recognize patterns.

[0737] The "notification means" is a device or function for providing information to the elderly person and their caregiver based on the analyzed results.

[0738] The "conversation means" is a device or system that has the function of having a conversation with the elderly person according to a designated conversation template and feeding back the content of that conversation as data.

[0739] An "alert means" is a device or system that issues a warning or notification to the elder's caregiver or professional in the event of an emergency.

[0740] A "navigation means" is a device or system that has the function of providing merchandise and promotional information based on the preferences of elderly people in a physical store and guiding them within the store.

[0741] This invention is a system that provides an environment where elderly people can shop safely and comfortably in physical stores, monitors their health status in real time, and provides necessary support. This system mainly works in cooperation with three parties: a server, terminals (devices such as smart glasses and smartphones), and users (elderly people and store staff).

[0742] System configuration and basic operation

[0743] Server Roles

[0744] The server's main role is to centrally manage the health and preference information of the elderly and analyze the collected data. Specifically, it provides the following functions:

[0745] 1. Data Management Measures:

[0746] The server collects the elderly person's health information (heart rate, blood pressure, etc.) and preference information and stores it in a database. For example, the data is updated when caregivers or store staff input newly collected health information or a list of preferred products.

[0747] 2. AI algorithm means:

[0748] The server analyzes the collected data using AI technologies such as TensorFlow, and if an anomaly is detected, an alert is generated immediately and a notification is sent.

[0749] 3. Conversation template generation:

[0750] The server generates appropriate conversation templates based on the elderly person's preferences and sends them to the device, providing topics of interest to the elderly (e.g., "old summer festivals") and helping them enjoy shopping.

[0751] 4. Navigation methods:

[0752] The server provides in-store product information and promotion information and generates in-store navigation instructions to help seniors shop efficiently in physical stores.

[0753] Device Role

[0754] The device uses data and conversation templates provided by the server to engage in everyday conversations with the elderly, supporting health management and navigation within the store.

[0755] 1. Data Receipt and Notification:

[0756] The device receives notifications and alerts from the server and relays them appropriately to the elderly. The device also has the function of collecting the elderly's health data and sending it to the server. For example, the smart glasses use medical sensors to measure heart rate and blood pressure, and if any abnormalities are detected, they immediately notify store staff.

[0757] 2. Interactive navigation:

[0758] The device guides the elderly through the store based on their voice commands. For example, if an elderly person asks, "Where is the tea section?", the navigation function will guide them to the appropriate section.

[0759] 3. Conversational Relationships:

[0760] The device then converses with the elderly according to a conversation template from the server. The content of the conversation is then fed back to the server, enabling history management. For example, the elderly can have a conversation about "old summer festivals."

[0761] User Roles

[0762] The user (elderly person or store staff) responds to notifications and alerts from the system and enters the necessary information.

[0763] 1. Enter your information:

[0764] Store staff can input new health and preference information into the system, and seniors can also report their own physical condition on the terminal.

[0765] 2. Notification and Alert Response:

[0766] Users can check notifications and emergency alerts from the system and take appropriate action, such as providing prompt assistance to elderly people or contacting experts in the event of an emergency.

[0767] Examples and prompts

[0768] 1. Example:

[0769] An elderly person wears smart glasses and walks around a physical store. Their heart rate rises, and the server detects the abnormality. An alert is immediately sent to store staff. Meanwhile, the elderly person asks the smart glasses, "Where is the tea section?" and the navigation function provides directions to the section.

[0770] 2. Example prompt:

[0771] An elderly customer is wearing smart glasses and walking around the store. When their heart rate rises, an abnormality detection alert is sent to store staff. When the customer asks the smart glasses, "Where is the tea section?", the glasses navigate the way to the tea section.

[0772] In this way, the system of the present invention provides multifunctional support necessary for health management and a comfortable shopping experience for the elderly through collaboration between the server, terminal, and user.

[0773] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0774] Step 1:

[0775] An elderly person arrives at a physical store and puts on smart glasses. The smart glasses use sensors to measure the elderly person's heart rate and blood pressure in real time and send the data to a server. The input is the biometric data obtained from the smart glasses' sensors. The output is that this biometric data is sent to the server.

[0776] Step 2:

[0777] The server stores the received biometric data in a database and begins analysis using an AI algorithm. The AI ​​algorithm uses TensorFlow to perform analysis to detect abnormal values. The input is the biometric data sent from the smart glasses. The output is the analysis result, indicating whether or not an abnormality has been detected.

[0778] Step 3:

[0779] If the server detects an abnormality based on the analysis results, it immediately generates an alert and sends a notification to the store staff's tablet. The input is the analysis result of the AI ​​algorithm. The output is an alert notification to the store staff. For example, if the heart rate rises abnormally, the staff will be notified that "an elderly customer's heart rate is abnormally high."

[0780] Step 4:

[0781] Store staff check the alerts sent to them on the tablet and take the necessary action. For example, they may directly check on the elderly person's health status or contact a medical institution. The input is the alert notification sent from the server. The output is the staff's response action.

[0782] Step 5:

[0783] When searching for a product in a store, the elderly person asks a question to the smart glasses by voice. For example, "Where is the tea section?" This voice data is processed by the device and sent to the server. The input is the elderly person's voice command. The output is the voice data sent to the server.

[0784] Step 6:

[0785] The server analyzes the voice data and generates appropriate navigation instructions. Based on voice recognition technology and the elderly person's preference information, it identifies the appropriate sales area within the store. The input is the elderly person's voice instruction data. The output is navigation information.

[0786] Step 7:

[0787] The terminal provides navigation information provided by the server to the elderly visually or audibly. For example, a "guide arrow to the tea section" is displayed on the smart glasses display. The input is the navigation information. The output is the visual and audio instructions provided to the elderly.

[0788] Step 8:

[0789] When the elderly person follows the navigation and finds the product they are looking for, they report the information to the terminal. For example, they may report by voice, "I found tea." This report data is sent back to the server and stored in the database. The input is the elderly person's report data. The output is feedback data stored on the server.

[0790] In this way, the input data at each step is appropriately processed and output to the next step, allowing the entire process to be executed in a coordinated manner.

[0791] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0792] The present invention relates to a care system that utilizes AI in elderly care and combines it with an emotion engine to achieve more advanced health management and psychological support. The following describes in detail the embodiments of this system based on the claims.

[0793] System configuration and basic operation

[0794] This system works in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver), and uses an emotion engine to recognize the emotions of the elderly person and respond accordingly.

[0795] Server Roles

[0796] The server has a data management system that centrally manages health and preference information for elderly people. In addition, it performs the following functions using an emotion engine.

[0797] 1. Data Collection and Storage:

[0798] The server collects the elderly's physical condition data (heart rate, blood pressure, etc.) and preference information and stores them in a database. Emotion data is also stored in the same way.

[0799] Examples:

[0800] The caregiver enters Mr. A's new medication schedule and recent medical checkup results through a web interface, and the server stores the information in a database.

[0801] The server collects the emotional data of elderly person A and stores it in a database.

[0802] 2. Data Analysis:

[0803] The server analyzes the collected data using AI algorithms and an emotion engine, and generates alerts based on the analysis results if there are any anomalies or necessary actions.

[0804] Examples:

[0805] The server analyzes elderly person B's blood pressure data and generates an alert if it detects an abnormal value.

[0806] The server analyzes the emotional data of elderly person B, and if it detects a state of stress, it generates a conversation template to help him relax.

[0807] 3. Conversation template generation:

[0808] The server generates appropriate conversation templates based on the elderly person's preference information and emotional data, providing content that the elderly person will enjoy and conversations that suit their emotions at the time.

[0809] Examples:

[0810] The server recognizes from elderly person C's preference information that he likes "stories about old travels," and if the emotion engine indicates that his current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the device.

[0811] Device Role

[0812] The device uses data from the server and conversation templates to engage in daily conversations with the elderly, supporting their health management. It also recognizes and responds to the elderly's emotions through an emotion engine.

[0813] 1. Data Receipt and Notification:

[0814] The device receives notifications, alerts, and conversation templates from the server and communicates them appropriately to the elderly. It also uses an emotion engine to recognize the elderly's emotions.

[0815] Examples:

[0816] The device receives a notification from the server that it is time for elderly person D to take his / her medicine, and when it reaches 2 p.m., it issues a voice message saying, "Please take your medicine."

[0817] The device analyzes the facial expressions and voice of elderly person D and recognizes that he is tired.

[0818] 2. Conversational Relationships:

[0819] The device starts a conversation with the elderly person according to the conversation template received from the server, collects emotion data during the conversation, and transmits it to the server.

[0820] Examples:

[0821] The device asks elderly person E, "Tell me a story about your travels from the past," and sends the response and emotional data to the server.

[0822] User Roles

[0823] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs necessary information, and receives and responds to feedback from the emotion engine.

[0824] 1. Enter your information:

[0825] Caregivers enter new health information and medication schedules into the system, and seniors report their physical condition and emotions to the device.

[0826] Examples:

[0827] The caregiver enters the new health check results of elderly person F into the server's management screen.

[0828] Elderly person F reports to the device, "I'm tired today."

[0829] 2. Notification and Alert Response:

[0830] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, such as contacting experts.

[0831] Examples:

[0832] An abnormal blood pressure alert for elderly person G is sent to the device, and the caregiver contacts a specialist and arranges for emergency response.

[0833] The device recognizes that elderly person G is feeling lonely, and the caregiver responds by providing support to address the emotion.

[0834] summary

[0835] The system of the present invention is a multifunctional care system that, by combining an emotion engine, can provide more advanced health management and psychological support for the elderly. This system appropriately manages and analyzes the elderly's health information, preference information, and emotion data, reducing the burden on caregivers while providing an environment in which the elderly can live happily and safely.

[0836] The processing flow will be explained below.

[0837] Step 1:

[0838] The server stores the health and preference information of the elderly person received from the user (caregiver) in a database. Specifically, when the caregiver inputs Elderly Person A's new medication schedule or the results of a recent health checkup through the web interface, the information is sent to the server and stored in the database.

[0839] Step 2:

[0840] The device periodically receives health data from the server and collects health information as needed. For example, the device measures the blood pressure of elderly person B and sends the data to the server. The server stores the received data in a database.

[0841] Step 3:

[0842] The server analyzes the received health data using an AI algorithm and monitors for abnormalities. For example, if the server analyzes the blood pressure data of elderly person B and detects an abnormal value, it generates an alert and sends it to the caregiver's smartphone.

[0843] Step 4:

[0844] The server uses an emotion engine to generate conversation templates based on the elderly person's preference information and past conversation history. For example, if it recognizes from the preference information of elderly person C that he likes to talk about travel, and the emotion engine detects that he is in an "enjoyed" state, it will generate a conversation template on that topic.

[0845] Step 5:

[0846] The device starts a conversation with the elderly person based on the conversation template received from the server. Specifically, the device asks Elderly Person C, "Tell me about your recent trip." When the elderly person responds, the content is sent from the device to the server.

[0847] Step 6:

[0848] The device analyzes the voice and facial expressions of the elderly person and uses an emotion engine to recognize their emotions. For example, when elderly person D speaks to the device, the device recognizes the emotion "happy" from the tone of voice and facial expression, and sends that data to the server.

[0849] Step 7:

[0850] The server updates health and preference information based on the emotion data sent from the device. For example, if elderly person D is recognized as "happy," that information is added to the preference data and used to generate future conversation templates.

[0851] Step 8:

[0852] The device will then appropriately convey notifications and alerts received from the server to the elderly. For example, the device may notify Elderly Person E by voice, "It's 2 p.m. Please take your medicine," and confirm that Elderly Person E has taken their medicine.

[0853] Step 9:

[0854] The user (caregiver) receives emergency alerts from the system and takes appropriate action. For example, if a caregiver receives an alert on their smartphone about an abnormal blood pressure for elderly person F, they can contact a specialist and arrange for an emergency response.

[0855] Example 2

[0856] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0857] Health management and psychological support for the elderly require prompt and appropriate responses according to their individual conditions and emotions. However, conventional systems do not adequately collect and analyze vital signs and emotional data of the elderly, placing a heavy burden on caregivers and making it insufficient to provide an environment where the elderly can live safely. Furthermore, a system that can respond quickly in emergencies is also needed.

[0858] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0859] In this invention, the server includes a data management means for managing the elderly person's vital data and hobby information, an artificial intelligence algorithm means for analyzing the vital data and hobby information, a notification means for notifying the elderly person and their caregiver based on the analysis results, a conversation means for engaging in a dialogue with the elderly person according to a predetermined conversation template, collecting the elderly person's emotional data, and feeding back the content of the dialogue as data, an emotion recognition means for recognizing the elderly person's emotional data and instructing the caregiver or the elderly person on the necessary response, and an alert means for sending an alert to the caregiver or a specialist in the event of an emergency. This not only enables more advanced and rapid health management and psychological support for the elderly, but also reduces the burden on caregivers and provides an environment in which the elderly can live with peace of mind.

[0860] "Vital data" refers to biometric information such as an elderly person's heart rate, blood pressure, and body temperature.

[0861] "Hobby information" refers to activities that the elderly like or are interested in, especially information related to their daily lives and leisure time.

[0862] "Data management means" refers to systems and functions that collect vital data and hobby information of elderly people and store and manage them in a centralized manner.

[0863] "Artificial intelligence algorithm means" refers to AI technology that analyzes collected data and assesses the health and emotional state of the elderly.

[0864] "Notification means" refers to systems and functions that convey appropriate information and alerts to elderly people and caregivers based on analysis results.

[0865] "Conversation means" refers to a system or function that engages in a conversation with the elderly person according to a predetermined conversation template and provides feedback on the content of that conversation.

[0866] "Emotion recognition means" refers to a system or function that recognizes the emotional state of an elderly person using their facial expressions, voice, movements, etc., and takes necessary action based on that.

[0867] "Alert means" refers to a system or feature that warns or notifies a caregiver or professional in the event of an emergency.

[0868] The system according to the present invention provides health management and psychological support for the elderly by effectively managing and analyzing their health information and emotional data through collaboration between a server, a terminal, and a user (elderly person or caregiver). A specific embodiment of this system is shown below.

[0869] Server Roles

[0870] The server has a data management means for centrally managing vital data and hobby information of elderly people, and also utilizes an artificial intelligence algorithm means to perform the following functions:

[0871] 1. Data Collection and Storage:

[0872] The server receives the elderly person's vital data and hobby information from the terminal and stores them in a database. The elderly person's emotional data is also stored in the same way.

[0873] Examples:

[0874] Caregivers use a web interface to enter their senior's new medication schedule and medical checkup results, and the server stores the information in a database.

[0875] The server collects the elderly's emotional data and stores it in a database.

[0876] 2. Data Analysis:

[0877] The server analyzes the collected data using an artificial intelligence algorithm, and if an abnormality or necessary action is detected based on the analysis results, an alert is generated and linked to the notification system.

[0878] Examples:

[0879] The server analyzes the blood pressure data of elderly people and generates an alert if it detects abnormal values.

[0880] The server analyzes the elderly person's emotional data using an artificial intelligence algorithm, and if it detects a state of stress, it generates a conversation template to help them relax.

[0881] 3. Conversation template generation:

[0882] The server uses an emotion engine to generate appropriate conversation templates based on the elderly person's hobby information and emotional data, providing content that the elderly will enjoy and conversations that suit their emotions at the time.

[0883] Examples:

[0884] The server recognizes from the elderly person's hobby information that they like "old travel stories," and if the emotion engine indicates that their current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the terminal.

[0885] Device Role

[0886] The device receives notifications, alerts, and conversation templates from the server, interacts with the elderly on a daily basis, and supports their health management. It also recognizes the elderly's emotions through emotion recognition and responds accordingly.

[0887] 1. Data Receipt and Notification:

[0888] The device receives notifications, alerts, and conversation templates from the server and conveys them appropriately to the elderly. It also recognizes the elderly's emotions using emotion recognition means.

[0889] Examples:

[0890] The device receives notifications from the server about when it is time for the elderly person to take their medicine, and when the time comes at 2 p.m., it issues a voice message saying, "Please take your medicine."

[0891] The device analyzes the elderly person's facial expressions and voice and recognizes that they are tired.

[0892] 2. Conversational Relationships:

[0893] The device starts a conversation with the elderly person according to the conversation template received from the server, collects emotion data during the conversation, and transmits it to the server.

[0894] Examples:

[0895] The device asks the elderly person, "Tell me a story about your travels from the past," and sends the response and emotional data to the server.

[0896] User Roles

[0897] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs necessary information, and receives and responds to feedback from emotion recognition means.

[0898] 1. Enter your information:

[0899] Caregivers enter new health information and medication schedules into the system, and seniors report their physical and emotional state to the device.

[0900] Examples:

[0901] The caregiver enters the elderly person's new health check results into the server's management screen.

[0902] An elderly person reports to the device, "I'm tired today."

[0903] 2. Notification and Alert Response:

[0904] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, contacting experts or taking necessary measures.

[0905] Examples:

[0906] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[0907] The device recognizes when an elderly person is feeling lonely, and the caregiver responds by providing support.

[0908] In this system, data analysis by a generative AI model and an emotion engine work together to comprehensively manage the health and emotional state of the elderly, thereby reducing the burden on caregivers and providing an environment in which the elderly can live with peace of mind.

[0909] Example prompt sentence:

[0910] "An elderly person recently started taking new medication, and the elderly person's caregiver entered the elderly person's medication schedule and recent medical checkup results through a web interface. This information is stored on a server, and health data is collected. If an abnormality is discovered when this data is analyzed, how will the server respond?"

[0911] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0912] Step 1:

[0913] Information entry and collection

[0914] User Action:

[0915] The user (caregiver or elderly person) inputs the necessary health information and emotional state into a device or web interface. The caregiver inputs the elderly person's health check results and new medication schedule. The elderly person reports on their physical condition and emotions.

[0916] Specific behavior:

[0917] Caregivers enter new medication schedules and health checkup results for their elderly relatives through a web interface, and the data is sent to a server via a terminal.

[0918] The elderly person reports to the device by voice, "I'm tired today," and the report data is also sent to the server via the device.

[0919] Input: Health information and emotional information of elderly people

[0920] Output: Information entered into the terminal is sent to the server

[0921] Step 2:

[0922] Data transmission and storage

[0923] Terminal behavior:

[0924] The terminal sends the information entered by the user to the server, which stores the received data in a database.

[0925] Specific behavior:

[0926] The terminal transmits the medication schedule and health check results entered by the caregiver to the server.

[0927] The device sends the elderly person's emotional data to a server, which then stores the data in a database.

[0928] Input: Health information and emotional information entered into the device

[0929] Output: The received data is saved in the server database.

[0930] Step 3:

[0931] Data Analysis and Alert Generation

[0932] Server behavior:

[0933] The server analyzes the stored data using artificial intelligence algorithms, and generates an alert if an anomaly is detected based on the results of the data analysis.

[0934] Specific behavior:

[0935] The server analyzes the blood pressure data of elderly people, and if it detects abnormal values, it generates an alert and connects to a notification system.

[0936] The server uses an artificial intelligence algorithm to analyze the elderly person's emotional data, and if it detects a high stress state, it generates a conversation template to help them relax.

[0937] Input: Health information and emotional information stored in the database

[0938] Output: Alert when an anomaly is detected, conversation template based on the analysis results

[0939] Step 4:

[0940] Conversation template generation

[0941] Server behavior:

[0942] The server uses an emotion engine to generate appropriate conversation templates based on the elderly person's hobby information and emotion data, and the generated conversation templates are sent to the device.

[0943] Specific behavior:

[0944] The server recognizes from the elderly person's hobby information that they like "old travel stories," and if the emotion engine indicates that their current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the terminal.

[0945] Input: Elderly people's hobby information, emotion data

[0946] Output: Generated conversation template

[0947] Step 5:

[0948] Notifications and conversation initiation

[0949] Terminal behavior:

[0950] The device receives notifications and conversation templates from the server and conveys them to the elderly via voice and screen display. A conversation with the elderly begins, and the device records the content of the conversation.

[0951] Specific behavior:

[0952] The device receives a notification from the server that it is time for the elderly person to take their medicine, and when it reaches 2 p.m., it tells them in a voice message to "take your medicine."

[0953] Based on the conversation template received from the server, the device asks the elderly person, "Tell me a story about your travels from the past," and begins the conversation.

[0954] Input: Notifications from the server, conversation templates

[0955] Output: Notification to the elderly person and start of dialogue

[0956] Step 6:

[0957] Emotion Recognition and Feedback Collection

[0958] Terminal behavior:

[0959] The device analyzes the elderly person's facial expressions and voice to recognize their emotions, and sends the emotional data collected during the conversation to a server.

[0960] Specific behavior:

[0961] The device recognizes that an elderly person is tired based on their facial expressions and voice.

[0962] The device asks the elderly people to tell stories about their past travels and sends their responses and emotional data to the server.

[0963] Input: Emotional data of elderly people, dialogue content

[0964] Output: Emotion recognition results, data sent to server

[0965] Step 7:

[0966] Alert Response and Enforcement

[0967] User Action:

[0968] Users receive notifications and alerts from the system and take appropriate action, especially in emergencies, contacting experts or taking necessary measures.

[0969] Specific behavior:

[0970] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[0971] The device recognizes when an elderly person is feeling lonely, and the caregiver responds by providing support.

[0972] Input: Notifications and alerts from the system

[0973] Output: Caregiver and professional response

[0974] (Application example 2)

[0975] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0976] In recent years, the demand for nursing care has increased along with the rapid aging of the population. However, conventional nursing care systems have had difficulty in properly understanding the emotions and health status of elderly people in real time and providing support in an interactive format. In addition, there is a lack of specific support to ensure a safe shopping experience for elderly people in physical stores. In order for elderly people to live independently, they need to be able to maintain their health and gain mental security while receiving appropriate support while shopping in physical stores.

[0977] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0978] In this invention, the server includes a data management means for managing the elderly's health information and preference information, an AI algorithm means for analyzing the health information and preference information, a notification means for notifying the elderly and their caregivers based on the analysis results, a conversation means for having a conversation with the elderly according to a predetermined conversation template and feeding back the content of the conversation as data, an alert means for sending an alert to a caregiver or expert in an emergency, and a conversation support means for providing real-time support in a physical store based on the elderly's emotional and health information. This allows the elderly's emotional and health status to be monitored while shopping in a physical store, enabling appropriate support and safety to be ensured.

[0979] "Health information and preference information" refers to data indicating the physical health status of an elderly person (e.g., heart rate, blood pressure, body temperature, etc.) and information regarding personal preferences and hobbies.

[0980] "Data management means" refers to a system that has the function of centrally managing and storing the above health information and preference information.

[0981] "AI algorithm means" refers to artificial intelligence technology that analyzes collected health and preference information and assesses the condition of elderly people.

[0982] "Notification means" refers to a means for notifying the elderly person or their caregiver of important information or alerts based on the analyzed results.

[0983] The "conversation means" is a means having a function of having a conversation with an elderly person according to a predetermined conversation template and feeding back the content of the conversation as data.

[0984] An "alert means" is a means for alerting a caregiver or professional in the event of an emergency, to prompt a prompt response.

[0985] A "brick and mortar store" is a physical store such as a supermarket or pharmacy.

[0986] "Interactive support tools" are tools for providing real-time support based on the emotions and health information of seniors within physical stores.

[0987] The present invention relates to a care system that realizes health management and psychological support for elderly people. Hereinafter, embodiments of this system will be described in detail based on the claims.

[0988] System configuration and basic operation

[0989] This system works in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver), and uses an emotion engine to recognize the emotions of the elderly and respond accordingly.

[0990] Server Roles

[0991] The server performs the following functions:

[0992] 1. Data Management Measures:

[0993] The server has a database that centrally manages the elderly's health information and preference information. Health information includes heart rate, blood pressure, body temperature, etc., and preference information includes information on daily activities and hobbies.

[0994] 2. AI algorithm means:

[0995] The server uses AI algorithms to analyze the collected health and preference information. If abnormal values ​​or patterns are detected, an alert is generated to the appropriate experts. It also uses an emotion engine to recognize emotions such as stress and joy.

[0996] 3. Means of notification:

[0997] It is a means of notifying the elderly and their caregivers of important information based on the results of data analysis. For example, if the server detects an abnormal blood pressure value, it will send an alert to the caregiver.

[0998] 4. Conversation template generation:

[0999] The server generates appropriate conversation templates based on the elderly person's preferences and emotional data. For example, if an elderly person feels nostalgic, it provides a template about a past trip.

[1000] The server can use a cloud-based system, such as Amazon Web Services (AWS).

[1001] Device Role

[1002] The device receives data and conversation templates from the server, engages in daily conversations with the elderly, and provides real-time support based on the elderly's emotional and health information in physical stores.

[1003] 1. Data Receipt and Notification:

[1004] The device receives notifications, alerts, and conversation templates from the server and communicates them appropriately to the elderly. For example, if the device detects that the elderly is tired using smart glasses, it displays a message encouraging them to take a break.

[1005] 2. Conversational Relationships:

[1006] The device communicates with the elderly person according to the conversation template received from the server, and transmits emotional data collected during the conversation to the server.

[1007] The terminal can be a smart eyeglasses (e.g., Google Glass) or a smart frame device.

[1008] User Roles

[1009] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs the necessary information, and appropriately utilizes support at the physical store.

[1010] 1. Enter your information:

[1011] Caregivers enter new health information and medication schedules into the system, and seniors report feedback about their physical condition and emotions to the device.

[1012] 2. Notification and Alert Response:

[1013] Users receive notifications and emergency alerts from the system and take appropriate action, especially contacting experts in case of an emergency.

[1014] Specific examples

[1015] For example, while an elderly person is shopping in a brick-and-mortar store, smart glasses could notify them that their heart rate is elevated and they need to take a short break, or assist them when choosing a specific medication at a pharmacy by saying, "This medication may affect your blood pressure, so please check with your doctor."

[1016] Prompt Sentence Examples

[1017] Here are some example prompts to input to a generative AI model:

[1018] "We are considering a smart glasses application that provides real-time support to elderly people while they shop in physical stores, based on their health and emotional data. Please generate an appropriate conversation template based on the following environment settings and data."

[1019] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1020] Step 1:

[1021] The server collects the elderly person's health and preference information from the device and stores it in a database. In this step, the health data collected by the device, such as heart rate, blood pressure, and body temperature, as well as preference information about daily activities and hobbies, are sent to the server. The server then converts this data into a format that is easy to analyze and stores it.

[1022] Step 2:

[1023] The server then analyzes the stored health and preference information using an AI algorithm. In this step, the AI ​​algorithm analyzes the health data and detects outliers and trends. For example, if there is significant fluctuation in heart rate, an alert is generated. The server also analyzes the elderly person's preferences and emotional tendencies based on the preference information, and recognizes their emotions using an emotion engine.

[1024] Step 3:

[1025] The server generates notifications and alerts based on the analysis results. In this step, notifications are sent to caregivers and seniors upon detection of abnormal values ​​or specific emotional states. For example, if the server detects an abnormal blood pressure value, it will send an alert to the caregiver saying, "The senior's blood pressure is abnormal. Please check it immediately."

[1026] Step 4:

[1027] The server generates an appropriate conversation template based on the elderly person's preference information and emotional data. In this step, the generative AI model is used to create a conversation template that is appropriate for the elderly person's emotions and situation based on the prompt sentence. For example, for an elderly person who is feeling nostalgic, a conversation template that uses stories of old travels is generated.

[1028] Step 5:

[1029] The device receives notifications, alerts, and conversation templates from the server and conveys them appropriately to the elderly. In this step, the received information is provided to the elderly through audio and visual means via smart glasses or smart frame devices. For example, a notification message such as "Please take your medicine at 3 p.m." may be displayed. A conversation may also begin by asking, "Tell me about your travels."

[1030] Step 6:

[1031] The device converses with the elderly person, collecting emotional data during the conversation and feeding it back to the server. In this step, the voice and facial expression data provided by the elderly person is analyzed to recognize emotions. This data is then sent to the server for use in future analyses and conversation template generation. For example, if an elderly person says, "Today was fun," this is fed back to the server as the emotion of "joy."

[1032] Step 7:

[1033] The user responds to notifications and alerts from the system and inputs the necessary information. In this step, the caregiver enters new health information and medication schedules into the system. The elderly person also reports their physical condition and emotions to the terminal. For example, if the caregiver enters "The new medication time is 2 p.m.", the system manages and notifies the user of that information.

[1034] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1035] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1036] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1037] [Third embodiment]

[1038] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1039] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1040] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1041] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1042] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1043] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1044] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1045] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1046] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1047] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1048] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1049] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1050] The present invention relates to a care system that utilizes AI to reduce the burden on elderly people and their caregivers. The following describes in detail the embodiments of the system based on the claims.

[1051] System configuration and basic operation

[1052] This system operates in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver).

[1053] Server Roles

[1054] The server has a data management system that centrally manages the health and preference information of elderly people. Specifically, it performs the following functions:

[1055] 1. Data Collection and Storage:

[1056] The server collects the elderly person's physical condition data (heart rate, blood pressure, etc.) and preference information and stores it in a database. The user (caregiver) can input new health information and medication schedules.

[1057] Examples:

[1058] The caregiver enters Mr. A's new medication schedule and recent medical checkup results through a web interface, and the server stores the information in a database.

[1059] 2. Data Analysis:

[1060] The server analyzes the collected data using AI algorithms and generates an alert if an anomaly is detected based on the analysis results.

[1061] Examples:

[1062] The server analyzes elderly person A's recent blood pressure data in real time, and if it detects an abnormal value, it immediately sends an alert to the caregiver.

[1063] 3. Conversation template generation:

[1064] The server generates appropriate conversation templates based on the elderly person's preferences, thereby providing conversation content that the elderly person will find enjoyable.

[1065] Examples:

[1066] The server recognizes from elderly person B's preference information that he likes talking about summer festivals, generates a conversation template about summer festivals, and sends it to the terminal.

[1067] Device Role

[1068] The device uses data and conversation templates obtained from the server to engage in everyday conversations with the elderly and support their health management.

[1069] 1. Data Receipt and Notification:

[1070] The device receives notifications and alerts from the server and conveys them appropriately to the elderly. It also has the function of collecting the elderly's health data and sending it to the server.

[1071] Examples:

[1072] The device receives a notification from the server that it is time for elderly person C to take his / her medicine, and when it reaches 2 p.m., it issues a voice message saying, "Please take your medicine."

[1073] 2. Conversational Relationships:

[1074] The device then converses with the elderly person according to a conversation template sent from the server. The content of the conversation is then sent back to the server, allowing for history management.

[1075] Examples:

[1076] Elderly person D enjoys a conversation with the device about "old summer festivals," and the response data is fed back to the server.

[1077] User Roles

[1078] The user (caregiver or elderly person) responds to the system's notifications and alerts and enters the required information.

[1079] 1. Enter your information:

[1080] Caregivers enter new health information and medication schedules into the system, and seniors report their health status to a terminal.

[1081] Examples:

[1082] The caregiver enters the new health check results of elderly person E into the server's management screen.

[1083] Elderly person E reports to the device, "I feel good today."

[1084] 2. Notification and Alert Response:

[1085] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, such as contacting experts.

[1086] Examples:

[1087] An alert for elderly person F's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[1088] summary

[1089] The system of the present invention is a multifunctional care system that links a server, a terminal, and a user to manage the health of the elderly and improve their psychological satisfaction. This system appropriately manages and analyzes the elderly's health information and preference information, reducing the burden on caregivers while providing an environment in which the elderly can live safely and enjoyably.

[1090] The processing flow will be explained below.

[1091] Step 1:

[1092] The server stores the health and preference information of the elderly person received from the user (caregiver) in a database. For example, when a caregiver inputs a new medication schedule for elderly person A through the web interface, the information is sent to the server and stored.

[1093] Step 2:

[1094] The device periodically receives health data from the server and collects health information as needed. The device measures the blood pressure of elderly person B and sends the data to the server. The server analyzes the received data, and the health data is stored in a database on the server side.

[1095] Step 3:

[1096] The server analyzes the received health data using an AI algorithm to determine whether there are any abnormalities. For example, if the server analyzes the blood pressure data of elderly person B and detects an abnormal value, it generates an alert. The server then sends the alert to the caregiver's smartphone using a notification method.

[1097] Step 4:

[1098] The server generates a conversation template based on the analyzed health data. For example, it recognizes from elderly person C's preference information that he likes "old stories" and generates a conversation template related to that content. The generated template is then sent to the device.

[1099] Step 5:

[1100] The device starts a conversation with the elderly person according to the conversation template received from the server. Elderly person C is asked by the device, "Would you like to hear a story about a summer festival from long ago?" When Elderly person C responds "Yes," the response data is sent from the device to the server.

[1101] Step 6:

[1102] The device periodically notifies the elderly person based on notifications from the server. For example, the device may notify elderly person D by voice, "It's 2 p.m. Please take your medicine." Voice recognition confirms that elderly person D has taken their medicine, and the device then sends this information to the server.

[1103] Step 7:

[1104] The server analyzes the conversation content and health information sent from the device and updates the elderly person's preference information and health status. The preference information is updated based on the data of Elderly C's response, "I like summer festivals." The updated information is used to generate future conversation templates and for health management.

[1105] Step 8:

[1106] The user (caregiver) receives an emergency alert notification and takes the necessary action. For example, if a caregiver receives an alert on their smartphone about an abnormal blood pressure of elderly person E, the caregiver will contact a specialist and arrange for an emergency response.

[1107] Example 1

[1108] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1109] In an aging society, there is a need to reduce the burden on caregivers while maintaining the health and psychological satisfaction of the elderly. However, conventional nursing care systems lack centralized management of health information, making it difficult to detect abnormalities and respond to emergencies in real time. Furthermore, they lacked mechanisms for providing conversation content that the elderly can enjoy. These issues must be resolved.

[1110] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1111] In this invention, the server includes a data management unit for managing the elderly's health information and preference information; a collection and storage unit for collecting the health information and preference information and storing it in a database; an AI algorithm unit for analyzing the health information and preference information; an alert generation unit for detecting abnormalities and generating alerts based on the analysis results; a notification unit for notifying the elderly and their caregivers of the analysis results and alerts; a conversation unit for engaging in a dialogue with the elderly according to a conversation template generated based on the elderly's preference information and providing feedback on the content of the dialogue as data; a health status monitoring unit for periodically analyzing the elderly's health data in real time and generating an emergency alert if an abnormal value is detected; and an emergency notification unit for sending an alert to a caregiver or specialist in the event of an emergency. This allows for the real-time management and analysis of the elderly's health information and preference information, enabling immediate response when an abnormality occurs. Furthermore, providing conversation content that the elderly enjoys can increase their psychological satisfaction.

[1112] The "data management means" refers to a system and method for centrally managing health information and preference information of elderly people.

[1113] "Collection and storage means" refers to the function for collecting health information and preference information of the elderly and storing it in a database.

[1114] "AI algorithm means" refers to an algorithm that analyzes collected health and preference information to detect abnormalities and identify patterns.

[1115] The "alert generation means" is a function for generating an alert when an abnormality is detected based on the analysis results.

[1116] "Notification means" refers to a system and method for appropriately notifying elderly people and their caregivers of analysis results and alerts.

[1117] The "conversation means" is a function for having a conversation with the elderly person in accordance with a conversation template generated based on the elderly person's preference information, and feeding back the content of that conversation as data.

[1118] The "health status monitoring means" is a function that periodically analyzes the health data of elderly people in real time and generates emergency alerts if abnormal values ​​are detected.

[1119] "Emergency notification means" is a function that sends an alert to caregivers or experts in the event of an emergency, urging them to respond promptly.

[1120] MODE FOR CARRYING OUT THE INVENTION

[1121] The present invention is a system for managing health information and preference information of elderly people and providing care support using that information. This system operates in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver). Detailed embodiments of the system are described below.

[1122] Server Roles

[1123] The server implements the following methods:

[1124] 1. Data Management Measures:

[1125] The server centrally manages the health and preference information of the elderly, preventing loss or duplication of information and enabling efficient management.

[1126] 2. Collection and storage methods:

[1127] The server receives the elderly person's physical condition data (heart rate, blood pressure, etc.) sent from the terminal and health information entered by the caregiver via a web interface, and stores it in a database.

[1128] Examples:

[1129] Blood pressure data measured by the elderly person using a terminal is sent to a server.

[1130] Caregivers enter their senior's medication schedule through a web interface, and the information is stored in a database.

[1131] 3. AI algorithm means:

[1132] The server analyzes the collected health and preference information using AI algorithms, which allows it to detect abnormalities and recognize patterns.

[1133] 4. Alert generation method:

[1134] The server generates an alert when an abnormality is detected based on the analysis results. This alert is promptly communicated to the user via the notification means and emergency notification means described below.

[1135] 5. Means of notification:

[1136] The server has the function of notifying the elderly person and their caregiver of analysis results and alerts.

[1137] Examples:

[1138] When it is nearly time for the elderly person to take their medicine, the server sends a notification to the terminal and an audio notification is given.

[1139] 6. Means of communication:

[1140] The server then engages in a dialogue with the elderly person according to a conversation template generated based on the elderly person's preferences. The content of this dialogue is fed back as data and stored on the server.

[1141] 7. Health monitoring measures:

[1142] The server periodically analyzes the elderly person's health data in real time and generates emergency alerts if it detects abnormal values.

[1143] 8. Emergency notification means:

[1144] The server sends alerts to caregivers or professionals in the event of an emergency, facilitating a rapid response.

[1145] Device Role

[1146] The terminal implements the following functions:

[1147] 1. Data reception and notification function:

[1148] The device receives notifications and alerts from the server and conveys them appropriately to the elderly. It also collects the elderly's physical condition data and sends it to the server.

[1149] Examples:

[1150] At 2 p.m., the device will notify you with a voice message saying, "Please take your medicine."

[1151] 2. Conversational features:

[1152] The device converses with the elderly person according to a conversation template provided by the server, and the content of this conversation is sent to the server and managed as a history.

[1153] Examples:

[1154] The elderly person enjoys a conversation with the device about "old summer festivals," and the conversation data is sent to the server.

[1155] User (caregiver / elderly) role

[1156] The user performs the following operations through the system:

[1157] 1. Enter your information:

[1158] Caregivers enter new health information and medication schedules into the system, and seniors report their health status to a terminal.

[1159] Examples:

[1160] The caregiver enters the elderly person's new health check results into the server's management screen.

[1161] An elderly person reports to the device, "I feel good today."

[1162] 2. Notification and Alert Response:

[1163] Users receive notifications and emergency alerts from the system and take appropriate action.

[1164] Examples:

[1165] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[1166] Prompt Sentence Examples

[1167] "Generate conversation templates about summer festivals based on elderly people's preferences."

[1168] The above is a detailed description of the mode for carrying out the present invention.

[1169] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1170] Step 1:

[1171] Data collection

[1172] The server receives the elderly person's physical condition data (e.g., heart rate, blood pressure data) from the device, as well as health and preference information entered by the caregiver through a web interface.

[1173] Input: Elderly person's physical condition data, caregiver's input data

[1174] Specific behavior:

[1175] Elderly people measure their heart rate using a device and send the data to a server.

[1176] Caregivers enter new medication schedules for seniors through a web interface.

[1177] Output: Received health and preference information

[1178] Step 2:

[1179] Data storage

[1180] The server stores the collected health and preference information in a database.

[1181] Input: Received health and preference information

[1182] Specific behavior:

[1183] The server adds the elderly person's latest blood pressure data to the database.

[1184] The server registers the medication schedule entered by the caregiver in a database.

[1185] Output: Health and preference information stored in a database

[1186] Step 3:

[1187] Data analysis

[1188] The server analyzes the stored health and preference information using AI algorithms to detect abnormalities and recognize patterns.

[1189] Input: Health and preference information stored in a database

[1190] Specific behavior:

[1191] The server analyzes the elderly person's blood pressure data from the past week and detects abnormal values.

[1192] Output: Analysis results

[1193] Step 4:

[1194] Alert Generation

[1195] Based on the analysis results, the server generates an alert if an abnormality is detected.

[1196] Input: Analysis results

[1197] Specific behavior:

[1198] The server detects abnormalities in an elderly person's blood pressure and immediately generates an alert to caregivers.

[1199] Output: Generated alerts

[1200] Step 5:

[1201] notification

[1202] The server notifies the elderly person and their caregiver of the analysis results and any generated alerts.

[1203] Input: Analysis results, generated alerts

[1204] Specific behavior:

[1205] The server sends information to the terminal to notify the elderly person that it is time to take their medicine at 2 p.m.

[1206] The server sends an alert to the caregiver about the elderly person's abnormal blood pressure.

[1207] Output: Notifications and alerts sent

[1208] Step 6:

[1209] Conversation template generation

[1210] The server generates a conversation template based on the preference information of the elderly person.

[1211] Input: Elderly person's preference information

[1212] Specific behavior:

[1213] Based on the information that elderly people like summer festivals, the server generates a conversation template about summer festivals.

[1214] Output: Generated conversation template

[1215] Step 7:

[1216] Conversational features

[1217] The device then converses with the elderly person according to the generated conversation template. The content of this conversation is then sent back to the server and managed as a history.

[1218] Input: Generated conversation template

[1219] Specific behavior:

[1220] Elderly people enjoy conversations about summer festivals with their devices, and the content of their conversations is fed back to the server.

[1221] Output: Feedback of the dialogue

[1222] Step 8:

[1223] Enter information

[1224] Caregivers and seniors enter new health information and condition reports into the system.

[1225] Input: New health information, condition report

[1226] Specific behavior:

[1227] The caregiver enters new medical results into the system.

[1228] An elderly person reports to the device, "I feel good today."

[1229] Output: New health information and condition report entered

[1230] Step 9:

[1231] emergency notification

[1232] The server sends alerts to caregivers or professionals in the event of an emergency, urging them to take prompt action.

[1233] Input: Outlier detection results

[1234] Specific behavior:

[1235] Abnormal blood pressure in elderly people is detected and the server immediately sends an emergency alert to specialists.

[1236] Output: Emergency alert sent

[1237] (Application example 1)

[1238] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1239] In an aging society, the number of elderly people shopping in physical stores is increasing. However, these elderly people need to manage their health and often find shopping in unfamiliar stores inconvenient. Conventional care systems are designed for use at home and do not support elderly people in physical stores. Therefore, there is a need for a system that provides an environment where elderly people can shop safely and comfortably in physical stores, monitors their health status in real time, and provides the necessary support.

[1240] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1241] In this invention, the server includes a data management means for managing the elderly's health information and preference information, an AI algorithm means for analyzing the health information and preference information, a notification means for notifying the elderly and their caregiver based on the analysis results, a conversation means for engaging in a dialogue with the elderly according to a predetermined conversation template and feeding back the content of the dialogue as data, an alert means for sending an alert to the caregiver or specialist in an emergency, and a navigation means for monitoring the elderly's health condition in real time in a physical store, sending an alert to store staff when an abnormality is detected, providing product and promotion information based on the elderly's preference information, and providing in-store navigation functions. This makes it possible to provide a comfortable and efficient shopping experience by monitoring the elderly's health condition in real time even in a physical store and responding immediately to any abnormalities.

[1242] The "data management means" is a device or system for centrally collecting, storing, and managing health information and preference information of elderly people.

[1243] "AI algorithm means" refers to artificial intelligence technology that analyzes collected health and preference information to detect abnormalities and recognize patterns.

[1244] The "notification means" is a device or function for providing information to the elderly person and their caregiver based on the analyzed results.

[1245] The "conversation means" is a device or system that has the function of having a conversation with the elderly person according to a designated conversation template and feeding back the content of that conversation as data.

[1246] An "alert means" is a device or system that issues a warning or notification to the elder's caregiver or professional in the event of an emergency.

[1247] A "navigation means" is a device or system that has the function of providing merchandise and promotional information based on the preferences of elderly people in a physical store and guiding them within the store.

[1248] This invention is a system that provides an environment where elderly people can shop safely and comfortably in physical stores, monitors their health status in real time, and provides necessary support. This system mainly works in cooperation with three parties: a server, terminals (devices such as smart glasses and smartphones), and users (elderly people and store staff).

[1249] System configuration and basic operation

[1250] Server Roles

[1251] The server's main role is to centrally manage the health and preference information of the elderly and analyze the collected data. Specifically, it provides the following functions:

[1252] 1. Data Management Measures:

[1253] The server collects the elderly person's health information (heart rate, blood pressure, etc.) and preference information and stores it in a database. For example, the data is updated when caregivers or store staff input newly collected health information or a list of preferred products.

[1254] 2. AI algorithm means:

[1255] The server analyzes the collected data using AI technologies such as TensorFlow, and if an anomaly is detected, an alert is generated immediately and a notification is sent.

[1256] 3. Conversation template generation:

[1257] The server generates appropriate conversation templates based on the elderly person's preferences and sends them to the device, providing topics of interest to the elderly (e.g., "old summer festivals") and helping them enjoy shopping.

[1258] 4. Navigation methods:

[1259] The server provides in-store product information and promotion information and generates in-store navigation instructions to help seniors shop efficiently in physical stores.

[1260] Device Role

[1261] The device uses data and conversation templates provided by the server to engage in everyday conversations with the elderly, supporting health management and navigation within the store.

[1262] 1. Data Receipt and Notification:

[1263] The device receives notifications and alerts from the server and relays them appropriately to the elderly. The device also has the function of collecting the elderly's health data and sending it to the server. For example, the smart glasses use medical sensors to measure heart rate and blood pressure, and if any abnormalities are detected, they immediately notify store staff.

[1264] 2. Interactive navigation:

[1265] The device guides the elderly through the store based on their voice commands. For example, if an elderly person asks, "Where is the tea section?", the navigation function will guide them to the appropriate section.

[1266] 3. Conversational Relationships:

[1267] The device then converses with the elderly according to a conversation template from the server. The content of the conversation is then fed back to the server, enabling history management. For example, the elderly can have a conversation about "old summer festivals."

[1268] User Roles

[1269] The user (elderly person or store staff) responds to notifications and alerts from the system and enters the necessary information.

[1270] 1. Enter your information:

[1271] Store staff can input new health and preference information into the system, and seniors can also report their own physical condition on the terminal.

[1272] 2. Notification and Alert Response:

[1273] Users can check notifications and emergency alerts from the system and take appropriate action, such as providing prompt assistance to elderly people or contacting experts in the event of an emergency.

[1274] Examples and prompts

[1275] 1. Example:

[1276] An elderly person wears smart glasses and walks around a physical store. Their heart rate rises, and the server detects the abnormality. An alert is immediately sent to store staff. Meanwhile, the elderly person asks the smart glasses, "Where is the tea section?" and the navigation function provides directions to the section.

[1277] 2. Example prompt:

[1278] An elderly customer is wearing smart glasses and walking around the store. When their heart rate rises, an abnormality detection alert is sent to store staff. When the customer asks the smart glasses, "Where is the tea section?", the glasses navigate the way to the tea section.

[1279] In this way, the system of the present invention provides multifunctional support necessary for health management and a comfortable shopping experience for the elderly through collaboration between the server, terminal, and user.

[1280] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1281] Step 1:

[1282] An elderly person arrives at a physical store and puts on smart glasses. The smart glasses use sensors to measure the elderly person's heart rate and blood pressure in real time and send the data to a server. The input is the biometric data obtained from the smart glasses' sensors. The output is that this biometric data is sent to the server.

[1283] Step 2:

[1284] The server stores the received biometric data in a database and begins analysis using an AI algorithm. The AI ​​algorithm uses TensorFlow to perform analysis to detect abnormal values. The input is the biometric data sent from the smart glasses. The output is the analysis result, indicating whether or not an abnormality has been detected.

[1285] Step 3:

[1286] If the server detects an abnormality based on the analysis results, it immediately generates an alert and sends a notification to the store staff's tablet. The input is the analysis result of the AI ​​algorithm. The output is an alert notification to the store staff. For example, if the heart rate rises abnormally, the staff will be notified that "an elderly customer's heart rate is abnormally high."

[1287] Step 4:

[1288] Store staff check the alerts sent to them on the tablet and take the necessary action. For example, they may directly check on the elderly person's health status or contact a medical institution. The input is the alert notification sent from the server. The output is the staff's response action.

[1289] Step 5:

[1290] When searching for a product in a store, the elderly person asks a question to the smart glasses by voice. For example, "Where is the tea section?" This voice data is processed by the device and sent to the server. The input is the elderly person's voice command. The output is the voice data sent to the server.

[1291] Step 6:

[1292] The server analyzes the voice data and generates appropriate navigation instructions. Based on voice recognition technology and the elderly person's preference information, it identifies the appropriate sales area within the store. The input is the elderly person's voice instruction data. The output is navigation information.

[1293] Step 7:

[1294] The terminal provides navigation information provided by the server to the elderly visually or audibly. For example, a "guide arrow to the tea section" is displayed on the smart glasses display. The input is the navigation information. The output is the visual and audio instructions provided to the elderly.

[1295] Step 8:

[1296] When the elderly person follows the navigation and finds the product they are looking for, they report the information to the terminal. For example, they may report by voice, "I found tea." This report data is sent back to the server and stored in the database. The input is the elderly person's report data. The output is feedback data stored on the server.

[1297] In this way, the input data at each step is appropriately processed and output to the next step, allowing the entire process to be executed in a coordinated manner.

[1298] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1299] The present invention relates to a care system that utilizes AI in elderly care and combines it with an emotion engine to achieve more advanced health management and psychological support. The following describes in detail the embodiments of this system based on the claims.

[1300] System configuration and basic operation

[1301] This system works in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver), and uses an emotion engine to recognize the emotions of the elderly person and respond accordingly.

[1302] Server Roles

[1303] The server has a data management system that centrally manages health and preference information for elderly people. In addition, it performs the following functions using an emotion engine.

[1304] 1. Data Collection and Storage:

[1305] The server collects the elderly's physical condition data (heart rate, blood pressure, etc.) and preference information and stores them in a database. Emotion data is also stored in the same way.

[1306] Examples:

[1307] The caregiver enters Mr. A's new medication schedule and recent medical checkup results through a web interface, and the server stores the information in a database.

[1308] The server collects the emotional data of elderly person A and stores it in a database.

[1309] 2. Data Analysis:

[1310] The server analyzes the collected data using AI algorithms and an emotion engine, and generates alerts based on the analysis results if there are any anomalies or necessary actions.

[1311] Examples:

[1312] The server analyzes elderly person B's blood pressure data and generates an alert if it detects an abnormal value.

[1313] The server analyzes the emotional data of elderly person B, and if it detects a state of stress, it generates a conversation template to help him relax.

[1314] 3. Conversation template generation:

[1315] The server generates appropriate conversation templates based on the elderly person's preference information and emotional data, providing content that the elderly person will enjoy and conversations that suit their emotions at the time.

[1316] Examples:

[1317] The server recognizes from elderly person C's preference information that he likes "stories about old travels," and if the emotion engine indicates that his current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the device.

[1318] Device Role

[1319] The device uses data from the server and conversation templates to engage in daily conversations with the elderly, supporting their health management. It also recognizes and responds to the elderly's emotions through an emotion engine.

[1320] 1. Data Receipt and Notification:

[1321] The device receives notifications, alerts, and conversation templates from the server and communicates them appropriately to the elderly. It also uses an emotion engine to recognize the elderly's emotions.

[1322] Examples:

[1323] The device receives a notification from the server that it is time for elderly person D to take his / her medicine, and when it reaches 2 p.m., it issues a voice message saying, "Please take your medicine."

[1324] The device analyzes the facial expressions and voice of elderly person D and recognizes that he is tired.

[1325] 2. Conversational Relationships:

[1326] The device starts a conversation with the elderly person according to the conversation template received from the server, collects emotion data during the conversation, and transmits it to the server.

[1327] Examples:

[1328] The device asks elderly person E, "Tell me a story about your travels from the past," and sends the response and emotional data to the server.

[1329] User Roles

[1330] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs necessary information, and receives and responds to feedback from the emotion engine.

[1331] 1. Enter your information:

[1332] Caregivers enter new health information and medication schedules into the system, and seniors report their physical condition and emotions to the device.

[1333] Examples:

[1334] The caregiver enters the new health check results of elderly person F into the server's management screen.

[1335] Elderly person F reports to the device, "I'm tired today."

[1336] 2. Notification and Alert Response:

[1337] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, such as contacting experts.

[1338] Examples:

[1339] An abnormal blood pressure alert for elderly person G is sent to the device, and the caregiver contacts a specialist and arranges for emergency response.

[1340] The device recognizes that elderly person G is feeling lonely, and the caregiver responds by providing support to address the emotion.

[1341] summary

[1342] The system of the present invention is a multifunctional care system that, by combining an emotion engine, can provide more advanced health management and psychological support for the elderly. This system appropriately manages and analyzes the elderly's health information, preference information, and emotion data, reducing the burden on caregivers while providing an environment in which the elderly can live happily and safely.

[1343] The processing flow will be explained below.

[1344] Step 1:

[1345] The server stores the health and preference information of the elderly person received from the user (caregiver) in a database. Specifically, when the caregiver inputs Elderly Person A's new medication schedule or the results of a recent health checkup through the web interface, the information is sent to the server and stored in the database.

[1346] Step 2:

[1347] The device periodically receives health data from the server and collects health information as needed. For example, the device measures the blood pressure of elderly person B and sends the data to the server. The server stores the received data in a database.

[1348] Step 3:

[1349] The server analyzes the received health data using an AI algorithm and monitors for abnormalities. For example, if the server analyzes the blood pressure data of elderly person B and detects an abnormal value, it generates an alert and sends it to the caregiver's smartphone.

[1350] Step 4:

[1351] The server uses an emotion engine to generate conversation templates based on the elderly person's preference information and past conversation history. For example, if it recognizes from the preference information of elderly person C that he likes to talk about travel, and the emotion engine detects that he is in an "enjoyed" state, it will generate a conversation template on that topic.

[1352] Step 5:

[1353] The device starts a conversation with the elderly person based on the conversation template received from the server. Specifically, the device asks Elderly Person C, "Tell me about your recent trip." When the elderly person responds, the content is sent from the device to the server.

[1354] Step 6:

[1355] The device analyzes the voice and facial expressions of the elderly person and uses an emotion engine to recognize their emotions. For example, when elderly person D speaks to the device, the device recognizes the emotion "happy" from the tone of voice and facial expression, and sends that data to the server.

[1356] Step 7:

[1357] The server updates health and preference information based on the emotion data sent from the device. For example, if elderly person D is recognized as "happy," that information is added to the preference data and used to generate future conversation templates.

[1358] Step 8:

[1359] The device will then appropriately convey notifications and alerts received from the server to the elderly. For example, the device may notify Elderly Person E by voice, "It's 2 p.m. Please take your medicine," and confirm that Elderly Person E has taken their medicine.

[1360] Step 9:

[1361] The user (caregiver) receives emergency alerts from the system and takes appropriate action. For example, if a caregiver receives an alert on their smartphone about an abnormal blood pressure for elderly person F, they can contact a specialist and arrange for an emergency response.

[1362] Example 2

[1363] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1364] Health management and psychological support for the elderly require prompt and appropriate responses according to their individual conditions and emotions. However, conventional systems do not adequately collect and analyze vital signs and emotional data of the elderly, placing a heavy burden on caregivers and making it insufficient to provide an environment where the elderly can live safely. Furthermore, a system that can respond quickly in emergencies is also needed.

[1365] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1366] In this invention, the server includes a data management means for managing the elderly person's vital data and hobby information, an artificial intelligence algorithm means for analyzing the vital data and hobby information, a notification means for notifying the elderly person and their caregiver based on the analysis results, a conversation means for engaging in a dialogue with the elderly person according to a predetermined conversation template, collecting the elderly person's emotional data, and feeding back the content of the dialogue as data, an emotion recognition means for recognizing the elderly person's emotional data and instructing the caregiver or the elderly person on the necessary response, and an alert means for sending an alert to the caregiver or a specialist in the event of an emergency. This not only enables more advanced and rapid health management and psychological support for the elderly, but also reduces the burden on caregivers and provides an environment in which the elderly can live with peace of mind.

[1367] "Vital data" refers to biometric information such as an elderly person's heart rate, blood pressure, and body temperature.

[1368] "Hobby information" refers to activities that the elderly like or are interested in, especially information related to their daily lives and leisure time.

[1369] "Data management means" refers to systems and functions that collect vital data and hobby information of elderly people and store and manage them in a centralized manner.

[1370] "Artificial intelligence algorithm means" refers to AI technology that analyzes collected data and assesses the health and emotional state of the elderly.

[1371] "Notification means" refers to systems and functions that convey appropriate information and alerts to elderly people and caregivers based on analysis results.

[1372] "Conversation means" refers to a system or function that engages in a conversation with the elderly person according to a predetermined conversation template and provides feedback on the content of that conversation.

[1373] "Emotion recognition means" refers to a system or function that recognizes the emotional state of an elderly person using their facial expressions, voice, movements, etc., and takes necessary action based on that.

[1374] "Alert means" refers to a system or feature that warns or notifies a caregiver or professional in the event of an emergency.

[1375] The system according to the present invention provides health management and psychological support for the elderly by effectively managing and analyzing their health information and emotional data through collaboration between a server, a terminal, and a user (elderly person or caregiver). A specific embodiment of this system is shown below.

[1376] Server Roles

[1377] The server has a data management means for centrally managing vital data and hobby information of elderly people, and also utilizes an artificial intelligence algorithm means to perform the following functions:

[1378] 1. Data Collection and Storage:

[1379] The server receives the elderly person's vital data and hobby information from the terminal and stores them in a database. The elderly person's emotional data is also stored in the same way.

[1380] Examples:

[1381] Caregivers use a web interface to enter their senior's new medication schedule and medical checkup results, and the server stores the information in a database.

[1382] The server collects the elderly's emotional data and stores it in a database.

[1383] 2. Data Analysis:

[1384] The server analyzes the collected data using an artificial intelligence algorithm, and if an abnormality or necessary action is detected based on the analysis results, an alert is generated and linked to the notification system.

[1385] Examples:

[1386] The server analyzes the blood pressure data of elderly people and generates an alert if it detects abnormal values.

[1387] The server analyzes the elderly person's emotional data using an artificial intelligence algorithm, and if it detects a state of stress, it generates a conversation template to help them relax.

[1388] 3. Conversation template generation:

[1389] The server uses an emotion engine to generate appropriate conversation templates based on the elderly person's hobby information and emotional data, providing content that the elderly will enjoy and conversations that suit their emotions at the time.

[1390] Examples:

[1391] The server recognizes from the elderly person's hobby information that they like "old travel stories," and if the emotion engine indicates that their current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the terminal.

[1392] Device Role

[1393] The device receives notifications, alerts, and conversation templates from the server, interacts with the elderly on a daily basis, and supports their health management. It also recognizes the elderly's emotions through emotion recognition and responds accordingly.

[1394] 1. Data Receipt and Notification:

[1395] The device receives notifications, alerts, and conversation templates from the server and conveys them appropriately to the elderly. It also recognizes the elderly's emotions using emotion recognition means.

[1396] Examples:

[1397] The device receives notifications from the server about when it is time for the elderly person to take their medicine, and when the time comes at 2 p.m., it issues a voice message saying, "Please take your medicine."

[1398] The device analyzes the elderly person's facial expressions and voice and recognizes that they are tired.

[1399] 2. Conversational Relationships:

[1400] The device starts a conversation with the elderly person according to the conversation template received from the server, collects emotion data during the conversation, and transmits it to the server.

[1401] Examples:

[1402] The device asks the elderly person, "Tell me a story about your travels from the past," and sends the response and emotional data to the server.

[1403] User Roles

[1404] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs necessary information, and receives and responds to feedback from emotion recognition means.

[1405] 1. Enter your information:

[1406] Caregivers enter new health information and medication schedules into the system, and seniors report their physical and emotional state to the device.

[1407] Examples:

[1408] The caregiver enters the elderly person's new health check results into the server's management screen.

[1409] An elderly person reports to the device, "I'm tired today."

[1410] 2. Notification and Alert Response:

[1411] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, contacting experts or taking necessary measures.

[1412] Examples:

[1413] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[1414] The device recognizes when an elderly person is feeling lonely, and the caregiver responds by providing support.

[1415] In this system, data analysis by a generative AI model and an emotion engine work together to comprehensively manage the health and emotional state of the elderly, thereby reducing the burden on caregivers and providing an environment in which the elderly can live with peace of mind.

[1416] Example prompt sentence:

[1417] "An elderly person recently started taking new medication, and the elderly person's caregiver entered the elderly person's medication schedule and recent medical checkup results through a web interface. This information is stored on a server, and health data is collected. If an abnormality is discovered when this data is analyzed, how will the server respond?"

[1418] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1419] Step 1:

[1420] Information entry and collection

[1421] User Action:

[1422] The user (caregiver or elderly person) inputs the necessary health information and emotional state into a device or web interface. The caregiver inputs the elderly person's health check results and new medication schedule. The elderly person reports on their physical condition and emotions.

[1423] Specific behavior:

[1424] Caregivers enter new medication schedules and health checkup results for their elderly relatives through a web interface, and the data is sent to a server via a terminal.

[1425] The elderly person reports to the device by voice, "I'm tired today," and the report data is also sent to the server via the device.

[1426] Input: Health information and emotional information of elderly people

[1427] Output: Information entered into the terminal is sent to the server

[1428] Step 2:

[1429] Data transmission and storage

[1430] Terminal behavior:

[1431] The terminal sends the information entered by the user to the server, which stores the received data in a database.

[1432] Specific behavior:

[1433] The terminal transmits the medication schedule and health check results entered by the caregiver to the server.

[1434] The device sends the elderly person's emotional data to a server, which then stores the data in a database.

[1435] Input: Health information and emotional information entered into the device

[1436] Output: The received data is saved in the server database.

[1437] Step 3:

[1438] Data Analysis and Alert Generation

[1439] Server behavior:

[1440] The server analyzes the stored data using artificial intelligence algorithms, and generates an alert if an anomaly is detected based on the results of the data analysis.

[1441] Specific behavior:

[1442] The server analyzes the blood pressure data of elderly people, and if it detects abnormal values, it generates an alert and connects to a notification system.

[1443] The server uses an artificial intelligence algorithm to analyze the elderly person's emotional data, and if it detects a high stress state, it generates a conversation template to help them relax.

[1444] Input: Health information and emotional information stored in the database

[1445] Output: Alert when an anomaly is detected, conversation template based on the analysis results

[1446] Step 4:

[1447] Conversation template generation

[1448] Server behavior:

[1449] The server uses an emotion engine to generate appropriate conversation templates based on the elderly person's hobby information and emotion data, and the generated conversation templates are sent to the device.

[1450] Specific behavior:

[1451] The server recognizes from the elderly person's hobby information that they like "old travel stories," and if the emotion engine indicates that their current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the terminal.

[1452] Input: Elderly people's hobby information, emotion data

[1453] Output: Generated conversation template

[1454] Step 5:

[1455] Notifications and conversation initiation

[1456] Terminal behavior:

[1457] The device receives notifications and conversation templates from the server and conveys them to the elderly via voice and screen display. A conversation with the elderly begins, and the device records the content of the conversation.

[1458] Specific behavior:

[1459] The device receives a notification from the server that it is time for the elderly person to take their medicine, and when it reaches 2 p.m., it tells them in a voice message to "take your medicine."

[1460] Based on the conversation template received from the server, the device asks the elderly person, "Tell me a story about your travels from the past," and begins the conversation.

[1461] Input: Notifications from the server, conversation templates

[1462] Output: Notification to the elderly person and start of dialogue

[1463] Step 6:

[1464] Emotion Recognition and Feedback Collection

[1465] Terminal behavior:

[1466] The device analyzes the elderly person's facial expressions and voice to recognize their emotions, and sends the emotional data collected during the conversation to a server.

[1467] Specific behavior:

[1468] The device recognizes that an elderly person is tired based on their facial expressions and voice.

[1469] The device asks the elderly people to tell stories about their past travels and sends their responses and emotional data to the server.

[1470] Input: Emotional data of elderly people, dialogue content

[1471] Output: Emotion recognition results, data sent to server

[1472] Step 7:

[1473] Alert Response and Enforcement

[1474] User Action:

[1475] Users receive notifications and alerts from the system and take appropriate action, especially in emergencies, contacting experts or taking necessary measures.

[1476] Specific behavior:

[1477] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[1478] The device recognizes when an elderly person is feeling lonely, and the caregiver responds by providing support.

[1479] Input: Notifications and alerts from the system

[1480] Output: Caregiver and professional response

[1481] (Application example 2)

[1482] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1483] In recent years, the demand for nursing care has increased along with the rapid aging of the population. However, conventional nursing care systems have had difficulty in properly understanding the emotions and health status of elderly people in real time and providing support in an interactive format. In addition, there is a lack of specific support to ensure a safe shopping experience for elderly people in physical stores. In order for elderly people to live independently, they need to be able to maintain their health and gain mental security while receiving appropriate support while shopping in physical stores.

[1484] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1485] In this invention, the server includes a data management means for managing the elderly's health information and preference information, an AI algorithm means for analyzing the health information and preference information, a notification means for notifying the elderly and their caregivers based on the analysis results, a conversation means for having a conversation with the elderly according to a predetermined conversation template and feeding back the content of the conversation as data, an alert means for sending an alert to a caregiver or expert in an emergency, and a conversation support means for providing real-time support in a physical store based on the elderly's emotional and health information. This allows the elderly's emotional and health status to be monitored while shopping in a physical store, enabling appropriate support and safety to be ensured.

[1486] "Health information and preference information" refers to data indicating the physical health status of an elderly person (e.g., heart rate, blood pressure, body temperature, etc.) and information regarding personal preferences and hobbies.

[1487] "Data management means" refers to a system that has the function of centrally managing and storing the above health information and preference information.

[1488] "AI algorithm means" refers to artificial intelligence technology that analyzes collected health and preference information and assesses the condition of elderly people.

[1489] "Notification means" refers to a means for notifying the elderly person or their caregiver of important information or alerts based on the analyzed results.

[1490] The "conversation means" is a means having a function of having a conversation with an elderly person according to a predetermined conversation template and feeding back the content of the conversation as data.

[1491] An "alert means" is a means for alerting a caregiver or professional in the event of an emergency, to prompt a prompt response.

[1492] A "brick and mortar store" is a physical store such as a supermarket or pharmacy.

[1493] "Interactive support tools" are tools for providing real-time support based on the emotions and health information of seniors within physical stores.

[1494] The present invention relates to a care system that realizes health management and psychological support for elderly people. Hereinafter, embodiments of this system will be described in detail based on the claims.

[1495] System configuration and basic operation

[1496] This system works in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver), and uses an emotion engine to recognize the emotions of the elderly and respond accordingly.

[1497] Server Roles

[1498] The server performs the following functions:

[1499] 1. Data Management Measures:

[1500] The server has a database that centrally manages the elderly's health information and preference information. Health information includes heart rate, blood pressure, body temperature, etc., and preference information includes information on daily activities and hobbies.

[1501] 2. AI algorithm means:

[1502] The server uses AI algorithms to analyze the collected health and preference information. If abnormal values ​​or patterns are detected, an alert is generated to the appropriate experts. It also uses an emotion engine to recognize emotions such as stress and joy.

[1503] 3. Means of notification:

[1504] It is a means of notifying the elderly and their caregivers of important information based on the results of data analysis. For example, if the server detects an abnormal blood pressure value, it will send an alert to the caregiver.

[1505] 4. Conversation template generation:

[1506] The server generates appropriate conversation templates based on the elderly person's preferences and emotional data. For example, if an elderly person feels nostalgic, it provides a template about a past trip.

[1507] The server can use a cloud-based system, such as Amazon Web Services (AWS).

[1508] Device Role

[1509] The device receives data and conversation templates from the server, engages in daily conversations with the elderly, and provides real-time support based on the elderly's emotional and health information in physical stores.

[1510] 1. Data Receipt and Notification:

[1511] The device receives notifications, alerts, and conversation templates from the server and communicates them appropriately to the elderly. For example, if the device detects that the elderly is tired using smart glasses, it displays a message encouraging them to take a break.

[1512] 2. Conversational Relationships:

[1513] The device communicates with the elderly person according to the conversation template received from the server, and transmits emotional data collected during the conversation to the server.

[1514] The terminal can be a smart eyeglasses (e.g., Google Glass) or a smart frame device.

[1515] User Roles

[1516] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs the necessary information, and appropriately utilizes support at the physical store.

[1517] 1. Enter your information:

[1518] Caregivers enter new health information and medication schedules into the system, and seniors report feedback about their physical condition and emotions to the device.

[1519] 2. Notification and Alert Response:

[1520] Users receive notifications and emergency alerts from the system and take appropriate action, especially contacting experts in case of an emergency.

[1521] Specific examples

[1522] For example, while an elderly person is shopping in a brick-and-mortar store, smart glasses could notify them that their heart rate is elevated and they need to take a short break, or assist them when choosing a specific medication at a pharmacy by saying, "This medication may affect your blood pressure, so please check with your doctor."

[1523] Prompt Sentence Examples

[1524] Here are some example prompts to input to a generative AI model:

[1525] "We are considering a smart glasses application that provides real-time support to elderly people while they shop in physical stores, based on their health and emotional data. Please generate an appropriate conversation template based on the following environment settings and data."

[1526] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1527] Step 1:

[1528] The server collects the elderly person's health and preference information from the device and stores it in a database. In this step, the health data collected by the device, such as heart rate, blood pressure, and body temperature, as well as preference information about daily activities and hobbies, are sent to the server. The server then converts this data into a format that is easy to analyze and stores it.

[1529] Step 2:

[1530] The server then analyzes the stored health and preference information using an AI algorithm. In this step, the AI ​​algorithm analyzes the health data and detects outliers and trends. For example, if there is significant fluctuation in heart rate, an alert is generated. The server also analyzes the elderly person's preferences and emotional tendencies based on the preference information, and recognizes their emotions using an emotion engine.

[1531] Step 3:

[1532] The server generates notifications and alerts based on the analysis results. In this step, notifications are sent to caregivers and seniors upon detection of abnormal values ​​or specific emotional states. For example, if the server detects an abnormal blood pressure value, it will send an alert to the caregiver saying, "The senior's blood pressure is abnormal. Please check it immediately."

[1533] Step 4:

[1534] The server generates an appropriate conversation template based on the elderly person's preference information and emotional data. In this step, the generative AI model is used to create a conversation template that is appropriate for the elderly person's emotions and situation based on the prompt sentence. For example, for an elderly person who is feeling nostalgic, a conversation template that uses stories of old travels is generated.

[1535] Step 5:

[1536] The device receives notifications, alerts, and conversation templates from the server and conveys them appropriately to the elderly. In this step, the received information is provided to the elderly through audio and visual means via smart glasses or smart frame devices. For example, a notification message such as "Please take your medicine at 3 p.m." may be displayed. A conversation may also begin by asking, "Tell me about your travels."

[1537] Step 6:

[1538] The device converses with the elderly person, collecting emotional data during the conversation and feeding it back to the server. In this step, the voice and facial expression data provided by the elderly person is analyzed to recognize emotions. This data is then sent to the server for use in future analyses and conversation template generation. For example, if an elderly person says, "Today was fun," this is fed back to the server as the emotion of "joy."

[1539] Step 7:

[1540] The user responds to notifications and alerts from the system and inputs the necessary information. In this step, the caregiver enters new health information and medication schedules into the system. The elderly person also reports their physical condition and emotions to the terminal. For example, if the caregiver enters "The new medication time is 2 p.m.", the system manages and notifies the user of that information.

[1541] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1542] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1543] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1544] [Fourth embodiment]

[1545] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1546] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1547] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1548] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1549] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1550] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1551] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1552] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1553] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1554] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1555] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1556] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1557] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1558] The present invention relates to a care system that utilizes AI to reduce the burden on elderly people and their caregivers. The following describes in detail the embodiments of the system based on the claims.

[1559] System configuration and basic operation

[1560] This system operates in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver).

[1561] Server Roles

[1562] The server has a data management system that centrally manages the health and preference information of elderly people. Specifically, it performs the following functions:

[1563] 1. Data Collection and Storage:

[1564] The server collects the elderly person's physical condition data (heart rate, blood pressure, etc.) and preference information and stores it in a database. The user (caregiver) can input new health information and medication schedules.

[1565] Examples:

[1566] The caregiver enters Mr. A's new medication schedule and recent medical checkup results through a web interface, and the server stores the information in a database.

[1567] 2. Data Analysis:

[1568] The server analyzes the collected data using AI algorithms and generates an alert if an anomaly is detected based on the analysis results.

[1569] Examples:

[1570] The server analyzes elderly person A's recent blood pressure data in real time, and if it detects an abnormal value, it immediately sends an alert to the caregiver.

[1571] 3. Conversation template generation:

[1572] The server generates appropriate conversation templates based on the elderly person's preferences, thereby providing conversation content that the elderly person will find enjoyable.

[1573] Examples:

[1574] The server recognizes from elderly person B's preference information that he likes talking about summer festivals, generates a conversation template about summer festivals, and sends it to the terminal.

[1575] Device Role

[1576] The device uses data and conversation templates obtained from the server to engage in everyday conversations with the elderly and support their health management.

[1577] 1. Data Receipt and Notification:

[1578] The device receives notifications and alerts from the server and conveys them appropriately to the elderly. It also has the function of collecting the elderly's health data and sending it to the server.

[1579] Examples:

[1580] The device receives a notification from the server that it is time for elderly person C to take his / her medicine, and when it reaches 2 p.m., it issues a voice message saying, "Please take your medicine."

[1581] 2. Conversational Relationships:

[1582] The device then converses with the elderly person according to a conversation template sent from the server. The content of the conversation is then sent back to the server, allowing for history management.

[1583] Examples:

[1584] Elderly person D enjoys a conversation with the device about "old summer festivals," and the response data is fed back to the server.

[1585] User Roles

[1586] The user (caregiver or elderly person) responds to the system's notifications and alerts and enters the required information.

[1587] 1. Enter your information:

[1588] Caregivers enter new health information and medication schedules into the system, and seniors report their health status to a terminal.

[1589] Examples:

[1590] The caregiver enters the new health check results of elderly person E into the server's management screen.

[1591] Elderly person E reports to the device, "I feel good today."

[1592] 2. Notification and Alert Response:

[1593] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, such as contacting experts.

[1594] Examples:

[1595] An alert for elderly person F's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[1596] summary

[1597] The system of the present invention is a multifunctional care system that links a server, a terminal, and a user to manage the health of the elderly and improve their psychological satisfaction. This system appropriately manages and analyzes the elderly's health information and preference information, reducing the burden on caregivers while providing an environment in which the elderly can live safely and enjoyably.

[1598] The processing flow will be explained below.

[1599] Step 1:

[1600] The server stores the health and preference information of the elderly person received from the user (caregiver) in a database. For example, when a caregiver inputs a new medication schedule for elderly person A through the web interface, the information is sent to the server and stored.

[1601] Step 2:

[1602] The device periodically receives health data from the server and collects health information as needed. The device measures the blood pressure of elderly person B and sends the data to the server. The server analyzes the received data, and the health data is stored in a database on the server side.

[1603] Step 3:

[1604] The server analyzes the received health data using an AI algorithm to determine whether there are any abnormalities. For example, if the server analyzes the blood pressure data of elderly person B and detects an abnormal value, it generates an alert. The server then sends the alert to the caregiver's smartphone using a notification method.

[1605] Step 4:

[1606] The server generates a conversation template based on the analyzed health data. For example, it recognizes from elderly person C's preference information that he likes "old stories" and generates a conversation template related to that content. The generated template is then sent to the device.

[1607] Step 5:

[1608] The device starts a conversation with the elderly person according to the conversation template received from the server. Elderly person C is asked by the device, "Would you like to hear a story about a summer festival from long ago?" When Elderly person C responds "Yes," the response data is sent from the device to the server.

[1609] Step 6:

[1610] The device periodically notifies the elderly person based on notifications from the server. For example, the device may notify elderly person D by voice, "It's 2 p.m. Please take your medicine." Voice recognition confirms that elderly person D has taken their medicine, and the device then sends this information to the server.

[1611] Step 7:

[1612] The server analyzes the conversation content and health information sent from the device and updates the elderly person's preference information and health status. The preference information is updated based on the data of Elderly C's response, "I like summer festivals." The updated information is used to generate future conversation templates and for health management.

[1613] Step 8:

[1614] The user (caregiver) receives an emergency alert notification and takes the necessary action. For example, if a caregiver receives an alert on their smartphone about an abnormal blood pressure of elderly person E, the caregiver will contact a specialist and arrange for an emergency response.

[1615] Example 1

[1616] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1617] In an aging society, there is a need to reduce the burden on caregivers while maintaining the health and psychological satisfaction of the elderly. However, conventional nursing care systems lack centralized management of health information, making it difficult to detect abnormalities and respond to emergencies in real time. Furthermore, they lacked mechanisms for providing conversation content that the elderly can enjoy. These issues must be resolved.

[1618] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1619] In this invention, the server includes a data management unit for managing the elderly's health information and preference information; a collection and storage unit for collecting the health information and preference information and storing it in a database; an AI algorithm unit for analyzing the health information and preference information; an alert generation unit for detecting abnormalities and generating alerts based on the analysis results; a notification unit for notifying the elderly and their caregivers of the analysis results and alerts; a conversation unit for engaging in a dialogue with the elderly according to a conversation template generated based on the elderly's preference information and providing feedback on the content of the dialogue as data; a health status monitoring unit for periodically analyzing the elderly's health data in real time and generating an emergency alert if an abnormal value is detected; and an emergency notification unit for sending an alert to a caregiver or specialist in the event of an emergency. This allows for the real-time management and analysis of the elderly's health information and preference information, enabling immediate response when an abnormality occurs. Furthermore, providing conversation content that the elderly enjoys can increase their psychological satisfaction.

[1620] The "data management means" refers to a system and method for centrally managing health information and preference information of elderly people.

[1621] "Collection and storage means" refers to the function for collecting health information and preference information of the elderly and storing it in a database.

[1622] "AI algorithm means" refers to an algorithm that analyzes collected health and preference information to detect abnormalities and identify patterns.

[1623] The "alert generation means" is a function for generating an alert when an abnormality is detected based on the analysis results.

[1624] "Notification means" refers to a system and method for appropriately notifying elderly people and their caregivers of analysis results and alerts.

[1625] The "conversation means" is a function for having a conversation with the elderly person in accordance with a conversation template generated based on the elderly person's preference information, and feeding back the content of that conversation as data.

[1626] The "health status monitoring means" is a function that periodically analyzes the health data of elderly people in real time and generates emergency alerts if abnormal values ​​are detected.

[1627] "Emergency notification means" is a function that sends an alert to caregivers or experts in the event of an emergency, urging them to respond promptly.

[1628] MODE FOR CARRYING OUT THE INVENTION

[1629] The present invention is a system for managing health information and preference information of elderly people and providing care support using that information. This system operates in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver). Detailed embodiments of the system are described below.

[1630] Server Roles

[1631] The server implements the following methods:

[1632] 1. Data Management Measures:

[1633] The server centrally manages the health and preference information of the elderly, preventing loss or duplication of information and enabling efficient management.

[1634] 2. Collection and storage methods:

[1635] The server receives the elderly person's physical condition data (heart rate, blood pressure, etc.) sent from the terminal and health information entered by the caregiver via a web interface, and stores it in a database.

[1636] Examples:

[1637] Blood pressure data measured by the elderly person using a terminal is sent to a server.

[1638] Caregivers enter their senior's medication schedule through a web interface, and the information is stored in a database.

[1639] 3. AI algorithm means:

[1640] The server analyzes the collected health and preference information using AI algorithms, which allows it to detect abnormalities and recognize patterns.

[1641] 4. Alert generation method:

[1642] The server generates an alert when an abnormality is detected based on the analysis results. This alert is promptly communicated to the user via the notification means and emergency notification means described below.

[1643] 5. Means of notification:

[1644] The server has the function of notifying the elderly person and their caregiver of analysis results and alerts.

[1645] Examples:

[1646] When it is nearly time for the elderly person to take their medicine, the server sends a notification to the terminal and an audio notification is given.

[1647] 6. Means of communication:

[1648] The server then engages in a dialogue with the elderly person according to a conversation template generated based on the elderly person's preferences. The content of this dialogue is fed back as data and stored on the server.

[1649] 7. Health monitoring measures:

[1650] The server periodically analyzes the elderly person's health data in real time and generates emergency alerts if it detects abnormal values.

[1651] 8. Emergency notification means:

[1652] The server sends alerts to caregivers or professionals in the event of an emergency, facilitating a rapid response.

[1653] Device Role

[1654] The terminal implements the following functions:

[1655] 1. Data reception and notification function:

[1656] The device receives notifications and alerts from the server and conveys them appropriately to the elderly. It also collects the elderly's physical condition data and sends it to the server.

[1657] Examples:

[1658] At 2 p.m., the device will notify you with a voice message saying, "Please take your medicine."

[1659] 2. Conversational features:

[1660] The device converses with the elderly person according to a conversation template provided by the server, and the content of this conversation is sent to the server and managed as a history.

[1661] Examples:

[1662] The elderly person enjoys a conversation with the device about "old summer festivals," and the conversation data is sent to the server.

[1663] User (caregiver / elderly) role

[1664] The user performs the following operations through the system:

[1665] 1. Enter your information:

[1666] Caregivers enter new health information and medication schedules into the system, and seniors report their health status to a terminal.

[1667] Examples:

[1668] The caregiver enters the elderly person's new health check results into the server's management screen.

[1669] An elderly person reports to the device, "I feel good today."

[1670] 2. Notification and Alert Response:

[1671] Users receive notifications and emergency alerts from the system and take appropriate action.

[1672] Examples:

[1673] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[1674] Prompt Sentence Examples

[1675] "Generate conversation templates about summer festivals based on elderly people's preferences."

[1676] The above is a detailed description of the mode for carrying out the present invention.

[1677] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1678] Step 1:

[1679] Data collection

[1680] The server receives the elderly person's physical condition data (e.g., heart rate, blood pressure data) from the device, as well as health and preference information entered by the caregiver through a web interface.

[1681] Input: Elderly person's physical condition data, caregiver's input data

[1682] Specific behavior:

[1683] Elderly people measure their heart rate using a device and send the data to a server.

[1684] Caregivers enter new medication schedules for seniors through a web interface.

[1685] Output: Received health and preference information

[1686] Step 2:

[1687] Data storage

[1688] The server stores the collected health and preference information in a database.

[1689] Input: Received health and preference information

[1690] Specific behavior:

[1691] The server adds the elderly person's latest blood pressure data to the database.

[1692] The server registers the medication schedule entered by the caregiver in a database.

[1693] Output: Health and preference information stored in a database

[1694] Step 3:

[1695] Data analysis

[1696] The server analyzes the stored health and preference information using AI algorithms to detect abnormalities and recognize patterns.

[1697] Input: Health and preference information stored in a database

[1698] Specific behavior:

[1699] The server analyzes the elderly person's blood pressure data from the past week and detects abnormal values.

[1700] Output: Analysis results

[1701] Step 4:

[1702] Alert Generation

[1703] Based on the analysis results, the server generates an alert if an abnormality is detected.

[1704] Input: Analysis results

[1705] Specific behavior:

[1706] The server detects abnormalities in an elderly person's blood pressure and immediately generates an alert to caregivers.

[1707] Output: Generated alerts

[1708] Step 5:

[1709] notification

[1710] The server notifies the elderly person and their caregiver of the analysis results and any generated alerts.

[1711] Input: Analysis results, generated alerts

[1712] Specific behavior:

[1713] The server sends information to the terminal to notify the elderly person that it is time to take their medicine at 2 p.m.

[1714] The server sends an alert to the caregiver about the elderly person's abnormal blood pressure.

[1715] Output: Notifications and alerts sent

[1716] Step 6:

[1717] Conversation template generation

[1718] The server generates a conversation template based on the preference information of the elderly person.

[1719] Input: Elderly person's preference information

[1720] Specific behavior:

[1721] Based on the information that elderly people like summer festivals, the server generates a conversation template about summer festivals.

[1722] Output: Generated conversation template

[1723] Step 7:

[1724] Conversational features

[1725] The device then converses with the elderly person according to the generated conversation template. The content of this conversation is then sent back to the server and managed as a history.

[1726] Input: Generated conversation template

[1727] Specific behavior:

[1728] Elderly people enjoy conversations about summer festivals with their devices, and the content of their conversations is fed back to the server.

[1729] Output: Feedback of the dialogue

[1730] Step 8:

[1731] Enter information

[1732] Caregivers and seniors enter new health information and condition reports into the system.

[1733] Input: New health information, condition report

[1734] Specific behavior:

[1735] The caregiver enters new medical results into the system.

[1736] An elderly person reports to the device, "I feel good today."

[1737] Output: New health information and condition report entered

[1738] Step 9:

[1739] emergency notification

[1740] The server sends alerts to caregivers or professionals in the event of an emergency, urging them to take prompt action.

[1741] Input: Outlier detection results

[1742] Specific behavior:

[1743] Abnormal blood pressure in elderly people is detected and the server immediately sends an emergency alert to specialists.

[1744] Output: Emergency alert sent

[1745] (Application example 1)

[1746] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1747] In an aging society, the number of elderly people shopping in physical stores is increasing. However, these elderly people need to manage their health and often find shopping in unfamiliar stores inconvenient. Conventional care systems are designed for use at home and do not support elderly people in physical stores. Therefore, there is a need for a system that provides an environment where elderly people can shop safely and comfortably in physical stores, monitors their health status in real time, and provides the necessary support.

[1748] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1749] In this invention, the server includes a data management means for managing the elderly's health information and preference information, an AI algorithm means for analyzing the health information and preference information, a notification means for notifying the elderly and their caregiver based on the analysis results, a conversation means for engaging in a dialogue with the elderly according to a predetermined conversation template and feeding back the content of the dialogue as data, an alert means for sending an alert to the caregiver or specialist in an emergency, and a navigation means for monitoring the elderly's health condition in real time in a physical store, sending an alert to store staff when an abnormality is detected, providing product and promotion information based on the elderly's preference information, and providing in-store navigation functions. This makes it possible to provide a comfortable and efficient shopping experience by monitoring the elderly's health condition in real time even in a physical store and responding immediately to any abnormalities.

[1750] The "data management means" is a device or system for centrally collecting, storing, and managing health information and preference information of elderly people.

[1751] "AI algorithm means" refers to artificial intelligence technology that analyzes collected health and preference information to detect abnormalities and recognize patterns.

[1752] The "notification means" is a device or function for providing information to the elderly person and their caregiver based on the analyzed results.

[1753] The "conversation means" is a device or system that has the function of having a conversation with the elderly person according to a designated conversation template and feeding back the content of that conversation as data.

[1754] An "alert means" is a device or system that issues a warning or notification to the elder's caregiver or professional in the event of an emergency.

[1755] A "navigation means" is a device or system that has the function of providing merchandise and promotional information based on the preferences of elderly people in a physical store and guiding them within the store.

[1756] This invention is a system that provides an environment where elderly people can shop safely and comfortably in physical stores, monitors their health status in real time, and provides necessary support. This system mainly works in cooperation with three parties: a server, terminals (devices such as smart glasses and smartphones), and users (elderly people and store staff).

[1757] System configuration and basic operation

[1758] Server Roles

[1759] The server's main role is to centrally manage the health and preference information of the elderly and analyze the collected data. Specifically, it provides the following functions:

[1760] 1. Data Management Measures:

[1761] The server collects the elderly person's health information (heart rate, blood pressure, etc.) and preference information and stores it in a database. For example, the data is updated when caregivers or store staff input newly collected health information or a list of preferred products.

[1762] 2. AI algorithm means:

[1763] The server analyzes the collected data using AI technologies such as TensorFlow, and if an anomaly is detected, an alert is generated immediately and a notification is sent.

[1764] 3. Conversation template generation:

[1765] The server generates appropriate conversation templates based on the elderly person's preferences and sends them to the device, providing topics of interest to the elderly (e.g., "old summer festivals") and helping them enjoy shopping.

[1766] 4. Navigation methods:

[1767] The server provides in-store product information and promotion information and generates in-store navigation instructions to help seniors shop efficiently in physical stores.

[1768] Device Role

[1769] The device uses data and conversation templates provided by the server to engage in everyday conversations with the elderly, supporting health management and navigation within the store.

[1770] 1. Data Receipt and Notification:

[1771] The device receives notifications and alerts from the server and relays them appropriately to the elderly. The device also has the function of collecting the elderly's health data and sending it to the server. For example, the smart glasses use medical sensors to measure heart rate and blood pressure, and if any abnormalities are detected, they immediately notify store staff.

[1772] 2. Interactive navigation:

[1773] The device guides the elderly through the store based on their voice commands. For example, if an elderly person asks, "Where is the tea section?", the navigation function will guide them to the appropriate section.

[1774] 3. Conversational Relationships:

[1775] The device then converses with the elderly according to a conversation template from the server. The content of the conversation is then fed back to the server, enabling history management. For example, the elderly can have a conversation about "old summer festivals."

[1776] User Roles

[1777] The user (elderly person or store staff) responds to notifications and alerts from the system and enters the necessary information.

[1778] 1. Enter your information:

[1779] Store staff can input new health and preference information into the system, and seniors can also report their own physical condition on the terminal.

[1780] 2. Notification and Alert Response:

[1781] Users can check notifications and emergency alerts from the system and take appropriate action, such as providing prompt assistance to elderly people or contacting experts in the event of an emergency.

[1782] Examples and prompts

[1783] 1. Example:

[1784] An elderly person wears smart glasses and walks around a physical store. Their heart rate rises, and the server detects the abnormality. An alert is immediately sent to store staff. Meanwhile, the elderly person asks the smart glasses, "Where is the tea section?" and the navigation function provides directions to the section.

[1785] 2. Example prompt:

[1786] An elderly customer is wearing smart glasses and walking around the store. When their heart rate rises, an abnormality detection alert is sent to store staff. When the customer asks the smart glasses, "Where is the tea section?", the glasses navigate the way to the tea section.

[1787] In this way, the system of the present invention provides multifunctional support necessary for health management and a comfortable shopping experience for the elderly through collaboration between the server, terminal, and user.

[1788] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1789] Step 1:

[1790] An elderly person arrives at a physical store and puts on smart glasses. The smart glasses use sensors to measure the elderly person's heart rate and blood pressure in real time and send the data to a server. The input is the biometric data obtained from the smart glasses' sensors. The output is that this biometric data is sent to the server.

[1791] Step 2:

[1792] The server stores the received biometric data in a database and begins analysis using an AI algorithm. The AI ​​algorithm uses TensorFlow to perform analysis to detect abnormal values. The input is the biometric data sent from the smart glasses. The output is the analysis result, indicating whether or not an abnormality has been detected.

[1793] Step 3:

[1794] If the server detects an abnormality based on the analysis results, it immediately generates an alert and sends a notification to the store staff's tablet. The input is the analysis result of the AI ​​algorithm. The output is an alert notification to the store staff. For example, if the heart rate rises abnormally, the staff will be notified that "an elderly customer's heart rate is abnormally high."

[1795] Step 4:

[1796] Store staff check the alerts sent to them on the tablet and take the necessary action. For example, they may directly check on the elderly person's health status or contact a medical institution. The input is the alert notification sent from the server. The output is the staff's response action.

[1797] Step 5:

[1798] When searching for a product in a store, the elderly person asks a question to the smart glasses by voice. For example, "Where is the tea section?" This voice data is processed by the device and sent to the server. The input is the elderly person's voice command. The output is the voice data sent to the server.

[1799] Step 6:

[1800] The server analyzes the voice data and generates appropriate navigation instructions. Based on voice recognition technology and the elderly person's preference information, it identifies the appropriate sales area within the store. The input is the elderly person's voice instruction data. The output is navigation information.

[1801] Step 7:

[1802] The terminal provides navigation information provided by the server to the elderly visually or audibly. For example, a "guide arrow to the tea section" is displayed on the smart glasses display. The input is the navigation information. The output is the visual and audio instructions provided to the elderly.

[1803] Step 8:

[1804] When the elderly person follows the navigation and finds the product they are looking for, they report the information to the terminal. For example, they may report by voice, "I found tea." This report data is sent back to the server and stored in the database. The input is the elderly person's report data. The output is feedback data stored on the server.

[1805] In this way, the input data at each step is appropriately processed and output to the next step, allowing the entire process to be executed in a coordinated manner.

[1806] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1807] The present invention relates to a care system that utilizes AI in elderly care and combines it with an emotion engine to achieve more advanced health management and psychological support. The following describes in detail the embodiments of this system based on the claims.

[1808] System configuration and basic operation

[1809] This system works in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver), and uses an emotion engine to recognize the emotions of the elderly person and respond accordingly.

[1810] Server Roles

[1811] The server has a data management system that centrally manages health and preference information for elderly people. In addition, it performs the following functions using an emotion engine.

[1812] 1. Data Collection and Storage:

[1813] The server collects the elderly's physical condition data (heart rate, blood pressure, etc.) and preference information and stores them in a database. Emotion data is also stored in the same way.

[1814] Examples:

[1815] The caregiver enters Mr. A's new medication schedule and recent medical checkup results through a web interface, and the server stores the information in a database.

[1816] The server collects the emotional data of elderly person A and stores it in a database.

[1817] 2. Data Analysis:

[1818] The server analyzes the collected data using AI algorithms and an emotion engine, and generates alerts based on the analysis results if there are any anomalies or necessary actions.

[1819] Examples:

[1820] The server analyzes elderly person B's blood pressure data and generates an alert if it detects an abnormal value.

[1821] The server analyzes the emotional data of elderly person B, and if it detects a state of stress, it generates a conversation template to help him relax.

[1822] 3. Conversation template generation:

[1823] The server generates appropriate conversation templates based on the elderly person's preference information and emotional data, providing content that the elderly person will enjoy and conversations that suit their emotions at the time.

[1824] Examples:

[1825] The server recognizes from elderly person C's preference information that he likes "stories about old travels," and if the emotion engine indicates that his current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the device.

[1826] Device Role

[1827] The device uses data from the server and conversation templates to engage in daily conversations with the elderly, supporting their health management. It also recognizes and responds to the elderly's emotions through an emotion engine.

[1828] 1. Data Receipt and Notification:

[1829] The device receives notifications, alerts, and conversation templates from the server and communicates them appropriately to the elderly. It also uses an emotion engine to recognize the elderly's emotions.

[1830] Examples:

[1831] The device receives a notification from the server that it is time for elderly person D to take his / her medicine, and when it reaches 2 p.m., it issues a voice message saying, "Please take your medicine."

[1832] The device analyzes the facial expressions and voice of elderly person D and recognizes that he is tired.

[1833] 2. Conversational Relationships:

[1834] The device starts a conversation with the elderly person according to the conversation template received from the server, collects emotion data during the conversation, and transmits it to the server.

[1835] Examples:

[1836] The device asks elderly person E, "Tell me a story about your travels from the past," and sends the response and emotional data to the server.

[1837] User Roles

[1838] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs necessary information, and receives and responds to feedback from the emotion engine.

[1839] 1. Enter your information:

[1840] Caregivers enter new health information and medication schedules into the system, and seniors report their physical condition and emotions to the device.

[1841] Examples:

[1842] The caregiver enters the new health check results of elderly person F into the server's management screen.

[1843] Elderly person F reports to the device, "I'm tired today."

[1844] 2. Notification and Alert Response:

[1845] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, such as contacting experts.

[1846] Examples:

[1847] An abnormal blood pressure alert for elderly person G is sent to the device, and the caregiver contacts a specialist and arranges for emergency response.

[1848] The device recognizes that elderly person G is feeling lonely, and the caregiver responds by providing support to address the emotion.

[1849] summary

[1850] The system of the present invention is a multifunctional care system that, by combining an emotion engine, can provide more advanced health management and psychological support for the elderly. This system appropriately manages and analyzes the elderly's health information, preference information, and emotion data, reducing the burden on caregivers while providing an environment in which the elderly can live happily and safely.

[1851] The processing flow will be explained below.

[1852] Step 1:

[1853] The server stores the health and preference information of the elderly person received from the user (caregiver) in a database. Specifically, when the caregiver inputs Elderly Person A's new medication schedule or the results of a recent health checkup through the web interface, the information is sent to the server and stored in the database.

[1854] Step 2:

[1855] The device periodically receives health data from the server and collects health information as needed. For example, the device measures the blood pressure of elderly person B and sends the data to the server. The server stores the received data in a database.

[1856] Step 3:

[1857] The server analyzes the received health data using an AI algorithm and monitors for abnormalities. For example, if the server analyzes the blood pressure data of elderly person B and detects an abnormal value, it generates an alert and sends it to the caregiver's smartphone.

[1858] Step 4:

[1859] The server uses an emotion engine to generate conversation templates based on the elderly person's preference information and past conversation history. For example, if it recognizes from the preference information of elderly person C that he likes to talk about travel, and the emotion engine detects that he is in an "enjoyed" state, it will generate a conversation template on that topic.

[1860] Step 5:

[1861] The device starts a conversation with the elderly person based on the conversation template received from the server. Specifically, the device asks Elderly Person C, "Tell me about your recent trip." When the elderly person responds, the content is sent from the device to the server.

[1862] Step 6:

[1863] The device analyzes the voice and facial expressions of the elderly person and uses an emotion engine to recognize their emotions. For example, when elderly person D speaks to the device, the device recognizes the emotion "happy" from the tone of voice and facial expression, and sends that data to the server.

[1864] Step 7:

[1865] The server updates health and preference information based on the emotion data sent from the device. For example, if elderly person D is recognized as "happy," that information is added to the preference data and used to generate future conversation templates.

[1866] Step 8:

[1867] The device will then appropriately convey notifications and alerts received from the server to the elderly. For example, the device may notify Elderly Person E by voice, "It's 2 p.m. Please take your medicine," and confirm that Elderly Person E has taken their medicine.

[1868] Step 9:

[1869] The user (caregiver) receives emergency alerts from the system and takes appropriate action. For example, if a caregiver receives an alert on their smartphone about an abnormal blood pressure for elderly person F, they can contact a specialist and arrange for an emergency response.

[1870] Example 2

[1871] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1872] Health management and psychological support for the elderly require prompt and appropriate responses according to their individual conditions and emotions. However, conventional systems do not adequately collect and analyze vital signs and emotional data of the elderly, placing a heavy burden on caregivers and making it insufficient to provide an environment where the elderly can live safely. Furthermore, a system that can respond quickly in emergencies is also needed.

[1873] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1874] In this invention, the server includes a data management means for managing the elderly person's vital data and hobby information, an artificial intelligence algorithm means for analyzing the vital data and hobby information, a notification means for notifying the elderly person and their caregiver based on the analysis results, a conversation means for engaging in a dialogue with the elderly person according to a predetermined conversation template, collecting the elderly person's emotional data, and feeding back the content of the dialogue as data, an emotion recognition means for recognizing the elderly person's emotional data and instructing the caregiver or the elderly person on the necessary response, and an alert means for sending an alert to the caregiver or a specialist in the event of an emergency. This not only enables more advanced and rapid health management and psychological support for the elderly, but also reduces the burden on caregivers and provides an environment in which the elderly can live with peace of mind.

[1875] "Vital data" refers to biometric information such as an elderly person's heart rate, blood pressure, and body temperature.

[1876] "Hobby information" refers to activities that the elderly like or are interested in, especially information related to their daily lives and leisure time.

[1877] "Data management means" refers to systems and functions that collect vital data and hobby information of elderly people and store and manage them in a centralized manner.

[1878] "Artificial intelligence algorithm means" refers to AI technology that analyzes collected data and assesses the health and emotional state of the elderly.

[1879] "Notification means" refers to systems and functions that convey appropriate information and alerts to elderly people and caregivers based on analysis results.

[1880] "Conversation means" refers to a system or function that engages in a conversation with the elderly person according to a predetermined conversation template and provides feedback on the content of that conversation.

[1881] "Emotion recognition means" refers to a system or function that recognizes the emotional state of an elderly person using their facial expressions, voice, movements, etc., and takes necessary action based on that.

[1882] "Alert means" refers to a system or feature that warns or notifies a caregiver or professional in the event of an emergency.

[1883] The system according to the present invention provides health management and psychological support for the elderly by effectively managing and analyzing their health information and emotional data through collaboration between a server, a terminal, and a user (elderly person or caregiver). A specific embodiment of this system is shown below.

[1884] Server Roles

[1885] The server has a data management means for centrally managing vital data and hobby information of elderly people, and also utilizes an artificial intelligence algorithm means to perform the following functions:

[1886] 1. Data Collection and Storage:

[1887] The server receives the elderly person's vital data and hobby information from the terminal and stores them in a database. The elderly person's emotional data is also stored in the same way.

[1888] Examples:

[1889] Caregivers use a web interface to enter their senior's new medication schedule and medical checkup results, and the server stores the information in a database.

[1890] The server collects the elderly's emotional data and stores it in a database.

[1891] 2. Data Analysis:

[1892] The server analyzes the collected data using an artificial intelligence algorithm, and if an abnormality or necessary action is detected based on the analysis results, an alert is generated and linked to the notification system.

[1893] Examples:

[1894] The server analyzes the blood pressure data of elderly people and generates an alert if it detects abnormal values.

[1895] The server analyzes the elderly person's emotional data using an artificial intelligence algorithm, and if it detects a state of stress, it generates a conversation template to help them relax.

[1896] 3. Conversation template generation:

[1897] The server uses an emotion engine to generate appropriate conversation templates based on the elderly person's hobby information and emotional data, providing content that the elderly will enjoy and conversations that suit their emotions at the time.

[1898] Examples:

[1899] The server recognizes from the elderly person's hobby information that they like "old travel stories," and if the emotion engine indicates that their current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the terminal.

[1900] Device Role

[1901] The device receives notifications, alerts, and conversation templates from the server, interacts with the elderly on a daily basis, and supports their health management. It also recognizes the elderly's emotions through emotion recognition and responds accordingly.

[1902] 1. Data Receipt and Notification:

[1903] The device receives notifications, alerts, and conversation templates from the server and conveys them appropriately to the elderly. It also recognizes the elderly's emotions using emotion recognition means.

[1904] Examples:

[1905] The device receives notifications from the server about when it is time for the elderly person to take their medicine, and when the time comes at 2 p.m., it issues a voice message saying, "Please take your medicine."

[1906] The device analyzes the elderly person's facial expressions and voice and recognizes that they are tired.

[1907] 2. Conversational Relationships:

[1908] The device starts a conversation with the elderly person according to the conversation template received from the server, collects emotion data during the conversation, and transmits it to the server.

[1909] Examples:

[1910] The device asks the elderly person, "Tell me a story about your travels from the past," and sends the response and emotional data to the server.

[1911] User Roles

[1912] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs necessary information, and receives and responds to feedback from emotion recognition means.

[1913] 1. Enter your information:

[1914] Caregivers enter new health information and medication schedules into the system, and seniors report their physical and emotional state to the device.

[1915] Examples:

[1916] The caregiver enters the elderly person's new health check results into the server's management screen.

[1917] An elderly person reports to the device, "I'm tired today."

[1918] 2. Notification and Alert Response:

[1919] Users receive notifications and emergency alerts from the system and take appropriate action, especially in emergencies, contacting experts or taking necessary measures.

[1920] Examples:

[1921] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[1922] The device recognizes when an elderly person is feeling lonely, and the caregiver responds by providing support.

[1923] In this system, data analysis by a generative AI model and an emotion engine work together to comprehensively manage the health and emotional state of the elderly, thereby reducing the burden on caregivers and providing an environment in which the elderly can live with peace of mind.

[1924] Example prompt sentence:

[1925] "An elderly person recently started taking new medication, and the elderly person's caregiver entered the elderly person's medication schedule and recent medical checkup results through a web interface. This information is stored on a server, and health data is collected. If an abnormality is discovered when this data is analyzed, how will the server respond?"

[1926] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1927] Step 1:

[1928] Information entry and collection

[1929] User Action:

[1930] The user (caregiver or elderly person) inputs the necessary health information and emotional state into a device or web interface. The caregiver inputs the elderly person's health check results and new medication schedule. The elderly person reports on their physical condition and emotions.

[1931] Specific behavior:

[1932] Caregivers enter new medication schedules and health checkup results for their elderly relatives through a web interface, and the data is sent to a server via a terminal.

[1933] The elderly person reports to the device by voice, "I'm tired today," and the report data is also sent to the server via the device.

[1934] Input: Health information and emotional information of elderly people

[1935] Output: Information entered into the terminal is sent to the server

[1936] Step 2:

[1937] Data transmission and storage

[1938] Terminal behavior:

[1939] The terminal sends the information entered by the user to the server, which stores the received data in a database.

[1940] Specific behavior:

[1941] The terminal transmits the medication schedule and health check results entered by the caregiver to the server.

[1942] The device sends the elderly person's emotional data to a server, which then stores the data in a database.

[1943] Input: Health information and emotional information entered into the device

[1944] Output: The received data is saved in the server database.

[1945] Step 3:

[1946] Data Analysis and Alert Generation

[1947] Server behavior:

[1948] The server analyzes the stored data using artificial intelligence algorithms, and generates an alert if an anomaly is detected based on the results of the data analysis.

[1949] Specific behavior:

[1950] The server analyzes the blood pressure data of elderly people, and if it detects abnormal values, it generates an alert and connects to a notification system.

[1951] The server uses an artificial intelligence algorithm to analyze the elderly person's emotional data, and if it detects a high stress state, it generates a conversation template to help them relax.

[1952] Input: Health information and emotional information stored in the database

[1953] Output: Alert when an anomaly is detected, conversation template based on the analysis results

[1954] Step 4:

[1955] Conversation template generation

[1956] Server behavior:

[1957] The server uses an emotion engine to generate appropriate conversation templates based on the elderly person's hobby information and emotion data, and the generated conversation templates are sent to the device.

[1958] Specific behavior:

[1959] The server recognizes from the elderly person's hobby information that they like "old travel stories," and if the emotion engine indicates that their current emotion is "nostalgia," it generates a conversation template related to that content and sends it to the terminal.

[1960] Input: Elderly people's hobby information, emotion data

[1961] Output: Generated conversation template

[1962] Step 5:

[1963] Notifications and conversation initiation

[1964] Terminal behavior:

[1965] The device receives notifications and conversation templates from the server and conveys them to the elderly via voice and screen display. A conversation with the elderly begins, and the device records the content of the conversation.

[1966] Specific behavior:

[1967] The device receives a notification from the server that it is time for the elderly person to take their medicine, and when it reaches 2 p.m., it tells them in a voice message to "take your medicine."

[1968] Based on the conversation template received from the server, the device asks the elderly person, "Tell me a story about your travels from the past," and begins the conversation.

[1969] Input: Notifications from the server, conversation templates

[1970] Output: Notification to the elderly person and start of dialogue

[1971] Step 6:

[1972] Emotion Recognition and Feedback Collection

[1973] Terminal behavior:

[1974] The device analyzes the elderly person's facial expressions and voice to recognize their emotions, and sends the emotional data collected during the conversation to a server.

[1975] Specific behavior:

[1976] The device recognizes that an elderly person is tired based on their facial expressions and voice.

[1977] The device asks the elderly people to tell stories about their past travels and sends their responses and emotional data to the server.

[1978] Input: Emotional data of elderly people, dialogue content

[1979] Output: Emotion recognition results, data sent to server

[1980] Step 7:

[1981] Alert Response and Enforcement

[1982] User Action:

[1983] Users receive notifications and alerts from the system and take appropriate action, especially in emergencies, contacting experts or taking necessary measures.

[1984] Specific behavior:

[1985] An alert for an elderly person's abnormal blood pressure is sent to the device, allowing the caregiver to contact a specialist and arrange for emergency response.

[1986] The device recognizes when an elderly person is feeling lonely, and the caregiver responds by providing support.

[1987] Input: Notifications and alerts from the system

[1988] Output: Caregiver and professional response

[1989] (Application example 2)

[1990] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1991] In recent years, the demand for nursing care has increased along with the rapid aging of the population. However, conventional nursing care systems have had difficulty in properly understanding the emotions and health status of elderly people in real time and providing support in an interactive format. In addition, there is a lack of specific support to ensure a safe shopping experience for elderly people in physical stores. In order for elderly people to live independently, they need to be able to maintain their health and gain mental security while receiving appropriate support while shopping in physical stores.

[1992] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1993] In this invention, the server includes a data management means for managing the elderly's health information and preference information, an AI algorithm means for analyzing the health information and preference information, a notification means for notifying the elderly and their caregivers based on the analysis results, a conversation means for having a conversation with the elderly according to a predetermined conversation template and feeding back the content of the conversation as data, an alert means for sending an alert to a caregiver or expert in an emergency, and a conversation support means for providing real-time support in a physical store based on the elderly's emotional and health information. This allows the elderly's emotional and health status to be monitored while shopping in a physical store, enabling appropriate support and safety to be ensured.

[1994] "Health information and preference information" refers to data indicating the physical health status of an elderly person (e.g., heart rate, blood pressure, body temperature, etc.) and information regarding personal preferences and hobbies.

[1995] "Data management means" refers to a system that has the function of centrally managing and storing the above health information and preference information.

[1996] "AI algorithm means" refers to artificial intelligence technology that analyzes collected health and preference information and assesses the condition of elderly people.

[1997] "Notification means" refers to a means for notifying the elderly person or their caregiver of important information or alerts based on the analyzed results.

[1998] The "conversation means" is a means having a function of having a conversation with an elderly person according to a predetermined conversation template and feeding back the content of the conversation as data.

[1999] An "alert means" is a means for alerting a caregiver or professional in the event of an emergency, to prompt a prompt response.

[2000] A "brick and mortar store" is a physical store such as a supermarket or pharmacy.

[2001] "Interactive support tools" are tools for providing real-time support based on the emotions and health information of seniors within physical stores.

[2002] The present invention relates to a care system that realizes health management and psychological support for elderly people. Hereinafter, embodiments of this system will be described in detail based on the claims.

[2003] System configuration and basic operation

[2004] This system works in cooperation with three parties: a server, a terminal, and a user (elderly person or caregiver), and uses an emotion engine to recognize the emotions of the elderly and respond accordingly.

[2005] Server Roles

[2006] The server performs the following functions:

[2007] 1. Data Management Measures:

[2008] The server has a database that centrally manages the elderly's health information and preference information. Health information includes heart rate, blood pressure, body temperature, etc., and preference information includes information on daily activities and hobbies.

[2009] 2. AI algorithm means:

[2010] The server uses AI algorithms to analyze the collected health and preference information. If abnormal values ​​or patterns are detected, an alert is generated to the appropriate experts. It also uses an emotion engine to recognize emotions such as stress and joy.

[2011] 3. Means of notification:

[2012] It is a means of notifying the elderly and their caregivers of important information based on the results of data analysis. For example, if the server detects an abnormal blood pressure value, it will send an alert to the caregiver.

[2013] 4. Conversation template generation:

[2014] The server generates appropriate conversation templates based on the elderly person's preferences and emotional data. For example, if an elderly person feels nostalgic, it provides a template about a past trip.

[2015] The server can use a cloud-based system, such as Amazon Web Services (AWS).

[2016] Device Role

[2017] The device receives data and conversation templates from the server, engages in daily conversations with the elderly, and provides real-time support based on the elderly's emotional and health information in physical stores.

[2018] 1. Data Receipt and Notification:

[2019] The device receives notifications, alerts, and conversation templates from the server and communicates them appropriately to the elderly. For example, if the device detects that the elderly is tired using smart glasses, it displays a message encouraging them to take a break.

[2020] 2. Conversational Relationships:

[2021] The device communicates with the elderly person according to the conversation template received from the server, and transmits emotional data collected during the conversation to the server.

[2022] The terminal can be a smart eyeglasses (e.g., Google Glass) or a smart frame device.

[2023] User Roles

[2024] The user (caregiver or elderly person) responds to notifications and alerts from the system, inputs the necessary information, and appropriately utilizes support at the physical store.

[2025] 1. Enter your information:

[2026] Caregivers enter new health information and medication schedules into the system, and seniors report feedback about their physical condition and emotions to the device.

[2027] 2. Notification and Alert Response:

[2028] Users receive notifications and emergency alerts from the system and take appropriate action, especially contacting experts in case of an emergency.

[2029] Specific examples

[2030] For example, while an elderly person is shopping in a brick-and-mortar store, smart glasses could notify them that their heart rate is elevated and they need to take a short break, or assist them when choosing a specific medication at a pharmacy by saying, "This medication may affect your blood pressure, so please check with your doctor."

[2031] Prompt Sentence Examples

[2032] Here are some example prompts to input to a generative AI model:

[2033] "We are considering a smart glasses application that provides real-time support to elderly people while they shop in physical stores, based on their health and emotional data. Please generate an appropriate conversation template based on the following environment settings and data."

[2034] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2035] Step 1:

[2036] The server collects the elderly person's health and preference information from the device and stores it in a database. In this step, the health data collected by the device, such as heart rate, blood pressure, and body temperature, as well as preference information about daily activities and hobbies, are sent to the server. The server then converts this data into a format that is easy to analyze and stores it.

[2037] Step 2:

[2038] The server then analyzes the stored health and preference information using an AI algorithm. In this step, the AI ​​algorithm analyzes the health data and detects outliers and trends. For example, if there is significant fluctuation in heart rate, an alert is generated. The server also analyzes the elderly person's preferences and emotional tendencies based on the preference information, and recognizes their emotions using an emotion engine.

[2039] Step 3:

[2040] The server generates notifications and alerts based on the analysis results. In this step, notifications are sent to caregivers and seniors upon detection of abnormal values ​​or specific emotional states. For example, if the server detects an abnormal blood pressure value, it will send an alert to the caregiver saying, "The senior's blood pressure is abnormal. Please check it immediately."

[2041] Step 4:

[2042] The server generates an appropriate conversation template based on the elderly person's preference information and emotional data. In this step, the generative AI model is used to create a conversation template that is appropriate for the elderly person's emotions and situation based on the prompt sentence. For example, for an elderly person who is feeling nostalgic, a conversation template that uses stories of old travels is generated.

[2043] Step 5:

[2044] The device receives notifications, alerts, and conversation templates from the server and conveys them appropriately to the elderly. In this step, the received information is provided to the elderly through audio and visual means via smart glasses or smart frame devices. For example, a notification message such as "Please take your medicine at 3 p.m." may be displayed. A conversation may also begin by asking, "Tell me about your travels."

[2045] Step 6:

[2046] The device converses with the elderly person, collecting emotional data during the conversation and feeding it back to the server. In this step, the voice and facial expression data provided by the elderly person is analyzed to recognize emotions. This data is then sent to the server for use in future analyses and conversation template generation. For example, if an elderly person says, "Today was fun," this is fed back to the server as the emotion of "joy."

[2047] Step 7:

[2048] The user responds to notifications and alerts from the system and inputs the necessary information. In this step, the caregiver enters new health information and medication schedules into the system. The elderly person also reports their physical condition and emotions to the terminal. For example, if the caregiver enters "The new medication time is 2 p.m.", the system manages and notifies the user of that information.

[2049] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2050] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2051] In the above embodiment, an example was given in which the specific proces...

Claims

1. a data management means for managing health information and preference information of the elderly person; an AI algorithm means for analyzing the health information and preference information; a notification means for notifying the elderly person and their caregiver based on the analyzed results; a conversation means for having a conversation with the elderly person according to a predetermined conversation template and feeding back the content of the conversation as data; an alerting means for alerting a caregiver or professional in the event of an emergency; The care system includes:

2. The system of claim 1, wherein the AI ​​algorithm means analyzes the health status of the elderly person and generates an alert to a corresponding expert if an abnormal value is detected.

3. 2. The system according to claim 1, wherein said conversation means conducts a conversation with the elderly person in accordance with a conversation template generated based on preference information of the elderly person.

Images