system
The system addresses the challenges of care planning and real-time health monitoring for the elderly by integrating a generation module for care plans, a communication module for information sharing, and a monitoring module for abnormalities, enhancing caregiver efficiency and response times.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SOFTBANK GROUP CORP
- Filing Date
- 2024-12-06
- Publication Date
- 2026-06-18
AI Technical Summary
Families and caregivers face challenges in formulating appropriate care plans for the elderly, managing daily care activities, and lack real-time monitoring and response mechanisms for health abnormalities, leading to a heavy burden.
A system with a generation module for creating optimal care plans, a communication module for information sharing, and a monitoring module for detecting abnormalities, reducing the burden on caregivers and families by enabling efficient care planning and real-time health management.
The system facilitates smooth collaboration among stakeholders, reduces caregiver burden, and ensures timely responses to health abnormalities through automated care planning and continuous monitoring.
Smart Images

Figure 2026099476000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In modern society where the aging process is accelerating, many families are facing the problem of caring for the elderly. Many caregivers not only have difficulty in formulating an appropriate care plan and managing daily care activities, but also have the problem of insufficient cooperation with family members and medical institutions. In addition, there is a lack of a mechanism for monitoring the health status of the elderly in real time and responding promptly in case of abnormalities. Therefore, there is a problem that it is a heavy burden for caregivers and family members.
Means for Solving the Problems
[0005] By using a generation module that receives health information from the elderly and automatically generates an optimal care plan based on the entered information, efficient care planning becomes possible. Furthermore, by implementing a communication module that notifies multiple stakeholders of the generated care plan and promotes information sharing, smooth collaboration with families and medical institutions is achieved. In addition, a monitoring module is provided that monitors health information and issues warnings if abnormalities are detected, enabling a rapid response. This reduces the burden on caregivers and families and provides an environment where the health management of the elderly can be carried out with greater peace of mind.
[0006] The term "elderly" generally refers to individuals who have reached a certain age and often require care or medical support.
[0007] "Health information" refers to data that indicates the physical and mental state of elderly individuals, including objective numerical data such as blood pressure, heart rate, and activity level.
[0008] An "input device" is an interface for users to provide data to a system, and includes devices such as smartphones and tablets.
[0009] A "generation module" refers to the program portion of the system that has the function of automatically creating an optimal care plan based on the input data.
[0010] A "communication module" refers to the program portion that has the function of transmitting generated information to relevant parties and enabling information sharing.
[0011] The "monitoring module" refers to the program portion that continuously analyzes health information and issues warnings when an abnormality is detected.
[0012] A "communication module" refers to the program portion that enables message exchange among stakeholders and facilitates the transmission of information and the exchange of opinions.
[0013] A "cloud environment" refers to a remote server space where data is stored and managed via the internet and accessible to multiple users.
[0014] "Preventive measures" refer to specific action plans and advice proposed to maintain or improve the health of older adults. [Brief explanation of the drawing]
[0015] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Example 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.
Embodiments for Carrying Out the Invention
[0016] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.
[0017] First, the terms used in the following description will be explained.
[0018] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.
[0019] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.
[0020] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.
[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).
[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0023] [First Embodiment]
[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0036] This system is designed to efficiently support elderly care and consists of multiple modules. The system primarily handles data input from terminals, data processing, generation, management, notification, and information sharing on the server.
[0037] Users first input their daily health information using a dedicated application on a device such as a smartphone or tablet. This application provides a user-friendly interface, allowing users to record their health status with simple operations. The entered data is securely transmitted from the device to the server.
[0038] The server stores the received health information in a database. An integrated generation module analyzes this data and automatically generates an optimal care plan using an AI algorithm. The generated plan includes daily care activity plans, dietary recommendations, and exercise programs. The generated information is notified to family members and relevant parties via a communication module. This enables rapid information sharing and collaboration.
[0039] Furthermore, the server incorporates a monitoring module that continuously monitors health information trends and sends warning messages to the user's terminal if an anomaly is detected. For example, if a blood pressure increase exceeding the expected range is detected, it can quickly notify the user and recommend necessary countermeasures.
[0040] Users can use the in-app communication module to exchange messages in real time with other family members and healthcare professionals. For example, if an elderly person records that they completed their daily exercise routine in the morning, that information can be shared with other family members, and feedback can be obtained.
[0041] Furthermore, the generated care plans and activity records are stored in a cloud environment, making them accessible to all stakeholders anytime, anywhere. This allows family members living far away to effectively participate in caregiving.
[0042] In this way, this system enables smooth information sharing and efficient care among users, the elderly, their families, and healthcare professionals.
[0043] The following describes the processing flow.
[0044] Step 1:
[0045] The user launches the application on their device and enters health information about the elderly. Specifically, they enter information such as blood pressure, heart rate, diet, and exercise level into a form and submit the information by pressing the submit button.
[0046] Step 2:
[0047] The terminal checks the entered data and verifies the accuracy of its format and content. After verification, it sends the data to the server using a security protocol.
[0048] Step 3:
[0049] The server receives data sent from the terminal and stores it in the database. After verifying the consistency and completeness of the data, it passes it to the generation module.
[0050] Step 4:
[0051] The generation module on the server generates a care plan based on the received health information. In this generation process, an AI algorithm creates the optimal plan by referring to past data and medical best practices.
[0052] Step 5:
[0053] The generated care plan is notified to all relevant parties via the server's communication module. The notification is sent via push message or email and reaches the user's device.
[0054] Step 6:
[0055] The monitoring module integrated into the server continuously monitors health information. If an abnormal value is detected, it sends an alert to the user's terminal and suggests appropriate countermeasures.
[0056] Step 7:
[0057] Users can exchange messages in real time with family members and medical professionals using a communication module on their device. This allows for the sharing of information about their latest health status and care needs.
[0058] Step 8:
[0059] Ultimately, all data and generated information are stored in a cloud environment and managed in a way that makes them accessible to all stakeholders. This allows family members in remote locations to participate in the care process.
[0060] (Example 1)
[0061] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0062] Continuously monitoring the health of the elderly and detecting abnormalities early is crucial for providing effective support. However, current systems often present challenges in terms of cumbersome data collection, analysis, and sharing, making rapid response difficult. Furthermore, insufficient information sharing and communication among stakeholders makes it difficult to develop flexible care plans tailored to the individual circumstances of the elderly.
[0063] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0064] In this invention, the server includes means including a storage device for storing and managing transmitted data, means including a processing device for analyzing the stored data and generating an optimized support plan, and means including a notification device for communicating the generated support plan to relevant people. This enables efficient management and analysis of health data, and allows for rapid notification and proposal of countermeasures in the event of an abnormality. Furthermore, it facilitates smooth communication among stakeholders and enables the formulation and sharing of support plans appropriate for the elderly.
[0065] A "terminal device" is an electronic device used by users to record their health status.
[0066] A "communication device" is a device or software used to securely transmit recorded data to another device.
[0067] A "storage device" is a data storage device or system used to store and manage transmitted data.
[0068] A "processing device" refers to a computer device and its software used to analyze stored data and generate an optimized support plan.
[0069] A "notification device" is an electronic device or service used to communicate a generated support plan to relevant individuals.
[0070] A "monitoring device" is a device or system used to monitor data, identify abnormal values, and issue warnings.
[0071] A "communication device" is a device that has the function of exchanging electronic messages to support dialogue between parties involved.
[0072] A "management device" is a system that stores support plans and data in an online environment, making them accessible to relevant parties remotely.
[0073] A "decision-making device" is a program or device that recommends preventive measures based on analyzed data.
[0074] This invention is a system that efficiently manages the health of the elderly through the coordination of multiple devices and software. This system consists of terminal devices, a server, and multiple modules, which enable its functionality.
[0075] Terminal device:
[0076] Users input health information for the elderly through a dedicated application using terminal devices such as smartphones and tablets. This application has a user-friendly interface, allowing users to easily record data such as blood pressure, body temperature, and heart rate. This data is securely and quickly transmitted to the server via the terminal device's communication functions.
[0077] server:
[0078] The server stores and manages received health data in a database. This data is analyzed by an integrated processing module, and an optimal care plan is generated using a generative AI model. The plan includes daily activity schedules and recommendations for diet and exercise. By utilizing AI technology, detailed suggestions tailored to each individual's health condition are possible.
[0079] The server also has a monitoring function that tracks trends in the collected data. If an anomaly is detected, a warning message can be sent to the user's terminal to prompt a quick response. For example, if a sudden increase in blood pressure is detected, a recommendation for appropriate medical action will be issued.
[0080] Sharing information:
[0081] The generated care plan is quickly notified to relevant family members and medical professionals via a communication module. Users can also utilize the app's communication features to share messages and images. This allows stakeholders, even those in remote locations, to stay informed about the patient's health status and provide feedback as needed.
[0082] The cloud environment stores support plans and past health data, which users and stakeholders can access from anywhere. This allows family members living far away to effectively participate in caregiving.
[0083] Examples of specific cases and prompt statements:
[0084] One specific example is when elderly individuals record their daily exercise and use that data to manage their health. The generated exercise program is then shared with family members, who can monitor its progress.
[0085] An example of a prompt message is, "Based on this week's health data for seniors, please generate an optimal exercise program." This allows you to instruct the system in this way.
[0086] In this way, this system enables smooth information sharing and efficient health management among users, the elderly, their families, and healthcare professionals.
[0087] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0088] Step 1:
[0089] Data entry
[0090] Users input health information for elderly individuals using a dedicated application on a terminal device. This input includes numerical data such as blood pressure, body temperature, and heart rate. The entered information is temporarily stored on the terminal device, and its accuracy is verified. This data undergoes temporary processing on the terminal before being prepared for transmission to the server.
[0091] Step 2:
[0092] Data transmission
[0093] The device transmits collected health data to the server using a secure communication protocol. A key feature is that the data is encrypted during transmission, ensuring its security after transmission. Once the input data reaches the server, the process can proceed to the next stage.
[0094] Step 3:
[0095] Data reception and storage
[0096] The server receives data sent from the terminal and stores it in the database. During the storage process, the data format is checked, and data cleansing is performed as needed. As a result, a clean and organized dataset is obtained, preparing it for a smooth subsequent analysis process.
[0097] Step 4:
[0098] Data analysis and plan generation
[0099] The server uses the stored data to begin analysis using a generative AI model. At this stage, it performs trend analysis of health conditions and generates an optimal care plan tailored to each individual's health status. The specific output includes a plan that includes daily activity schedules, dietary recommendations, and exercise program suggestions.
[0100] Step 5:
[0101] Notifications and sharing
[0102] The generated care plan is communicated from the server to relevant family members and healthcare professionals via a notification module. This process takes into account the appropriateness of the message content and the timing to ensure that stakeholders receive the information quickly.
[0103] Step 6:
[0104] Anomaly detection and warning issuance
[0105] The server's monitoring module continues to continuously observe the data, and if any abnormal patterns are detected, it promptly sends a warning message to the terminal. This process ensures the safety of elderly users and allows for appropriate action to be taken.
[0106] Step 7:
[0107] Real-time communication and cloud access
[0108] Users can exchange messages with family members and medical professionals in real time through the device's communication function. At the same time, they can easily access data stored in the cloud, allowing them to obtain and share information from anywhere. This improves the quality of care and creates an environment where all stakeholders can work together to optimize the care of the elderly.
[0109] (Application Example 1)
[0110] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0111] In elderly care, there is a need to efficiently manage health information and quickly provide individually optimized care plans. Furthermore, a system is needed that allows family members, care staff, and other stakeholders to share information in real time and respond quickly when abnormalities are detected. Additionally, methods are needed that allow stakeholders, even those in remote locations, to participate in caregiving.
[0112] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0113] In this invention, the server includes means including a data receiving device for acquiring health information of elderly persons, means including a generation module for analyzing the acquired information and generating individually optimized care processes, and means including a communication device for notifying multiple relevant users of the generated care processes. This enables efficient management of health information, provision of optimized care processes, real-time information sharing and rapid response in the event of anomaly detection, and remote involvement.
[0114] The term "elderly" generally refers to people aged 65 and over, who are often the group that requires particular health management and care support.
[0115] "Health information" refers to data about an individual's physical condition and lifestyle, including, for example, blood pressure, body temperature, heart rate, and steps taken.
[0116] A "data receiving device" is a mechanism for receiving information input from various sensors or users, and often includes smartphones and other mobile devices.
[0117] A "generative module" is a system component that analyzes received data and forms some kind of plan or procedure based on it, and can utilize artificial intelligence or algorithms.
[0118] The "care process" refers to a series of activities and policies related to the care of a specific elderly person, encompassing everything from support for daily living activities to activities for maintaining and promoting health.
[0119] "Communication equipment" refers to devices and software that enable the transmission of data and information to other devices or systems, and also includes interfaces for connecting to a network.
[0120] A "monitoring device" is a device that continuously monitors data, promptly identifies the occurrence of abnormal situations, and provides necessary notifications.
[0121] A "communication device" refers to a system or tool that enables multiple people to share information and communicate with one another.
[0122] A "cloud infrastructure" refers to a remote, virtual infrastructure for using computing resources and data over the internet.
[0123] A "data management device" refers to a system or application that securely stores data and makes it easily accessible when needed.
[0124] A "proposal device" is a system or device that has the function of presenting effective strategies or options based on analyzed data.
[0125] In implementing this invention, a smartphone or tablet is used as the terminal. The user inputs the elderly person's daily health information via these terminals. This information is biometric data such as blood pressure and heart rate, and is acquired through sensors or manual input. The terminal securely transmits the input health data to a cloud-based server.
[0126] The server stores the received health information in a database, after which a generation module analyzes the data. This analysis uses artificial intelligence software such as TENSORFLOW®. Based on the analysis results, an individually optimized care process is generated. This generated care process includes plans for daily care activities and health promotion programs.
[0127] The generated care process is notified to multiple users via a communication device. Here, "users" refers to family members and care staff. Furthermore, the monitoring device continuously monitors health information and immediately sends a warning message to the terminal if an abnormal event is detected. This function enables a rapid response.
[0128] Furthermore, communication devices are provided, enabling real-time information exchange among users. For example, records of exercises performed by elderly individuals in the morning can be shared among family members, and countermeasures and comments can be exchanged in real time.
[0129] As a concrete example of its use, by inputting a prompt message such as, "Create a recommended care plan for a male in his 70s whose blood pressure has recently been on an upward trend. Please suggest appropriate care activities and precautions considering his current health condition," into the AI model, it is possible to automatically obtain a personalized care process.
[0130] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0131] Step 1:
[0132] The device retrieves health information entered by the user. This input is done using a smartphone application, where the user manually selects items and enters numerical values such as blood pressure and heart rate. The entered information is temporarily stored on the device.
[0133] Step 2:
[0134] The device transmits the acquired health information to a server on the cloud infrastructure. This communication is encrypted using SSL / TLS, ensuring a secure connection. The entered health data is received on the server side.
[0135] Step 3:
[0136] The server stores the received data in a database and passes that information to a generation module. The generation module analyzes the data using AI software such as TensorFlow. Through this analysis, it automatically generates an optimal care process for the elderly.
[0137] Step 4:
[0138] The server uses communication devices to notify relevant parties of the generated care process. Notifications are sent via email or in-app notifications. This allows family members and care staff to individually review the most suitable care plan.
[0139] Step 5:
[0140] The server continuously analyzes health information via monitoring devices and detects abnormal events. This analysis uses real-time processing; for example, if blood pressure exceeds a certain threshold, a warning message is generated prompting action.
[0141] Step 6:
[0142] Information is exchanged between users using the communication device built into the terminal. Users can chat with family members and medical professionals through the app, for example, to share questions and feedback regarding the care process.
[0143] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0144] This invention aims to provide a comprehensive care support system for the elderly that considers not only the management of health information but also the emotional state of the user. This system combines various modules to achieve efficient and effective care support.
[0145] Users use applications on their smart devices to input health information about seniors and engage in daily communication. Users can also naturally input their emotions through the device, or the system can automatically input them. The device formats this information appropriately before sending it to the server.
[0146] On the server, the generation module and emotion engine work together to create an optimal care plan based on the received health and emotional information. The emotion engine analyzes the input emotional information and evaluates the stress level and mental state of the user or elderly person. This evaluation result is reflected in the care plan by the generation module's algorithm, and adjustments are made to daily activities and care content.
[0147] For example, if an elderly person has a prolonged period of inactivity and the caregiver is assessed as experiencing stress, the emotional engine will add relaxation-promoting activities and stress-reducing techniques to the care plan. For instance, it might recommend listening to relaxation music or incorporate light exercise into the schedule.
[0148] The generated care plans and emotion-based advice are communicated to all stakeholders via a communication module. Caregivers, in particular, receive special support based on their emotional state. Health information and emotional states are continuously monitored on the server, and any abnormalities are immediately alerted to the terminal, providing an opportunity to take appropriate action.
[0149] Furthermore, the communication module allows users and stakeholders to share information in real time and receive necessary feedback and advice, enabling closer collaboration.
[0150] The entire system manages data in a cloud environment, making it accessible to all stakeholders and offering the advantage of enabling participation in caregiving regardless of location. In this way, it improves the quality of care for the elderly while reducing the mental burden on caregivers themselves.
[0151] The following describes the processing flow.
[0152] Step 1:
[0153] Users input health information and their emotional state using an application on their device. This input includes methods such as touch input and voice input. Users can easily record daily changes in their physical condition and emotions.
[0154] Step 2:
[0155] The terminal checks the format of the entered health and emotional information and converts it into a formal data format. After conversion, the data is encrypted and sent to the server.
[0156] Step 3:
[0157] The server receives information sent from the terminal and stores it in the database. It then checks the consistency and integrity of the data and prepares for the next processing step.
[0158] Step 4:
[0159] The server's generation module generates a care plan based on the received health information. Simultaneously, the emotion engine analyzes the emotional information and evaluates the psychological state of the user and the elderly person. This evaluation result is used as an adjustment parameter for the care plan.
[0160] Step 5:
[0161] Based on the results from the generation module and the emotion engine, a comprehensive care plan is created, incorporating additional activities and care plans tailored to the individual's emotions. For example, this might include suggestions for stress reduction.
[0162] Step 6:
[0163] The generated care plan and the emotional engine's advice are communicated to all stakeholders via push notifications and email through the server's communication module. This allows stakeholders to receive the latest information immediately.
[0164] Step 7:
[0165] The server's monitoring module continuously analyzes stored health and emotional data, and if an anomaly is detected, it immediately sends a warning notification to the user's terminal. Specific countermeasures are also provided at that time.
[0166] Step 8:
[0167] Users can utilize the application's communication module to communicate in real time with other family members and healthcare professionals, allowing them to receive immediate feedback and support suggestions.
[0168] Step 9:
[0169] Finally, the server stores all data in a cloud environment, allowing stakeholders to log in and access it anytime, anywhere. This enables stakeholders in remote locations to check the latest information on caregiving and collaboratively devise countermeasures.
[0170] (Example 2)
[0171] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0172] In elderly care, comprehensive support is required that takes into account not only health information but also emotional information. However, conventional systems have difficulty accurately analyzing emotional information and reflecting it in appropriate care plans, and problems such as the situation only being communicated to a limited number of administrators arise. As a result, the quality of care is declining and the burden on caregivers is increasing.
[0173] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0174] In this invention, the server includes means including a device for receiving and shaping biometric and emotional information of elderly persons; means including a generation device in which an emotional engine uses the received information to evaluate stress levels and generate an optimal care plan; and means including a transmission device for notifying multiple administrators of the generated care plan and emotionally-based advice. This enables the real-time sharing of an optimal care plan that takes into account the emotions of elderly persons and caregivers with all administrators, thereby improving the quality of care and reducing the burden on caregivers.
[0175] "Biometric information" refers to data that indicates the daily health status of elderly people, including information such as body temperature and blood pressure.
[0176] "Emotional information" refers to data that indicates the emotional state of users or elderly individuals, and includes information such as stress levels and mental state.
[0177] A "device" is a device used to input and format biometric and emotional information, and includes smart devices and sensor equipment.
[0178] A "generation device" is a device that uses an emotion engine to generate an optimal care plan based on received biometric and emotional information.
[0179] A "transfer device" is a device that notifies relevant parties of the generated care plan and emotionally-based advice, and includes a communication module.
[0180] An "auditing device" is a device that continuously monitors biometric information and issues a warning if an abnormality is detected.
[0181] A "dialogue device" is a device that enables two-way information sharing among stakeholders, and includes a communication module.
[0182] A "regulation device" is a device that stores care plans in a network environment, making them accessible to relevant parties at any time.
[0183] A "support device" is a device that proposes preventive measures based on evaluated biological and emotional information.
[0184] This invention is a system that provides comprehensive care support for the elderly, taking into account not only health information but also emotional information. The following describes a specific form for implementing this system.
[0185] Users input biometric information about the health status of elderly individuals using a smart device application. This includes data such as body temperature and blood pressure. Users can also input their own and the elderly individuals' emotional information, which can be entered using multiple-choice options or automated input using voice and facial recognition technology.
[0186] The terminal formats the input information and converts it into a data format for transmission to the cloud server. This process is performed using application software installed on the smart device. The terminal uses a secure protocol (e.g., HTTPS) to transmit data and protect privacy.
[0187] The server receives biometric and emotional information and analyzes it using a generative AI model. The emotional engine evaluates the emotional information, quantifying stress levels and mental state. Based on these evaluation results, the generator creates an optimal care plan for the elderly. For example, if stress levels are high, it can suggest incorporating relaxation music into the plan.
[0188] The generated care plan and emotion-based advice are communicated to all relevant parties via a transfer device. Furthermore, the server continuously monitors biometric information using an auditing device and issues an immediate alert if any anomalies occur, enabling a rapid response.
[0189] Furthermore, the dialogue device allows stakeholders to share information and provide feedback in real time. This two-way information sharing is important for improving the quality of care and reducing the burden on caregivers.
[0190] As a concrete example, here is an example of a prompt message for a generative AI model: "An elderly person has been less active lately, and their caregiver is feeling stressed. Please use the emotion engine to suggest the best care plan for this situation."
[0191] In this form, the invention provides a system that optimizes elderly care and reduces the burden on those involved.
[0192] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0193] Step 1:
[0194] Users launch the application on their smart device and input biometric information related to the health status of elderly individuals, such as body temperature and blood pressure. Users can also input their own or the elderly individual's emotional state using multiple-choice input or voice / facial recognition technology. This input is stored on the device through the application software.
[0195] Step 2:
[0196] The device acquires biometric and emotional information entered by the user and formats the data. Specifically, biometric information is converted into numerical data, and emotional information is converted into predefined categorical data. This formatted data is then ready to be sent to a cloud server using a secure communication protocol.
[0197] Step 3:
[0198] The server receives biometric and emotional information transmitted from the terminal. Based on the received data, a generative AI model analyzes the relationships between them. During the analysis process, the emotion engine evaluates the emotional information and quantifies the stress level. This evaluation serves as foundational data for determining future care plans.
[0199] Step 4:
[0200] The server uses a generative AI model to generate an optimal care plan. Considering stress levels and health conditions derived from input data, it creates specific care plans and suggestions, such as "listen to relaxation music for 10 minutes every day." The generated care plan is then ready for distribution to all relevant parties.
[0201] Step 5:
[0202] The server notifies stakeholders of care plans and emotion-based advice generated using the transfer device. The notification includes details of the recommended care plan and corresponding action instructions. This allows stakeholders to obtain the latest care information in real time and implement appropriate measures.
[0203] Step 6:
[0204] The server continuously monitors biometric information, and if abnormal data is detected using auditing equipment, it generates an alert and quickly notifies the relevant parties. This allows those involved to respond immediately to abnormal situations, improving the quality and safety of care.
[0205] (Application Example 2)
[0206] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".
[0207] In elderly care, comprehensive support is required that takes into account not only the management of health information but also the emotional state of the caregiver. However, conventional systems have difficulty effectively integrating these two aspects and dynamically adjusting care plans. Furthermore, the lack of infrastructure for all stakeholders to share information in real time has made it difficult to improve the quality of life for the elderly and reduce the mental burden on caregivers.
[0208] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0209] In this invention, the server includes means including an input device for receiving the physiological parameters of the elderly person and the emotional state of the caregiver; means including a generation and emotion engine module for generating an optimal care plan based on the input information and analyzing the emotional state of the user; means including a care plan that proposes activities aimed at improving lifestyle habits; and means including communication means for notifying relevant parties of the care plan, which includes activities based on a specific emotional state. This enables the creation of plans that meet the needs of both the caregiver and the elderly person, and real-time information sharing.
[0210] "Physiological parameters for the elderly" are indicators of the health status of the elderly and include physiological data such as heart rate, blood pressure, and body temperature.
[0211] "The emotional state of the caregiver" refers to information that indicates the psychological and emotional situation of the caregiver, and is data that evaluates stress levels and mood.
[0212] An "input device" is a device or system for receiving the physiological parameters of elderly individuals and the emotional state of caregivers as digital data.
[0213] A "generation and emotion engine module" is a program or system that creates an optimal care plan based on received information and analyzes emotional information to reflect it in the care plan.
[0214] "Communication means" refers to a digital communication method or system for transmitting generated care plans and related information to multiple relevant parties.
[0215] An "analysis and alarm module" is a software or hardware component that analyzes data to detect anomalies and sends necessary warnings to the relevant parties.
[0216] A "cloud environment" is the infrastructure of cloud computing provided via the internet, and is a technological foundation that enables data storage, processing, and access.
[0217] This system is a comprehensive care support system designed to efficiently manage the physiological parameters of elderly individuals and the emotional state of caregivers, and to create optimal care plans. Users can input the physiological parameters of elderly individuals and their own emotional state using devices such as smartphones and tablets. This data is sent to a server in the cloud. The server appropriately formats the data and performs analysis using a generation and emotion engine module. This module uses natural language processing and machine learning algorithms to evaluate the input emotional information and determine stress levels and mental state. As a result, necessary adjustments are dynamically made to the care plan.
[0218] Furthermore, the generated care plan is notified to all relevant parties in real time via communication channels. This allows caregivers to quickly provide care tailored to the elderly person's condition. The analysis and alarm module constantly monitors the received data and immediately issues an alarm if an anomaly is detected. This system can be used regardless of location by accessing a cloud environment via the internet.
[0219] For example, if recent data indicates that an elderly person is not very active, a message recommending a weekend video call will be sent to their caregiver. In such a case, the following example prompt for the generative AI model will be used: "Recent monitoring data indicates that the elderly person is not very active, and their caregiver is experiencing stress. Please suggest specific activities or advice to improve this situation."
[0220] In this way, it is possible to improve the quality of life for the elderly and reduce the burden on caregivers.
[0221] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0222] Step 1:
[0223] The user uses a terminal to input the physiological parameters of the elderly person (e.g., heart rate, blood pressure) and the emotional state of the caregiver (e.g., stress level). The input data is sent to a server connected to the cloud. The input here is physiological and emotional data, and the output is formatted data. The server converts the input data to a standard format.
[0224] Step 2:
[0225] The server uses generation and emotion engine modules to analyze the received data. This includes a process of evaluating emotional states using natural language processing techniques. The input for this step is formatted data, and the output is analyzed emotional and health status information. Based on this analysis, the server evaluates stress levels and health status and generates data to be reflected in care plans.
[0226] Step 3:
[0227] The generated care plan and analyzed emotional information are communicated to relevant parties via communication means. The input for this step is the analyzed information, and the output is a care plan in notification format. The server distributes this data and sends messages to relevant parties in real time. The notification includes future activity plans and recommended adjustments.
[0228] Step 4:
[0229] The analysis and alarm modules continuously monitor the data and immediately issue an alarm if an anomaly is detected. The input here is newly received data, and the output is a warning message. When an anomaly is detected, the server alerts relevant parties and suggests appropriate countermeasures.
[0230] Step 5:
[0231] Users and stakeholders adjust their lifestyles based on feedback provided by the system through real-time communication. Input is system-provided information, and output is the status of the adjusted care implementation. Users can use this information to modify the care plan as needed.
[0232] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0233] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0234] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0235] [Second Embodiment]
[0236] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0237] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0238] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0239] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0240] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0241] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0242] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0243] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0244] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0245] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0246] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0247] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0248] This system is designed to efficiently support elderly care and consists of multiple modules. The system primarily handles data input from terminals, data processing, generation, management, notification, and information sharing on the server.
[0249] Users first input their daily health information using a dedicated application on a device such as a smartphone or tablet. This application provides a user-friendly interface, allowing users to record their health status with simple operations. The entered data is securely transmitted from the device to the server.
[0250] The server stores the received health information in a database. An integrated generation module analyzes this data and automatically generates an optimal care plan using an AI algorithm. The generated plan includes daily care activity plans, dietary recommendations, and exercise programs. The generated information is notified to family members and relevant parties via a communication module. This enables rapid information sharing and collaboration.
[0251] Furthermore, the server incorporates a monitoring module that continuously monitors health information trends and sends warning messages to the user's terminal if an anomaly is detected. For example, if a blood pressure increase exceeding the expected range is detected, it can quickly notify the user and recommend necessary countermeasures.
[0252] Users can use the in-app communication module to exchange messages in real time with other family members and healthcare professionals. For example, if an elderly person records that they completed their daily exercise routine in the morning, that information can be shared with other family members, and feedback can be obtained.
[0253] Furthermore, the generated care plans and activity records are stored in a cloud environment, making them accessible to all stakeholders anytime, anywhere. This allows family members living far away to effectively participate in caregiving.
[0254] In this way, this system enables smooth information sharing and efficient care among users, the elderly, their families, and healthcare professionals.
[0255] The following describes the processing flow.
[0256] Step 1:
[0257] The user launches the application on their device and enters health information about the elderly. Specifically, they enter information such as blood pressure, heart rate, diet, and exercise level into a form and submit the information by pressing the submit button.
[0258] Step 2:
[0259] The terminal checks the entered data and verifies the accuracy of its format and content. After verification, it sends the data to the server using a security protocol.
[0260] Step 3:
[0261] The server receives data sent from the terminal and stores it in the database. After verifying the consistency and completeness of the data, it passes it to the generation module.
[0262] Step 4:
[0263] The generation module on the server generates a care plan based on the received health information. In this generation process, an AI algorithm creates the optimal plan by referring to past data and medical best practices.
[0264] Step 5:
[0265] The generated care plan is notified to all relevant parties via the server's communication module. The notification is sent via push message or email and reaches the user's device.
[0266] Step 6:
[0267] The monitoring module integrated into the server continuously monitors health information. If an abnormal value is detected, it sends an alert to the user's terminal and suggests appropriate countermeasures.
[0268] Step 7:
[0269] Users can exchange messages in real time with family members and medical professionals using a communication module on their device. This allows for the sharing of information about their latest health status and care needs.
[0270] Step 8:
[0271] Ultimately, all data and generated information are stored in a cloud environment and managed in a way that makes them accessible to all stakeholders. This allows family members in remote locations to participate in the care process.
[0272] (Example 1)
[0273] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0274] Continuously monitoring the health of the elderly and detecting abnormalities early is crucial for providing effective support. However, current systems often present challenges in terms of cumbersome data collection, analysis, and sharing, making rapid response difficult. Furthermore, insufficient information sharing and communication among stakeholders makes it difficult to develop flexible care plans tailored to the individual circumstances of the elderly.
[0275] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0276] In this invention, the server includes means including a storage device for storing and managing transmitted data, means including a processing device for analyzing the stored data and generating an optimized support plan, and means including a notification device for communicating the generated support plan to relevant people. This enables efficient management and analysis of health data, and allows for rapid notification and proposal of countermeasures in the event of an abnormality. Furthermore, it facilitates smooth communication among stakeholders and enables the formulation and sharing of support plans appropriate for the elderly.
[0277] A "terminal device" is an electronic device used by users to record their health status.
[0278] A "communication device" is a device or software used to securely transmit recorded data to another device.
[0279] A "memory device" is a data storage device or system for storing and managing transmitted data.
[0280] A "processing device" is a computer device and its software for analyzing stored data and generating an optimized support plan.
[0281] A "notification device" is an electronic device or service for transmitting the generated support plan to relevant people.
[0282] A "monitoring device" is a device or system for monitoring data to identify abnormal values and issue warnings.
[0283] A "communication device" is a device with an electronic message exchange function for supporting interactions among related parties.
[0284] A "management device" is a system for storing support plans and data in an online environment so that related parties can access them remotely.
[0285] A "judgment device" is a program or device that recommends preventive measures based on the analyzed data.
[0286] This invention is a system for efficiently managing the health of the elderly through the cooperation of multiple devices and software. This system is composed of a terminal device, a server, and multiple modules, and realizes its functions.
[0287] Terminal device:
[0288] The user uses a terminal device such as a smartphone or a tablet to input the health information of the elderly through a dedicated application. This application has a user-friendly interface, and the user can easily record data such as blood pressure, body temperature, and heart rate. In addition, these data are securely and quickly transmitted to the server through the communication function of the terminal device.
[0289] server:
[0290] The server stores and manages received health data in a database. This data is analyzed by an integrated processing module, and an optimal care plan is generated using a generative AI model. The plan includes daily activity schedules and recommendations for diet and exercise. By utilizing AI technology, detailed suggestions tailored to each individual's health condition are possible.
[0291] The server also has a monitoring function that tracks trends in the collected data. If an anomaly is detected, a warning message can be sent to the user's terminal to prompt a quick response. For example, if a sudden increase in blood pressure is detected, a recommendation for appropriate medical action will be issued.
[0292] Sharing information:
[0293] The generated care plan is quickly notified to relevant family members and medical professionals via a communication module. Users can also utilize the app's communication features to share messages and images. This allows stakeholders, even those in remote locations, to stay informed about the patient's health status and provide feedback as needed.
[0294] The cloud environment stores support plans and past health data, which users and stakeholders can access from anywhere. This allows family members living far away to effectively participate in caregiving.
[0295] Examples of specific cases and prompt statements:
[0296] One specific example is when elderly individuals record their daily exercise and use that data to manage their health. The generated exercise program is then shared with family members, who can monitor its progress.
[0297] As an example of a prompt sentence, it is possible to give instructions to the system in the form of "Please generate an optimal exercise program based on the data of the health information of the elderly this week."
[0298] In this way, this system realizes smooth information sharing and efficient health management among users, the elderly, their families, and medical staff.
[0299] The flow of the specific process in Example 1 will be described using FIG. 11.
[0300] Step 1:
[0301] Data input
[0302] The user uses a dedicated application on the terminal device to input the health information of the elderly. Specific inputs include numerical data such as blood pressure, body temperature, and heart rate. The input information is temporarily stored in the terminal device, and it is confirmed that the accuracy is reliably maintained. This data is prepared to be sent to the server after undergoing temporary processing on the terminal.
[0303] Step 2:
[0304] Data transmission
[0305] The terminal uses a secure communication protocol to send the collected health data to the server. At this time, the data is encrypted, and it is characterized by ensuring security after transmission. When the input data reaches the server, it becomes possible to proceed to the next stage.
[0306] Step 3:
[0307] Data reception and storage
[0308] The server receives data sent from the terminal and stores it in the database. During the storage process, the data format is checked, and data cleansing is performed as needed. As a result, a clean and organized dataset is obtained, preparing it for a smooth subsequent analysis process.
[0309] Step 4:
[0310] Data analysis and plan generation
[0311] The server uses the stored data to begin analysis using a generative AI model. At this stage, it performs trend analysis of health conditions and generates an optimal care plan tailored to each individual's health status. The specific output includes a plan that includes daily activity schedules, dietary recommendations, and exercise program suggestions.
[0312] Step 5:
[0313] Notifications and sharing
[0314] The generated care plan is communicated from the server to relevant family members and healthcare professionals via a notification module. This process takes into account the appropriateness of the message content and the timing to ensure that stakeholders receive the information quickly.
[0315] Step 6:
[0316] Anomaly detection and warning issuance
[0317] The server's monitoring module continues to continuously observe the data, and if any abnormal patterns are detected, it promptly sends a warning message to the terminal. This process ensures the safety of elderly users and allows for appropriate action to be taken.
[0318] Step 7:
[0319] Real-time communication and cloud access
[0320] Users can exchange messages with family members and medical professionals in real time through the device's communication function. At the same time, they can easily access data stored in the cloud, allowing them to obtain and share information from anywhere. This improves the quality of care and creates an environment where all stakeholders can work together to optimize the care of the elderly.
[0321] (Application Example 1)
[0322] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0323] In elderly care, there is a need to efficiently manage health information and quickly provide individually optimized care plans. Furthermore, a system is needed that allows family members, care staff, and other stakeholders to share information in real time and respond quickly when abnormalities are detected. Additionally, methods are needed that allow stakeholders, even those in remote locations, to participate in caregiving.
[0324] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0325] In this invention, the server includes means including a data receiving device for acquiring health information of elderly persons, means including a generation module for analyzing the acquired information and generating individually optimized care processes, and means including a communication device for notifying multiple relevant users of the generated care processes. This enables efficient management of health information, provision of optimized care processes, real-time information sharing and rapid response in the event of anomaly detection, and remote involvement.
[0326] The term "elderly" generally refers to people aged 65 and over, who are often the group that requires particular health management and care support.
[0327] "Health information" refers to data about an individual's physical condition and lifestyle, including, for example, blood pressure, body temperature, heart rate, and steps taken.
[0328] A "data receiving device" is a mechanism for receiving information input from various sensors or users, and often includes smartphones and other mobile devices.
[0329] A "generative module" is a system component that analyzes received data and forms some kind of plan or procedure based on it, and can utilize artificial intelligence or algorithms.
[0330] The "care process" refers to a series of activities and policies related to the care of a specific elderly person, encompassing everything from support for daily living activities to activities for maintaining and promoting health.
[0331] "Communication equipment" refers to devices and software that enable the transmission of data and information to other devices or systems, and also includes interfaces for connecting to a network.
[0332] A "monitoring device" is a device that continuously monitors data, promptly identifies the occurrence of abnormal situations, and provides necessary notifications.
[0333] A "communication device" refers to a system or tool that enables multiple people to share information and communicate with one another.
[0334] A "cloud infrastructure" refers to a remote, virtual infrastructure for using computing resources and data over the internet.
[0335] A "data management device" refers to a system or application that securely stores data and makes it easily accessible when needed.
[0336] A "proposal device" is a system or device that has the function of presenting effective strategies or options based on analyzed data.
[0337] In implementing this invention, a smartphone or tablet is used as the terminal. The user inputs the elderly person's daily health information via these terminals. This information is biometric data such as blood pressure and heart rate, and is acquired through sensors or manual input. The terminal securely transmits the input health data to a cloud-based server.
[0338] The server stores the received health information in a database, after which a generation module analyzes the data. This analysis uses artificial intelligence software such as TensorFlow. Based on the analysis results, an individually optimized care process is generated. This generated care process includes plans for daily care activities and health promotion programs.
[0339] The generated care process is notified to multiple users via a communication device. Here, "users" refers to family members and care staff. Furthermore, the monitoring device continuously monitors health information and immediately sends a warning message to the terminal if an abnormal event is detected. This function enables a rapid response.
[0340] Furthermore, communication devices are provided, enabling real-time information exchange among users. For example, records of exercises performed by elderly individuals in the morning can be shared among family members, and countermeasures and comments can be exchanged in real time.
[0341] As a concrete example of its use, by inputting a prompt message such as, "Create a recommended care plan for a male in his 70s whose blood pressure has recently been on an upward trend. Please suggest appropriate care activities and precautions considering his current health condition," into the AI model, it is possible to automatically obtain a personalized care process.
[0342] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0343] Step 1:
[0344] The device retrieves health information entered by the user. This input is done using a smartphone application, where the user manually selects items and enters numerical values such as blood pressure and heart rate. The entered information is temporarily stored on the device.
[0345] Step 2:
[0346] The device transmits the acquired health information to a server on the cloud infrastructure. This communication is encrypted using SSL / TLS, ensuring a secure connection. The entered health data is received on the server side.
[0347] Step 3:
[0348] The server stores the received data in a database and passes that information to a generation module. The generation module analyzes the data using AI software such as TensorFlow. Through this analysis, it automatically generates an optimal care process for the elderly.
[0349] Step 4:
[0350] The server uses communication devices to notify relevant parties of the generated care process. Notifications are sent via email or in-app notifications. This allows family members and care staff to individually review the most suitable care plan.
[0351] Step 5:
[0352] The server continuously analyzes health information via monitoring devices and detects abnormal events. This analysis uses real-time processing; for example, if blood pressure exceeds a certain threshold, a warning message is generated prompting action.
[0353] Step 6:
[0354] Information is exchanged between users using the communication device built into the terminal. Users can chat with family members and medical professionals through the app, for example, to share questions and feedback regarding the care process.
[0355] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0356] This invention aims to provide a comprehensive care support system for the elderly that considers not only the management of health information but also the emotional state of the user. This system combines various modules to achieve efficient and effective care support.
[0357] Users use applications on their smart devices to input health information about seniors and engage in daily communication. Users can also naturally input their emotions through the device, or the system can automatically input them. The device formats this information appropriately before sending it to the server.
[0358] On the server, the generation module and emotion engine work together to create an optimal care plan based on the received health and emotional information. The emotion engine analyzes the input emotional information and evaluates the stress level and mental state of the user or elderly person. This evaluation result is reflected in the care plan by the generation module's algorithm, and adjustments are made to daily activities and care content.
[0359] For example, if an elderly person has a prolonged period of inactivity and the caregiver is assessed as experiencing stress, the emotional engine will add relaxation-promoting activities and stress-reducing techniques to the care plan. For instance, it might recommend listening to relaxation music or incorporate light exercise into the schedule.
[0360] The generated care plans and emotion-based advice are communicated to all stakeholders via a communication module. Caregivers, in particular, receive special support based on their emotional state. Health information and emotional states are continuously monitored on the server, and any abnormalities are immediately alerted to the terminal, providing an opportunity to take appropriate action.
[0361] Furthermore, the communication module allows users and stakeholders to share information in real time and receive necessary feedback and advice, enabling closer collaboration.
[0362] The entire system manages data in a cloud environment, making it accessible to all stakeholders and offering the advantage of enabling participation in caregiving regardless of location. In this way, it improves the quality of care for the elderly while reducing the mental burden on caregivers themselves.
[0363] The following describes the processing flow.
[0364] Step 1:
[0365] Users input health information and their emotional state using an application on their device. This input includes methods such as touch input and voice input. Users can easily record daily changes in their physical condition and emotions.
[0366] Step 2:
[0367] The terminal checks the format of the entered health and emotional information and converts it into a formal data format. After conversion, the data is encrypted and sent to the server.
[0368] Step 3:
[0369] The server receives information sent from the terminal and stores it in the database. It then checks the consistency and integrity of the data and prepares for the next processing step.
[0370] Step 4:
[0371] The server's generation module generates a care plan based on the received health information. Simultaneously, the emotion engine analyzes the emotional information and evaluates the psychological state of the user and the elderly person. This evaluation result is used as an adjustment parameter for the care plan.
[0372] Step 5:
[0373] Based on the results from the generation module and the emotion engine, a comprehensive care plan is created, incorporating additional activities and care plans tailored to the individual's emotions. For example, this might include suggestions for stress reduction.
[0374] Step 6:
[0375] The generated care plan and the emotional engine's advice are communicated to all stakeholders via push notifications and email through the server's communication module. This allows stakeholders to receive the latest information immediately.
[0376] Step 7:
[0377] The server's monitoring module continuously analyzes stored health and emotional data, and if an anomaly is detected, it immediately sends a warning notification to the user's terminal. Specific countermeasures are also provided at that time.
[0378] Step 8:
[0379] Users can utilize the application's communication module to communicate in real time with other family members and healthcare professionals, allowing them to receive immediate feedback and support suggestions.
[0380] Step 9:
[0381] Finally, the server stores all data in a cloud environment, allowing stakeholders to log in and access it anytime, anywhere. This enables stakeholders in remote locations to check the latest information on caregiving and collaboratively devise countermeasures.
[0382] (Example 2)
[0383] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0384] In elderly care, comprehensive support is required that takes into account not only health information but also emotional information. However, conventional systems have difficulty accurately analyzing emotional information and reflecting it in appropriate care plans, and problems such as the situation only being communicated to a limited number of administrators arise. As a result, the quality of care is declining and the burden on caregivers is increasing.
[0385] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0386] In this invention, the server includes means including a device for receiving and shaping biometric and emotional information of elderly persons; means including a generation device in which an emotional engine uses the received information to evaluate stress levels and generate an optimal care plan; and means including a transmission device for notifying multiple administrators of the generated care plan and emotionally-based advice. This enables the real-time sharing of an optimal care plan that takes into account the emotions of elderly persons and caregivers with all administrators, thereby improving the quality of care and reducing the burden on caregivers.
[0387] "Biometric information" refers to data that indicates the daily health status of elderly people, including information such as body temperature and blood pressure.
[0388] "Emotional information" refers to data that indicates the emotional state of users or elderly individuals, and includes information such as stress levels and mental state.
[0389] A "device" is a device used to input and format biometric and emotional information, and includes smart devices and sensor equipment.
[0390] A "generation device" is a device that uses an emotion engine to generate an optimal care plan based on received biometric and emotional information.
[0391] A "transfer device" is a device that notifies relevant parties of the generated care plan and emotionally-based advice, and includes a communication module.
[0392] An "auditing device" is a device that continuously monitors biometric information and issues a warning if an abnormality is detected.
[0393] A "dialogue device" is a device that enables two-way information sharing among stakeholders, and includes a communication module.
[0394] A "regulation device" is a device that stores care plans in a network environment, making them accessible to relevant parties at any time.
[0395] A "support device" is a device that proposes preventive measures based on evaluated biological and emotional information.
[0396] This invention is a system that provides comprehensive care support for the elderly, taking into account not only health information but also emotional information. The following describes a specific form for implementing this system.
[0397] Users input biometric information about the health status of elderly individuals using a smart device application. This includes data such as body temperature and blood pressure. Users can also input their own and the elderly individuals' emotional information, which can be entered using multiple-choice options or automated input using voice and facial recognition technology.
[0398] The terminal formats the input information and converts it into a data format for transmission to the cloud server. This process is performed using application software installed on the smart device. The terminal uses a secure protocol (e.g., HTTPS) to transmit data and protect privacy.
[0399] The server receives biometric and emotional information and analyzes it using a generative AI model. The emotional engine evaluates the emotional information, quantifying stress levels and mental state. Based on these evaluation results, the generator creates an optimal care plan for the elderly. For example, if stress levels are high, it can suggest incorporating relaxation music into the plan.
[0400] The generated care plan and emotion-based advice are communicated to all relevant parties via a transfer device. Furthermore, the server continuously monitors biometric information using an auditing device and issues an immediate alert if any anomalies occur, enabling a rapid response.
[0401] Furthermore, the dialogue device allows stakeholders to share information and provide feedback in real time. This two-way information sharing is important for improving the quality of care and reducing the burden on caregivers.
[0402] As a concrete example, here is an example of a prompt message for a generative AI model: "An elderly person has been less active lately, and their caregiver is feeling stressed. Please use the emotion engine to suggest the best care plan for this situation."
[0403] In this form, the invention provides a system that optimizes elderly care and reduces the burden on those involved.
[0404] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0405] Step 1:
[0406] Users launch the application on their smart device and input biometric information related to the health status of elderly individuals, such as body temperature and blood pressure. Users can also input their own or the elderly individual's emotional state using multiple-choice input or voice / facial recognition technology. This input is stored on the device through the application software.
[0407] Step 2:
[0408] The device acquires biometric and emotional information entered by the user and formats the data. Specifically, biometric information is converted into numerical data, and emotional information is converted into predefined categorical data. This formatted data is then ready to be sent to a cloud server using a secure communication protocol.
[0409] Step 3:
[0410] The server receives biometric and emotional information transmitted from the terminal. Based on the received data, a generative AI model analyzes the relationships between them. During the analysis process, the emotion engine evaluates the emotional information and quantifies the stress level. This evaluation serves as foundational data for determining future care plans.
[0411] Step 4:
[0412] The server uses a generative AI model to generate an optimal care plan. Considering stress levels and health conditions derived from input data, it creates specific care plans and suggestions, such as "listen to relaxation music for 10 minutes every day." The generated care plan is then ready for distribution to all relevant parties.
[0413] Step 5:
[0414] The server notifies stakeholders of care plans and emotion-based advice generated using the transfer device. The notification includes details of the recommended care plan and corresponding action instructions. This allows stakeholders to obtain the latest care information in real time and implement appropriate measures.
[0415] Step 6:
[0416] The server continuously monitors biometric information, and if abnormal data is detected using auditing equipment, it generates an alert and quickly notifies the relevant parties. This allows those involved to respond immediately to abnormal situations, improving the quality and safety of care.
[0417] (Application Example 2)
[0418] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0419] In elderly care, comprehensive support is required that takes into account not only the management of health information but also the emotional state of the caregiver. However, conventional systems have difficulty effectively integrating these two aspects and dynamically adjusting care plans. Furthermore, the lack of infrastructure for all stakeholders to share information in real time has made it difficult to improve the quality of life for the elderly and reduce the mental burden on caregivers.
[0420] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0421] In this invention, the server includes means including an input device for receiving the physiological parameters of the elderly person and the emotional state of the caregiver; means including a generation and emotion engine module for generating an optimal care plan based on the input information and analyzing the emotional state of the user; means including a care plan that proposes activities aimed at improving lifestyle habits; and means including communication means for notifying relevant parties of the care plan, which includes activities based on a specific emotional state. This enables the creation of plans that meet the needs of both the caregiver and the elderly person, and real-time information sharing.
[0422] "Physiological parameters for the elderly" are indicators of the health status of the elderly and include physiological data such as heart rate, blood pressure, and body temperature.
[0423] "The emotional state of the caregiver" refers to information that indicates the psychological and emotional situation of the caregiver, and is data that evaluates stress levels and mood.
[0424] An "input device" is a device or system for receiving the physiological parameters of elderly individuals and the emotional state of caregivers as digital data.
[0425] A "generation and emotion engine module" is a program or system that creates an optimal care plan based on received information and analyzes emotional information to reflect it in the care plan.
[0426] "Communication means" refers to a digital communication method or system for transmitting generated care plans and related information to multiple relevant parties.
[0427] An "analysis and alarm module" is a software or hardware component that analyzes data to detect anomalies and sends necessary warnings to the relevant parties.
[0428] A "cloud environment" is the infrastructure of cloud computing provided via the internet, and is a technological foundation that enables data storage, processing, and access.
[0429] This system is a comprehensive care support system designed to efficiently manage the physiological parameters of elderly individuals and the emotional state of caregivers, and to create optimal care plans. Users can input the physiological parameters of elderly individuals and their own emotional state using devices such as smartphones and tablets. This data is sent to a server in the cloud. The server appropriately formats the data and performs analysis using a generation and emotion engine module. This module uses natural language processing and machine learning algorithms to evaluate the input emotional information and determine stress levels and mental state. As a result, necessary adjustments are dynamically made to the care plan.
[0430] Furthermore, the generated care plan is notified to all relevant parties in real time via communication channels. This allows caregivers to quickly provide care tailored to the elderly person's condition. The analysis and alarm module constantly monitors the received data and immediately issues an alarm if an anomaly is detected. This system can be used regardless of location by accessing a cloud environment via the internet.
[0431] For example, if recent data indicates that an elderly person is not very active, a message recommending a weekend video call will be sent to their caregiver. In such a case, the following example prompt for the generative AI model will be used: "Recent monitoring data indicates that the elderly person is not very active, and their caregiver is experiencing stress. Please suggest specific activities or advice to improve this situation."
[0432] In this way, it is possible to improve the quality of life for the elderly and reduce the burden on caregivers.
[0433] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0434] Step 1:
[0435] The user uses a terminal to input the physiological parameters of the elderly person (e.g., heart rate, blood pressure) and the emotional state of the caregiver (e.g., stress level). The input data is sent to a server connected to the cloud. The input here is physiological and emotional data, and the output is formatted data. The server converts the input data to a standard format.
[0436] Step 2:
[0437] The server uses generation and emotion engine modules to analyze the received data. This includes a process of evaluating emotional states using natural language processing techniques. The input for this step is formatted data, and the output is analyzed emotional and health status information. Based on this analysis, the server evaluates stress levels and health status and generates data to be reflected in care plans.
[0438] Step 3:
[0439] The generated care plan and analyzed emotional information are communicated to relevant parties via communication means. The input for this step is the analyzed information, and the output is a care plan in notification format. The server distributes this data and sends messages to relevant parties in real time. The notification includes future activity plans and recommended adjustments.
[0440] Step 4:
[0441] The analysis and alarm modules continuously monitor the data and immediately issue an alarm if an anomaly is detected. The input here is newly received data, and the output is a warning message. When an anomaly is detected, the server alerts relevant parties and suggests appropriate countermeasures.
[0442] Step 5:
[0443] Users and stakeholders adjust their lifestyles based on feedback provided by the system through real-time communication. Input is system-provided information, and output is the status of the adjusted care implementation. Users can use this information to modify the care plan as needed.
[0444] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0445] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0446] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0447] [Third Embodiment]
[0448] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0449] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0450] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0451] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0452] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0453] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0454] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0455] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0456] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0457] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0458] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0459] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[0460] This system is designed to efficiently support elderly care and consists of multiple modules. The system primarily handles data input from terminals, data processing, generation, management, notification, and information sharing on the server.
[0461] Users first input their daily health information using a dedicated application on a device such as a smartphone or tablet. This application provides a user-friendly interface, allowing users to record their health status with simple operations. The entered data is securely transmitted from the device to the server.
[0462] The server stores the received health information in a database. An integrated generation module analyzes this data and automatically generates an optimal care plan using an AI algorithm. The generated plan includes daily care activity plans, dietary recommendations, and exercise programs. The generated information is notified to family members and relevant parties via a communication module. This enables rapid information sharing and collaboration.
[0463] Furthermore, the server incorporates a monitoring module that continuously monitors health information trends and sends warning messages to the user's terminal if an anomaly is detected. For example, if a blood pressure increase exceeding the expected range is detected, it can quickly notify the user and recommend necessary countermeasures.
[0464] Users can use the in-app communication module to exchange messages in real time with other family members and healthcare professionals. For example, if an elderly person records that they completed their daily exercise routine in the morning, that information can be shared with other family members, and feedback can be obtained.
[0465] Furthermore, the generated care plans and activity records are stored in a cloud environment, making them accessible to all stakeholders anytime, anywhere. This allows family members living far away to effectively participate in caregiving.
[0466] In this way, this system enables smooth information sharing and efficient care among users, the elderly, their families, and healthcare professionals.
[0467] The following describes the processing flow.
[0468] Step 1:
[0469] The user launches the application on their device and enters health information about the elderly. Specifically, they enter information such as blood pressure, heart rate, diet, and exercise level into a form and submit the information by pressing the submit button.
[0470] Step 2:
[0471] The terminal checks the entered data and verifies the accuracy of its format and content. After verification, it sends the data to the server using a security protocol.
[0472] Step 3:
[0473] The server receives data sent from the terminal and stores it in the database. After verifying the consistency and completeness of the data, it passes it to the generation module.
[0474] Step 4:
[0475] The generation module on the server generates a care plan based on the received health information. In this generation process, an AI algorithm creates the optimal plan by referring to past data and medical best practices.
[0476] Step 5:
[0477] The generated care plan is notified to all relevant parties via the server's communication module. The notification is sent via push message or email and reaches the user's device.
[0478] Step 6:
[0479] The monitoring module integrated into the server continuously monitors health information. If an abnormal value is detected, it sends an alert to the user's terminal and suggests appropriate countermeasures.
[0480] Step 7:
[0481] Users can exchange messages in real time with family members and medical professionals using a communication module on their device. This allows for the sharing of information about their latest health status and care needs.
[0482] Step 8:
[0483] Ultimately, all data and generated information are stored in a cloud environment and managed in a way that makes them accessible to all stakeholders. This allows family members in remote locations to participate in the care process.
[0484] (Example 1)
[0485] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0486] Continuously monitoring the health of the elderly and detecting abnormalities early is crucial for providing effective support. However, current systems often present challenges in terms of cumbersome data collection, analysis, and sharing, making rapid response difficult. Furthermore, insufficient information sharing and communication among stakeholders makes it difficult to develop flexible care plans tailored to the individual circumstances of the elderly.
[0487] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0488] In this invention, the server includes means including a storage device for storing and managing transmitted data, means including a processing device for analyzing the stored data and generating an optimized support plan, and means including a notification device for communicating the generated support plan to relevant people. This enables efficient management and analysis of health data, and allows for rapid notification and proposal of countermeasures in the event of an abnormality. Furthermore, it facilitates smooth communication among stakeholders and enables the formulation and sharing of support plans appropriate for the elderly.
[0489] A "terminal device" is an electronic device used by users to record their health status.
[0490] A "communication device" is a device or software used to securely transmit recorded data to another device.
[0491] A "storage device" is a data storage device or system used to store and manage transmitted data.
[0492] A "processing device" refers to a computer device and its software used to analyze stored data and generate an optimized support plan.
[0493] A "notification device" is an electronic device or service used to communicate a generated support plan to relevant individuals.
[0494] A "monitoring device" is a device or system used to monitor data, identify abnormal values, and issue warnings.
[0495] A "communication device" is a device that has the function of exchanging electronic messages to support dialogue between parties involved.
[0496] A "management device" is a system that stores support plans and data in an online environment, making them accessible to relevant parties remotely.
[0497] A "decision-making device" is a program or device that recommends preventive measures based on analyzed data.
[0498] This invention is a system that efficiently manages the health of the elderly through the coordination of multiple devices and software. This system consists of terminal devices, a server, and multiple modules, which enable its functionality.
[0499] Terminal device:
[0500] Users input health information for the elderly through a dedicated application using terminal devices such as smartphones and tablets. This application has a user-friendly interface, allowing users to easily record data such as blood pressure, body temperature, and heart rate. This data is securely and quickly transmitted to the server via the terminal device's communication functions.
[0501] server:
[0502] The server stores and manages received health data in a database. This data is analyzed by an integrated processing module, and an optimal care plan is generated using a generative AI model. The plan includes daily activity schedules and recommendations for diet and exercise. By utilizing AI technology, detailed suggestions tailored to each individual's health condition are possible.
[0503] The server also has a monitoring function that tracks trends in the collected data. If an anomaly is detected, a warning message can be sent to the user's terminal to prompt a quick response. For example, if a sudden increase in blood pressure is detected, a recommendation for appropriate medical action will be issued.
[0504] Sharing information:
[0505] The generated care plan is quickly notified to relevant family members and medical professionals via a communication module. Users can also utilize the app's communication features to share messages and images. This allows stakeholders, even those in remote locations, to stay informed about the patient's health status and provide feedback as needed.
[0506] The cloud environment stores support plans and past health data, which users and stakeholders can access from anywhere. This allows family members living far away to effectively participate in caregiving.
[0507] Examples of specific cases and prompt statements:
[0508] One specific example is when elderly individuals record their daily exercise and use that data to manage their health. The generated exercise program is then shared with family members, who can monitor its progress.
[0509] An example of a prompt message is, "Based on this week's health data for seniors, please generate an optimal exercise program." This allows you to instruct the system in this way.
[0510] In this way, this system enables smooth information sharing and efficient health management among users, the elderly, their families, and healthcare professionals.
[0511] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0512] Step 1:
[0513] Data entry
[0514] Users input health information for elderly individuals using a dedicated application on a terminal device. This input includes numerical data such as blood pressure, body temperature, and heart rate. The entered information is temporarily stored on the terminal device, and its accuracy is verified. This data undergoes temporary processing on the terminal before being prepared for transmission to the server.
[0515] Step 2:
[0516] Data transmission
[0517] The device transmits collected health data to the server using a secure communication protocol. A key feature is that the data is encrypted during transmission, ensuring its security after transmission. Once the input data reaches the server, the process can proceed to the next stage.
[0518] Step 3:
[0519] Data reception and storage
[0520] The server receives data sent from the terminal and stores it in the database. During the storage process, the data format is checked, and data cleansing is performed as needed. As a result, a clean and organized dataset is obtained, preparing it for a smooth subsequent analysis process.
[0521] Step 4:
[0522] Data analysis and plan generation
[0523] The server uses the stored data to begin analysis using a generative AI model. At this stage, it performs trend analysis of health conditions and generates an optimal care plan tailored to each individual's health status. The specific output includes a plan that includes daily activity schedules, dietary recommendations, and exercise program suggestions.
[0524] Step 5:
[0525] Notifications and sharing
[0526] The generated care plan is communicated from the server to relevant family members and healthcare professionals via a notification module. This process takes into account the appropriateness of the message content and the timing to ensure that stakeholders receive the information quickly.
[0527] Step 6:
[0528] Anomaly detection and warning issuance
[0529] The server's monitoring module continues to continuously observe the data, and if any abnormal patterns are detected, it promptly sends a warning message to the terminal. This process ensures the safety of elderly users and allows for appropriate action to be taken.
[0530] Step 7:
[0531] Real-time communication and cloud access
[0532] Users can exchange messages with family members and medical professionals in real time through the device's communication function. At the same time, they can easily access data stored in the cloud, allowing them to obtain and share information from anywhere. This improves the quality of care and creates an environment where all stakeholders can work together to optimize the care of the elderly.
[0533] (Application Example 1)
[0534] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0535] In elderly care, there is a need to efficiently manage health information and quickly provide individually optimized care plans. Furthermore, a system is needed that allows family members, care staff, and other stakeholders to share information in real time and respond quickly when abnormalities are detected. Additionally, methods are needed that allow stakeholders, even those in remote locations, to participate in caregiving.
[0536] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0537] In this invention, the server includes means including a data receiving device for acquiring health information of elderly persons, means including a generation module for analyzing the acquired information and generating individually optimized care processes, and means including a communication device for notifying multiple relevant users of the generated care processes. This enables efficient management of health information, provision of optimized care processes, real-time information sharing and rapid response in the event of anomaly detection, and remote involvement.
[0538] The term "elderly" generally refers to people aged 65 and over, who are often the group that requires particular health management and care support.
[0539] "Health information" refers to data about an individual's physical condition and lifestyle, including, for example, blood pressure, body temperature, heart rate, and steps taken.
[0540] A "data receiving device" is a mechanism for receiving information input from various sensors or users, and often includes smartphones and other mobile devices.
[0541] A "generative module" is a system component that analyzes received data and forms some kind of plan or procedure based on it, and can utilize artificial intelligence or algorithms.
[0542] The "care process" refers to a series of activities and policies related to the care of a specific elderly person, encompassing everything from support for daily living activities to activities for maintaining and promoting health.
[0543] "Communication equipment" refers to devices and software that enable the transmission of data and information to other devices or systems, and also includes interfaces for connecting to a network.
[0544] A "monitoring device" is a device that continuously monitors data, promptly identifies the occurrence of abnormal situations, and provides necessary notifications.
[0545] A "communication device" refers to a system or tool that enables multiple people to share information and communicate with one another.
[0546] A "cloud infrastructure" refers to a remote, virtual infrastructure for using computing resources and data over the internet.
[0547] A "data management device" refers to a system or application that securely stores data and makes it easily accessible when needed.
[0548] A "proposal device" is a system or device that has the function of presenting effective strategies or options based on analyzed data.
[0549] In implementing this invention, a smartphone or tablet is used as the terminal. The user inputs the elderly person's daily health information via these terminals. This information is biometric data such as blood pressure and heart rate, and is acquired through sensors or manual input. The terminal securely transmits the input health data to a cloud-based server.
[0550] The server stores the received health information in a database, after which a generation module analyzes the data. This analysis uses artificial intelligence software such as TensorFlow. Based on the analysis results, an individually optimized care process is generated. This generated care process includes plans for daily care activities and health promotion programs.
[0551] The generated care process is notified to multiple users via a communication device. Here, "users" refers to family members and care staff. Furthermore, the monitoring device continuously monitors health information and immediately sends a warning message to the terminal if an abnormal event is detected. This function enables a rapid response.
[0552] Furthermore, communication devices are provided, enabling real-time information exchange among users. For example, records of exercises performed by elderly individuals in the morning can be shared among family members, and countermeasures and comments can be exchanged in real time.
[0553] As a concrete example of its use, by inputting a prompt message such as, "Create a recommended care plan for a male in his 70s whose blood pressure has recently been on an upward trend. Please suggest appropriate care activities and precautions considering his current health condition," into the AI model, it is possible to automatically obtain a personalized care process.
[0554] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0555] Step 1:
[0556] The device retrieves health information entered by the user. This input is done using a smartphone application, where the user manually selects items and enters numerical values such as blood pressure and heart rate. The entered information is temporarily stored on the device.
[0557] Step 2:
[0558] The device transmits the acquired health information to a server on the cloud infrastructure. This communication is encrypted using SSL / TLS, ensuring a secure connection. The entered health data is received on the server side.
[0559] Step 3:
[0560] The server stores the received data in a database and passes that information to a generation module. The generation module analyzes the data using AI software such as TensorFlow. Through this analysis, it automatically generates an optimal care process for the elderly.
[0561] Step 4:
[0562] The server uses communication devices to notify relevant parties of the generated care process. Notifications are sent via email or in-app notifications. This allows family members and care staff to individually review the most suitable care plan.
[0563] Step 5:
[0564] The server continuously analyzes health information via monitoring devices and detects abnormal events. This analysis uses real-time processing; for example, if blood pressure exceeds a certain threshold, a warning message is generated prompting action.
[0565] Step 6:
[0566] Information is exchanged between users using the communication device built into the terminal. Users can chat with family members and medical professionals through the app, for example, to share questions and feedback regarding the care process.
[0567] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0568] This invention aims to provide a comprehensive care support system for the elderly that considers not only the management of health information but also the emotional state of the user. This system combines various modules to achieve efficient and effective care support.
[0569] Users use applications on their smart devices to input health information about seniors and engage in daily communication. Users can also naturally input their emotions through the device, or the system can automatically input them. The device formats this information appropriately before sending it to the server.
[0570] On the server, the generation module and emotion engine work together to create an optimal care plan based on the received health and emotional information. The emotion engine analyzes the input emotional information and evaluates the stress level and mental state of the user or elderly person. This evaluation result is reflected in the care plan by the generation module's algorithm, and adjustments are made to daily activities and care content.
[0571] For example, if an elderly person has a prolonged period of inactivity and the caregiver is assessed as experiencing stress, the emotional engine will add relaxation-promoting activities and stress-reducing techniques to the care plan. For instance, it might recommend listening to relaxation music or incorporate light exercise into the schedule.
[0572] The generated care plans and emotion-based advice are communicated to all stakeholders via a communication module. Caregivers, in particular, receive special support based on their emotional state. Health information and emotional states are continuously monitored on the server, and any abnormalities are immediately alerted to the terminal, providing an opportunity to take appropriate action.
[0573] Furthermore, the communication module allows users and stakeholders to share information in real time and receive necessary feedback and advice, enabling closer collaboration.
[0574] The entire system manages data in a cloud environment, making it accessible to all stakeholders and offering the advantage of enabling participation in caregiving regardless of location. In this way, it improves the quality of care for the elderly while reducing the mental burden on caregivers themselves.
[0575] The following describes the processing flow.
[0576] Step 1:
[0577] Users input health information and their emotional state using an application on their device. This input includes methods such as touch input and voice input. Users can easily record daily changes in their physical condition and emotions.
[0578] Step 2:
[0579] The terminal checks the format of the entered health and emotional information and converts it into a formal data format. After conversion, the data is encrypted and sent to the server.
[0580] Step 3:
[0581] The server receives information sent from the terminal and stores it in the database. It then checks the consistency and integrity of the data and prepares for the next processing step.
[0582] Step 4:
[0583] The server's generation module generates a care plan based on the received health information. Simultaneously, the emotion engine analyzes the emotional information and evaluates the psychological state of the user and the elderly person. This evaluation result is used as an adjustment parameter for the care plan.
[0584] Step 5:
[0585] Based on the results from the generation module and the emotion engine, a comprehensive care plan is created, incorporating additional activities and care plans tailored to the individual's emotions. For example, this might include suggestions for stress reduction.
[0586] Step 6:
[0587] The generated care plan and the emotional engine's advice are communicated to all stakeholders via push notifications and email through the server's communication module. This allows stakeholders to receive the latest information immediately.
[0588] Step 7:
[0589] The server's monitoring module continuously analyzes stored health and emotional data, and if an anomaly is detected, it immediately sends a warning notification to the user's terminal. Specific countermeasures are also provided at that time.
[0590] Step 8:
[0591] Users can utilize the application's communication module to communicate in real time with other family members and healthcare professionals, allowing them to receive immediate feedback and support suggestions.
[0592] Step 9:
[0593] Finally, the server stores all data in a cloud environment, allowing stakeholders to log in and access it anytime, anywhere. This enables stakeholders in remote locations to check the latest information on caregiving and collaboratively devise countermeasures.
[0594] (Example 2)
[0595] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0596] In elderly care, comprehensive support is required that takes into account not only health information but also emotional information. However, conventional systems have difficulty accurately analyzing emotional information and reflecting it in appropriate care plans, and problems such as the situation only being communicated to a limited number of administrators arise. As a result, the quality of care is declining and the burden on caregivers is increasing.
[0597] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0598] In this invention, the server includes means including a device for receiving and shaping biometric and emotional information of elderly persons; means including a generation device in which an emotional engine uses the received information to evaluate stress levels and generate an optimal care plan; and means including a transmission device for notifying multiple administrators of the generated care plan and emotionally-based advice. This enables the real-time sharing of an optimal care plan that takes into account the emotions of elderly persons and caregivers with all administrators, thereby improving the quality of care and reducing the burden on caregivers.
[0599] "Biometric information" refers to data that indicates the daily health status of elderly people, including information such as body temperature and blood pressure.
[0600] "Emotional information" refers to data that indicates the emotional state of users or elderly individuals, and includes information such as stress levels and mental state.
[0601] A "device" is a device used to input and format biometric and emotional information, and includes smart devices and sensor equipment.
[0602] A "generation device" is a device that uses an emotion engine to generate an optimal care plan based on received biometric and emotional information.
[0603] A "transfer device" is a device that notifies relevant parties of the generated care plan and emotionally-based advice, and includes a communication module.
[0604] An "auditing device" is a device that continuously monitors biometric information and issues a warning if an abnormality is detected.
[0605] A "dialogue device" is a device that enables two-way information sharing among stakeholders, and includes a communication module.
[0606] A "regulation device" is a device that stores care plans in a network environment, making them accessible to relevant parties at any time.
[0607] A "support device" is a device that proposes preventive measures based on evaluated biological and emotional information.
[0608] This invention is a system that provides comprehensive care support for the elderly, taking into account not only health information but also emotional information. The following describes a specific form for implementing this system.
[0609] Users input biometric information about the health status of elderly individuals using a smart device application. This includes data such as body temperature and blood pressure. Users can also input their own and the elderly individuals' emotional information, which can be entered using multiple-choice options or automated input using voice and facial recognition technology.
[0610] The terminal formats the input information and converts it into a data format for transmission to the cloud server. This process is performed using application software installed on the smart device. The terminal uses a secure protocol (e.g., HTTPS) to transmit data and protect privacy.
[0611] The server receives biometric and emotional information and analyzes it using a generative AI model. The emotional engine evaluates the emotional information, quantifying stress levels and mental state. Based on these evaluation results, the generator creates an optimal care plan for the elderly. For example, if stress levels are high, it can suggest incorporating relaxation music into the plan.
[0612] The generated care plan and emotion-based advice are communicated to all relevant parties via a transfer device. Furthermore, the server continuously monitors biometric information using an auditing device and issues an immediate alert if any anomalies occur, enabling a rapid response.
[0613] Furthermore, the dialogue device allows stakeholders to share information and provide feedback in real time. This two-way information sharing is important for improving the quality of care and reducing the burden on caregivers.
[0614] As a concrete example, here is an example of a prompt message for a generative AI model: "An elderly person has been less active lately, and their caregiver is feeling stressed. Please use the emotion engine to suggest the best care plan for this situation."
[0615] In this form, the invention provides a system that optimizes elderly care and reduces the burden on those involved.
[0616] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0617] Step 1:
[0618] Users launch the application on their smart device and input biometric information related to the health status of elderly individuals, such as body temperature and blood pressure. Users can also input their own or the elderly individual's emotional state using multiple-choice input or voice / facial recognition technology. This input is stored on the device through the application software.
[0619] Step 2:
[0620] The device acquires biometric and emotional information entered by the user and formats the data. Specifically, biometric information is converted into numerical data, and emotional information is converted into predefined categorical data. This formatted data is then ready to be sent to a cloud server using a secure communication protocol.
[0621] Step 3:
[0622] The server receives biometric and emotional information transmitted from the terminal. Based on the received data, a generative AI model analyzes the relationships between them. During the analysis process, the emotion engine evaluates the emotional information and quantifies the stress level. This evaluation serves as foundational data for determining future care plans.
[0623] Step 4:
[0624] The server uses a generative AI model to generate an optimal care plan. Considering stress levels and health conditions derived from input data, it creates specific care plans and suggestions, such as "listen to relaxation music for 10 minutes every day." The generated care plan is then ready for distribution to all relevant parties.
[0625] Step 5:
[0626] The server notifies stakeholders of care plans and emotion-based advice generated using the transfer device. The notification includes details of the recommended care plan and corresponding action instructions. This allows stakeholders to obtain the latest care information in real time and implement appropriate measures.
[0627] Step 6:
[0628] The server continuously monitors biometric information, and if abnormal data is detected using auditing equipment, it generates an alert and quickly notifies the relevant parties. This allows those involved to respond immediately to abnormal situations, improving the quality and safety of care.
[0629] (Application Example 2)
[0630] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0631] In elderly care, comprehensive support is required that takes into account not only the management of health information but also the emotional state of the caregiver. However, conventional systems have difficulty effectively integrating these two aspects and dynamically adjusting care plans. Furthermore, the lack of infrastructure for all stakeholders to share information in real time has made it difficult to improve the quality of life for the elderly and reduce the mental burden on caregivers.
[0632] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0633] In this invention, the server includes means including an input device for receiving the physiological parameters of the elderly person and the emotional state of the caregiver; means including a generation and emotion engine module for generating an optimal care plan based on the input information and analyzing the emotional state of the user; means including a care plan that proposes activities aimed at improving lifestyle habits; and means including communication means for notifying relevant parties of the care plan, which includes activities based on a specific emotional state. This enables the creation of plans that meet the needs of both the caregiver and the elderly person, and real-time information sharing.
[0634] "Physiological parameters for the elderly" are indicators of the health status of the elderly and include physiological data such as heart rate, blood pressure, and body temperature.
[0635] "The emotional state of the caregiver" refers to information that indicates the psychological and emotional situation of the caregiver, and is data that evaluates stress levels and mood.
[0636] An "input device" is a device or system for receiving the physiological parameters of elderly individuals and the emotional state of caregivers as digital data.
[0637] A "generation and emotion engine module" is a program or system that creates an optimal care plan based on received information and analyzes emotional information to reflect it in the care plan.
[0638] "Communication means" refers to a digital communication method or system for transmitting generated care plans and related information to multiple relevant parties.
[0639] An "analysis and alarm module" is a software or hardware component that analyzes data to detect anomalies and sends necessary warnings to the relevant parties.
[0640] A "cloud environment" is the infrastructure of cloud computing provided via the internet, and is a technological foundation that enables data storage, processing, and access.
[0641] This system is a comprehensive care support system designed to efficiently manage the physiological parameters of elderly individuals and the emotional state of caregivers, and to create optimal care plans. Users can input the physiological parameters of elderly individuals and their own emotional state using devices such as smartphones and tablets. This data is sent to a server in the cloud. The server appropriately formats the data and performs analysis using a generation and emotion engine module. This module uses natural language processing and machine learning algorithms to evaluate the input emotional information and determine stress levels and mental state. As a result, necessary adjustments are dynamically made to the care plan.
[0642] Furthermore, the generated care plan is notified to all relevant parties in real time via communication channels. This allows caregivers to quickly provide care tailored to the elderly person's condition. The analysis and alarm module constantly monitors the received data and immediately issues an alarm if an anomaly is detected. This system can be used regardless of location by accessing a cloud environment via the internet.
[0643] For example, if recent data indicates that an elderly person is not very active, a message recommending a weekend video call will be sent to their caregiver. In such a case, the following example prompt for the generative AI model will be used: "Recent monitoring data indicates that the elderly person is not very active, and their caregiver is experiencing stress. Please suggest specific activities or advice to improve this situation."
[0644] In this way, it is possible to improve the quality of life for the elderly and reduce the burden on caregivers.
[0645] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0646] Step 1:
[0647] The user uses a terminal to input the physiological parameters of the elderly person (e.g., heart rate, blood pressure) and the emotional state of the caregiver (e.g., stress level). The input data is sent to a server connected to the cloud. The input here is physiological and emotional data, and the output is formatted data. The server converts the input data to a standard format.
[0648] Step 2:
[0649] The server uses generation and emotion engine modules to analyze the received data. This includes a process of evaluating emotional states using natural language processing techniques. The input for this step is formatted data, and the output is analyzed emotional and health status information. Based on this analysis, the server evaluates stress levels and health status and generates data to be reflected in care plans.
[0650] Step 3:
[0651] The generated care plan and analyzed emotional information are communicated to relevant parties via communication means. The input for this step is the analyzed information, and the output is a care plan in notification format. The server distributes this data and sends messages to relevant parties in real time. The notification includes future activity plans and recommended adjustments.
[0652] Step 4:
[0653] The analysis and alarm modules continuously monitor the data and immediately issue an alarm if an anomaly is detected. The input here is newly received data, and the output is a warning message. When an anomaly is detected, the server alerts relevant parties and suggests appropriate countermeasures.
[0654] Step 5:
[0655] Users and stakeholders adjust their lifestyles based on feedback provided by the system through real-time communication. Input is system-provided information, and output is the status of the adjusted care implementation. Users can use this information to modify the care plan as needed.
[0656] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0657] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0658] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[0659] [Fourth Embodiment]
[0660] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[0661] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[0662] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0663] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[0664] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0665] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0666] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0667] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[0668] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0669] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0670] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0671] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0672] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0673] This system is designed to efficiently support elderly care and consists of multiple modules. The system primarily handles data input from terminals, data processing, generation, management, notification, and information sharing on the server.
[0674] Users first input their daily health information using a dedicated application on a device such as a smartphone or tablet. This application provides a user-friendly interface, allowing users to record their health status with simple operations. The entered data is securely transmitted from the device to the server.
[0675] The server stores the received health information in a database. An integrated generation module analyzes this data and automatically generates an optimal care plan using an AI algorithm. The generated plan includes daily care activity plans, dietary recommendations, and exercise programs. The generated information is notified to family members and relevant parties via a communication module. This enables rapid information sharing and collaboration.
[0676] Furthermore, the server incorporates a monitoring module that continuously monitors health information trends and sends warning messages to the user's terminal if an anomaly is detected. For example, if a blood pressure increase exceeding the expected range is detected, it can quickly notify the user and recommend necessary countermeasures.
[0677] Users can use the in-app communication module to exchange messages in real time with other family members and healthcare professionals. For example, if an elderly person records that they completed their daily exercise routine in the morning, that information can be shared with other family members, and feedback can be obtained.
[0678] Furthermore, the generated care plans and activity records are stored in a cloud environment, making them accessible to all stakeholders anytime, anywhere. This allows family members living far away to effectively participate in caregiving.
[0679] In this way, this system enables smooth information sharing and efficient care among users, the elderly, their families, and healthcare professionals.
[0680] The following describes the processing flow.
[0681] Step 1:
[0682] The user launches the application on their device and enters health information about the elderly. Specifically, they enter information such as blood pressure, heart rate, diet, and exercise level into a form and submit the information by pressing the submit button.
[0683] Step 2:
[0684] The terminal checks the entered data and verifies the accuracy of its format and content. After verification, it sends the data to the server using a security protocol.
[0685] Step 3:
[0686] The server receives data sent from the terminal and stores it in the database. After verifying the consistency and completeness of the data, it passes it to the generation module.
[0687] Step 4:
[0688] The generation module on the server generates a care plan based on the received health information. In this generation process, an AI algorithm creates the optimal plan by referring to past data and medical best practices.
[0689] Step 5:
[0690] The generated care plan is notified to all relevant parties via the server's communication module. The notification is sent via push message or email and reaches the user's device.
[0691] Step 6:
[0692] The monitoring module integrated into the server continuously monitors health information. If an abnormal value is detected, it sends an alert to the user's terminal and suggests appropriate countermeasures.
[0693] Step 7:
[0694] Users can exchange messages in real time with family members and medical professionals using a communication module on their device. This allows for the sharing of information about their latest health status and care needs.
[0695] Step 8:
[0696] Ultimately, all data and generated information are stored in a cloud environment and managed in a way that makes them accessible to all stakeholders. This allows family members in remote locations to participate in the care process.
[0697] (Example 1)
[0698] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0699] Continuously monitoring the health of the elderly and detecting abnormalities early is crucial for providing effective support. However, current systems often present challenges in terms of cumbersome data collection, analysis, and sharing, making rapid response difficult. Furthermore, insufficient information sharing and communication among stakeholders makes it difficult to develop flexible care plans tailored to the individual circumstances of the elderly.
[0700] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0701] In this invention, the server includes means including a storage device for storing and managing transmitted data, means including a processing device for analyzing the stored data and generating an optimized support plan, and means including a notification device for communicating the generated support plan to relevant people. This enables efficient management and analysis of health data, and allows for rapid notification and proposal of countermeasures in the event of an abnormality. Furthermore, it facilitates smooth communication among stakeholders and enables the formulation and sharing of support plans appropriate for the elderly.
[0702] A "terminal device" is an electronic device used by users to record their health status.
[0703] A "communication device" is a device or software used to securely transmit recorded data to another device.
[0704] A "storage device" is a data storage device or system used to store and manage transmitted data.
[0705] A "processing device" refers to a computer device and its software used to analyze stored data and generate an optimized support plan.
[0706] A "notification device" is an electronic device or service used to communicate a generated support plan to relevant individuals.
[0707] A "monitoring device" is a device or system used to monitor data, identify abnormal values, and issue warnings.
[0708] A "communication device" is a device that has the function of exchanging electronic messages to support dialogue between parties involved.
[0709] A "management device" is a system that stores support plans and data in an online environment, making them accessible to relevant parties remotely.
[0710] A "decision-making device" is a program or device that recommends preventive measures based on analyzed data.
[0711] This invention is a system that efficiently manages the health of the elderly through the coordination of multiple devices and software. This system consists of terminal devices, a server, and multiple modules, which enable its functionality.
[0712] Terminal device:
[0713] Users input health information for the elderly through a dedicated application using terminal devices such as smartphones and tablets. This application has a user-friendly interface, allowing users to easily record data such as blood pressure, body temperature, and heart rate. This data is securely and quickly transmitted to the server via the terminal device's communication functions.
[0714] server:
[0715] The server stores and manages received health data in a database. This data is analyzed by an integrated processing module, and an optimal care plan is generated using a generative AI model. The plan includes daily activity schedules and recommendations for diet and exercise. By utilizing AI technology, detailed suggestions tailored to each individual's health condition are possible.
[0716] The server also has a monitoring function that tracks trends in the collected data. If an anomaly is detected, a warning message can be sent to the user's terminal to prompt a quick response. For example, if a sudden increase in blood pressure is detected, a recommendation for appropriate medical action will be issued.
[0717] Sharing information:
[0718] The generated care plan is quickly notified to relevant family members and medical professionals via a communication module. Users can also utilize the app's communication features to share messages and images. This allows stakeholders, even those in remote locations, to stay informed about the patient's health status and provide feedback as needed.
[0719] The cloud environment stores support plans and past health data, which users and stakeholders can access from anywhere. This allows family members living far away to effectively participate in caregiving.
[0720] Examples of specific cases and prompt statements:
[0721] One specific example is when elderly individuals record their daily exercise and use that data to manage their health. The generated exercise program is then shared with family members, who can monitor its progress.
[0722] An example of a prompt message is, "Based on this week's health data for seniors, please generate an optimal exercise program." This allows you to instruct the system in this way.
[0723] In this way, this system enables smooth information sharing and efficient health management among users, the elderly, their families, and healthcare professionals.
[0724] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0725] Step 1:
[0726] Data entry
[0727] Users input health information for elderly individuals using a dedicated application on a terminal device. This input includes numerical data such as blood pressure, body temperature, and heart rate. The entered information is temporarily stored on the terminal device, and its accuracy is verified. This data undergoes temporary processing on the terminal before being prepared for transmission to the server.
[0728] Step 2:
[0729] Data transmission
[0730] The device transmits collected health data to the server using a secure communication protocol. A key feature is that the data is encrypted during transmission, ensuring its security after transmission. Once the input data reaches the server, the process can proceed to the next stage.
[0731] Step 3:
[0732] Data reception and storage
[0733] The server receives data sent from the terminal and stores it in the database. During the storage process, the data format is checked, and data cleansing is performed as needed. As a result, a clean and organized dataset is obtained, preparing it for a smooth subsequent analysis process.
[0734] Step 4:
[0735] Data analysis and plan generation
[0736] The server uses the stored data to begin analysis using a generative AI model. At this stage, it performs trend analysis of health conditions and generates an optimal care plan tailored to each individual's health status. The specific output includes a plan that includes daily activity schedules, dietary recommendations, and exercise program suggestions.
[0737] Step 5:
[0738] Notifications and sharing
[0739] The generated care plan is communicated from the server to relevant family members and healthcare professionals via a notification module. This process takes into account the appropriateness of the message content and the timing to ensure that stakeholders receive the information quickly.
[0740] Step 6:
[0741] Anomaly detection and warning issuance
[0742] The server's monitoring module continues to continuously observe the data, and if any abnormal patterns are detected, it promptly sends a warning message to the terminal. This process ensures the safety of elderly users and allows for appropriate action to be taken.
[0743] Step 7:
[0744] Real-time communication and cloud access
[0745] Users can exchange messages with family members and medical professionals in real time through the device's communication function. At the same time, they can easily access data stored in the cloud, allowing them to obtain and share information from anywhere. This improves the quality of care and creates an environment where all stakeholders can work together to optimize the care of the elderly.
[0746] (Application Example 1)
[0747] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0748] In elderly care, there is a need to efficiently manage health information and quickly provide individually optimized care plans. Furthermore, a system is needed that allows family members, care staff, and other stakeholders to share information in real time and respond quickly when abnormalities are detected. Additionally, methods are needed that allow stakeholders, even those in remote locations, to participate in caregiving.
[0749] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0750] In this invention, the server includes means including a data receiving device for acquiring health information of elderly persons, means including a generation module for analyzing the acquired information and generating individually optimized care processes, and means including a communication device for notifying multiple relevant users of the generated care processes. This enables efficient management of health information, provision of optimized care processes, real-time information sharing and rapid response in the event of anomaly detection, and remote involvement.
[0751] The term "elderly" generally refers to people aged 65 and over, who are often the group that requires particular health management and care support.
[0752] "Health information" refers to data about an individual's physical condition and lifestyle, including, for example, blood pressure, body temperature, heart rate, and steps taken.
[0753] A "data receiving device" is a mechanism for receiving information input from various sensors or users, and often includes smartphones and other mobile devices.
[0754] A "generative module" is a system component that analyzes received data and forms some kind of plan or procedure based on it, and can utilize artificial intelligence or algorithms.
[0755] The "care process" refers to a series of activities and policies related to the care of a specific elderly person, encompassing everything from support for daily living activities to activities for maintaining and promoting health.
[0756] "Communication equipment" refers to devices and software that enable the transmission of data and information to other devices or systems, and also includes interfaces for connecting to a network.
[0757] A "monitoring device" is a device that continuously monitors data, promptly identifies the occurrence of abnormal situations, and provides necessary notifications.
[0758] A "communication device" refers to a system or tool that enables multiple people to share information and communicate with one another.
[0759] A "cloud infrastructure" refers to a remote, virtual infrastructure for using computing resources and data over the internet.
[0760] A "data management device" refers to a system or application that securely stores data and makes it easily accessible when needed.
[0761] A "proposal device" is a system or device that has the function of presenting effective strategies or options based on analyzed data.
[0762] In implementing this invention, a smartphone or tablet is used as the terminal. The user inputs the elderly person's daily health information via these terminals. This information is biometric data such as blood pressure and heart rate, and is acquired through sensors or manual input. The terminal securely transmits the input health data to a cloud-based server.
[0763] The server stores the received health information in a database, after which a generation module analyzes the data. This analysis uses artificial intelligence software such as TensorFlow. Based on the analysis results, an individually optimized care process is generated. This generated care process includes plans for daily care activities and health promotion programs.
[0764] The generated care process is notified to multiple users via a communication device. Here, "users" refers to family members and care staff. Furthermore, the monitoring device continuously monitors health information and immediately sends a warning message to the terminal if an abnormal event is detected. This function enables a rapid response.
[0765] Furthermore, communication devices are provided, enabling real-time information exchange among users. For example, records of exercises performed by elderly individuals in the morning can be shared among family members, and countermeasures and comments can be exchanged in real time.
[0766] As a concrete example of its use, by inputting a prompt message such as, "Create a recommended care plan for a male in his 70s whose blood pressure has recently been on an upward trend. Please suggest appropriate care activities and precautions considering his current health condition," into the AI model, it is possible to automatically obtain a personalized care process.
[0767] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0768] Step 1:
[0769] The device retrieves health information entered by the user. This input is done using a smartphone application, where the user manually selects items and enters numerical values such as blood pressure and heart rate. The entered information is temporarily stored on the device.
[0770] Step 2:
[0771] The device transmits the acquired health information to a server on the cloud infrastructure. This communication is encrypted using SSL / TLS, ensuring a secure connection. The entered health data is received on the server side.
[0772] Step 3:
[0773] The server stores the received data in a database and passes that information to a generation module. The generation module analyzes the data using AI software such as TensorFlow. Through this analysis, it automatically generates an optimal care process for the elderly.
[0774] Step 4:
[0775] The server uses communication devices to notify relevant parties of the generated care process. Notifications are sent via email or in-app notifications. This allows family members and care staff to individually review the most suitable care plan.
[0776] Step 5:
[0777] The server continuously analyzes health information via monitoring devices and detects abnormal events. This analysis uses real-time processing; for example, if blood pressure exceeds a certain threshold, a warning message is generated prompting action.
[0778] Step 6:
[0779] Information is exchanged between users using the communication device built into the terminal. Users can chat with family members and medical professionals through the app, for example, to share questions and feedback regarding the care process.
[0780] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0781] This invention aims to provide a comprehensive care support system for the elderly that considers not only the management of health information but also the emotional state of the user. This system combines various modules to achieve efficient and effective care support.
[0782] Users use applications on their smart devices to input health information about seniors and engage in daily communication. Users can also naturally input their emotions through the device, or the system can automatically input them. The device formats this information appropriately before sending it to the server.
[0783] On the server, the generation module and emotion engine work together to create an optimal care plan based on the received health and emotional information. The emotion engine analyzes the input emotional information and evaluates the stress level and mental state of the user or elderly person. This evaluation result is reflected in the care plan by the generation module's algorithm, and adjustments are made to daily activities and care content.
[0784] For example, if an elderly person has a prolonged period of inactivity and the caregiver is assessed as experiencing stress, the emotional engine will add relaxation-promoting activities and stress-reducing techniques to the care plan. For instance, it might recommend listening to relaxation music or incorporate light exercise into the schedule.
[0785] The generated care plans and emotion-based advice are communicated to all stakeholders via a communication module. Caregivers, in particular, receive special support based on their emotional state. Health information and emotional states are continuously monitored on the server, and any abnormalities are immediately alerted to the terminal, providing an opportunity to take appropriate action.
[0786] Furthermore, the communication module allows users and stakeholders to share information in real time and receive necessary feedback and advice, enabling closer collaboration.
[0787] The entire system manages data in a cloud environment, making it accessible to all stakeholders and offering the advantage of enabling participation in caregiving regardless of location. In this way, it improves the quality of care for the elderly while reducing the mental burden on caregivers themselves.
[0788] The following describes the processing flow.
[0789] Step 1:
[0790] Users input health information and their emotional state using an application on their device. This input includes methods such as touch input and voice input. Users can easily record daily changes in their physical condition and emotions.
[0791] Step 2:
[0792] The terminal checks the format of the entered health and emotional information and converts it into a formal data format. After conversion, the data is encrypted and sent to the server.
[0793] Step 3:
[0794] The server receives information sent from the terminal and stores it in the database. It then checks the consistency and integrity of the data and prepares for the next processing step.
[0795] Step 4:
[0796] The server's generation module generates a care plan based on the received health information. Simultaneously, the emotion engine analyzes the emotional information and evaluates the psychological state of the user and the elderly person. This evaluation result is used as an adjustment parameter for the care plan.
[0797] Step 5:
[0798] Based on the results from the generation module and the emotion engine, a comprehensive care plan is created, incorporating additional activities and care plans tailored to the individual's emotions. For example, this might include suggestions for stress reduction.
[0799] Step 6:
[0800] The generated care plan and the emotional engine's advice are communicated to all stakeholders via push notifications and email through the server's communication module. This allows stakeholders to receive the latest information immediately.
[0801] Step 7:
[0802] The server's monitoring module continuously analyzes stored health and emotional data, and if an anomaly is detected, it immediately sends a warning notification to the user's terminal. Specific countermeasures are also provided at that time.
[0803] Step 8:
[0804] Users can utilize the application's communication module to communicate in real time with other family members and healthcare professionals, allowing them to receive immediate feedback and support suggestions.
[0805] Step 9:
[0806] Finally, the server stores all data in a cloud environment, allowing stakeholders to log in and access it anytime, anywhere. This enables stakeholders in remote locations to check the latest information on caregiving and collaboratively devise countermeasures.
[0807] (Example 2)
[0808] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0809] In elderly care, comprehensive support is required that takes into account not only health information but also emotional information. However, conventional systems have difficulty accurately analyzing emotional information and reflecting it in appropriate care plans, and problems such as the situation only being communicated to a limited number of administrators arise. As a result, the quality of care is declining and the burden on caregivers is increasing.
[0810] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0811] In this invention, the server includes means including a device for receiving and shaping biometric and emotional information of elderly persons; means including a generation device in which an emotional engine uses the received information to evaluate stress levels and generate an optimal care plan; and means including a transmission device for notifying multiple administrators of the generated care plan and emotionally-based advice. This enables the real-time sharing of an optimal care plan that takes into account the emotions of elderly persons and caregivers with all administrators, thereby improving the quality of care and reducing the burden on caregivers.
[0812] "Biometric information" refers to data that indicates the daily health status of elderly people, including information such as body temperature and blood pressure.
[0813] "Emotional information" refers to data that indicates the emotional state of users or elderly individuals, and includes information such as stress levels and mental state.
[0814] A "device" is a device used to input and format biometric and emotional information, and includes smart devices and sensor equipment.
[0815] A "generation device" is a device that uses an emotion engine to generate an optimal care plan based on received biometric and emotional information.
[0816] A "transfer device" is a device that notifies relevant parties of the generated care plan and emotionally-based advice, and includes a communication module.
[0817] An "auditing device" is a device that continuously monitors biometric information and issues a warning if an abnormality is detected.
[0818] A "dialogue device" is a device that enables two-way information sharing among stakeholders, and includes a communication module.
[0819] A "regulation device" is a device that stores care plans in a network environment, making them accessible to relevant parties at any time.
[0820] A "support device" is a device that proposes preventive measures based on evaluated biological and emotional information.
[0821] This invention is a system that provides comprehensive care support for the elderly, taking into account not only health information but also emotional information. The following describes a specific form for implementing this system.
[0822] Users input biometric information about the health status of elderly individuals using a smart device application. This includes data such as body temperature and blood pressure. Users can also input their own and the elderly individuals' emotional information, which can be entered using multiple-choice options or automated input using voice and facial recognition technology.
[0823] The terminal formats the input information and converts it into a data format for transmission to the cloud server. This process is performed using application software installed on the smart device. The terminal uses a secure protocol (e.g., HTTPS) to transmit data and protect privacy.
[0824] The server receives biometric and emotional information and analyzes it using a generative AI model. The emotional engine evaluates the emotional information, quantifying stress levels and mental state. Based on these evaluation results, the generator creates an optimal care plan for the elderly. For example, if stress levels are high, it can suggest incorporating relaxation music into the plan.
[0825] The generated care plan and emotion-based advice are communicated to all relevant parties via a transfer device. Furthermore, the server continuously monitors biometric information using an auditing device and issues an immediate alert if any anomalies occur, enabling a rapid response.
[0826] Furthermore, the dialogue device allows stakeholders to share information and provide feedback in real time. This two-way information sharing is important for improving the quality of care and reducing the burden on caregivers.
[0827] As a concrete example, here is an example of a prompt message for a generative AI model: "An elderly person has been less active lately, and their caregiver is feeling stressed. Please use the emotion engine to suggest the best care plan for this situation."
[0828] In this form, the invention provides a system that optimizes elderly care and reduces the burden on those involved.
[0829] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0830] Step 1:
[0831] Users launch the application on their smart device and input biometric information related to the health status of elderly individuals, such as body temperature and blood pressure. Users can also input their own or the elderly individual's emotional state using multiple-choice input or voice / facial recognition technology. This input is stored on the device through the application software.
[0832] Step 2:
[0833] The device acquires biometric and emotional information entered by the user and formats the data. Specifically, biometric information is converted into numerical data, and emotional information is converted into predefined categorical data. This formatted data is then ready to be sent to a cloud server using a secure communication protocol.
[0834] Step 3:
[0835] The server receives biometric and emotional information transmitted from the terminal. Based on the received data, a generative AI model analyzes the relationships between them. During the analysis process, the emotion engine evaluates the emotional information and quantifies the stress level. This evaluation serves as foundational data for determining future care plans.
[0836] Step 4:
[0837] The server uses a generative AI model to generate an optimal care plan. Considering stress levels and health conditions derived from input data, it creates specific care plans and suggestions, such as "listen to relaxation music for 10 minutes every day." The generated care plan is then ready for distribution to all relevant parties.
[0838] Step 5:
[0839] The server notifies stakeholders of care plans and emotion-based advice generated using the transfer device. The notification includes details of the recommended care plan and corresponding action instructions. This allows stakeholders to obtain the latest care information in real time and implement appropriate measures.
[0840] Step 6:
[0841] The server continuously monitors biometric information, and if abnormal data is detected using auditing equipment, it generates an alert and quickly notifies the relevant parties. This allows those involved to respond immediately to abnormal situations, improving the quality and safety of care.
[0842] (Application Example 2)
[0843] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0844] In elderly care, comprehensive support is required that takes into account not only the management of health information but also the emotional state of the caregiver. However, conventional systems have difficulty effectively integrating these two aspects and dynamically adjusting care plans. Furthermore, the lack of infrastructure for all stakeholders to share information in real time has made it difficult to improve the quality of life for the elderly and reduce the mental burden on caregivers.
[0845] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0846] In this invention, the server includes means including an input device for receiving the physiological parameters of the elderly person and the emotional state of the caregiver; means including a generation and emotion engine module for generating an optimal care plan based on the input information and analyzing the emotional state of the user; means including a care plan that proposes activities aimed at improving lifestyle habits; and means including communication means for notifying relevant parties of the care plan, which includes activities based on a specific emotional state. This enables the creation of plans that meet the needs of both the caregiver and the elderly person, and real-time information sharing.
[0847] "Physiological parameters for the elderly" are indicators of the health status of the elderly and include physiological data such as heart rate, blood pressure, and body temperature.
[0848] "The emotional state of the caregiver" refers to information that indicates the psychological and emotional situation of the caregiver, and is data that evaluates stress levels and mood.
[0849] An "input device" is a device or system for receiving the physiological parameters of elderly individuals and the emotional state of caregivers as digital data.
[0850] A "generation and emotion engine module" is a program or system that creates an optimal care plan based on received information and analyzes emotional information to reflect it in the care plan.
[0851] "Communication means" refers to a digital communication method or system for transmitting generated care plans and related information to multiple relevant parties.
[0852] An "analysis and alarm module" is a software or hardware component that analyzes data to detect anomalies and sends necessary warnings to the relevant parties.
[0853] A "cloud environment" is the infrastructure of cloud computing provided via the internet, and is a technological foundation that enables data storage, processing, and access.
[0854] This system is a comprehensive care support system designed to efficiently manage the physiological parameters of elderly individuals and the emotional state of caregivers, and to create optimal care plans. Users can input the physiological parameters of elderly individuals and their own emotional state using devices such as smartphones and tablets. This data is sent to a server in the cloud. The server appropriately formats the data and performs analysis using a generation and emotion engine module. This module uses natural language processing and machine learning algorithms to evaluate the input emotional information and determine stress levels and mental state. As a result, necessary adjustments are dynamically made to the care plan.
[0855] Furthermore, the generated care plan is notified to all relevant parties in real time via communication channels. This allows caregivers to quickly provide care tailored to the elderly person's condition. The analysis and alarm module constantly monitors the received data and immediately issues an alarm if an anomaly is detected. This system can be used regardless of location by accessing a cloud environment via the internet.
[0856] For example, if recent data indicates that an elderly person is not very active, a message recommending a weekend video call will be sent to their caregiver. In such a case, the following example prompt for the generative AI model will be used: "Recent monitoring data indicates that the elderly person is not very active, and their caregiver is experiencing stress. Please suggest specific activities or advice to improve this situation."
[0857] In this way, it is possible to improve the quality of life for the elderly and reduce the burden on caregivers.
[0858] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0859] Step 1:
[0860] The user uses a terminal to input the physiological parameters of the elderly person (e.g., heart rate, blood pressure) and the emotional state of the caregiver (e.g., stress level). The input data is sent to a server connected to the cloud. The input here is physiological and emotional data, and the output is formatted data. The server converts the input data to a standard format.
[0861] Step 2:
[0862] The server uses generation and emotion engine modules to analyze the received data. This includes a process of evaluating emotional states using natural language processing techniques. The input for this step is formatted data, and the output is analyzed emotional and health status information. Based on this analysis, the server evaluates stress levels and health status and generates data to be reflected in care plans.
[0863] Step 3:
[0864] The generated care plan and analyzed emotional information are communicated to relevant parties via communication means. The input for this step is the analyzed information, and the output is a care plan in notification format. The server distributes this data and sends messages to relevant parties in real time. The notification includes future activity plans and recommended adjustments.
[0865] Step 4:
[0866] The analysis and alarm modules continuously monitor the data and immediately issue an alarm if an anomaly is detected. The input here is newly received data, and the output is a warning message. When an anomaly is detected, the server alerts relevant parties and suggests appropriate countermeasures.
[0867] Step 5:
[0868] Users and stakeholders adjust their lifestyles based on feedback provided by the system through real-time communication. Input is system-provided information, and output is the status of the adjusted care implementation. Users can use this information to modify the care plan as needed.
[0869] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0870] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0871] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.
[0872] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[0873] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.
[0874] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.
[0875] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.
[0876] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.
[0877] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."
[0878] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.
[0879] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.
[0880] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.
[0881] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.
[0882] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[0883] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.
[0884] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.
[0885] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.
[0886] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.
[0887] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.
[0888] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.
[0889] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.
[0890] The following is further disclosed regarding the embodiments described above.
[0891] (Claim 1)
[0892] Means including an input device for receiving health information of the elderly,
[0893] A means including a generation module that generates an optimal care plan based on the input information,
[0894] A means including a communication module for notifying multiple stakeholders of the generated care plan,
[0895] A means including a monitoring module that analyzes health information and notifies a warning if an abnormality is detected,
[0896] A means including a communication module that enables information exchange among stakeholders,
[0897] A system that includes this.
[0898] (Claim 2)
[0899] The system according to claim 1, including a management module that saves care plans in a cloud environment and makes them accessible to relevant parties.
[0900] (Claim 3)
[0901] The system according to claim 1, comprising a suggestion module that recommends preventive measures based on analyzed health information.
[0902] "Example 1"
[0903] (Claim 1)
[0904] A means including a terminal device for recording the user's health status,
[0905] Means including a communication device for securely transmitting recorded data,
[0906] Means including a storage device for storing and managing transmitted data,
[0907] A means including a processing device that analyzes stored data and generates an optimized support plan,
[0908] A means including a notification device for communicating the generated support plan to relevant persons,
[0909] A means including a monitoring device that monitors data, identifies abnormal values, and issues warnings,
[0910] Means including communication devices to support dialogue among stakeholders,
[0911] A system that includes this.
[0912] (Claim 2)
[0913] The system according to claim 1, including a management device that stores support plans and data in an online environment and makes them available to relevant parties remotely.
[0914] (Claim 3)
[0915] The system according to claim 1, comprising a decision-making device that recommends preventive measures based on analyzed data.
[0916] "Application Example 1"
[0917] (Claim 1)
[0918] A means including a data receiving device for acquiring health information of elderly people,
[0919] Means including a generation module that analyzes acquired information and generates individually optimized care processes,
[0920] Means including a communication device for notifying multiple relevant users of the generated care process,
[0921] A means including a monitoring device that continuously analyzes health data and notifies when an abnormal event is detected,
[0922] A means including a communication device for exchanging information among users,
[0923] A system that includes this.
[0924] (Claim 2)
[0925] The system according to claim 1, comprising a data management device that stores caregiving processes on a cloud platform and makes them accessible to users.
[0926] (Claim 3)
[0927] The system according to claim 1, comprising a suggestion device that presents preventive measures based on analyzed health data.
[0928] "Example 2 of combining an emotion engine"
[0929] (Claim 1)
[0930] Means including a device for receiving and shaping biometric and emotional information of elderly persons,
[0931] A means including a generating device that uses received information to enable an emotion engine to evaluate stress levels and generate an optimal care plan,
[0932] A means including a transmission device that notifies multiple administrators of the generated care plan and emotion-based advice,
[0933] A means including an auditing device that monitors biometric information and issues warnings in the event of an anomaly,
[0934] A means including a dialogue device that enables two-way information sharing among administrators,
[0935] A system that includes this.
[0936] (Claim 2)
[0937] The system according to claim 1, including an adjustment device that stores care plans in a network environment and allows administrators to access them at any time.
[0938] (Claim 3)
[0939] The system according to claim 1, comprising a support device that proposes preventive measures based on evaluated biological and emotional information.
[0940] "Application example 2 when combining with an emotional engine"
[0941] (Claim 1)
[0942] A means including an input device for receiving the physiological parameters of an elderly person and the emotional state of a caregiver,
[0943] A means including a generation and emotion engine module that generates an optimal care plan based on input information and analyzes the emotional state of the user,
[0944] A care plan that proposes activities aimed at improving lifestyle habits, and means of notifying relevant parties of the care plan, which includes activities based on specific emotional states, including means of communication.
[0945] A means including an analysis and alarm module that analyzes received data and issues a warning if a serious anomaly is detected,
[0946] A means including a communication method that enables real-time communication among stakeholders,
[0947] A system that includes this.
[0948] (Claim 2)
[0949] The system according to claim 1, comprising a management module that saves the generated care plan in a cloud environment and allows stakeholders to access it.
[0950] (Claim 3)
[0951] The system according to claim 1, comprising a suggestion module that recommends specific activities useful for relaxation and stress reduction based on analyzed emotional information. [Explanation of symbols]
[0952] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>
Claims
1. Means including an input device for receiving health information of the elderly, A means including a generation module that generates an optimal care plan based on the input information, A means including a communication module for notifying multiple stakeholders of the generated care plan, A means including a monitoring module that analyzes health information and notifies a warning if an abnormality is detected, A means including a communication module that enables information exchange among stakeholders, A system that includes this.
2. The system according to claim 1, including a management module that saves care plans in a cloud environment and makes them accessible to relevant parties.
3. The system according to claim 1, comprising a suggestion module that recommends preventive measures based on analyzed health information.