System

Abstract

A system is provided.SOLUTION: A system comprising: means for collecting health information of a user; means for analyzing the collected health information; means for detecting an abnormality based on an analysis result; means for instructing a response when the abnormality is detected; and means for notifying information related to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, the number of elderly people living alone is increasing. While there are benefits to living independently, it also brings concerns about unexpected accidents and health conditions for family members and relatives. Furthermore, there is a serious shortage of staff in nursing care facilities, and specialized care is required for each individual. In such a situation, early detection of dementia and appropriate health management are important, and new systems are needed to improve the quality of life of users. [Means for solving the problem]

[0005] The present invention is a system that includes a means for collecting a user's health information, a means for analyzing the collected health information, a means for detecting abnormalities based on the analysis results, a means for instructing the user to take action when an abnormality is detected, and a means for notifying the user of information about the user. The system also includes a means for monitoring the user's behavior and speech to detect cognitive decline, a means for early detection of dementia based on the detection results, a means for encouraging the user to exercise, and a means for collecting exercise data and evaluating the amount of exercise. In this way, it is possible to effectively manage and care for the elderly and improve their quality of life.

[0006] "User" refers to an individual who uses the system to receive health management or care.

[0007] "Health information" refers to information including the user's medical history, daily behavior data, vital data such as heart rate, walking patterns, conversation content, and the like.

[0008] "Means of collection" refers to means of obtaining health information from users using devices such as cameras, microphones, and sensors.

[0009] "Means of analysis" refers to data analysis algorithms and AI models used to detect abnormalities based on collected health information.

[0010] "Means for detecting abnormalities" refers to means for determining whether there is an abnormality in the user's health condition based on the analysis results.

[0011] "Means for issuing instructions on how to respond" refers to the means for issuing appropriate instructions or alerts to the user or related persons when an abnormality is detected.

[0012] "Means of notification" refers to the means of communicating detected abnormalities and health information to family members and medical professionals.

[0013] "Monitoring" refers to the continuous observation of a user's daily life and behavior using sensors and cameras.

[0014] "Cognitive decline" refers to a state in which a user's cognitive functions, such as memory, judgment, and calculation ability, fall below the normal range.

[0015] "Early detection" refers to detecting cognitive decline and other health problems before they become severe.

[0016] "Means for encouraging exercise" refers to means by which the pet robot provides audio guidance or displays to encourage the user to exercise moderately.

[0017] "Exercise data" refers to data such as the type of exercise performed by the user, the duration, number of steps, and heart rate.

[0018] The "means for evaluating the amount of exercise" refers to a means for analyzing collected exercise data and evaluating the user's exercise habits and health condition. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0021] First, the terms used in the following description will be explained.

[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0027] [First embodiment]

[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0040] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI. Specific embodiments of the system are described below.

[0041] System configuration

[0042] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[0043] 1. Users: Elderly people who use the system to receive health management and care.

[0044] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, and AI processors.

[0045] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[0046] Initial Setup

[0047] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[0048] Daily Life Monitoring

[0049] PetRobo monitors the user's daily life and collects the following data:

[0050] Physical activity: Sensors detect steps, walking speed, posture, etc.

[0051] Conversation content: What the user says is recorded through the microphone and converted into text data.

[0052] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[0053] Health assessment

[0054] The server analyzes the data sent from the pet robot in real time, for example, by performing the following processes:

[0055] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, possible falls, or cognitive decline in conversation.

[0056] Health Assessment: Based on regularly collected data, the device comprehensively assesses the user's health status, such as detecting heart rate fluctuations and lack of physical activity.

[0057] Alerts and Notifications

[0058] If an abnormality is detected, the server will respond by the following means.

[0059] Instant Notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[0060] Regular notifications: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members and care facilities.

[0061] Local notifications: The pet robot will notify the user by voice, such as "We recommend that you see a doctor."

[0062] Regular health checks

[0063] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[0064] Promotion of exercise

[0065] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[0066] Data management and advice

[0067] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[0068] Specific examples

[0069] Example 1: Early detection of dementia

[0070] (monitoring):

[0071] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[0072] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[0073] (Evaluation and Notification):

[0074] Server: If cognitive decline is suspected, a detailed report will be prepared.

[0075] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[0076] Server: Notify family members and medical personnel and encourage appropriate action.

[0077] Example 2: Exercise promotion

[0078] (Exercise prompt):

[0079] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[0080] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[0081] (Data storage and analysis):

[0082] Terminal: The pet robot records the number of steps and walking speed.

[0083] Server: Stores the collected data and evaluates the user's exercise volume.

[0084] (Advice provided):

[0085] Server: Analyzes exercise results and provides feedback to the user and their family.

[0086] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[0087] The above is an embodiment of the present invention. It is expected that this system will enable efficient and effective health management and care for the elderly.

[0088] The processing flow will be explained below.

[0089] Specific steps for daily life monitoring and health management program

[0090] Overall system flow

[0091] Initial Setup

[0092] Step 1: Register user information

[0093] User: Uses a smartphone or PC to enter basic health information such as name, age, height, weight, and medical history.

[0094] Step 2: Save the information to the server

[0095] Server: Stores the information entered by the user in a database and generates a unique user ID for each user.

[0096] Step 3: Initial setup of your pet robot

[0097] Terminal: The pet robot connects to the server, obtains user information, and prepares for operation. It also calibrates sensors and cameras.

[0098] Daily Life Monitoring

[0099] Step 4: Start collecting data

[0100] Terminal: The pet robot begins collecting data on the user's daily activities (walking, talking, facial expressions, etc.) using sensors.

[0101] Step 5: Send monitoring data

[0102] Terminal: Sends collected data to the server at regular intervals (e.g., every 30 minutes).

[0103] Step 6: Analyze the data

[0104] Server: Analyzes the received data in real time, applies anomaly detection algorithms, and flags any anomalies detected.

[0105] Health assessment

[0106] Step 7: Anomaly detection

[0107] Server: Based on the analysis results, detects slowing walking speed, falls, and abnormalities in speech (signs of cognitive decline).

[0108] Step 8: Evaluate and record any abnormalities

[0109] Server: Evaluates the detected anomalies and generates a report on the user's health status, which is stored in a database.

[0110] Alerts and Notifications

[0111] Step 9: Generate an alert

[0112] Server: If a significant abnormality is detected, it generates an alert and sends a notification to the user's family and medical personnel.

[0113] Step 10: Sending notifications

[0114] Server: Sends the alert information using the notification medium used (SMS, app notification, email, etc.).

[0115] Step 11: Notify users

[0116] Terminal: The pet robot notifies the user by voice, "An abnormality has been detected. We recommend that you see a doctor."

[0117] Regular health checks

[0118] Step 12: Start the health check

[0119] Terminal: The pet robot notifies the user by voice, "Regular health check will begin."

[0120] Step 13: Run the checklist

[0121] Terminal: The pet robot will ask questions and carry out reaction tests based on a checklist.

[0122] Step 14: Collecting check results

[0123] Terminal: Records the results of the check and sends them to the server.

[0124] Step 15: Analyze and save the results

[0125] Server: Analyzes the check results and stores the user's health status in a database.

[0126] Promotion of exercise

[0127] Step 16: Exercise Suggestion

[0128] Terminal: The pet robot suggests exercise to the user by saying, "Let's go for a walk together."

[0129] Step 17: User Activity

[0130] User: Take walks or do light exercise together according to suggestions from the pet robot.

[0131] Step 18: Collect exercise data

[0132] Terminal: The pet robot collects walking data and heart rate during exercise and sends it to the server.

[0133] Step 19: Analyze the movement data

[0134] Server: Analyzes the collected exercise data and evaluates the user's exercise volume.

[0135] Data management and advice

[0136] Step 20: Centralize your data

[0137] Server: All data is managed centrally and backed up regularly.

[0138] Step 21: Generate Advice

[0139] Server: Based on the results of data analysis, it generates specific advice for the user on maintaining their health.

[0140] Step 22: Providing advice

[0141] Device: The pet robot provides the user with specific advice via voice, such as "It is recommended to walk your pet three times a week."

[0142] Step 23: Create and submit the report

[0143] Server: Generates monthly and weekly reports and sends them to the user's family and care facility personnel.

[0144] In this way, the system supports the elderly in their daily lives and manages their health.

[0145] Example 1

[0146] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0147] Efficient and effective health management and care for the elderly requires detailed monitoring and analysis of their daily lives. However, current systems are insufficient in collecting health information and detecting abnormalities, making it difficult to respond quickly. In addition, some systems are unable to provide specific countermeasures for cognitive decline and lack of exercise in the elderly. To solve these problems, a system is needed that can perform detailed, real-time monitoring and analysis and provide appropriate notifications and advice.

[0148] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0149] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, and means for monitoring the user's daily life. This enables detailed and real-time collection and analysis of health information. It also includes means for encouraging the user to exercise, means for notifying the user based on the monitoring results, and means for initializing the system. This enables evaluation of health status, provision of appropriate advice, regular health checks, and promotion of exercise. It also includes means for monitoring conversation content to detect cognitive decline, and means for collecting exercise data and evaluating the amount of exercise. This enables early detection of cognitive decline and provision of specific countermeasures to address lack of exercise.

[0150] "Users" refer to elderly people who use the system to receive health management and care.

[0151] "Health Information" refers to health-related data such as a user's name, age, height, weight, and medical history.

[0152] "Means of collection" refers to the function of obtaining the user's health information using a pet robot or other sensor devices.

[0153] "Means for analysis" refers to algorithms or software that use collected health information to assess a user's health status.

[0154] "Means for detecting abnormalities" refers to the function of identifying abnormal patterns that differ from normal conditions based on the results of analyzing health information.

[0155] "Means for instructing a response" refers to a function that notifies the user, family, or medical personnel of the necessary actions when an abnormality is detected.

[0156] "Means of monitoring" refers to the function of continuously observing the user's daily activities and behavior using a pet robot or other sensor devices.

[0157] "Means to encourage exercise" refers to the function in which the pet robot uses voice or other means to suggest appropriate exercise to the user and encourage them to do so.

[0158] "Means of notification" refers to the function of notifying users of health information and abnormality detection results via voice, SMS, app notifications, etc.

[0159] "Means for performing initial settings" refers to the function that allows a user to input the health information required when starting to use the system and register it with the pet robot and server.

[0160] "Means for monitoring conversation content" refers to the function of recording and analyzing the user's conversation using the pet robot's microphone.

[0161] "Means for detecting cognitive decline" refers to algorithms or software that analyze a user's daily conversations and behavioral patterns to identify cognitive decline at an early stage.

[0162] "Means for collecting data from exercise" refers to the function of obtaining data such as the number of steps taken during exercise, exercise time, and heart rate through the pet robot's sensors and sending it to a server.

[0163] "Means for assessing exercise volume" refers to algorithms or software that analyze the collected exercise data and assess the user's exercise volume.

[0164] This invention is a system for managing and caring for the elderly using a pet robot equipped with AI. This system monitors the user's daily life, and if an abnormality is detected, it instructs appropriate measures, evaluates the user's health, and provides advice. Specifically, it uses the following hardware and software components.

[0165] System configuration

[0166] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[0167] 1. Users: Elderly people who use the system to receive health management and care.

[0168] 2. Terminal (Pet Robot): Equipped with hardware such as sensors, cameras, microphones, speakers, and AI processors.

[0169] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[0170] Initial Setup

[0171] The user performs the initial setup of the system using a smartphone or PC. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[0172] Daily Life Monitoring

[0173] The robotic pet will monitor the user's daily life and collect the following data:

[0174] Physical activity: The PetRobo's sensors detect steps, walking speed, posture, etc.

[0175] Conversation content: Record what the user says through the microphone and convert the voice data into text data.

[0176] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[0177] Health assessment

[0178] The server analyzes the data sent from the pet robot in real time and performs the following processes:

[0179] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, potential falls, or if conversations indicate a decline in cognitive function.

[0180] Health assessment: Comprehensively assess the user's health status based on regularly collected data, such as detecting heart rate fluctuations and lack of physical activity.

[0181] Alerts and Notifications

[0182] If an abnormality is detected, the server will respond by the following means.

[0183] Immediate notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[0184] Regular notification: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members or care facilities.

[0185] Local notification: The robotic pet will notify the user via voice, such as "We recommend that you see a doctor."

[0186] Regular health checks

[0187] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[0188] Promotion of exercise

[0189] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[0190] Data management and advice

[0191] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[0192] Specific examples

[0193] Example 1: Early detection of dementia

[0194] monitoring:

[0195] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[0196] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[0197] Rating and Notification:

[0198] Server: If cognitive decline is suspected, a detailed report will be prepared.

[0199] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[0200] Server: Notify family members and medical personnel and encourage appropriate action.

[0201] Example 2: Exercise promotion

[0202] Exercise prompt:

[0203] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[0204] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[0205] Data storage and analysis:

[0206] Terminal: The pet robot records the number of steps and walking speed.

[0207] Server: Stores the collected data and evaluates the user's exercise volume.

[0208] Advice provided:

[0209] Server: Analyzes exercise results and provides feedback to the user and their family.

[0210] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[0211] Prompt sentence for generative AI model

[0212] "This system uses an AI-equipped pet robot to manage and care for the elderly. Please create a program that meets the following requirements: It will monitor the user's daily life and notify them if any abnormalities are detected. It will also suggest moderate exercise and collect data during exercise. The data will be analyzed on the server, and the health status will be evaluated and advice will be provided."

[0213] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0214] Step 1: Initial Setup

[0215] Users enter health information such as their name, age, height, weight, and medical history via their smartphone or PC.

[0216] Input: User health information entered via smartphone or PC.

[0217] How it works: The user enters their health information into a form displayed in the UI.

[0218] Output: The input information is sent to the pet robot's terminal and server.

[0219] Step 2: Register your health information

[0220] The terminal receives the health information input by the user to the pet robot.

[0221] Input: Health information entered and submitted by a user.

[0222] Operation: The device temporarily stores the received health information and prepares to send it to the server.

[0223] Output: Health information is sent to the server.

[0224] Step 3: Save your health information

[0225] The server stores the received health information in a database.

[0226] Input: Health information sent from the device.

[0227] How it works: The server connects to a database and stores health information for each user as a record.

[0228] Output: User's health information stored in a database.

[0229] Step 4: Start monitoring your daily life

[0230] The terminal is a pet robot that monitors the user's daily life.

[0231] Input: Data about the user's everyday movements, speech, and facial expressions.

[0232] How it works: The device collects data using sensors, cameras, microphones, etc. For example, sensors detect the number of steps taken and walking speed, microphones record conversations, and facial recognition cameras capture facial expressions.

[0233] Output: The collected data is sent to the server.

[0234] Step 5: Data analysis

[0235] The server analyzes the data sent from the pet robot in real time.

[0236] Input: Daily life data sent from the device.

[0237] How it works: The server runs data analysis algorithms to detect anomalies, for example, a slower walking speed compared to normal behavior patterns is flagged as an anomaly.

[0238] Output: A flag is set to indicate whether the analysis result is abnormal or not.

[0239] Step 6: Anomaly detection

[0240] The server detects abnormalities based on the analysis results.

[0241] Input: Results of data analysis.

[0242] Operation: If an anomaly is detected, the server flags the anomaly information for the user and proceeds to the next processing step.

[0243] Output: The results of the anomaly detection are sent to the notification system.

[0244] Step 7: Notification

[0245] If an abnormality is detected, the server will notify you as necessary.

[0246] Input: Anomaly detection results.

[0247] Operation: Depending on the type of abnormality, the server will send immediate notification (SMS or app notification) or regular notification (regular report creation). It will also instruct the pet robot to send a local notification.

[0248] Output: Notifications sent to family and medical personnel, and audio notifications from the PetRobo itself.

[0249] Step 8: Regular Health Checks

[0250] The device will have a pet robot perform regular health checks.

[0251] Input: Pre-configured checklist and health questions.

[0252] How it works: The robot will notify the user by voice when it's time to check, ask questions, and record the results.

[0253] Output: The checklist results answered by the user are sent to the server.

[0254] Step 9: Analyze the results

[0255] The server analyzes the results of the periodic health check.

[0256] Input: Checklist result data.

[0257] How it works: The server uses analytical algorithms to assess the user's health status.

[0258] Output: The analysis results are compiled into a detailed report.

[0259] Step 10: Provide feedback

[0260] The server provides detailed feedback based on the analysis results.

[0261] Input: Analysis results report.

[0262] How it works: The server creates feedback content and sends it to the user or family.

[0263] Output: Feedback sent to user and family, audio notification by PetRobo.

[0264] Step 11: Exercise Suggestion

[0265] The device uses a pet robot to suggest exercises to the user.

[0266] Input: Pre-set exercise plan, user's daily activity data.

[0267] How it works: The pet robot will suggest to the user via voice, "Let's go for a walk together."

[0268] Output: Exercise suggestion notification.

[0269] Step 12: Collecting data during exercise

[0270] The device collects data during exercise (number of steps, exercise time, heart rate, etc.).

[0271] Input: User's exercise data.

[0272] How it works: The PetRobo's sensors record data such as steps taken, exercise time, and heart rate.

[0273] Output: The collected movement data is temporarily stored in the pet robot and later sent to the server.

[0274] Step 13: Analyze your exercise data

[0275] The server analyzes the collected exercise data in real time.

[0276] Input: Exercise data sent from the device.

[0277] Operation: The server analyzes the exercise data and evaluates the user's exercise volume.

[0278] Output: The results of the momentum assessment are saved.

[0279] Step 14: Exercise results feedback

[0280] The server analyzes the exercise results and sends feedback to the user and their family.

[0281] Input: Analysis results of movement data.

[0282] Operation: The server creates feedback and notifies the pet robot that "Today's exercise was very good."

[0283] Output: Exercise evaluation feedback communicated to the user and family.

[0284] (Application example 1)

[0285] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0286] Although elderly people need support in both health management and security, no technology to date has been able to comprehensively meet these needs. In particular, there is a need for a system that can consistently monitor health information, detect anomalies, and detect security risks in the elderly's daily lives.

[0287] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0288] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, means for instructing a response when an abnormality is detected, means for notifying information about the user, means for monitoring the user's living environment, means for detecting security risks, and means for notifying a warning about detected risks, thereby enabling integrated support for health management and security for the elderly.

[0289] "User's health information" is data related to the user's health condition, such as heart rate, number of steps, body temperature, amount of exercise, and medical history.

[0290] "Means for collection" refers to a device or method for acquiring a user's health information using a sensor, camera, or microphone.

[0291] The "analyzing means" is a system that includes algorithms and programs for processing collected health information and determining its condition or abnormality.

[0292] "Means for detecting abnormalities" refers to a device or method for comparing the analysis results with reference values ​​and determining whether there is an abnormality in the health condition.

[0293] The "means for instructing a response" is a device or method for generating instructions to prompt the user and related parties to take an appropriate response when an abnormality is detected.

[0294] The "notification means" is a device or method for transmitting information about abnormalities or health conditions to the user or related parties.

[0295] "Means for monitoring living environments" are devices such as sensors, cameras, and microphones that continuously monitor the behavior and environment of elderly people in their daily lives.

[0296] "Means for detecting security risks" refers to a system that includes sensors and analytical technologies to detect intruders and unusual events in the elderly's living environment.

[0297] A "means for issuing a warning" is a device or method for issuing a warning to a user or other relevant party about a detected security risk.

[0298] This invention is a system that provides support for elderly people in terms of both health management and security. Specifically, it collects and analyzes data on the user's health and living environment, and if an abnormality is detected, it instructs the user to take action and notifies the user of the necessary information.

[0299] System configuration

[0300] The system consists of the following main components:

[0301] 1. Users: Elderly people who use the system to receive health management and security support.

[0302] 2. Terminal: It is configured as a pet robot and is equipped with hardware such as sensors, cameras, microphones, speakers, and AI processors.

[0303] 3. Server: A cloud-based data center that collects, stores, analyzes, and notifies users of their health and security information.

[0304] Initial Setup

[0305] The user will use their smartphone to perform the initial setup of the system, entering the following information to register the pet robot and the server.

[0306] Basic health information such as name, age, height, weight, and medical history

[0307] Family and emergency contacts

[0308] The server stores this information in a database and maintains records for each user.

[0309] Daily Life Monitoring

[0310] The Pet Robot terminal monitors the user's daily life in the following ways:

[0311] Physical activity: Sensors detect steps, walking speed, posture, etc.

[0312] Conversation content: Record what the user says through the microphone and convert it into text data.

[0313] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[0314] Environmental monitoring: Detects abnormalities in living spaces and entry / exit.

[0315] Health and security assessment

[0316] The server analyzes the data sent from the pet robot in real time.

[0317] Health abnormality detection: Compares with normal behavioral patterns to check for abnormalities. For example, it detects slower walking speed, the possibility of falls, and cognitive decline seen in conversations.

[0318] Comprehensive health assessment: Continuously assess the user's health status from collected data, detecting heart rate fluctuations, lack of physical activity, etc.

[0319] Security anomaly detection: Detect suspicious behavior and intruders in users' living spaces.

[0320] Alerts and Notifications

[0321] If an abnormality is detected, the server will respond by the following means.

[0322] Real-time notifications: If a serious abnormality (such as a fall or a break-in) is detected, emergency contacts will be notified in real time.

[0323] Regular reports: Minor abnormalities (such as changes in walking pattern) are compiled into regular reports and sent to family members or care facilities.

[0324] Local notifications: The robotic pet will notify the user via voice, such as "We recommend that you see a doctor."

[0325] Regular health checks and exercise promotion

[0326] PetRobo also includes features for regular health checks and encouraging exercise.

[0327] Regular health checks: The robot will give voice notifications and ask questions and conduct reaction tests based on the user's health checklist. The results are sent to the server for analysis.

[0328] Exercise promotion: The robotic pet will suggest appropriate exercise to the user, saying things like, "Good morning, let's go for a walk together!" Data collected during exercise is also sent to a server for analysis.

[0329] Data management and advice

[0330] The server centrally manages all data, backs it up in a timely manner, and provides specific health and security advice to users and their associates based on the analysis results.

[0331] Specific examples

[0332] Example of combining cognitive abnormalities and security alerts

[0333] Monitoring: The robotic pet monitors the user's daily activities using cameras and sensors to detect suspicious activity (such as home invasions).

[0334] Evaluation and notification: Based on the analysis results, an abnormal behavior detection report is generated, and the pet robot notifies the elderly person that an intruder has been detected, and also sends an alert to emergency contacts.

[0335] Example prompts for generative AI models

[0336] This system monitors the living environment of the elderly and detects abnormal daily behavior and security risks in real time. Data analyzed by the AI ​​model is immediately notified in the event of an emergency and is output as regular reports during normal times. As a specific example of how the system works, it detects a suspicious intrusion in the middle of the night and notifies the elderly and their emergency contacts.

[0337] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0338] Step 1:

[0339] The user performs the initial setup using a smartphone. The data entered here is basic information such as name, age, height, weight, medical history, family and emergency contact information, etc. This data is sent to the server, which then stores it in a database.

[0340] Step 2:

[0341] The pet robot terminal monitors the user's daily life. Specifically, sensors detect the number of steps, walking speed, and posture, and a camera captures facial expressions. In addition, conversations are recorded via a microphone and converted into text data. This data is sent from the terminal to a server. The input is the user's daily activity data, and the output is data sent to the server.

[0342] Step 3:

[0343] The server analyzes the received data. An AI model (such as TENSORFLOW (registered trademark)) is used here. Specifically, the server compares it with normal behavioral patterns and detects abnormalities in walking speed, heart rate, conversation content, etc. The input is the data sent from the device, and the output is the analysis results.

[0344] Step 4:

[0345] The server detects anomalies based on the analysis results. If an anomaly is detected, the server determines how to respond depending on the type of anomaly. The input is the analysis results, and the output is the anomaly detection status and its type.

[0346] Step 5:

[0347] If an abnormality is detected, the server instructs the appropriate response. Specifically, in the case of a serious abnormality (such as a fall or a break-in), emergency contacts (family members or medical personnel) are notified in real time. In addition, minor abnormalities (such as a change in walking pattern) are compiled into a regular report and sent. The input is the abnormality detection status and type, and the output is notification data.

[0348] Step 6:

[0349] In the event of an emergency, the server will send a notification. Notifications to emergency contacts are sent via SMS or app notifications. At the same time, the pet robot device will also send a local notification to the user via voice, such as "We recommend that you see a doctor." The input is the notification data, and the output is the actual notification content.

[0350] Step 7:

[0351] The robotic pet is set to perform regular health checks. The server sends a checklist to the robotic pet, which then notifies the user in advance by voice and asks questions and conducts reaction tests based on the checklist. The results are sent back to the server, which analyzes them. The input is the checklist instructions from the server, and the output is the check results.

[0352] Step 8:

[0353] The server centrally manages data and backs it up in a timely manner. Furthermore, based on the analysis results, the system provides specific advice on health maintenance and security measures to users and their associates. The input is all of the user's data and the analysis results, and the output is advice content.

[0354] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0355] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI, and also combines it with an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described below.

[0356] System configuration

[0357] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[0358] 1. Users: Elderly people who use the system to receive health management and care.

[0359] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, AI processors, and emotion engines.

[0360] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[0361] Initial Setup

[0362] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[0363] Daily Life Monitoring

[0364] PetRobo monitors the user's daily life and collects the following data:

[0365] Physical activity: Sensors detect steps, walking speed, posture, etc.

[0366] Conversation content: What the user says is recorded through the microphone and converted into text data.

[0367] Facial Expressions and Emotions: The camera captures the user's facial expressions and the emotion engine recognizes their emotions, allowing the robot to respond according to the user's emotional state.

[0368] Health assessment

[0369] The server analyzes the data sent from the pet robot in real time, for example, by performing the following processes:

[0370] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, possible falls, or cognitive decline in conversation.

[0371] Health Assessment: Based on regularly collected data, the device comprehensively assesses the user's health status, such as detecting heart rate fluctuations and lack of physical activity.

[0372] Emotion assessment: Analyzes user emotions recognized by the emotion engine to detect early signs of stress or anxiety.

[0373] Alerts and Notifications

[0374] If an abnormality is detected, the server will respond by the following means.

[0375] Instant Notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[0376] Regular notifications: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members and care facilities.

[0377] Local notifications: The pet robot will notify the user by voice, such as "We recommend that you see a doctor."

[0378] Regular health checks

[0379] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[0380] Promotion of exercise

[0381] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[0382] Emotional engine response

[0383] By utilizing the emotion engine, the following responses are taken based on the user's emotional state.

[0384] Stress relief suggestions: If the user is feeling stressed or anxious, the robotic pet will suggest relaxation activities (e.g., deep breathing or short breaks).

[0385] Positive feedback: When the user is in a good emotional state, the robotic pet will provide positive feedback, further reinforcing that emotion.

[0386] Emotion-based communication: Based on the emotions recognized by the emotion engine, the pet robot communicates with the user in an appropriate tone and content.

[0387] Data management and advice

[0388] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[0389] Specific examples

[0390] Example 1: Early detection of dementia

[0391] (monitoring):

[0392] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[0393] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[0394] (Evaluation and Notification):

[0395] Server: If cognitive decline is suspected, a detailed report will be prepared.

[0396] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[0397] Server: Notify family members and medical personnel and encourage appropriate action.

[0398] Example 2: Exercise promotion

[0399] (Exercise prompt):

[0400] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[0401] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[0402] (Data storage and analysis):

[0403] Terminal: The pet robot records the number of steps and walking speed.

[0404] Server: Stores the collected data and evaluates the user's exercise volume.

[0405] (Advice provided):

[0406] Server: Analyzes exercise results and provides feedback to the user and their family.

[0407] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[0408] Example 3: Recognizing and responding to emotions

[0409] (Emotion Monitoring):

[0410] Terminal: The pet robot uses a camera and an emotion engine to analyze the user's facial expressions and recognize their emotions.

[0411] Server: Collects emotional data and stores daily emotional patterns in a database.

[0412] (Stress detection and suggestions):

[0413] Server: Notifies the pet robot if it detects signs of stress or anxiety from the user's emotional patterns.

[0414] Terminal: The pet robot suggests relaxation to the user by saying, "Try taking a deep breath."

[0415] In this way, by combining emotion engines, care and health management that responds to the user's emotional state becomes possible, realizing higher quality lifestyle support.

[0416] The processing flow will be explained below.

[0417] Specific processing steps of a health management system that combines an emotion engine

[0418] Initial Setup

[0419] Step 1: Register user information

[0420] User: Uses a smartphone or PC to enter basic health information such as name, age, height, weight, and medical history.

[0421] Step 2: Save the information to the server

[0422] Server: Stores the information entered by the user in a database and generates a unique user ID for each user.

[0423] Step 3: Initial setup of your pet robot

[0424] Terminal: The pet robot connects to the server, obtains user information, and prepares for operation. It also calibrates sensors and cameras.

[0425] Daily Life Monitoring

[0426] Step 4: Start collecting data

[0427] Terminal: The pet robot begins collecting data on the user's daily activities (walking, talking, facial expressions, etc.) using sensors and cameras. The emotion engine analyzes the user's facial expressions and recognizes their emotions.

[0428] Step 5: Send monitoring data

[0429] Terminal: Sends collected data to the server at regular intervals (e.g., every 30 minutes).

[0430] Step 6: Analyze the data

[0431] Server: Analyzes the received data in real time, applies anomaly detection and emotion recognition algorithms, and flags any anomalies or changes in emotion.

[0432] Health assessment

[0433] Step 7: Anomaly detection

[0434] Server: Based on the analysis results, it detects slowing of walking speed, falls, and abnormalities in speech (signs of cognitive decline). The emotion engine detects stress and anxiety.

[0435] Step 8: Evaluate and record any abnormalities

[0436] Server: Evaluates detected anomalies and emotional changes, generates a report on the user's health status, and stores it in a database.

[0437] Alerts and Notifications

[0438] Step 9: Generate an alert

[0439] Server: If a significant abnormality is detected, it generates an alert and sends a notification to the user's family and medical personnel.

[0440] Step 10: Sending notifications

[0441] Server: Sends the alert information using the notification medium used (SMS, app notification, email, etc.).

[0442] Step 11: Notify users

[0443] Terminal: The pet robot notifies the user by voice, "An abnormality has been detected. We recommend that you see a doctor."

[0444] Regular health checks

[0445] Step 12: Start the health check

[0446] Terminal: The pet robot notifies the user by voice, "Regular health check will begin."

[0447] Step 13: Run the checklist

[0448] Terminal: The pet robot will ask questions and carry out reaction tests based on a checklist.

[0449] Step 14: Collecting check results

[0450] Terminal: Records the results of the check and sends them to the server.

[0451] Step 15: Analyze and save the results

[0452] Server: Analyzes the check results and stores the user's health status in a database.

[0453] Promotion of exercise

[0454] Step 16: Exercise Suggestion

[0455] Terminal: The pet robot suggests exercise to the user by saying, "Let's go for a walk together."

[0456] Step 17: User Activity

[0457] User: Take walks or do light exercise together according to suggestions from the pet robot.

[0458] Step 18: Collect exercise data

[0459] Terminal: The pet robot collects walking data and heart rate during exercise and sends it to the server.

[0460] Step 19: Analyze the movement data

[0461] Server: Analyzes the collected exercise data and evaluates the user's exercise volume.

[0462] Emotional engine response

[0463] Step 20: Sentiment Analysis

[0464] Terminal: The pet robot uses a camera and emotion engine to analyze the user's facial expressions and recognize their emotions.

[0465] Step 21: Sending Emotion Data

[0466] Terminal: Sends emotional data to the server and stores daily emotional patterns in a database.

[0467] Step 22: Stress detection and countermeasures

[0468] Server: Notifies the pet robot if it detects signs of stress or anxiety from emotional patterns.

[0469] Terminal: The pet robot suggests relaxation to the user by saying, "Try taking a deep breath."

[0470] Step 23: Positive Feedback

[0471] Device: If the user is in a good emotional state, the robotic pet will provide positive feedback such as "You look great today!"

[0472] Step 24: Communicate Emotionally

[0473] Terminal: Based on the emotions recognized by the emotion engine, the pet robot communicates with the user in an appropriate tone and content.

[0474] Data management and advice

[0475] Step 25: Centralize your data

[0476] Server: All data is managed centrally and backed up regularly.

[0477] Step 26: Generating Advice

[0478] Server: Based on the results of data analysis, it generates specific advice for the user on maintaining their health.

[0479] Step 27: Providing advice

[0480] Device: The pet robot provides the user with specific advice via voice, such as "It is recommended to walk your pet three times a week."

[0481] Step 28: Create and submit a report

[0482] Server: Generates monthly and weekly reports and sends them to the user's family and care facility personnel.

[0483] In this way, by combining emotion engines, care and health management that responds to the user's emotional state becomes possible, realizing higher quality lifestyle support.

[0484] Example 2

[0485] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0486] Health management and care systems for the elderly require comprehensive support that includes not only physical health but also mental health. In particular, it is important to detect cognitive decline and emotional changes such as stress and anxiety early and provide appropriate responses. However, current systems lack these functions, making it difficult to provide highly accurate monitoring and appropriate feedback.

[0487] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0488] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, means for instructing a response when an abnormality is detected, means for notifying information about the user, means for recognizing the user's emotions, and means for suggesting a response based on the recognized emotions. This makes it possible to closely monitor not only the user's physical health condition but also their mental health condition, and to respond immediately when an abnormality is detected.

[0489] A "user" is a person who receives health management and care using this system.

[0490] "Health Information" refers to basic health data such as a user's name, age, height, weight, and medical history, as well as physiological and behavioral data obtained from daily life.

[0491] The term "means" refers to a device or method used to achieve a specific purpose, and in the present invention includes a module for realizing a specific function.

[0492] "Server" refers to a cloud-based data center, a computer system responsible for collecting, storing, and analyzing users' health information.

[0493] The "terminal" refers to the pet robot itself, which is hardware equipped with sensors, a camera, a microphone, a speaker, an AI processor, an emotion engine, etc.

[0494] An "emotion engine" refers to an algorithm and software system that recognizes emotions by analyzing a user's facial expressions, voice, etc.

[0495] "Abnormal" refers to a state that deviates from normal behavioral patterns or a situation that is deemed to be a health problem.

[0496] "Notification" refers to the act of the system communicating information to the user, family, or medical professionals, and includes methods such as SMS, app notification, and voice message.

[0497] "Exercise promotion" refers to the process of suggesting appropriate exercise to users and encouraging them to do so.

[0498] A "health check" refers to the act of periodically conducting tests and asking questions to assess a user's health.

[0499] "Real-time analytics" refers to the process of analyzing data immediately as it is generated.

[0500] A "machine learning algorithm" refers to a computational model that recognizes patterns based on large amounts of data and makes predictions and classifications.

[0501] "Backup" refers to the process of regularly saving copies of data in case of data loss.

[0502] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI, and also combines it with an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described below.

[0503] System Configuration Overview

[0504] This system mainly consists of the following three components:

[0505] 1. Users: Elderly people who use the system to receive health management and care.

[0506] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, AI processors, and emotion engines.

[0507] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[0508] Initial Setup

[0509] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[0510] Daily Life Monitoring

[0511] The device (Pet Robot) monitors the user's daily life and collects the following data:

[0512] Physical activity: Sensors detect steps, walking speed, and posture, specifically using the built-in accelerometer and gyroscope.

[0513] Conversation: The conversation is recorded through a microphone and converted into text data. Specifically, speech recognition software is used to convert speech into text.

[0514] Facial expressions and emotions: The camera analyzes facial expressions and the emotion engine recognizes emotions. Specifically, the image processing algorithm is used to analyze facial expressions and the emotion engine digitizes emotions.

[0515] Health assessment

[0516] The server analyzes the data sent from the pet robot in real time.

[0517] Anomaly detection: Compares a user's behavioral patterns with past data to detect anomalies, such as a slowdown in walking speed, the possibility of a fall, or a decline in cognitive function in conversations.

[0518] Health Assessment: A comprehensive assessment of the user's health status is performed based on heart rate and exercise volume. In particular, a health index is calculated by taking a weighted average of each data point.

[0519] Emotion assessment: The emotion engine analyzes the recognized emotional data and assesses the level of stress and anxiety.

[0520] Alerts and Notifications

[0521] If an abnormality is detected, the server will respond appropriately.

[0522] Immediate Notification: If a critical abnormality is detected, an SMS or app notification will be sent to family members or medical personnel. For example, if a fall is detected.

[0523] Regular notifications: If minor abnormalities are detected, they can be compiled into regular reports and sent to family members or care facilities. For example, changes in walking patterns.

[0524] Local notifications: The robotic pet will notify the user directly, for example, saying "We recommend you see a doctor."

[0525] Regular health checks

[0526] The device periodically performs health checks, notifying the user in advance via voice, and conducting checklist-based questions and reaction tests. The results are sent to a server for further analysis.

[0527] Promotion of exercise

[0528] The device will suggest moderate exercise to the user, for example, "Good morning, let's go for a walk together!" The Pet Robot records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[0529] Emotional engine response

[0530] The device utilizes an emotion engine to take the following actions:

[0531] Stress relief suggestions: If the user is feeling stressed or anxious, suggest relaxation activities (e.g., deep breathing or short breaks).

[0532] Positive feedback: If the user is in a good emotional state, provide positive feedback.

[0533] Emotion-based communication: Based on the emotions recognized by the emotion engine, the pet robot will communicate with the appropriate tone and content.

[0534] Data management and advice

[0535] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families. For example, the advice could be, "It is recommended to take a walk three times a week."

[0536] Specific examples

[0537] Early detection of dementia

[0538] 1. Monitoring:

[0539] Device: The robotic pet observes the user's daily life and records their recent conversation patterns. Speech recognition software analyzes the conversation and sends it to the server.

[0540] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[0541] 2. Evaluation and Notification:

[0542] Server: If cognitive decline is suspected, it creates a detailed report. It detects abnormal patterns, generates and sends the report.

[0543] Terminal: The robotic pet notifies the user, "We recommend that you see a doctor." Specifically, it uses voice synthesis to convey the message.

[0544] Server: Notify family members and medical personnel and encourage appropriate action.

[0545] Promotion of exercise

[0546] 1. Exercise prompts:

[0547] Device: In the morning, the robot pet will suggest to the user, "Let's go for a walk together." It will play a voice message to signal when it's time to exercise.

[0548] User: Accept the suggestion and do some light exercise or a walk with the pet robot. Put on the pedometer and start walking.

[0549] 2. Data Storage and Analysis:

[0550] Device: The robot records the number of steps and walking speed. Data is collected using a walking sensor.

[0551] Server: Stores the collected data and evaluates the user's exercise volume. Data analysis tools evaluate the exercise volume and generate reports.

[0552] 3. Providing advice:

[0553] Server: Analyzes exercise results and provides feedback to the user and their family. Based on the analysis results, generates and sends specific exercise advice.

[0554] Terminal: The robot pet gives feedback to the user, saying, "Your exercise today was great." Specifically, it uses voice synthesis to convey a positive message.

[0555] Recognizing and Responding to Emotions

[0556] 1. Emotional monitoring:

[0557] Terminal: The robotic pet uses a camera and an emotion engine to analyze the user's facial expressions and recognize their emotions. It uses an image processing algorithm to capture the facial expressions and generate analytical data.

[0558] Server: Collects emotional data and stores daily emotional patterns in a database. Records the emotional data in cloud storage.

[0559] 2. Stress detection and suggestions:

[0560] Server: Notifies the Pet Robot if it detects signs of stress or anxiety from the user's emotional patterns. Detects abnormal patterns and sends instructions to the Pet Robot.

[0561] Terminal: The pet robot suggests relaxation to the user by saying, "Try taking a deep breath." The relaxation suggestion is made using voice synthesis.

[0562] In this way, the entire system functions in coordination to provide comprehensive health support for the elderly.

[0563] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0564] Step 1: Initial Setup

[0565] The user performs the initial setup of the system using a smartphone or PC. Specifically, the user opens a dedicated app and enters basic information such as name, age, height, weight, and medical history. Input: Basic health information. Output: Registered user information. The server saves the entered information in a database and manages records for each user. Specifically, the server registers the information in the database and generates a user ID.

[0566] Step 2: Monitoring your daily life

[0567] The terminal (pet robot) monitors the user's daily life. Input: User's behavior and environmental data. Output: Collected data. The specific operations are as follows.

[0568] Physical activity monitoring: Sensors detect steps, walking speed, and posture using the built-in accelerometer and gyroscope.

[0569] Conversation monitoring: Recording conversations through a microphone and converting them into text data. Using speech recognition software to convert speech to text.

[0570] Facial Expression and Emotion Monitoring: Using a camera to analyze facial expressions and an emotion engine to recognize emotions, image processing algorithms are used to analyze facial expressions and digitize emotions.

[0571] Step 3: Send data

[0572] The device sends the collected data to the server. Input: Monitored data. Output: Data sent to the server. Specifically, the data is uploaded to the cloud server using an internet connection.

[0573] Step 4: Health Assessment

[0574] The server analyzes the transmitted data in real time. Input: Transmitted data. Output: Evaluation results. The specific operation is as follows.

[0575] Anomaly detection: Compares data with past data in the database to see if there are any anomalies. Machine learning algorithms are used to detect outliers.

[0576] Health Assessment: A comprehensive assessment of the user's health status is performed based on heart rate, exercise volume, etc. A weighted average of each data point is used to calculate a health index.

[0577] Emotion Assessment: The emotion engine analyzes the recognized emotion data to assess the level of stress and anxiety. Emotion data is analyzed to detect signs of stress and anxiety.

[0578] Step 5: Alerts and Notifications

[0579] If an abnormality is detected, the server will take appropriate action. Input: Data in which an abnormality was detected. Output: Notification message. The specific operations are as follows:

[0580] Immediate notification: If a critical abnormality is detected, family members or medical personnel will be notified via SMS or app notifications. SMS gateways and push notification services will be used to contact them.

[0581] Regular notification: If a minor abnormality is detected, it will be compiled into a regular report and sent to the family or care facility. Data will be collected periodically and reports will be generated.

[0582] Local notification: The robotic pet notifies the user directly, using text-to-speech to say, "We recommend you see a doctor."

[0583] Step 6: Regular Health Checks

[0584] The device periodically performs health checks. Input: Checklist. Output: Check results. Specific operations include notifying the user in advance by voice, and asking questions and conducting reaction tests based on the checklist. The results are sent to the server for further analysis.

[0585] Step 7: Exercise promotion

[0586] The device will suggest moderate exercise to the user. Input: Suggested time and content. Output: User's exercise data. The specific operation is as follows.

[0587] Exercise suggestion: Uses voice synthesis technology to suggest, "Good morning, let's go for a walk together!"

[0588] User response: The user accepts the suggestion and starts exercising. The robotic pet uses a pedometer to measure the data.

[0589] Data recording: Records exercise data (number of steps, exercise time, heart rate) and sends it to the server. The collected data is saved and the user's exercise volume is evaluated.

[0590] Step 8: Respond with the Emotion Engine

[0591] The device utilizes an emotion engine to respond based on the user's emotional state. Input: Emotion data. Output: Countermeasures. Specific operations are as follows:

[0592] Emotion Recognition: Facial expressions are captured and analyzed with a camera, and image processing algorithms are used to generate emotion data.

[0593] Stress response: If the user is feeling stressed or anxious, the app suggests relaxation activities, using voice synthesis to suggest things like, "Try taking a deep breath."

[0594] Positive feedback: If the user is in a good emotional state, provide positive feedback. The voice will say, "Your workout today was great."

[0595] Step 9: Data management and advice

[0596] The server centrally manages and backs up all data. Input: All collected data. Output: Advice report. Specific operations are as follows:

[0597] Data storage: Store data in cloud storage and back it up regularly.

[0598] Advice based on analysis results: Based on the data analysis results, specific health maintenance advice is generated and sent to the user or family. For example, advice such as "It is recommended to take a walk three times a week" is provided.

[0599] (Application example 2)

[0600] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0601] With the increasing number of elderly people in modern society, health management and safety assurance in daily life are becoming increasingly important. However, existing systems lack detailed monitoring of elderly people's behavior and emotional state, making it difficult to detect abnormalities early and respond appropriately. Furthermore, in many cases, prompt and appropriate notifications are not provided to elderly people or their families, resulting in safety issues. Therefore, an effective method for simultaneously managing the health and safety of elderly people is needed.

[0602] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, and means for monitoring the user's behavior with a sensor. This enables detailed monitoring of changes in the user's behavior and emotions and enables prompt and appropriate responses. Furthermore, by analyzing the collected data on a cloud server, abnormal behavior and changes in emotions can be immediately detected and promptly notified to the elderly person, their family, and even a security company, thereby ensuring safety.

[0603] "User's health information" refers to all data related to the user's physical condition and health, and specifically includes heart rate, blood pressure, number of steps, weight, etc.

[0604] "Means of collection" refers to devices and technologies that acquire data using sensors, cameras, audio microphones, etc.

[0605] "Means of analysis" refers to the algorithms and software used to analyze collected data and assess a user's health status and behavioral patterns.

[0606] "Means for detecting anomalies" refers to hardware and software that identify data that deviates from normal patterns and recognize abnormal situations.

[0607] "Means for instructing how to respond" refers to a method or device for providing appropriate advice or instructions to the user when an abnormality is detected.

[0608] "Means of notification" refers to the method or system for communicating detected information to the user, their family, security companies, and other relevant parties.

[0609] "Means for monitoring user behavior using sensors" refers to sensors and related technologies for monitoring user movements and behavior in real time.

[0610] "Means for recognizing a user's emotional state using a camera" refers to technology that analyzes images taken with a camera and infers emotions from the user's facial expressions and movements.

[0611] "Means for transmitting to a cloud server for analysis" refers to the technology for transmitting collected data via the Internet to a remote server where it can be analyzed in detail.

[0612] "Means for providing advice" refers to a method or device for providing health care or security instructions or suggestions to a user based on the results of the analysis.

[0613] This invention relates to a system that collects, analyzes, detects abnormalities, and provides instructions and notifications regarding user health information. In particular, it comprehensively manages the user's health and safety by monitoring the user's behavior with sensors and recognizing their emotional state with a camera.

[0614] System configuration

[0615] This system consists of the following main components:

[0616] 1. Pet Robot (terminal): Equipped with sensors, cameras, microphones, speakers, AI processors, and emotion engines, it monitors the user's daily life.

[0617] 2. Cloud server: Responsible for storing and analyzing collected data and notifying the results.

[0618] 3. Smartphone application: Serves as an interface for notifying users, their families, and security companies.

[0619] Data collection

[0620] The robot uses sensors and cameras to collect health information about the user, including the number of steps, walking speed, posture, heart rate, and facial expression data, in real time. It also records the user's conversations through a microphone and converts them into text data.

[0621] Data analysis

[0622] The collected data undergoes initial processing by the robot's AI processor and is then sent in real time to a cloud server, where it undergoes further analysis using machine learning models and an emotion engine. This allows the robot to evaluate the user's behavioral patterns and emotional state and detect any anomalies.

[0623] Anomaly detection and notification

[0624] If an abnormality is detected, a notification is sent from the cloud server to the smartphone application. If a serious abnormality is detected (e.g., a fall), an immediate notification is sent, and alerts are also sent to security companies and family members. If the abnormality is minor, a regular report is sent.

[0625] Responding to users

[0626] If an abnormality is detected, the robot will give the user voice advice and instructions, such as suggesting relaxation activities like "Try taking deep breaths."

[0627] Data management and advice

[0628] The cloud server centrally manages all data and regularly backs it up. Based on the analysis results, the system provides specific health maintenance advice to users and their families. For example, the system might say, "It is recommended that you take a walk three times a week."

[0629] Examples and prompts

[0630] Specific examples

[0631] A pet robot detects that an elderly person gets up and wanders around multiple times at night, and a smart guard robot immediately notifies the family and the security company.

[0632] Prompt Sentence Examples

[0633] Behavioral recognition:

[0634] The system monitors user behavior and sends a notification if an abnormality occurs. If the user moves significantly during sleep hours, which is considered normal behavior, it is treated as an abnormality.

[0635] Sentiment analysis:

[0636] The system analyzes facial images captured by the camera to determine the user's emotional state. If negative emotions such as stress or anxiety are detected, it sends a notification and suggests relaxation activities to the user.

[0637] This will enable comprehensive management of the user's health and safety, and enable prompt and appropriate response. The implementation of the invention includes hardware and software such as sensors, cameras, AI processors, cloud servers, and smartphone applications.

[0638] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0639] Step 1:

[0640] The PetRobo (terminal) uses sensors and a camera to collect the user's health and behavioral data. The sensors measure the number of steps taken, heart rate, and walking speed, and the camera captures facial expressions. This data is input into the PetRobo's AI processor.

[0641] Step 2:

[0642] The PetRobo's AI processor performs an initial analysis of the collected data. For example, it detects abnormalities in the number of steps and heart rate, and estimates the emotional state from facial expression data. This process allows for early detection of anomalies. The analyzed data is then sent to a cloud server for the next step.

[0643] Step 3:

[0644] The cloud server receives the data sent from the robotic pet and performs a detailed analysis. The server uses a generative AI model to further analyze walking patterns and emotional data. For example, the cloud server detects abnormal walking patterns during specific times of the day and uses an emotion engine to analyze signs of stress or anxiety. The results of this analysis are used in the next step.

[0645] Step 4:

[0646] The cloud server determines whether an abnormality has been detected based on the detailed analysis results. If an abnormality is detected, the cloud server sends a notification to the smartphone application. For example, if a serious abnormality (such as a fall) is detected, an immediate notification will be sent, and if a minor abnormality (such as a change in walking pattern) is detected, a periodic report will be sent.

[0647] Step 5:

[0648] The smartphone application receives notifications from the cloud server and displays alerts to the user, their family, and the security company, allowing the user to check the notifications and take necessary action.

[0649] Step 6:

[0650] The pet robot will give voice advice to the user. For example, if abnormal behavior is detected, it will give advice such as "Try taking deep breaths" or "We recommend that you see a doctor." This voice advice is generated based on the analysis results of the cloud server.

[0651] Step 7:

[0652] The cloud server stores all data and backs it up regularly. Furthermore, the cloud server uses the data history to provide specific health advice to users and their families. For example, it generates instructions such as "It is recommended to take a walk three times a week," and notifies users via a smartphone application.

[0653] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0654] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0655] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0656] [Second embodiment]

[0657] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0658] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0659] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0660] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0661] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0662] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0663] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0664] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0665] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0666] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0667] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0668] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0669] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI. Specific embodiments of the system are described below.

[0670] System configuration

[0671] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[0672] 1. Users: Elderly people who use the system to receive health management and care.

[0673] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, and AI processors.

[0674] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[0675] Initial Setup

[0676] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[0677] Daily Life Monitoring

[0678] PetRobo monitors the user's daily life and collects the following data:

[0679] Physical activity: Sensors detect steps, walking speed, posture, etc.

[0680] Conversation content: What the user says is recorded through the microphone and converted into text data.

[0681] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[0682] Health assessment

[0683] The server analyzes the data sent from the pet robot in real time, for example, by performing the following processes:

[0684] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, possible falls, or cognitive decline in conversation.

[0685] Health Assessment: Based on regularly collected data, the device comprehensively assesses the user's health status, such as detecting heart rate fluctuations and lack of physical activity.

[0686] Alerts and Notifications

[0687] If an abnormality is detected, the server will respond by the following means.

[0688] Instant Notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[0689] Regular notifications: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members and care facilities.

[0690] Local notifications: The pet robot will notify the user by voice, such as "We recommend that you see a doctor."

[0691] Regular health checks

[0692] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[0693] Promotion of exercise

[0694] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[0695] Data management and advice

[0696] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[0697] Specific examples

[0698] Example 1: Early detection of dementia

[0699] (monitoring):

[0700] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[0701] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[0702] (Evaluation and Notification):

[0703] Server: If cognitive decline is suspected, a detailed report will be prepared.

[0704] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[0705] Server: Notify family members and medical personnel and encourage appropriate action.

[0706] Example 2: Exercise promotion

[0707] (Exercise prompt):

[0708] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[0709] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[0710] (Data storage and analysis):

[0711] Terminal: The pet robot records the number of steps and walking speed.

[0712] Server: Stores the collected data and evaluates the user's exercise volume.

[0713] (Advice provided):

[0714] Server: Analyzes exercise results and provides feedback to the user and their family.

[0715] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[0716] The above is an embodiment of the present invention. It is expected that this system will enable efficient and effective health management and care for the elderly.

[0717] The processing flow will be explained below.

[0718] Specific steps for daily life monitoring and health management program

[0719] Overall system flow

[0720] Initial Setup

[0721] Step 1: Register user information

[0722] User: Uses a smartphone or PC to enter basic health information such as name, age, height, weight, and medical history.

[0723] Step 2: Save the information to the server

[0724] Server: Stores the information entered by the user in a database and generates a unique user ID for each user.

[0725] Step 3: Initial setup of your pet robot

[0726] Terminal: The pet robot connects to the server, obtains user information, and prepares for operation. It also calibrates sensors and cameras.

[0727] Daily Life Monitoring

[0728] Step 4: Start collecting data

[0729] Terminal: The pet robot begins collecting data on the user's daily activities (walking, talking, facial expressions, etc.) using sensors.

[0730] Step 5: Send monitoring data

[0731] Terminal: Sends collected data to the server at regular intervals (e.g., every 30 minutes).

[0732] Step 6: Analyze the data

[0733] Server: Analyzes the received data in real time, applies anomaly detection algorithms, and flags any anomalies detected.

[0734] Health assessment

[0735] Step 7: Anomaly detection

[0736] Server: Based on the analysis results, detects slowing walking speed, falls, and abnormalities in speech (signs of cognitive decline).

[0737] Step 8: Evaluate and record any abnormalities

[0738] Server: Evaluates the detected anomalies and generates a report on the user's health status, which is stored in a database.

[0739] Alerts and Notifications

[0740] Step 9: Generate an alert

[0741] Server: If a significant abnormality is detected, it generates an alert and sends a notification to the user's family and medical personnel.

[0742] Step 10: Sending notifications

[0743] Server: Sends the alert information using the notification medium used (SMS, app notification, email, etc.).

[0744] Step 11: Notify users

[0745] Terminal: The pet robot notifies the user by voice, "An abnormality has been detected. We recommend that you see a doctor."

[0746] Regular health checks

[0747] Step 12: Start the health check

[0748] Terminal: The pet robot notifies the user by voice, "Regular health check will begin."

[0749] Step 13: Run the checklist

[0750] Terminal: The pet robot will ask questions and carry out reaction tests based on a checklist.

[0751] Step 14: Collecting check results

[0752] Terminal: Records the results of the check and sends them to the server.

[0753] Step 15: Analyze and save the results

[0754] Server: Analyzes the check results and stores the user's health status in a database.

[0755] Promotion of exercise

[0756] Step 16: Exercise Suggestion

[0757] Terminal: The pet robot suggests exercise to the user by saying, "Let's go for a walk together."

[0758] Step 17: User Activity

[0759] User: Take walks or do light exercise together according to suggestions from the pet robot.

[0760] Step 18: Collect exercise data

[0761] Terminal: The pet robot collects walking data and heart rate during exercise and sends it to the server.

[0762] Step 19: Analyze the movement data

[0763] Server: Analyzes the collected exercise data and evaluates the user's exercise volume.

[0764] Data management and advice

[0765] Step 20: Centralize your data

[0766] Server: All data is managed centrally and backed up regularly.

[0767] Step 21: Generate Advice

[0768] Server: Based on the results of data analysis, it generates specific advice for the user on maintaining their health.

[0769] Step 22: Providing advice

[0770] Device: The pet robot provides the user with specific advice via voice, such as "It is recommended to walk your pet three times a week."

[0771] Step 23: Create and submit the report

[0772] Server: Generates monthly and weekly reports and sends them to the user's family and care facility personnel.

[0773] In this way, the system supports the elderly in their daily lives and manages their health.

[0774] Example 1

[0775] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0776] Efficient and effective health management and care for the elderly requires detailed monitoring and analysis of their daily lives. However, current systems are insufficient in collecting health information and detecting abnormalities, making it difficult to respond quickly. In addition, some systems are unable to provide specific countermeasures for cognitive decline and lack of exercise in the elderly. To solve these problems, a system is needed that can perform detailed, real-time monitoring and analysis and provide appropriate notifications and advice.

[0777] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0778] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, and means for monitoring the user's daily life. This enables detailed and real-time collection and analysis of health information. It also includes means for encouraging the user to exercise, means for notifying the user based on the monitoring results, and means for initializing the system. This enables evaluation of health status, provision of appropriate advice, regular health checks, and promotion of exercise. It also includes means for monitoring conversation content to detect cognitive decline, and means for collecting exercise data and evaluating the amount of exercise. This enables early detection of cognitive decline and provision of specific countermeasures to address lack of exercise.

[0779] "Users" refer to elderly people who use the system to receive health management and care.

[0780] "Health Information" refers to health-related data such as a user's name, age, height, weight, and medical history.

[0781] "Means of collection" refers to the function of obtaining the user's health information using a pet robot or other sensor devices.

[0782] "Means for analysis" refers to algorithms or software that use collected health information to assess a user's health status.

[0783] "Means for detecting abnormalities" refers to the function of identifying abnormal patterns that differ from normal conditions based on the results of analyzing health information.

[0784] "Means for instructing a response" refers to a function that notifies the user, family, or medical personnel of the necessary actions when an abnormality is detected.

[0785] "Means of monitoring" refers to the function of continuously observing the user's daily activities and behavior using a pet robot or other sensor devices.

[0786] "Means to encourage exercise" refers to the function in which the pet robot uses voice or other means to suggest appropriate exercise to the user and encourage them to do so.

[0787] "Means of notification" refers to the function of notifying users of health information and abnormality detection results via voice, SMS, app notifications, etc.

[0788] "Means for performing initial settings" refers to the function that allows a user to input the health information required when starting to use the system and register it with the pet robot and server.

[0789] "Means for monitoring conversation content" refers to the function of recording and analyzing the user's conversation using the pet robot's microphone.

[0790] "Means for detecting cognitive decline" refers to algorithms or software that analyze a user's daily conversations and behavioral patterns to identify cognitive decline at an early stage.

[0791] "Means for collecting data from exercise" refers to the function of obtaining data such as the number of steps taken during exercise, exercise time, and heart rate through the pet robot's sensors and sending it to a server.

[0792] "Means for assessing exercise volume" refers to algorithms or software that analyze the collected exercise data and assess the user's exercise volume.

[0793] This invention is a system for managing and caring for the elderly using a pet robot equipped with AI. This system monitors the user's daily life, and if an abnormality is detected, it instructs appropriate measures, evaluates the user's health, and provides advice. Specifically, it uses the following hardware and software components.

[0794] System configuration

[0795] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[0796] 1. Users: Elderly people who use the system to receive health management and care.

[0797] 2. Terminal (Pet Robot): Equipped with hardware such as sensors, cameras, microphones, speakers, and AI processors.

[0798] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[0799] Initial Setup

[0800] The user performs the initial setup of the system using a smartphone or PC. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[0801] Daily Life Monitoring

[0802] The robotic pet will monitor the user's daily life and collect the following data:

[0803] Physical activity: The PetRobo's sensors detect steps, walking speed, posture, etc.

[0804] Conversation content: Record what the user says through the microphone and convert the voice data into text data.

[0805] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[0806] Health assessment

[0807] The server analyzes the data sent from the pet robot in real time and performs the following processes:

[0808] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, potential falls, or if conversations indicate a decline in cognitive function.

[0809] Health assessment: Comprehensively assess the user's health status based on regularly collected data, such as detecting heart rate fluctuations and lack of physical activity.

[0810] Alerts and Notifications

[0811] If an abnormality is detected, the server will respond by the following means.

[0812] Immediate notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[0813] Regular notification: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members or care facilities.

[0814] Local notification: The robotic pet will notify the user via voice, such as "We recommend that you see a doctor."

[0815] Regular health checks

[0816] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[0817] Promotion of exercise

[0818] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[0819] Data management and advice

[0820] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[0821] Specific examples

[0822] Example 1: Early detection of dementia

[0823] monitoring:

[0824] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[0825] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[0826] Rating and Notification:

[0827] Server: If cognitive decline is suspected, a detailed report will be prepared.

[0828] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[0829] Server: Notify family members and medical personnel and encourage appropriate action.

[0830] Example 2: Exercise promotion

[0831] Exercise prompt:

[0832] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[0833] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[0834] Data storage and analysis:

[0835] Terminal: The pet robot records the number of steps and walking speed.

[0836] Server: Stores the collected data and evaluates the user's exercise volume.

[0837] Advice provided:

[0838] Server: Analyzes exercise results and provides feedback to the user and their family.

[0839] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[0840] Prompt sentence for generative AI model

[0841] "This system uses an AI-equipped pet robot to manage and care for the elderly. Please create a program that meets the following requirements: It will monitor the user's daily life and notify them if any abnormalities are detected. It will also suggest moderate exercise and collect data during exercise. The data will be analyzed on the server, and the health status will be evaluated and advice will be provided."

[0842] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0843] Step 1: Initial Setup

[0844] Users enter health information such as their name, age, height, weight, and medical history via their smartphone or PC.

[0845] Input: User health information entered via smartphone or PC.

[0846] How it works: The user enters their health information into a form displayed in the UI.

[0847] Output: The input information is sent to the pet robot's terminal and server.

[0848] Step 2: Register your health information

[0849] The terminal receives the health information input by the user to the pet robot.

[0850] Input: Health information entered and submitted by a user.

[0851] Operation: The device temporarily stores the received health information and prepares to send it to the server.

[0852] Output: Health information is sent to the server.

[0853] Step 3: Save your health information

[0854] The server stores the received health information in a database.

[0855] Input: Health information sent from the device.

[0856] How it works: The server connects to a database and stores health information for each user as a record.

[0857] Output: User's health information stored in a database.

[0858] Step 4: Start monitoring your daily life

[0859] The terminal is a pet robot that monitors the user's daily life.

[0860] Input: Data about the user's everyday movements, speech, and facial expressions.

[0861] How it works: The device collects data using sensors, cameras, microphones, etc. For example, sensors detect the number of steps taken and walking speed, microphones record conversations, and facial recognition cameras capture facial expressions.

[0862] Output: The collected data is sent to the server.

[0863] Step 5: Data analysis

[0864] The server analyzes the data sent from the pet robot in real time.

[0865] Input: Daily life data sent from the device.

[0866] How it works: The server runs data analysis algorithms to detect anomalies, for example, a slower walking speed compared to normal behavior patterns is flagged as an anomaly.

[0867] Output: A flag is set to indicate whether the analysis result is abnormal or not.

[0868] Step 6: Anomaly detection

[0869] The server detects abnormalities based on the analysis results.

[0870] Input: Results of data analysis.

[0871] Operation: If an anomaly is detected, the server flags the anomaly information for the user and proceeds to the next processing step.

[0872] Output: The results of the anomaly detection are sent to the notification system.

[0873] Step 7: Notification

[0874] If an abnormality is detected, the server will notify you as necessary.

[0875] Input: Anomaly detection results.

[0876] Operation: Depending on the type of abnormality, the server will send immediate notification (SMS or app notification) or regular notification (regular report creation). It will also instruct the pet robot to send a local notification.

[0877] Output: Notifications sent to family and medical personnel, and audio notifications from the PetRobo itself.

[0878] Step 8: Regular Health Checks

[0879] The device will have a pet robot perform regular health checks.

[0880] Input: Pre-configured checklist and health questions.

[0881] How it works: The robot will notify the user by voice when it's time to check, ask questions, and record the results.

[0882] Output: The checklist results answered by the user are sent to the server.

[0883] Step 9: Analyze the results

[0884] The server analyzes the results of the periodic health check.

[0885] Input: Checklist result data.

[0886] How it works: The server uses analytical algorithms to assess the user's health status.

[0887] Output: The analysis results are compiled into a detailed report.

[0888] Step 10: Provide feedback

[0889] The server provides detailed feedback based on the analysis results.

[0890] Input: Analysis results report.

[0891] How it works: The server creates feedback content and sends it to the user or family.

[0892] Output: Feedback sent to user and family, audio notification by PetRobo.

[0893] Step 11: Exercise Suggestion

[0894] The device uses a pet robot to suggest exercises to the user.

[0895] Input: Pre-set exercise plan, user's daily activity data.

[0896] How it works: The pet robot will suggest to the user via voice, "Let's go for a walk together."

[0897] Output: Exercise suggestion notification.

[0898] Step 12: Collecting data during exercise

[0899] The device collects data during exercise (number of steps, exercise time, heart rate, etc.).

[0900] Input: User's exercise data.

[0901] How it works: The PetRobo's sensors record data such as steps taken, exercise time, and heart rate.

[0902] Output: The collected movement data is temporarily stored in the pet robot and later sent to the server.

[0903] Step 13: Analyze your exercise data

[0904] The server analyzes the collected exercise data in real time.

[0905] Input: Exercise data sent from the device.

[0906] Operation: The server analyzes the exercise data and evaluates the user's exercise volume.

[0907] Output: The results of the momentum assessment are saved.

[0908] Step 14: Exercise results feedback

[0909] The server analyzes the exercise results and sends feedback to the user and their family.

[0910] Input: Analysis results of movement data.

[0911] Operation: The server creates feedback and notifies the pet robot that "Today's exercise was very good."

[0912] Output: Exercise evaluation feedback communicated to the user and family.

[0913] (Application example 1)

[0914] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0915] Although elderly people need support in both health management and security, no technology to date has been able to comprehensively meet these needs. In particular, there is a need for a system that can consistently monitor health information, detect anomalies, and detect security risks in the elderly's daily lives.

[0916] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0917] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, means for instructing a response when an abnormality is detected, means for notifying information about the user, means for monitoring the user's living environment, means for detecting security risks, and means for notifying a warning about detected risks, thereby enabling integrated support for health management and security for the elderly.

[0918] "User's health information" is data related to the user's health condition, such as heart rate, number of steps, body temperature, amount of exercise, and medical history.

[0919] "Means for collection" refers to a device or method for acquiring a user's health information using a sensor, camera, or microphone.

[0920] The "analyzing means" is a system that includes algorithms and programs for processing collected health information and determining its condition or abnormality.

[0921] "Means for detecting abnormalities" refers to a device or method for comparing the analysis results with reference values ​​and determining whether there is an abnormality in the health condition.

[0922] The "means for instructing a response" is a device or method for generating instructions to prompt the user and related parties to take an appropriate response when an abnormality is detected.

[0923] The "notification means" is a device or method for transmitting information about abnormalities or health conditions to the user or related parties.

[0924] "Means for monitoring living environments" are devices such as sensors, cameras, and microphones that continuously monitor the behavior and environment of elderly people in their daily lives.

[0925] "Means for detecting security risks" refers to a system that includes sensors and analytical technologies to detect intruders and unusual events in the elderly's living environment.

[0926] A "means for issuing a warning" is a device or method for issuing a warning to a user or other relevant party about a detected security risk.

[0927] This invention is a system that provides support for elderly people in terms of both health management and security. Specifically, it collects and analyzes data on the user's health and living environment, and if an abnormality is detected, it instructs the user to take action and notifies the user of the necessary information.

[0928] System configuration

[0929] The system consists of the following main components:

[0930] 1. Users: Elderly people who use the system to receive health management and security support.

[0931] 2. Terminal: It is configured as a pet robot and is equipped with hardware such as sensors, cameras, microphones, speakers, and AI processors.

[0932] 3. Server: A cloud-based data center that collects, stores, analyzes, and notifies users of their health and security information.

[0933] Initial Setup

[0934] The user will use their smartphone to perform the initial setup of the system, entering the following information to register the pet robot and the server.

[0935] Basic health information such as name, age, height, weight, and medical history

[0936] Family and emergency contacts

[0937] The server stores this information in a database and maintains records for each user.

[0938] Daily Life Monitoring

[0939] The Pet Robot terminal monitors the user's daily life in the following ways:

[0940] Physical activity: Sensors detect steps, walking speed, posture, etc.

[0941] Conversation content: Record what the user says through the microphone and convert it into text data.

[0942] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[0943] Environmental monitoring: Detects abnormalities in living spaces and entry / exit.

[0944] Health and security assessment

[0945] The server analyzes the data sent from the pet robot in real time.

[0946] Health abnormality detection: Compares with normal behavioral patterns to check for abnormalities. For example, it detects slower walking speed, the possibility of falls, and cognitive decline seen in conversations.

[0947] Comprehensive health assessment: Continuously assess the user's health status from collected data, detecting heart rate fluctuations, lack of physical activity, etc.

[0948] Security anomaly detection: Detect suspicious behavior and intruders in users' living spaces.

[0949] Alerts and Notifications

[0950] If an abnormality is detected, the server will respond by the following means.

[0951] Real-time notifications: If a serious abnormality (such as a fall or a break-in) is detected, emergency contacts will be notified in real time.

[0952] Regular reports: Minor abnormalities (such as changes in walking pattern) are compiled into regular reports and sent to family members or care facilities.

[0953] Local notifications: The robotic pet will notify the user via voice, such as "We recommend that you see a doctor."

[0954] Regular health checks and exercise promotion

[0955] PetRobo also includes features for regular health checks and encouraging exercise.

[0956] Regular health checks: The robot will give voice notifications and ask questions and conduct reaction tests based on the user's health checklist. The results are sent to the server for analysis.

[0957] Exercise promotion: The robotic pet will suggest appropriate exercise to the user, saying things like, "Good morning, let's go for a walk together!" Data collected during exercise is also sent to a server for analysis.

[0958] Data management and advice

[0959] The server centrally manages all data, backs it up in a timely manner, and provides specific health and security advice to users and their associates based on the analysis results.

[0960] Specific examples

[0961] Example of combining cognitive abnormalities and security alerts

[0962] Monitoring: The robotic pet monitors the user's daily activities using cameras and sensors to detect suspicious activity (such as home invasions).

[0963] Evaluation and notification: Based on the analysis results, an abnormal behavior detection report is generated, and the pet robot notifies the elderly person that an intruder has been detected, and also sends an alert to emergency contacts.

[0964] Example prompts for generative AI models

[0965] This system monitors the living environment of the elderly and detects abnormal daily behavior and security risks in real time. Data analyzed by the AI ​​model is immediately notified in the event of an emergency and is output as regular reports during normal times. As a specific example of how the system works, it detects a suspicious intrusion in the middle of the night and notifies the elderly and their emergency contacts.

[0966] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0967] Step 1:

[0968] The user performs the initial setup using a smartphone. The data entered here is basic information such as name, age, height, weight, medical history, family and emergency contact information, etc. This data is sent to the server, which then stores it in a database.

[0969] Step 2:

[0970] The pet robot terminal monitors the user's daily life. Specifically, sensors detect the number of steps, walking speed, and posture, and a camera captures facial expressions. In addition, conversations are recorded via a microphone and converted into text data. This data is sent from the terminal to a server. The input is the user's daily activity data, and the output is data sent to the server.

[0971] Step 3:

[0972] The server analyzes the received data. An AI model (such as TensorFlow) is used here. Specifically, the server compares it with normal behavioral patterns and detects abnormalities in walking speed, heart rate, conversation content, etc. The input is the data sent from the device, and the output is the analysis results.

[0973] Step 4:

[0974] The server detects anomalies based on the analysis results. If an anomaly is detected, the server determines how to respond depending on the type of anomaly. The input is the analysis results, and the output is the anomaly detection status and its type.

[0975] Step 5:

[0976] If an abnormality is detected, the server instructs the appropriate response. Specifically, in the case of a serious abnormality (such as a fall or a break-in), emergency contacts (family members or medical personnel) are notified in real time. In addition, minor abnormalities (such as a change in walking pattern) are compiled into a regular report and sent. The input is the abnormality detection status and type, and the output is notification data.

[0977] Step 6:

[0978] In the event of an emergency, the server will send a notification. Notifications to emergency contacts are sent via SMS or app notifications. At the same time, the pet robot device will also send a local notification to the user via voice, such as "We recommend that you see a doctor." The input is the notification data, and the output is the actual notification content.

[0979] Step 7:

[0980] The robotic pet is set to perform regular health checks. The server sends a checklist to the robotic pet, which then notifies the user in advance by voice and asks questions and conducts reaction tests based on the checklist. The results are sent back to the server, which analyzes them. The input is the checklist instructions from the server, and the output is the check results.

[0981] Step 8:

[0982] The server centrally manages data and backs it up in a timely manner. Furthermore, based on the analysis results, the system provides specific advice on health maintenance and security measures to users and their associates. The input is all of the user's data and the analysis results, and the output is advice content.

[0983] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0984] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI, and also combines it with an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described below.

[0985] System configuration

[0986] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[0987] 1. Users: Elderly people who use the system to receive health management and care.

[0988] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, AI processors, and emotion engines.

[0989] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[0990] Initial Setup

[0991] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[0992] Daily Life Monitoring

[0993] PetRobo monitors the user's daily life and collects the following data:

[0994] Physical activity: Sensors detect steps, walking speed, posture, etc.

[0995] Conversation content: What the user says is recorded through the microphone and converted into text data.

[0996] Facial Expressions and Emotions: The camera captures the user's facial expressions and the emotion engine recognizes their emotions, allowing the robot to respond according to the user's emotional state.

[0997] Health assessment

[0998] The server analyzes the data sent from the pet robot in real time, for example, by performing the following processes:

[0999] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, possible falls, or cognitive decline in conversation.

[1000] Health Assessment: Based on regularly collected data, the device comprehensively assesses the user's health status, such as detecting heart rate fluctuations and lack of physical activity.

[1001] Emotion assessment: Analyzes user emotions recognized by the emotion engine to detect early signs of stress or anxiety.

[1002] Alerts and Notifications

[1003] If an abnormality is detected, the server will respond by the following means.

[1004] Instant Notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[1005] Regular notifications: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members and care facilities.

[1006] Local notifications: The pet robot will notify the user by voice, such as "We recommend that you see a doctor."

[1007] Regular health checks

[1008] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[1009] Promotion of exercise

[1010] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[1011] Emotional engine response

[1012] By utilizing the emotion engine, the following responses are taken based on the user's emotional state.

[1013] Stress relief suggestions: If the user is feeling stressed or anxious, the robotic pet will suggest relaxation activities (e.g., deep breathing or short breaks).

[1014] Positive feedback: When the user is in a good emotional state, the robotic pet will provide positive feedback, further reinforcing that emotion.

[1015] Emotion-based communication: Based on the emotions recognized by the emotion engine, the pet robot communicates with the user in an appropriate tone and content.

[1016] Data management and advice

[1017] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[1018] Specific examples

[1019] Example 1: Early detection of dementia

[1020] (monitoring):

[1021] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[1022] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[1023] (Evaluation and Notification):

[1024] Server: If cognitive decline is suspected, a detailed report will be prepared.

[1025] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[1026] Server: Notify family members and medical personnel and encourage appropriate action.

[1027] Example 2: Exercise promotion

[1028] (Exercise prompt):

[1029] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[1030] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[1031] (Data storage and analysis):

[1032] Terminal: The pet robot records the number of steps and walking speed.

[1033] Server: Stores the collected data and evaluates the user's exercise volume.

[1034] (Advice provided):

[1035] Server: Analyzes exercise results and provides feedback to the user and their family.

[1036] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[1037] Example 3: Recognizing and responding to emotions

[1038] (Emotion Monitoring):

[1039] Terminal: The pet robot uses a camera and an emotion engine to analyze the user's facial expressions and recognize their emotions.

[1040] Server: Collects emotional data and stores daily emotional patterns in a database.

[1041] (Stress detection and suggestions):

[1042] Server: Notifies the pet robot if it detects signs of stress or anxiety from the user's emotional patterns.

[1043] Terminal: The pet robot suggests relaxation to the user by saying, "Try taking a deep breath."

[1044] In this way, by combining emotion engines, care and health management that responds to the user's emotional state becomes possible, realizing higher quality lifestyle support.

[1045] The processing flow will be explained below.

[1046] Specific processing steps of a health management system that combines an emotion engine

[1047] Initial Setup

[1048] Step 1: Register user information

[1049] User: Uses a smartphone or PC to enter basic health information such as name, age, height, weight, and medical history.

[1050] Step 2: Save the information to the server

[1051] Server: Stores the information entered by the user in a database and generates a unique user ID for each user.

[1052] Step 3: Initial setup of your pet robot

[1053] Terminal: The pet robot connects to the server, obtains user information, and prepares for operation. It also calibrates sensors and cameras.

[1054] Daily Life Monitoring

[1055] Step 4: Start collecting data

[1056] Terminal: The pet robot begins collecting data on the user's daily activities (walking, talking, facial expressions, etc.) using sensors and cameras. The emotion engine analyzes the user's facial expressions and recognizes their emotions.

[1057] Step 5: Send monitoring data

[1058] Terminal: Sends collected data to the server at regular intervals (e.g., every 30 minutes).

[1059] Step 6: Analyze the data

[1060] Server: Analyzes the received data in real time, applies anomaly detection and emotion recognition algorithms, and flags any anomalies or changes in emotion.

[1061] Health assessment

[1062] Step 7: Anomaly detection

[1063] Server: Based on the analysis results, it detects slowing of walking speed, falls, and abnormalities in speech (signs of cognitive decline). The emotion engine detects stress and anxiety.

[1064] Step 8: Evaluate and record any abnormalities

[1065] Server: Evaluates detected anomalies and emotional changes, generates a report on the user's health status, and stores it in a database.

[1066] Alerts and Notifications

[1067] Step 9: Generate an alert

[1068] Server: If a significant abnormality is detected, it generates an alert and sends a notification to the user's family and medical personnel.

[1069] Step 10: Sending notifications

[1070] Server: Sends the alert information using the notification medium used (SMS, app notification, email, etc.).

[1071] Step 11: Notify users

[1072] Terminal: The pet robot notifies the user by voice, "An abnormality has been detected. We recommend that you see a doctor."

[1073] Regular health checks

[1074] Step 12: Start the health check

[1075] Terminal: The pet robot notifies the user by voice, "Regular health check will begin."

[1076] Step 13: Run the checklist

[1077] Terminal: The pet robot will ask questions and carry out reaction tests based on a checklist.

[1078] Step 14: Collecting check results

[1079] Terminal: Records the results of the check and sends them to the server.

[1080] Step 15: Analyze and save the results

[1081] Server: Analyzes the check results and stores the user's health status in a database.

[1082] Promotion of exercise

[1083] Step 16: Exercise Suggestion

[1084] Terminal: The pet robot suggests exercise to the user by saying, "Let's go for a walk together."

[1085] Step 17: User Activity

[1086] User: Take walks or do light exercise together according to suggestions from the pet robot.

[1087] Step 18: Collect exercise data

[1088] Terminal: The pet robot collects walking data and heart rate during exercise and sends it to the server.

[1089] Step 19: Analyze the movement data

[1090] Server: Analyzes the collected exercise data and evaluates the user's exercise volume.

[1091] Emotional engine response

[1092] Step 20: Sentiment Analysis

[1093] Terminal: The pet robot uses a camera and emotion engine to analyze the user's facial expressions and recognize their emotions.

[1094] Step 21: Sending Emotion Data

[1095] Terminal: Sends emotional data to the server and stores daily emotional patterns in a database.

[1096] Step 22: Stress detection and countermeasures

[1097] Server: Notifies the pet robot if it detects signs of stress or anxiety from emotional patterns.

[1098] Terminal: The pet robot suggests relaxation to the user by saying, "Try taking a deep breath."

[1099] Step 23: Positive Feedback

[1100] Device: If the user is in a good emotional state, the robotic pet will provide positive feedback such as "You look great today!"

[1101] Step 24: Communicate Emotionally

[1102] Terminal: Based on the emotions recognized by the emotion engine, the pet robot communicates with the user in an appropriate tone and content.

[1103] Data management and advice

[1104] Step 25: Centralize your data

[1105] Server: All data is managed centrally and backed up regularly.

[1106] Step 26: Generating Advice

[1107] Server: Based on the results of data analysis, it generates specific advice for the user on maintaining their health.

[1108] Step 27: Providing advice

[1109] Device: The pet robot provides the user with specific advice via voice, such as "It is recommended to walk your pet three times a week."

[1110] Step 28: Create and submit a report

[1111] Server: Generates monthly and weekly reports and sends them to the user's family and care facility personnel.

[1112] In this way, by combining emotion engines, care and health management that responds to the user's emotional state becomes possible, realizing higher quality lifestyle support.

[1113] Example 2

[1114] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1115] Health management and care systems for the elderly require comprehensive support that includes not only physical health but also mental health. In particular, it is important to detect cognitive decline and emotional changes such as stress and anxiety early and provide appropriate responses. However, current systems lack these functions, making it difficult to provide highly accurate monitoring and appropriate feedback.

[1116] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1117] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, means for instructing a response when an abnormality is detected, means for notifying information about the user, means for recognizing the user's emotions, and means for suggesting a response based on the recognized emotions. This makes it possible to closely monitor not only the user's physical health condition but also their mental health condition, and to respond immediately when an abnormality is detected.

[1118] A "user" is a person who receives health management and care using this system.

[1119] "Health Information" refers to basic health data such as a user's name, age, height, weight, and medical history, as well as physiological and behavioral data obtained from daily life.

[1120] The term "means" refers to a device or method used to achieve a specific purpose, and in the present invention includes a module for realizing a specific function.

[1121] "Server" refers to a cloud-based data center, a computer system responsible for collecting, storing, and analyzing users' health information.

[1122] The "terminal" refers to the pet robot itself, which is hardware equipped with sensors, a camera, a microphone, a speaker, an AI processor, an emotion engine, etc.

[1123] An "emotion engine" refers to an algorithm and software system that recognizes emotions by analyzing a user's facial expressions, voice, etc.

[1124] "Abnormal" refers to a state that deviates from normal behavioral patterns or a situation that is deemed to be a health problem.

[1125] "Notification" refers to the act of the system communicating information to the user, family, or medical professionals, and includes methods such as SMS, app notification, and voice message.

[1126] "Exercise promotion" refers to the process of suggesting appropriate exercise to users and encouraging them to do so.

[1127] A "health check" refers to the act of periodically conducting tests and asking questions to assess a user's health.

[1128] "Real-time analytics" refers to the process of analyzing data immediately as it is generated.

[1129] A "machine learning algorithm" refers to a computational model that recognizes patterns based on large amounts of data and makes predictions and classifications.

[1130] "Backup" refers to the process of regularly saving copies of data in case of data loss.

[1131] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI, and also combines it with an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described below.

[1132] System Configuration Overview

[1133] This system mainly consists of the following three components:

[1134] 1. Users: Elderly people who use the system to receive health management and care.

[1135] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, AI processors, and emotion engines.

[1136] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[1137] Initial Setup

[1138] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[1139] Daily Life Monitoring

[1140] The device (Pet Robot) monitors the user's daily life and collects the following data:

[1141] Physical activity: Sensors detect steps, walking speed, and posture, specifically using the built-in accelerometer and gyroscope.

[1142] Conversation: The conversation is recorded through a microphone and converted into text data. Specifically, speech recognition software is used to convert speech into text.

[1143] Facial expressions and emotions: The camera analyzes facial expressions and the emotion engine recognizes emotions. Specifically, the image processing algorithm is used to analyze facial expressions and the emotion engine digitizes emotions.

[1144] Health assessment

[1145] The server analyzes the data sent from the pet robot in real time.

[1146] Anomaly detection: Compares a user's behavioral patterns with past data to detect anomalies, such as a slowdown in walking speed, the possibility of a fall, or a decline in cognitive function in conversations.

[1147] Health Assessment: A comprehensive assessment of the user's health status is performed based on heart rate and exercise volume. In particular, a health index is calculated by taking a weighted average of each data point.

[1148] Emotion assessment: The emotion engine analyzes the recognized emotional data and assesses the level of stress and anxiety.

[1149] Alerts and Notifications

[1150] If an abnormality is detected, the server will respond appropriately.

[1151] Immediate Notification: If a critical abnormality is detected, an SMS or app notification will be sent to family members or medical personnel. For example, if a fall is detected.

[1152] Regular notifications: If minor abnormalities are detected, they can be compiled into regular reports and sent to family members or care facilities. For example, changes in walking patterns.

[1153] Local notifications: The robotic pet will notify the user directly, for example, saying "We recommend you see a doctor."

[1154] Regular health checks

[1155] The device periodically performs health checks, notifying the user in advance via voice, and conducting checklist-based questions and reaction tests. The results are sent to a server for further analysis.

[1156] Promotion of exercise

[1157] The device will suggest moderate exercise to the user, for example, "Good morning, let's go for a walk together!" The Pet Robot records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[1158] Emotional engine response

[1159] The device utilizes an emotion engine to take the following actions:

[1160] Stress relief suggestions: If the user is feeling stressed or anxious, suggest relaxation activities (e.g., deep breathing or short breaks).

[1161] Positive feedback: If the user is in a good emotional state, provide positive feedback.

[1162] Emotion-based communication: Based on the emotions recognized by the emotion engine, the pet robot will communicate with the appropriate tone and content.

[1163] Data management and advice

[1164] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families. For example, the advice could be, "It is recommended to take a walk three times a week."

[1165] Specific examples

[1166] Early detection of dementia

[1167] 1. Monitoring:

[1168] Device: The robotic pet observes the user's daily life and records their recent conversation patterns. Speech recognition software analyzes the conversation and sends it to the server.

[1169] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[1170] 2. Evaluation and Notification:

[1171] Server: If cognitive decline is suspected, it creates a detailed report. It detects abnormal patterns, generates and sends the report.

[1172] Terminal: The robotic pet notifies the user, "We recommend that you see a doctor." Specifically, it uses voice synthesis to convey the message.

[1173] Server: Notify family members and medical personnel and encourage appropriate action.

[1174] Promotion of exercise

[1175] 1. Exercise prompts:

[1176] Device: In the morning, the robot pet will suggest to the user, "Let's go for a walk together." It will play a voice message to signal when it's time to exercise.

[1177] User: Accept the suggestion and do some light exercise or a walk with the pet robot. Put on the pedometer and start walking.

[1178] 2. Data Storage and Analysis:

[1179] Device: The robot records the number of steps and walking speed. Data is collected using a walking sensor.

[1180] Server: Stores the collected data and evaluates the user's exercise volume. Data analysis tools evaluate the exercise volume and generate reports.

[1181] 3. Providing advice:

[1182] Server: Analyzes exercise results and provides feedback to the user and their family. Based on the analysis results, generates and sends specific exercise advice.

[1183] Terminal: The robot pet gives feedback to the user, saying, "Your exercise today was great." Specifically, it uses voice synthesis to convey a positive message.

[1184] Recognizing and Responding to Emotions

[1185] 1. Emotional monitoring:

[1186] Terminal: The robotic pet uses a camera and an emotion engine to analyze the user's facial expressions and recognize their emotions. It uses an image processing algorithm to capture the facial expressions and generate analytical data.

[1187] Server: Collects emotional data and stores daily emotional patterns in a database. Records the emotional data in cloud storage.

[1188] 2. Stress detection and suggestions:

[1189] Server: Notifies the Pet Robot if it detects signs of stress or anxiety from the user's emotional patterns. Detects abnormal patterns and sends instructions to the Pet Robot.

[1190] Terminal: The pet robot suggests relaxation to the user by saying, "Try taking a deep breath." The relaxation suggestion is made using voice synthesis.

[1191] In this way, the entire system functions in coordination to provide comprehensive health support for the elderly.

[1192] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1193] Step 1: Initial Setup

[1194] The user performs the initial setup of the system using a smartphone or PC. Specifically, the user opens a dedicated app and enters basic information such as name, age, height, weight, and medical history. Input: Basic health information. Output: Registered user information. The server saves the entered information in a database and manages records for each user. Specifically, the server registers the information in the database and generates a user ID.

[1195] Step 2: Monitoring your daily life

[1196] The terminal (pet robot) monitors the user's daily life. Input: User's behavior and environmental data. Output: Collected data. The specific operations are as follows.

[1197] Physical activity monitoring: Sensors detect steps, walking speed, and posture using the built-in accelerometer and gyroscope.

[1198] Conversation monitoring: Recording conversations through a microphone and converting them into text data. Using speech recognition software to convert speech to text.

[1199] Facial Expression and Emotion Monitoring: Using a camera to analyze facial expressions and an emotion engine to recognize emotions, image processing algorithms are used to analyze facial expressions and digitize emotions.

[1200] Step 3: Send data

[1201] The device sends the collected data to the server. Input: Monitored data. Output: Data sent to the server. Specifically, the data is uploaded to the cloud server using an internet connection.

[1202] Step 4: Health Assessment

[1203] The server analyzes the transmitted data in real time. Input: Transmitted data. Output: Evaluation results. The specific operation is as follows.

[1204] Anomaly detection: Compares data with past data in the database to see if there are any anomalies. Machine learning algorithms are used to detect outliers.

[1205] Health Assessment: A comprehensive assessment of the user's health status is performed based on heart rate, exercise volume, etc. A weighted average of each data point is used to calculate a health index.

[1206] Emotion Assessment: The emotion engine analyzes the recognized emotion data to assess the level of stress and anxiety. Emotion data is analyzed to detect signs of stress and anxiety.

[1207] Step 5: Alerts and Notifications

[1208] If an abnormality is detected, the server will take appropriate action. Input: Data in which an abnormality was detected. Output: Notification message. The specific operations are as follows:

[1209] Immediate notification: If a critical abnormality is detected, family members or medical personnel will be notified via SMS or app notifications. SMS gateways and push notification services will be used to contact them.

[1210] Regular notification: If a minor abnormality is detected, it will be compiled into a regular report and sent to the family or care facility. Data will be collected periodically and reports will be generated.

[1211] Local notification: The robotic pet notifies the user directly, using text-to-speech to say, "We recommend you see a doctor."

[1212] Step 6: Regular Health Checks

[1213] The device periodically performs health checks. Input: Checklist. Output: Check results. Specific operations include notifying the user in advance by voice, and asking questions and conducting reaction tests based on the checklist. The results are sent to the server for further analysis.

[1214] Step 7: Exercise promotion

[1215] The device will suggest moderate exercise to the user. Input: Suggested time and content. Output: User's exercise data. The specific operation is as follows.

[1216] Exercise suggestion: Uses voice synthesis technology to suggest, "Good morning, let's go for a walk together!"

[1217] User response: The user accepts the suggestion and starts exercising. The robotic pet uses a pedometer to measure the data.

[1218] Data recording: Records exercise data (number of steps, exercise time, heart rate) and sends it to the server. The collected data is saved and the user's exercise volume is evaluated.

[1219] Step 8: Respond with the Emotion Engine

[1220] The device utilizes an emotion engine to respond based on the user's emotional state. Input: Emotion data. Output: Countermeasures. Specific operations are as follows:

[1221] Emotion Recognition: Facial expressions are captured and analyzed with a camera, and image processing algorithms are used to generate emotion data.

[1222] Stress response: If the user is feeling stressed or anxious, the app suggests relaxation activities, using voice synthesis to suggest things like, "Try taking a deep breath."

[1223] Positive feedback: If the user is in a good emotional state, provide positive feedback. The voice will say, "Your workout today was great."

[1224] Step 9: Data management and advice

[1225] The server centrally manages and backs up all data. Input: All collected data. Output: Advice report. Specific operations are as follows:

[1226] Data storage: Store data in cloud storage and back it up regularly.

[1227] Advice based on analysis results: Based on the data analysis results, specific health maintenance advice is generated and sent to the user or family. For example, advice such as "It is recommended to take a walk three times a week" is provided.

[1228] (Application example 2)

[1229] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1230] With the increasing number of elderly people in modern society, health management and safety assurance in daily life are becoming increasingly important. However, existing systems lack detailed monitoring of elderly people's behavior and emotional state, making it difficult to detect abnormalities early and respond appropriately. Furthermore, in many cases, prompt and appropriate notifications are not provided to elderly people or their families, resulting in safety issues. Therefore, an effective method for simultaneously managing the health and safety of elderly people is needed.

[1231] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, and means for monitoring the user's behavior with a sensor. This enables detailed monitoring of changes in the user's behavior and emotions and enables prompt and appropriate responses. Furthermore, by analyzing the collected data on a cloud server, abnormal behavior and changes in emotions can be immediately detected and promptly notified to the elderly person, their family, and even a security company, thereby ensuring safety.

[1232] "User's health information" refers to all data related to the user's physical condition and health, and specifically includes heart rate, blood pressure, number of steps, weight, etc.

[1233] "Means of collection" refers to devices and technologies that acquire data using sensors, cameras, audio microphones, etc.

[1234] "Means of analysis" refers to the algorithms and software used to analyze collected data and assess a user's health status and behavioral patterns.

[1235] "Means for detecting anomalies" refers to hardware and software that identify data that deviates from normal patterns and recognize abnormal situations.

[1236] "Means for instructing how to respond" refers to a method or device for providing appropriate advice or instructions to the user when an abnormality is detected.

[1237] "Means of notification" refers to the method or system for communicating detected information to the user, their family, security companies, and other relevant parties.

[1238] "Means for monitoring user behavior using sensors" refers to sensors and related technologies for monitoring user movements and behavior in real time.

[1239] "Means for recognizing a user's emotional state using a camera" refers to technology that analyzes images taken with a camera and infers emotions from the user's facial expressions and movements.

[1240] "Means for transmitting to a cloud server for analysis" refers to the technology for transmitting collected data via the Internet to a remote server where it can be analyzed in detail.

[1241] "Means for providing advice" refers to a method or device for providing health care or security instructions or suggestions to a user based on the results of the analysis.

[1242] This invention relates to a system that collects, analyzes, detects abnormalities, and provides instructions and notifications regarding user health information. In particular, it comprehensively manages the user's health and safety by monitoring the user's behavior with sensors and recognizing their emotional state with a camera.

[1243] System configuration

[1244] This system consists of the following main components:

[1245] 1. Pet Robot (terminal): Equipped with sensors, cameras, microphones, speakers, AI processors, and emotion engines, it monitors the user's daily life.

[1246] 2. Cloud server: Responsible for storing and analyzing collected data and notifying the results.

[1247] 3. Smartphone application: Serves as an interface for notifying users, their families, and security companies.

[1248] Data collection

[1249] The robot uses sensors and cameras to collect health information about the user, including the number of steps, walking speed, posture, heart rate, and facial expression data, in real time. It also records the user's conversations through a microphone and converts them into text data.

[1250] Data analysis

[1251] The collected data undergoes initial processing by the robot's AI processor and is then sent in real time to a cloud server, where it undergoes further analysis using machine learning models and an emotion engine. This allows the robot to evaluate the user's behavioral patterns and emotional state and detect any anomalies.

[1252] Anomaly detection and notification

[1253] If an abnormality is detected, a notification is sent from the cloud server to the smartphone application. If a serious abnormality is detected (e.g., a fall), an immediate notification is sent, and alerts are also sent to security companies and family members. If the abnormality is minor, a regular report is sent.

[1254] Responding to users

[1255] If an abnormality is detected, the robot will give the user voice advice and instructions, such as suggesting relaxation activities like "Try taking deep breaths."

[1256] Data management and advice

[1257] The cloud server centrally manages all data and regularly backs it up. Based on the analysis results, the system provides specific health maintenance advice to users and their families. For example, the system might say, "It is recommended that you take a walk three times a week."

[1258] Examples and prompts

[1259] Specific examples

[1260] A pet robot detects that an elderly person gets up and wanders around multiple times at night, and a smart guard robot immediately notifies the family and the security company.

[1261] Prompt Sentence Examples

[1262] Behavioral recognition:

[1263] The system monitors user behavior and sends a notification if an abnormality occurs. If the user moves significantly during sleep hours, which is considered normal behavior, it is treated as an abnormality.

[1264] Sentiment analysis:

[1265] The system analyzes facial images captured by the camera to determine the user's emotional state. If negative emotions such as stress or anxiety are detected, it sends a notification and suggests relaxation activities to the user.

[1266] This will enable comprehensive management of the user's health and safety, and enable prompt and appropriate response. The implementation of the invention includes hardware and software such as sensors, cameras, AI processors, cloud servers, and smartphone applications.

[1267] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1268] Step 1:

[1269] The PetRobo (terminal) uses sensors and a camera to collect the user's health and behavioral data. The sensors measure the number of steps taken, heart rate, and walking speed, and the camera captures facial expressions. This data is input into the PetRobo's AI processor.

[1270] Step 2:

[1271] The PetRobo's AI processor performs an initial analysis of the collected data. For example, it detects abnormalities in the number of steps and heart rate, and estimates the emotional state from facial expression data. This process allows for early detection of anomalies. The analyzed data is then sent to a cloud server for the next step.

[1272] Step 3:

[1273] The cloud server receives the data sent from the robotic pet and performs a detailed analysis. The server uses a generative AI model to further analyze walking patterns and emotional data. For example, the cloud server detects abnormal walking patterns during specific times of the day and uses an emotion engine to analyze signs of stress or anxiety. The results of this analysis are used in the next step.

[1274] Step 4:

[1275] The cloud server determines whether an abnormality has been detected based on the detailed analysis results. If an abnormality is detected, the cloud server sends a notification to the smartphone application. For example, if a serious abnormality (such as a fall) is detected, an immediate notification will be sent, and if a minor abnormality (such as a change in walking pattern) is detected, a periodic report will be sent.

[1276] Step 5:

[1277] The smartphone application receives notifications from the cloud server and displays alerts to the user, their family, and the security company, allowing the user to check the notifications and take necessary action.

[1278] Step 6:

[1279] The pet robot will give voice advice to the user. For example, if abnormal behavior is detected, it will give advice such as "Try taking deep breaths" or "We recommend that you see a doctor." This voice advice is generated based on the analysis results of the cloud server.

[1280] Step 7:

[1281] The cloud server stores all data and backs it up regularly. Furthermore, the cloud server uses the data history to provide specific health advice to users and their families. For example, it generates instructions such as "It is recommended to take a walk three times a week," and notifies users via a smartphone application.

[1282] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1283] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1284] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1285] [Third embodiment]

[1286] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1287] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1288] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1289] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1290] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1291] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1292] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1293] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1294] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1295] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1296] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1297] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1298] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI. Specific embodiments of the system are described below.

[1299] System configuration

[1300] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[1301] 1. Users: Elderly people who use the system to receive health management and care.

[1302] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, and AI processors.

[1303] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[1304] Initial Setup

[1305] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[1306] Daily Life Monitoring

[1307] PetRobo monitors the user's daily life and collects the following data:

[1308] Physical activity: Sensors detect steps, walking speed, posture, etc.

[1309] Conversation content: What the user says is recorded through the microphone and converted into text data.

[1310] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[1311] Health assessment

[1312] The server analyzes the data sent from the pet robot in real time, for example, by performing the following processes:

[1313] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, possible falls, or cognitive decline in conversation.

[1314] Health Assessment: Based on regularly collected data, the device comprehensively assesses the user's health status, such as detecting heart rate fluctuations and lack of physical activity.

[1315] Alerts and Notifications

[1316] If an abnormality is detected, the server will respond by the following means.

[1317] Instant Notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[1318] Regular notifications: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members and care facilities.

[1319] Local notifications: The pet robot will notify the user by voice, such as "We recommend that you see a doctor."

[1320] Regular health checks

[1321] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[1322] Promotion of exercise

[1323] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[1324] Data management and advice

[1325] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[1326] Specific examples

[1327] Example 1: Early detection of dementia

[1328] (monitoring):

[1329] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[1330] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[1331] (Evaluation and Notification):

[1332] Server: If cognitive decline is suspected, a detailed report will be prepared.

[1333] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[1334] Server: Notify family members and medical personnel and encourage appropriate action.

[1335] Example 2: Exercise promotion

[1336] (Exercise prompt):

[1337] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[1338] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[1339] (Data storage and analysis):

[1340] Terminal: The pet robot records the number of steps and walking speed.

[1341] Server: Stores the collected data and evaluates the user's exercise volume.

[1342] (Advice provided):

[1343] Server: Analyzes exercise results and provides feedback to the user and their family.

[1344] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[1345] The above is an embodiment of the present invention. It is expected that this system will enable efficient and effective health management and care for the elderly.

[1346] The processing flow will be explained below.

[1347] Specific steps for daily life monitoring and health management program

[1348] Overall system flow

[1349] Initial Setup

[1350] Step 1: Register user information

[1351] User: Uses a smartphone or PC to enter basic health information such as name, age, height, weight, and medical history.

[1352] Step 2: Save the information to the server

[1353] Server: Stores the information entered by the user in a database and generates a unique user ID for each user.

[1354] Step 3: Initial setup of your pet robot

[1355] Terminal: The pet robot connects to the server, obtains user information, and prepares for operation. It also calibrates sensors and cameras.

[1356] Daily Life Monitoring

[1357] Step 4: Start collecting data

[1358] Terminal: The pet robot begins collecting data on the user's daily activities (walking, talking, facial expressions, etc.) using sensors.

[1359] Step 5: Send monitoring data

[1360] Terminal: Sends collected data to the server at regular intervals (e.g., every 30 minutes).

[1361] Step 6: Analyze the data

[1362] Server: Analyzes the received data in real time, applies anomaly detection algorithms, and flags any anomalies detected.

[1363] Health assessment

[1364] Step 7: Anomaly detection

[1365] Server: Based on the analysis results, detects slowing walking speed, falls, and abnormalities in speech (signs of cognitive decline).

[1366] Step 8: Evaluate and record any abnormalities

[1367] Server: Evaluates the detected anomalies and generates a report on the user's health status, which is stored in a database.

[1368] Alerts and Notifications

[1369] Step 9: Generate an alert

[1370] Server: If a significant abnormality is detected, it generates an alert and sends a notification to the user's family and medical personnel.

[1371] Step 10: Sending notifications

[1372] Server: Sends the alert information using the notification medium used (SMS, app notification, email, etc.).

[1373] Step 11: Notify users

[1374] Terminal: The pet robot notifies the user by voice, "An abnormality has been detected. We recommend that you see a doctor."

[1375] Regular health checks

[1376] Step 12: Start the health check

[1377] Terminal: The pet robot notifies the user by voice, "Regular health check will begin."

[1378] Step 13: Run the checklist

[1379] Terminal: The pet robot will ask questions and carry out reaction tests based on a checklist.

[1380] Step 14: Collecting check results

[1381] Terminal: Records the results of the check and sends them to the server.

[1382] Step 15: Analyze and save the results

[1383] Server: Analyzes the check results and stores the user's health status in a database.

[1384] Promotion of exercise

[1385] Step 16: Exercise Suggestion

[1386] Terminal: The pet robot suggests exercise to the user by saying, "Let's go for a walk together."

[1387] Step 17: User Activity

[1388] User: Take walks or do light exercise together according to suggestions from the pet robot.

[1389] Step 18: Collect exercise data

[1390] Terminal: The pet robot collects walking data and heart rate during exercise and sends it to the server.

[1391] Step 19: Analyze the movement data

[1392] Server: Analyzes the collected exercise data and evaluates the user's exercise volume.

[1393] Data management and advice

[1394] Step 20: Centralize your data

[1395] Server: All data is managed centrally and backed up regularly.

[1396] Step 21: Generate Advice

[1397] Server: Based on the results of data analysis, it generates specific advice for the user on maintaining their health.

[1398] Step 22: Providing advice

[1399] Device: The pet robot provides the user with specific advice via voice, such as "It is recommended to walk your pet three times a week."

[1400] Step 23: Create and submit the report

[1401] Server: Generates monthly and weekly reports and sends them to the user's family and care facility personnel.

[1402] In this way, the system supports the elderly in their daily lives and manages their health.

[1403] Example 1

[1404] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1405] Efficient and effective health management and care for the elderly requires detailed monitoring and analysis of their daily lives. However, current systems are insufficient in collecting health information and detecting abnormalities, making it difficult to respond quickly. In addition, some systems are unable to provide specific countermeasures for cognitive decline and lack of exercise in the elderly. To solve these problems, a system is needed that can perform detailed, real-time monitoring and analysis and provide appropriate notifications and advice.

[1406] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1407] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, and means for monitoring the user's daily life. This enables detailed and real-time collection and analysis of health information. It also includes means for encouraging the user to exercise, means for notifying the user based on the monitoring results, and means for initializing the system. This enables evaluation of health status, provision of appropriate advice, regular health checks, and promotion of exercise. It also includes means for monitoring conversation content to detect cognitive decline, and means for collecting exercise data and evaluating the amount of exercise. This enables early detection of cognitive decline and provision of specific countermeasures to address lack of exercise.

[1408] "Users" refer to elderly people who use the system to receive health management and care.

[1409] "Health Information" refers to health-related data such as a user's name, age, height, weight, and medical history.

[1410] "Means of collection" refers to the function of obtaining the user's health information using a pet robot or other sensor devices.

[1411] "Means for analysis" refers to algorithms or software that use collected health information to assess a user's health status.

[1412] "Means for detecting abnormalities" refers to the function of identifying abnormal patterns that differ from normal conditions based on the results of analyzing health information.

[1413] "Means for instructing a response" refers to a function that notifies the user, family, or medical personnel of the necessary actions when an abnormality is detected.

[1414] "Means of monitoring" refers to the function of continuously observing the user's daily activities and behavior using a pet robot or other sensor devices.

[1415] "Means to encourage exercise" refers to the function in which the pet robot uses voice or other means to suggest appropriate exercise to the user and encourage them to do so.

[1416] "Means of notification" refers to the function of notifying users of health information and abnormality detection results via voice, SMS, app notifications, etc.

[1417] "Means for performing initial settings" refers to the function that allows a user to input the health information required when starting to use the system and register it with the pet robot and server.

[1418] "Means for monitoring conversation content" refers to the function of recording and analyzing the user's conversation using the pet robot's microphone.

[1419] "Means for detecting cognitive decline" refers to algorithms or software that analyze a user's daily conversations and behavioral patterns to identify cognitive decline at an early stage.

[1420] "Means for collecting data from exercise" refers to the function of obtaining data such as the number of steps taken during exercise, exercise time, and heart rate through the pet robot's sensors and sending it to a server.

[1421] "Means for assessing exercise volume" refers to algorithms or software that analyze the collected exercise data and assess the user's exercise volume.

[1422] This invention is a system for managing and caring for the elderly using a pet robot equipped with AI. This system monitors the user's daily life, and if an abnormality is detected, it instructs appropriate measures, evaluates the user's health, and provides advice. Specifically, it uses the following hardware and software components.

[1423] System configuration

[1424] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[1425] 1. Users: Elderly people who use the system to receive health management and care.

[1426] 2. Terminal (Pet Robot): Equipped with hardware such as sensors, cameras, microphones, speakers, and AI processors.

[1427] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[1428] Initial Setup

[1429] The user performs the initial setup of the system using a smartphone or PC. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[1430] Daily Life Monitoring

[1431] The robotic pet will monitor the user's daily life and collect the following data:

[1432] Physical activity: The PetRobo's sensors detect steps, walking speed, posture, etc.

[1433] Conversation content: Record what the user says through the microphone and convert the voice data into text data.

[1434] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[1435] Health assessment

[1436] The server analyzes the data sent from the pet robot in real time and performs the following processes:

[1437] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, potential falls, or if conversations indicate a decline in cognitive function.

[1438] Health assessment: Comprehensively assess the user's health status based on regularly collected data, such as detecting heart rate fluctuations and lack of physical activity.

[1439] Alerts and Notifications

[1440] If an abnormality is detected, the server will respond by the following means.

[1441] Immediate notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[1442] Regular notification: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members or care facilities.

[1443] Local notification: The robotic pet will notify the user via voice, such as "We recommend that you see a doctor."

[1444] Regular health checks

[1445] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[1446] Promotion of exercise

[1447] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[1448] Data management and advice

[1449] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[1450] Specific examples

[1451] Example 1: Early detection of dementia

[1452] monitoring:

[1453] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[1454] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[1455] Rating and Notification:

[1456] Server: If cognitive decline is suspected, a detailed report will be prepared.

[1457] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[1458] Server: Notify family members and medical personnel and encourage appropriate action.

[1459] Example 2: Exercise promotion

[1460] Exercise prompt:

[1461] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[1462] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[1463] Data storage and analysis:

[1464] Terminal: The pet robot records the number of steps and walking speed.

[1465] Server: Stores the collected data and evaluates the user's exercise volume.

[1466] Advice provided:

[1467] Server: Analyzes exercise results and provides feedback to the user and their family.

[1468] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[1469] Prompt sentence for generative AI model

[1470] "This system uses an AI-equipped pet robot to manage and care for the elderly. Please create a program that meets the following requirements: It will monitor the user's daily life and notify them if any abnormalities are detected. It will also suggest moderate exercise and collect data during exercise. The data will be analyzed on the server, and the health status will be evaluated and advice will be provided."

[1471] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1472] Step 1: Initial Setup

[1473] Users enter health information such as their name, age, height, weight, and medical history via their smartphone or PC.

[1474] Input: User health information entered via smartphone or PC.

[1475] How it works: The user enters their health information into a form displayed in the UI.

[1476] Output: The input information is sent to the pet robot's terminal and server.

[1477] Step 2: Register your health information

[1478] The terminal receives the health information input by the user to the pet robot.

[1479] Input: Health information entered and submitted by a user.

[1480] Operation: The device temporarily stores the received health information and prepares to send it to the server.

[1481] Output: Health information is sent to the server.

[1482] Step 3: Save your health information

[1483] The server stores the received health information in a database.

[1484] Input: Health information sent from the device.

[1485] How it works: The server connects to a database and stores health information for each user as a record.

[1486] Output: User's health information stored in a database.

[1487] Step 4: Start monitoring your daily life

[1488] The terminal is a pet robot that monitors the user's daily life.

[1489] Input: Data about the user's everyday movements, speech, and facial expressions.

[1490] How it works: The device collects data using sensors, cameras, microphones, etc. For example, sensors detect the number of steps taken and walking speed, microphones record conversations, and facial recognition cameras capture facial expressions.

[1491] Output: The collected data is sent to the server.

[1492] Step 5: Data analysis

[1493] The server analyzes the data sent from the pet robot in real time.

[1494] Input: Daily life data sent from the device.

[1495] How it works: The server runs data analysis algorithms to detect anomalies, for example, a slower walking speed compared to normal behavior patterns is flagged as an anomaly.

[1496] Output: A flag is set to indicate whether the analysis result is abnormal or not.

[1497] Step 6: Anomaly detection

[1498] The server detects abnormalities based on the analysis results.

[1499] Input: Results of data analysis.

[1500] Operation: If an anomaly is detected, the server flags the anomaly information for the user and proceeds to the next processing step.

[1501] Output: The results of the anomaly detection are sent to the notification system.

[1502] Step 7: Notification

[1503] If an abnormality is detected, the server will notify you as necessary.

[1504] Input: Anomaly detection results.

[1505] Operation: Depending on the type of abnormality, the server will send immediate notification (SMS or app notification) or regular notification (regular report creation). It will also instruct the pet robot to send a local notification.

[1506] Output: Notifications sent to family and medical personnel, and audio notifications from the PetRobo itself.

[1507] Step 8: Regular Health Checks

[1508] The device will have a pet robot perform regular health checks.

[1509] Input: Pre-configured checklist and health questions.

[1510] How it works: The robot will notify the user by voice when it's time to check, ask questions, and record the results.

[1511] Output: The checklist results answered by the user are sent to the server.

[1512] Step 9: Analyze the results

[1513] The server analyzes the results of the periodic health check.

[1514] Input: Checklist result data.

[1515] How it works: The server uses analytical algorithms to assess the user's health status.

[1516] Output: The analysis results are compiled into a detailed report.

[1517] Step 10: Provide feedback

[1518] The server provides detailed feedback based on the analysis results.

[1519] Input: Analysis results report.

[1520] How it works: The server creates feedback content and sends it to the user or family.

[1521] Output: Feedback sent to user and family, audio notification by PetRobo.

[1522] Step 11: Exercise Suggestion

[1523] The device uses a pet robot to suggest exercises to the user.

[1524] Input: Pre-set exercise plan, user's daily activity data.

[1525] How it works: The pet robot will suggest to the user via voice, "Let's go for a walk together."

[1526] Output: Exercise suggestion notification.

[1527] Step 12: Collecting data during exercise

[1528] The device collects data during exercise (number of steps, exercise time, heart rate, etc.).

[1529] Input: User's exercise data.

[1530] How it works: The PetRobo's sensors record data such as steps taken, exercise time, and heart rate.

[1531] Output: The collected movement data is temporarily stored in the pet robot and later sent to the server.

[1532] Step 13: Analyze your exercise data

[1533] The server analyzes the collected exercise data in real time.

[1534] Input: Exercise data sent from the device.

[1535] Operation: The server analyzes the exercise data and evaluates the user's exercise volume.

[1536] Output: The results of the momentum assessment are saved.

[1537] Step 14: Exercise results feedback

[1538] The server analyzes the exercise results and sends feedback to the user and their family.

[1539] Input: Analysis results of movement data.

[1540] Operation: The server creates feedback and notifies the pet robot that "Today's exercise was very good."

[1541] Output: Exercise evaluation feedback communicated to the user and family.

[1542] (Application example 1)

[1543] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1544] Although elderly people need support in both health management and security, no technology to date has been able to comprehensively meet these needs. In particular, there is a need for a system that can consistently monitor health information, detect anomalies, and detect security risks in the elderly's daily lives.

[1545] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1546] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, means for instructing a response when an abnormality is detected, means for notifying information about the user, means for monitoring the user's living environment, means for detecting security risks, and means for notifying a warning about detected risks, thereby enabling integrated support for health management and security for the elderly.

[1547] "User's health information" is data related to the user's health condition, such as heart rate, number of steps, body temperature, amount of exercise, and medical history.

[1548] "Means for collection" refers to a device or method for acquiring a user's health information using a sensor, camera, or microphone.

[1549] The "analyzing means" is a system that includes algorithms and programs for processing collected health information and determining its condition or abnormality.

[1550] "Means for detecting abnormalities" refers to a device or method for comparing the analysis results with reference values ​​and determining whether there is an abnormality in the health condition.

[1551] The "means for instructing a response" is a device or method for generating instructions to prompt the user and related parties to take an appropriate response when an abnormality is detected.

[1552] The "notification means" is a device or method for transmitting information about abnormalities or health conditions to the user or related parties.

[1553] "Means for monitoring living environments" are devices such as sensors, cameras, and microphones that continuously monitor the behavior and environment of elderly people in their daily lives.

[1554] "Means for detecting security risks" refers to a system that includes sensors and analytical technologies to detect intruders and unusual events in the elderly's living environment.

[1555] A "means for issuing a warning" is a device or method for issuing a warning to a user or other relevant party about a detected security risk.

[1556] This invention is a system that provides support for elderly people in terms of both health management and security. Specifically, it collects and analyzes data on the user's health and living environment, and if an abnormality is detected, it instructs the user to take action and notifies the user of the necessary information.

[1557] System configuration

[1558] The system consists of the following main components:

[1559] 1. Users: Elderly people who use the system to receive health management and security support.

[1560] 2. Terminal: It is configured as a pet robot and is equipped with hardware such as sensors, cameras, microphones, speakers, and AI processors.

[1561] 3. Server: A cloud-based data center that collects, stores, analyzes, and notifies users of their health and security information.

[1562] Initial Setup

[1563] The user will use their smartphone to perform the initial setup of the system, entering the following information to register the pet robot and the server.

[1564] Basic health information such as name, age, height, weight, and medical history

[1565] Family and emergency contacts

[1566] The server stores this information in a database and maintains records for each user.

[1567] Daily Life Monitoring

[1568] The Pet Robot terminal monitors the user's daily life in the following ways:

[1569] Physical activity: Sensors detect steps, walking speed, posture, etc.

[1570] Conversation content: Record what the user says through the microphone and convert it into text data.

[1571] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[1572] Environmental monitoring: Detects abnormalities in living spaces and entry / exit.

[1573] Health and security assessment

[1574] The server analyzes the data sent from the pet robot in real time.

[1575] Health abnormality detection: Compares with normal behavioral patterns to check for abnormalities. For example, it detects slower walking speed, the possibility of falls, and cognitive decline seen in conversations.

[1576] Comprehensive health assessment: Continuously assess the user's health status from collected data, detecting heart rate fluctuations, lack of physical activity, etc.

[1577] Security anomaly detection: Detect suspicious behavior and intruders in users' living spaces.

[1578] Alerts and Notifications

[1579] If an abnormality is detected, the server will respond by the following means.

[1580] Real-time notifications: If a serious abnormality (such as a fall or a break-in) is detected, emergency contacts will be notified in real time.

[1581] Regular reports: Minor abnormalities (such as changes in walking pattern) are compiled into regular reports and sent to family members or care facilities.

[1582] Local notifications: The robotic pet will notify the user via voice, such as "We recommend that you see a doctor."

[1583] Regular health checks and exercise promotion

[1584] PetRobo also includes features for regular health checks and encouraging exercise.

[1585] Regular health checks: The robot will give voice notifications and ask questions and conduct reaction tests based on the user's health checklist. The results are sent to the server for analysis.

[1586] Exercise promotion: The robotic pet will suggest appropriate exercise to the user, saying things like, "Good morning, let's go for a walk together!" Data collected during exercise is also sent to a server for analysis.

[1587] Data management and advice

[1588] The server centrally manages all data, backs it up in a timely manner, and provides specific health and security advice to users and their associates based on the analysis results.

[1589] Specific examples

[1590] Example of combining cognitive abnormalities and security alerts

[1591] Monitoring: The robotic pet monitors the user's daily activities using cameras and sensors to detect suspicious activity (such as home invasions).

[1592] Evaluation and notification: Based on the analysis results, an abnormal behavior detection report is generated, and the pet robot notifies the elderly person that an intruder has been detected, and also sends an alert to emergency contacts.

[1593] Example prompts for generative AI models

[1594] This system monitors the living environment of the elderly and detects abnormal daily behavior and security risks in real time. Data analyzed by the AI ​​model is immediately notified in the event of an emergency and is output as regular reports during normal times. As a specific example of how the system works, it detects a suspicious intrusion in the middle of the night and notifies the elderly and their emergency contacts.

[1595] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1596] Step 1:

[1597] The user performs the initial setup using a smartphone. The data entered here is basic information such as name, age, height, weight, medical history, family and emergency contact information, etc. This data is sent to the server, which then stores it in a database.

[1598] Step 2:

[1599] The pet robot terminal monitors the user's daily life. Specifically, sensors detect the number of steps, walking speed, and posture, and a camera captures facial expressions. In addition, conversations are recorded via a microphone and converted into text data. This data is sent from the terminal to a server. The input is the user's daily activity data, and the output is data sent to the server.

[1600] Step 3:

[1601] The server analyzes the received data. An AI model (such as TensorFlow) is used here. Specifically, the server compares it with normal behavioral patterns and detects abnormalities in walking speed, heart rate, conversation content, etc. The input is the data sent from the device, and the output is the analysis results.

[1602] Step 4:

[1603] The server detects anomalies based on the analysis results. If an anomaly is detected, the server determines how to respond depending on the type of anomaly. The input is the analysis results, and the output is the anomaly detection status and its type.

[1604] Step 5:

[1605] If an abnormality is detected, the server instructs the appropriate response. Specifically, in the case of a serious abnormality (such as a fall or a break-in), emergency contacts (family members or medical personnel) are notified in real time. In addition, minor abnormalities (such as a change in walking pattern) are compiled into a regular report and sent. The input is the abnormality detection status and type, and the output is notification data.

[1606] Step 6:

[1607] In the event of an emergency, the server will send a notification. Notifications to emergency contacts are sent via SMS or app notifications. At the same time, the pet robot device will also send a local notification to the user via voice, such as "We recommend that you see a doctor." The input is the notification data, and the output is the actual notification content.

[1608] Step 7:

[1609] The robotic pet is set to perform regular health checks. The server sends a checklist to the robotic pet, which then notifies the user in advance by voice and asks questions and conducts reaction tests based on the checklist. The results are sent back to the server, which analyzes them. The input is the checklist instructions from the server, and the output is the check results.

[1610] Step 8:

[1611] The server centrally manages data and backs it up in a timely manner. Furthermore, based on the analysis results, the system provides specific advice on health maintenance and security measures to users and their associates. The input is all of the user's data and the analysis results, and the output is advice content.

[1612] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1613] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI, and also combines it with an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described below.

[1614] System configuration

[1615] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[1616] 1. Users: Elderly people who use the system to receive health management and care.

[1617] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, AI processors, and emotion engines.

[1618] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[1619] Initial Setup

[1620] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[1621] Daily Life Monitoring

[1622] PetRobo monitors the user's daily life and collects the following data:

[1623] Physical activity: Sensors detect steps, walking speed, posture, etc.

[1624] Conversation content: What the user says is recorded through the microphone and converted into text data.

[1625] Facial Expressions and Emotions: The camera captures the user's facial expressions and the emotion engine recognizes their emotions, allowing the robot to respond according to the user's emotional state.

[1626] Health assessment

[1627] The server analyzes the data sent from the pet robot in real time, for example, by performing the following processes:

[1628] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, possible falls, or cognitive decline in conversation.

[1629] Health Assessment: Based on regularly collected data, the device comprehensively assesses the user's health status, such as detecting heart rate fluctuations and lack of physical activity.

[1630] Emotion assessment: Analyzes user emotions recognized by the emotion engine to detect early signs of stress or anxiety.

[1631] Alerts and Notifications

[1632] If an abnormality is detected, the server will respond by the following means.

[1633] Instant Notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[1634] Regular notifications: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members and care facilities.

[1635] Local notifications: The pet robot will notify the user by voice, such as "We recommend that you see a doctor."

[1636] Regular health checks

[1637] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[1638] Promotion of exercise

[1639] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[1640] Emotional engine response

[1641] By utilizing the emotion engine, the following responses are taken based on the user's emotional state.

[1642] Stress relief suggestions: If the user is feeling stressed or anxious, the robotic pet will suggest relaxation activities (e.g., deep breathing or short breaks).

[1643] Positive feedback: When the user is in a good emotional state, the robotic pet will provide positive feedback, further reinforcing that emotion.

[1644] Emotion-based communication: Based on the emotions recognized by the emotion engine, the pet robot communicates with the user in an appropriate tone and content.

[1645] Data management and advice

[1646] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[1647] Specific examples

[1648] Example 1: Early detection of dementia

[1649] (monitoring):

[1650] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[1651] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[1652] (Evaluation and Notification):

[1653] Server: If cognitive decline is suspected, a detailed report will be prepared.

[1654] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[1655] Server: Notify family members and medical personnel and encourage appropriate action.

[1656] Example 2: Exercise promotion

[1657] (Exercise prompt):

[1658] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[1659] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[1660] (Data storage and analysis):

[1661] Terminal: The pet robot records the number of steps and walking speed.

[1662] Server: Stores the collected data and evaluates the user's exercise volume.

[1663] (Advice provided):

[1664] Server: Analyzes exercise results and provides feedback to the user and their family.

[1665] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[1666] Example 3: Recognizing and responding to emotions

[1667] (Emotion Monitoring):

[1668] Terminal: The pet robot uses a camera and an emotion engine to analyze the user's facial expressions and recognize their emotions.

[1669] Server: Collects emotional data and stores daily emotional patterns in a database.

[1670] (Stress detection and suggestions):

[1671] Server: Notifies the pet robot if it detects signs of stress or anxiety from the user's emotional patterns.

[1672] Terminal: The pet robot suggests relaxation to the user by saying, "Try taking a deep breath."

[1673] In this way, by combining emotion engines, care and health management that responds to the user's emotional state becomes possible, realizing higher quality lifestyle support.

[1674] The processing flow will be explained below.

[1675] Specific processing steps of a health management system that combines an emotion engine

[1676] Initial Setup

[1677] Step 1: Register user information

[1678] User: Uses a smartphone or PC to enter basic health information such as name, age, height, weight, and medical history.

[1679] Step 2: Save the information to the server

[1680] Server: Stores the information entered by the user in a database and generates a unique user ID for each user.

[1681] Step 3: Initial setup of your pet robot

[1682] Terminal: The pet robot connects to the server, obtains user information, and prepares for operation. It also calibrates sensors and cameras.

[1683] Daily Life Monitoring

[1684] Step 4: Start collecting data

[1685] Terminal: The pet robot begins collecting data on the user's daily activities (walking, talking, facial expressions, etc.) using sensors and cameras. The emotion engine analyzes the user's facial expressions and recognizes their emotions.

[1686] Step 5: Send monitoring data

[1687] Terminal: Sends collected data to the server at regular intervals (e.g., every 30 minutes).

[1688] Step 6: Analyze the data

[1689] Server: Analyzes the received data in real time, applies anomaly detection and emotion recognition algorithms, and flags any anomalies or changes in emotion.

[1690] Health assessment

[1691] Step 7: Anomaly detection

[1692] Server: Based on the analysis results, it detects slowing of walking speed, falls, and abnormalities in speech (signs of cognitive decline). The emotion engine detects stress and anxiety.

[1693] Step 8: Evaluate and record any abnormalities

[1694] Server: Evaluates detected anomalies and emotional changes, generates a report on the user's health status, and stores it in a database.

[1695] Alerts and Notifications

[1696] Step 9: Generate an alert

[1697] Server: If a significant abnormality is detected, it generates an alert and sends a notification to the user's family and medical personnel.

[1698] Step 10: Sending notifications

[1699] Server: Sends the alert information using the notification medium used (SMS, app notification, email, etc.).

[1700] Step 11: Notify users

[1701] Terminal: The pet robot notifies the user by voice, "An abnormality has been detected. We recommend that you see a doctor."

[1702] Regular health checks

[1703] Step 12: Start the health check

[1704] Terminal: The pet robot notifies the user by voice, "Regular health check will begin."

[1705] Step 13: Run the checklist

[1706] Terminal: The pet robot will ask questions and carry out reaction tests based on a checklist.

[1707] Step 14: Collecting check results

[1708] Terminal: Records the results of the check and sends them to the server.

[1709] Step 15: Analyze and save the results

[1710] Server: Analyzes the check results and stores the user's health status in a database.

[1711] Promotion of exercise

[1712] Step 16: Exercise Suggestion

[1713] Terminal: The pet robot suggests exercise to the user by saying, "Let's go for a walk together."

[1714] Step 17: User Activity

[1715] User: Take walks or do light exercise together according to suggestions from the pet robot.

[1716] Step 18: Collect exercise data

[1717] Terminal: The pet robot collects walking data and heart rate during exercise and sends it to the server.

[1718] Step 19: Analyze the movement data

[1719] Server: Analyzes the collected exercise data and evaluates the user's exercise volume.

[1720] Emotional engine response

[1721] Step 20: Sentiment Analysis

[1722] Terminal: The pet robot uses a camera and emotion engine to analyze the user's facial expressions and recognize their emotions.

[1723] Step 21: Sending Emotion Data

[1724] Terminal: Sends emotional data to the server and stores daily emotional patterns in a database.

[1725] Step 22: Stress detection and countermeasures

[1726] Server: Notifies the pet robot if it detects signs of stress or anxiety from emotional patterns.

[1727] Terminal: The pet robot suggests relaxation to the user by saying, "Try taking a deep breath."

[1728] Step 23: Positive Feedback

[1729] Device: If the user is in a good emotional state, the robotic pet will provide positive feedback such as "You look great today!"

[1730] Step 24: Communicate Emotionally

[1731] Terminal: Based on the emotions recognized by the emotion engine, the pet robot communicates with the user in an appropriate tone and content.

[1732] Data management and advice

[1733] Step 25: Centralize your data

[1734] Server: All data is managed centrally and backed up regularly.

[1735] Step 26: Generating Advice

[1736] Server: Based on the results of data analysis, it generates specific advice for the user on maintaining their health.

[1737] Step 27: Providing advice

[1738] Device: The pet robot provides the user with specific advice via voice, such as "It is recommended to walk your pet three times a week."

[1739] Step 28: Create and submit a report

[1740] Server: Generates monthly and weekly reports and sends them to the user's family and care facility personnel.

[1741] In this way, by combining emotion engines, care and health management that responds to the user's emotional state becomes possible, realizing higher quality lifestyle support.

[1742] Example 2

[1743] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1744] Health management and care systems for the elderly require comprehensive support that includes not only physical health but also mental health. In particular, it is important to detect cognitive decline and emotional changes such as stress and anxiety early and provide appropriate responses. However, current systems lack these functions, making it difficult to provide highly accurate monitoring and appropriate feedback.

[1745] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1746] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, means for instructing a response when an abnormality is detected, means for notifying information about the user, means for recognizing the user's emotions, and means for suggesting a response based on the recognized emotions. This makes it possible to closely monitor not only the user's physical health condition but also their mental health condition, and to respond immediately when an abnormality is detected.

[1747] A "user" is a person who receives health management and care using this system.

[1748] "Health Information" refers to basic health data such as a user's name, age, height, weight, and medical history, as well as physiological and behavioral data obtained from daily life.

[1749] The term "means" refers to a device or method used to achieve a specific purpose, and in the present invention includes a module for realizing a specific function.

[1750] "Server" refers to a cloud-based data center, a computer system responsible for collecting, storing, and analyzing users' health information.

[1751] The "terminal" refers to the pet robot itself, which is hardware equipped with sensors, a camera, a microphone, a speaker, an AI processor, an emotion engine, etc.

[1752] An "emotion engine" refers to an algorithm and software system that recognizes emotions by analyzing a user's facial expressions, voice, etc.

[1753] "Abnormal" refers to a state that deviates from normal behavioral patterns or a situation that is deemed to be a health problem.

[1754] "Notification" refers to the act of the system communicating information to the user, family, or medical professionals, and includes methods such as SMS, app notification, and voice message.

[1755] "Exercise promotion" refers to the process of suggesting appropriate exercise to users and encouraging them to do so.

[1756] A "health check" refers to the act of periodically conducting tests and asking questions to assess a user's health.

[1757] "Real-time analytics" refers to the process of analyzing data immediately as it is generated.

[1758] A "machine learning algorithm" refers to a computational model that recognizes patterns based on large amounts of data and makes predictions and classifications.

[1759] "Backup" refers to the process of regularly saving copies of data in case of data loss.

[1760] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI, and also combines it with an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described below.

[1761] System Configuration Overview

[1762] This system mainly consists of the following three components:

[1763] 1. Users: Elderly people who use the system to receive health management and care.

[1764] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, AI processors, and emotion engines.

[1765] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[1766] Initial Setup

[1767] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[1768] Daily Life Monitoring

[1769] The device (Pet Robot) monitors the user's daily life and collects the following data:

[1770] Physical activity: Sensors detect steps, walking speed, and posture, specifically using the built-in accelerometer and gyroscope.

[1771] Conversation: The conversation is recorded through a microphone and converted into text data. Specifically, speech recognition software is used to convert speech into text.

[1772] Facial expressions and emotions: The camera analyzes facial expressions and the emotion engine recognizes emotions. Specifically, the image processing algorithm is used to analyze facial expressions and the emotion engine digitizes emotions.

[1773] Health assessment

[1774] The server analyzes the data sent from the pet robot in real time.

[1775] Anomaly detection: Compares a user's behavioral patterns with past data to detect anomalies, such as a slowdown in walking speed, the possibility of a fall, or a decline in cognitive function in conversations.

[1776] Health Assessment: A comprehensive assessment of the user's health status is performed based on heart rate and exercise volume. In particular, a health index is calculated by taking a weighted average of each data point.

[1777] Emotion assessment: The emotion engine analyzes the recognized emotional data and assesses the level of stress and anxiety.

[1778] Alerts and Notifications

[1779] If an abnormality is detected, the server will respond appropriately.

[1780] Immediate Notification: If a critical abnormality is detected, an SMS or app notification will be sent to family members or medical personnel. For example, if a fall is detected.

[1781] Regular notifications: If minor abnormalities are detected, they can be compiled into regular reports and sent to family members or care facilities. For example, changes in walking patterns.

[1782] Local notifications: The robotic pet will notify the user directly, for example, saying "We recommend you see a doctor."

[1783] Regular health checks

[1784] The device periodically performs health checks, notifying the user in advance via voice, and conducting checklist-based questions and reaction tests. The results are sent to a server for further analysis.

[1785] Promotion of exercise

[1786] The device will suggest moderate exercise to the user, for example, "Good morning, let's go for a walk together!" The Pet Robot records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[1787] Emotional engine response

[1788] The device utilizes an emotion engine to take the following actions:

[1789] Stress relief suggestions: If the user is feeling stressed or anxious, suggest relaxation activities (e.g., deep breathing or short breaks).

[1790] Positive feedback: If the user is in a good emotional state, provide positive feedback.

[1791] Emotion-based communication: Based on the emotions recognized by the emotion engine, the pet robot will communicate with the appropriate tone and content.

[1792] Data management and advice

[1793] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families. For example, the advice could be, "It is recommended to take a walk three times a week."

[1794] Specific examples

[1795] Early detection of dementia

[1796] 1. Monitoring:

[1797] Device: The robotic pet observes the user's daily life and records their recent conversation patterns. Speech recognition software analyzes the conversation and sends it to the server.

[1798] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[1799] 2. Evaluation and Notification:

[1800] Server: If cognitive decline is suspected, it creates a detailed report. It detects abnormal patterns, generates and sends the report.

[1801] Terminal: The robotic pet notifies the user, "We recommend that you see a doctor." Specifically, it uses voice synthesis to convey the message.

[1802] Server: Notify family members and medical personnel and encourage appropriate action.

[1803] Promotion of exercise

[1804] 1. Exercise prompts:

[1805] Device: In the morning, the robot pet will suggest to the user, "Let's go for a walk together." It will play a voice message to signal when it's time to exercise.

[1806] User: Accept the suggestion and do some light exercise or a walk with the pet robot. Put on the pedometer and start walking.

[1807] 2. Data Storage and Analysis:

[1808] Device: The robot records the number of steps and walking speed. Data is collected using a walking sensor.

[1809] Server: Stores the collected data and evaluates the user's exercise volume. Data analysis tools evaluate the exercise volume and generate reports.

[1810] 3. Providing advice:

[1811] Server: Analyzes exercise results and provides feedback to the user and their family. Based on the analysis results, generates and sends specific exercise advice.

[1812] Terminal: The robot pet gives feedback to the user, saying, "Your exercise today was great." Specifically, it uses voice synthesis to convey a positive message.

[1813] Recognizing and Responding to Emotions

[1814] 1. Emotional monitoring:

[1815] Terminal: The robotic pet uses a camera and an emotion engine to analyze the user's facial expressions and recognize their emotions. It uses an image processing algorithm to capture the facial expressions and generate analytical data.

[1816] Server: Collects emotional data and stores daily emotional patterns in a database. Records the emotional data in cloud storage.

[1817] 2. Stress detection and suggestions:

[1818] Server: Notifies the Pet Robot if it detects signs of stress or anxiety from the user's emotional patterns. Detects abnormal patterns and sends instructions to the Pet Robot.

[1819] Terminal: The pet robot suggests relaxation to the user by saying, "Try taking a deep breath." The relaxation suggestion is made using voice synthesis.

[1820] In this way, the entire system functions in coordination to provide comprehensive health support for the elderly.

[1821] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1822] Step 1: Initial Setup

[1823] The user performs the initial setup of the system using a smartphone or PC. Specifically, the user opens a dedicated app and enters basic information such as name, age, height, weight, and medical history. Input: Basic health information. Output: Registered user information. The server saves the entered information in a database and manages records for each user. Specifically, the server registers the information in the database and generates a user ID.

[1824] Step 2: Monitoring your daily life

[1825] The terminal (pet robot) monitors the user's daily life. Input: User's behavior and environmental data. Output: Collected data. The specific operations are as follows.

[1826] Physical activity monitoring: Sensors detect steps, walking speed, and posture using the built-in accelerometer and gyroscope.

[1827] Conversation monitoring: Recording conversations through a microphone and converting them into text data. Using speech recognition software to convert speech to text.

[1828] Facial Expression and Emotion Monitoring: Using a camera to analyze facial expressions and an emotion engine to recognize emotions, image processing algorithms are used to analyze facial expressions and digitize emotions.

[1829] Step 3: Send data

[1830] The device sends the collected data to the server. Input: Monitored data. Output: Data sent to the server. Specifically, the data is uploaded to the cloud server using an internet connection.

[1831] Step 4: Health Assessment

[1832] The server analyzes the transmitted data in real time. Input: Transmitted data. Output: Evaluation results. The specific operation is as follows.

[1833] Anomaly detection: Compares data with past data in the database to see if there are any anomalies. Machine learning algorithms are used to detect outliers.

[1834] Health Assessment: A comprehensive assessment of the user's health status is performed based on heart rate, exercise volume, etc. A weighted average of each data point is used to calculate a health index.

[1835] Emotion Assessment: The emotion engine analyzes the recognized emotion data to assess the level of stress and anxiety. Emotion data is analyzed to detect signs of stress and anxiety.

[1836] Step 5: Alerts and Notifications

[1837] If an abnormality is detected, the server will take appropriate action. Input: Data in which an abnormality was detected. Output: Notification message. The specific operations are as follows:

[1838] Immediate notification: If a critical abnormality is detected, family members or medical personnel will be notified via SMS or app notifications. SMS gateways and push notification services will be used to contact them.

[1839] Regular notification: If a minor abnormality is detected, it will be compiled into a regular report and sent to the family or care facility. Data will be collected periodically and reports will be generated.

[1840] Local notification: The robotic pet notifies the user directly, using text-to-speech to say, "We recommend you see a doctor."

[1841] Step 6: Regular Health Checks

[1842] The device periodically performs health checks. Input: Checklist. Output: Check results. Specific operations include notifying the user in advance by voice, and asking questions and conducting reaction tests based on the checklist. The results are sent to the server for further analysis.

[1843] Step 7: Exercise promotion

[1844] The device will suggest moderate exercise to the user. Input: Suggested time and content. Output: User's exercise data. The specific operation is as follows.

[1845] Exercise suggestion: Uses voice synthesis technology to suggest, "Good morning, let's go for a walk together!"

[1846] User response: The user accepts the suggestion and starts exercising. The robotic pet uses a pedometer to measure the data.

[1847] Data recording: Records exercise data (number of steps, exercise time, heart rate) and sends it to the server. The collected data is saved and the user's exercise volume is evaluated.

[1848] Step 8: Respond with the Emotion Engine

[1849] The device utilizes an emotion engine to respond based on the user's emotional state. Input: Emotion data. Output: Countermeasures. Specific operations are as follows:

[1850] Emotion Recognition: Facial expressions are captured and analyzed with a camera, and image processing algorithms are used to generate emotion data.

[1851] Stress response: If the user is feeling stressed or anxious, the app suggests relaxation activities, using voice synthesis to suggest things like, "Try taking a deep breath."

[1852] Positive feedback: If the user is in a good emotional state, provide positive feedback. The voice will say, "Your workout today was great."

[1853] Step 9: Data management and advice

[1854] The server centrally manages and backs up all data. Input: All collected data. Output: Advice report. Specific operations are as follows:

[1855] Data storage: Store data in cloud storage and back it up regularly.

[1856] Advice based on analysis results: Based on the data analysis results, specific health maintenance advice is generated and sent to the user or family. For example, advice such as "It is recommended to take a walk three times a week" is provided.

[1857] (Application example 2)

[1858] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1859] With the increasing number of elderly people in modern society, health management and safety assurance in daily life are becoming increasingly important. However, existing systems lack detailed monitoring of elderly people's behavior and emotional state, making it difficult to detect abnormalities early and respond appropriately. Furthermore, in many cases, prompt and appropriate notifications are not provided to elderly people or their families, resulting in safety issues. Therefore, an effective method for simultaneously managing the health and safety of elderly people is needed.

[1860] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, and means for monitoring the user's behavior with a sensor. This enables detailed monitoring of changes in the user's behavior and emotions and enables prompt and appropriate responses. Furthermore, by analyzing the collected data on a cloud server, abnormal behavior and changes in emotions can be immediately detected and promptly notified to the elderly person, their family, and even a security company, thereby ensuring safety.

[1861] "User's health information" refers to all data related to the user's physical condition and health, and specifically includes heart rate, blood pressure, number of steps, weight, etc.

[1862] "Means of collection" refers to devices and technologies that acquire data using sensors, cameras, audio microphones, etc.

[1863] "Means of analysis" refers to the algorithms and software used to analyze collected data and assess a user's health status and behavioral patterns.

[1864] "Means for detecting anomalies" refers to hardware and software that identify data that deviates from normal patterns and recognize abnormal situations.

[1865] "Means for instructing how to respond" refers to a method or device for providing appropriate advice or instructions to the user when an abnormality is detected.

[1866] "Means of notification" refers to the method or system for communicating detected information to the user, their family, security companies, and other relevant parties.

[1867] "Means for monitoring user behavior using sensors" refers to sensors and related technologies for monitoring user movements and behavior in real time.

[1868] "Means for recognizing a user's emotional state using a camera" refers to technology that analyzes images taken with a camera and infers emotions from the user's facial expressions and movements.

[1869] "Means for transmitting to a cloud server for analysis" refers to the technology for transmitting collected data via the Internet to a remote server where it can be analyzed in detail.

[1870] "Means for providing advice" refers to a method or device for providing health care or security instructions or suggestions to a user based on the results of the analysis.

[1871] This invention relates to a system that collects, analyzes, detects abnormalities, and provides instructions and notifications regarding user health information. In particular, it comprehensively manages the user's health and safety by monitoring the user's behavior with sensors and recognizing their emotional state with a camera.

[1872] System configuration

[1873] This system consists of the following main components:

[1874] 1. Pet Robot (terminal): Equipped with sensors, cameras, microphones, speakers, AI processors, and emotion engines, it monitors the user's daily life.

[1875] 2. Cloud server: Responsible for storing and analyzing collected data and notifying the results.

[1876] 3. Smartphone application: Serves as an interface for notifying users, their families, and security companies.

[1877] Data collection

[1878] The robot uses sensors and cameras to collect health information about the user, including the number of steps, walking speed, posture, heart rate, and facial expression data, in real time. It also records the user's conversations through a microphone and converts them into text data.

[1879] Data analysis

[1880] The collected data undergoes initial processing by the robot's AI processor and is then sent in real time to a cloud server, where it undergoes further analysis using machine learning models and an emotion engine. This allows the robot to evaluate the user's behavioral patterns and emotional state and detect any anomalies.

[1881] Anomaly detection and notification

[1882] If an abnormality is detected, a notification is sent from the cloud server to the smartphone application. If a serious abnormality is detected (e.g., a fall), an immediate notification is sent, and alerts are also sent to security companies and family members. If the abnormality is minor, a regular report is sent.

[1883] Responding to users

[1884] If an abnormality is detected, the robot will give the user voice advice and instructions, such as suggesting relaxation activities like "Try taking deep breaths."

[1885] Data management and advice

[1886] The cloud server centrally manages all data and regularly backs it up. Based on the analysis results, the system provides specific health maintenance advice to users and their families. For example, the system might say, "It is recommended that you take a walk three times a week."

[1887] Examples and prompts

[1888] Specific examples

[1889] A pet robot detects that an elderly person gets up and wanders around multiple times at night, and a smart guard robot immediately notifies the family and the security company.

[1890] Prompt Sentence Examples

[1891] Behavioral recognition:

[1892] The system monitors user behavior and sends a notification if an abnormality occurs. If the user moves significantly during sleep hours, which is considered normal behavior, it is treated as an abnormality.

[1893] Sentiment analysis:

[1894] The system analyzes facial images captured by the camera to determine the user's emotional state. If negative emotions such as stress or anxiety are detected, it sends a notification and suggests relaxation activities to the user.

[1895] This will enable comprehensive management of the user's health and safety, and enable prompt and appropriate response. The implementation of the invention includes hardware and software such as sensors, cameras, AI processors, cloud servers, and smartphone applications.

[1896] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1897] Step 1:

[1898] The PetRobo (terminal) uses sensors and a camera to collect the user's health and behavioral data. The sensors measure the number of steps taken, heart rate, and walking speed, and the camera captures facial expressions. This data is input into the PetRobo's AI processor.

[1899] Step 2:

[1900] The PetRobo's AI processor performs an initial analysis of the collected data. For example, it detects abnormalities in the number of steps and heart rate, and estimates the emotional state from facial expression data. This process allows for early detection of anomalies. The analyzed data is then sent to a cloud server for the next step.

[1901] Step 3:

[1902] The cloud server receives the data sent from the robotic pet and performs a detailed analysis. The server uses a generative AI model to further analyze walking patterns and emotional data. For example, the cloud server detects abnormal walking patterns during specific times of the day and uses an emotion engine to analyze signs of stress or anxiety. The results of this analysis are used in the next step.

[1903] Step 4:

[1904] The cloud server determines whether an abnormality has been detected based on the detailed analysis results. If an abnormality is detected, the cloud server sends a notification to the smartphone application. For example, if a serious abnormality (such as a fall) is detected, an immediate notification will be sent, and if a minor abnormality (such as a change in walking pattern) is detected, a periodic report will be sent.

[1905] Step 5:

[1906] The smartphone application receives notifications from the cloud server and displays alerts to the user, their family, and the security company, allowing the user to check the notifications and take necessary action.

[1907] Step 6:

[1908] The pet robot will give voice advice to the user. For example, if abnormal behavior is detected, it will give advice such as "Try taking deep breaths" or "We recommend that you see a doctor." This voice advice is generated based on the analysis results of the cloud server.

[1909] Step 7:

[1910] The cloud server stores all data and backs it up regularly. Furthermore, the cloud server uses the data history to provide specific health advice to users and their families. For example, it generates instructions such as "It is recommended to take a walk three times a week," and notifies users via a smartphone application.

[1911] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1912] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1913] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1914] [Fourth embodiment]

[1915] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1916] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1917] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1918] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1919] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1920] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1921] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1922] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1923] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1924] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1925] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1926] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1927] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1928] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI. Specific embodiments of the system are described below.

[1929] System configuration

[1930] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[1931] 1. Users: Elderly people who use the system to receive health management and care.

[1932] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, and AI processors.

[1933] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[1934] Initial Setup

[1935] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[1936] Daily Life Monitoring

[1937] PetRobo monitors the user's daily life and collects the following data:

[1938] Physical activity: Sensors detect steps, walking speed, posture, etc.

[1939] Conversation content: What the user says is recorded through the microphone and converted into text data.

[1940] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[1941] Health assessment

[1942] The server analyzes the data sent from the pet robot in real time, for example, by performing the following processes:

[1943] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, possible falls, or cognitive decline in conversation.

[1944] Health Assessment: Based on regularly collected data, the device comprehensively assesses the user's health status, such as detecting heart rate fluctuations and lack of physical activity.

[1945] Alerts and Notifications

[1946] If an abnormality is detected, the server will respond by the following means.

[1947] Instant Notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[1948] Regular notifications: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members and care facilities.

[1949] Local notifications: The pet robot will notify the user by voice, such as "We recommend that you see a doctor."

[1950] Regular health checks

[1951] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[1952] Promotion of exercise

[1953] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[1954] Data management and advice

[1955] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[1956] Specific examples

[1957] Example 1: Early detection of dementia

[1958] (monitoring):

[1959] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[1960] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[1961] (Evaluation and Notification):

[1962] Server: If cognitive decline is suspected, a detailed report will be prepared.

[1963] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[1964] Server: Notify family members and medical personnel and encourage appropriate action.

[1965] Example 2: Exercise promotion

[1966] (Exercise prompt):

[1967] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[1968] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[1969] (Data storage and analysis):

[1970] Terminal: The pet robot records the number of steps and walking speed.

[1971] Server: Stores the collected data and evaluates the user's exercise volume.

[1972] (Advice provided):

[1973] Server: Analyzes exercise results and provides feedback to the user and their family.

[1974] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[1975] The above is an embodiment of the present invention. It is expected that this system will enable efficient and effective health management and care for the elderly.

[1976] The processing flow will be explained below.

[1977] Specific steps for daily life monitoring and health management program

[1978] Overall system flow

[1979] Initial Setup

[1980] Step 1: Register user information

[1981] User: Uses a smartphone or PC to enter basic health information such as name, age, height, weight, and medical history.

[1982] Step 2: Save the information to the server

[1983] Server: Stores the information entered by the user in a database and generates a unique user ID for each user.

[1984] Step 3: Initial setup of your pet robot

[1985] Terminal: The pet robot connects to the server, obtains user information, and prepares for operation. It also calibrates sensors and cameras.

[1986] Daily Life Monitoring

[1987] Step 4: Start collecting data

[1988] Terminal: The pet robot begins collecting data on the user's daily activities (walking, talking, facial expressions, etc.) using sensors.

[1989] Step 5: Send monitoring data

[1990] Terminal: Sends collected data to the server at regular intervals (e.g., every 30 minutes).

[1991] Step 6: Analyze the data

[1992] Server: Analyzes the received data in real time, applies anomaly detection algorithms, and flags any anomalies detected.

[1993] Health assessment

[1994] Step 7: Anomaly detection

[1995] Server: Based on the analysis results, detects slowing walking speed, falls, and abnormalities in speech (signs of cognitive decline).

[1996] Step 8: Evaluate and record any abnormalities

[1997] Server: Evaluates the detected anomalies and generates a report on the user's health status, which is stored in a database.

[1998] Alerts and Notifications

[1999] Step 9: Generate an alert

[2000] Server: If a significant abnormality is detected, it generates an alert and sends a notification to the user's family and medical personnel.

[2001] Step 10: Sending notifications

[2002] Server: Sends the alert information using the notification medium used (SMS, app notification, email, etc.).

[2003] Step 11: Notify users

[2004] Terminal: The pet robot notifies the user by voice, "An abnormality has been detected. We recommend that you see a doctor."

[2005] Regular health checks

[2006] Step 12: Start the health check

[2007] Terminal: The pet robot notifies the user by voice, "Regular health check will begin."

[2008] Step 13: Run the checklist

[2009] Terminal: The pet robot will ask questions and carry out reaction tests based on a checklist.

[2010] Step 14: Collecting check results

[2011] Terminal: Records the results of the check and sends them to the server.

[2012] Step 15: Analyze and save the results

[2013] Server: Analyzes the check results and stores the user's health status in a database.

[2014] Promotion of exercise

[2015] Step 16: Exercise Suggestion

[2016] Terminal: The pet robot suggests exercise to the user by saying, "Let's go for a walk together."

[2017] Step 17: User Activity

[2018] User: Take walks or do light exercise together according to suggestions from the pet robot.

[2019] Step 18: Collect exercise data

[2020] Terminal: The pet robot collects walking data and heart rate during exercise and sends it to the server.

[2021] Step 19: Analyze the movement data

[2022] Server: Analyzes the collected exercise data and evaluates the user's exercise volume.

[2023] Data management and advice

[2024] Step 20: Centralize your data

[2025] Server: All data is managed centrally and backed up regularly.

[2026] Step 21: Generate Advice

[2027] Server: Based on the results of data analysis, it generates specific advice for the user on maintaining their health.

[2028] Step 22: Providing advice

[2029] Device: The pet robot provides the user with specific advice via voice, such as "It is recommended to walk your pet three times a week."

[2030] Step 23: Create and submit the report

[2031] Server: Generates monthly and weekly reports and sends them to the user's family and care facility personnel.

[2032] In this way, the system supports the elderly in their daily lives and manages their health.

[2033] Example 1

[2034] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2035] Efficient and effective health management and care for the elderly requires detailed monitoring and analysis of their daily lives. However, current systems are insufficient in collecting health information and detecting abnormalities, making it difficult to respond quickly. In addition, some systems are unable to provide specific countermeasures for cognitive decline and lack of exercise in the elderly. To solve these problems, a system is needed that can perform detailed, real-time monitoring and analysis and provide appropriate notifications and advice.

[2036] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2037] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, and means for monitoring the user's daily life. This enables detailed and real-time collection and analysis of health information. It also includes means for encouraging the user to exercise, means for notifying the user based on the monitoring results, and means for initializing the system. This enables evaluation of health status, provision of appropriate advice, regular health checks, and promotion of exercise. It also includes means for monitoring conversation content to detect cognitive decline, and means for collecting exercise data and evaluating the amount of exercise. This enables early detection of cognitive decline and provision of specific countermeasures to address lack of exercise.

[2038] "Users" refer to elderly people who use the system to receive health management and care.

[2039] "Health Information" refers to health-related data such as a user's name, age, height, weight, and medical history.

[2040] "Means of collection" refers to the function of obtaining the user's health information using a pet robot or other sensor devices.

[2041] "Means for analysis" refers to algorithms or software that use collected health information to assess a user's health status.

[2042] "Means for detecting abnormalities" refers to the function of identifying abnormal patterns that differ from normal conditions based on the results of analyzing health information.

[2043] "Means for instructing a response" refers to a function that notifies the user, family, or medical personnel of the necessary actions when an abnormality is detected.

[2044] "Means of monitoring" refers to the function of continuously observing the user's daily activities and behavior using a pet robot or other sensor devices.

[2045] "Means to encourage exercise" refers to the function in which the pet robot uses voice or other means to suggest appropriate exercise to the user and encourage them to do so.

[2046] "Means of notification" refers to the function of notifying users of health information and abnormality detection results via voice, SMS, app notifications, etc.

[2047] "Means for performing initial settings" refers to the function that allows a user to input the health information required when starting to use the system and register it with the pet robot and server.

[2048] "Means for monitoring conversation content" refers to the function of recording and analyzing the user's conversation using the pet robot's microphone.

[2049] "Means for detecting cognitive decline" refers to algorithms or software that analyze a user's daily conversations and behavioral patterns to identify cognitive decline at an early stage.

[2050] "Means for collecting data from exercise" refers to the function of obtaining data such as the number of steps taken during exercise, exercise time, and heart rate through the pet robot's sensors and sending it to a server.

[2051] "Means for assessing exercise volume" refers to algorithms or software that analyze the collected exercise data and assess the user's exercise volume.

[2052] This invention is a system for managing and caring for the elderly using a pet robot equipped with AI. This system monitors the user's daily life, and if an abnormality is detected, it instructs appropriate measures, evaluates the user's health, and provides advice. Specifically, it uses the following hardware and software components.

[2053] System configuration

[2054] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[2055] 1. Users: Elderly people who use the system to receive health management and care.

[2056] 2. Terminal (Pet Robot): Equipped with hardware such as sensors, cameras, microphones, speakers, and AI processors.

[2057] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[2058] Initial Setup

[2059] The user performs the initial setup of the system using a smartphone or PC. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[2060] Daily Life Monitoring

[2061] The robotic pet will monitor the user's daily life and collect the following data:

[2062] Physical activity: The PetRobo's sensors detect steps, walking speed, posture, etc.

[2063] Conversation content: Record what the user says through the microphone and convert the voice data into text data.

[2064] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[2065] Health assessment

[2066] The server analyzes the data sent from the pet robot in real time and performs the following processes:

[2067] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, potential falls, or if conversations indicate a decline in cognitive function.

[2068] Health assessment: Comprehensively assess the user's health status based on regularly collected data, such as detecting heart rate fluctuations and lack of physical activity.

[2069] Alerts and Notifications

[2070] If an abnormality is detected, the server will respond by the following means.

[2071] Immediate notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to family members or medical professionals.

[2072] Regular notification: Minor abnormalities (e.g., changes in walking pattern) are compiled into regular reports and sent to family members or care facilities.

[2073] Local notification: The robotic pet will notify the user via voice, such as "We recommend that you see a doctor."

[2074] Regular health checks

[2075] The robotic pet can be set to periodically check its health. It notifies the user in advance by voice and asks questions based on a checklist and conducts reaction tests. The results are sent to a server for analysis.

[2076] Promotion of exercise

[2077] PetRobo suggests moderate exercise to the user. For example, it will say something like, "Good morning, let's go for a walk together!" to encourage the user to participate in the exercise. PetRobo records data during exercise (number of steps, exercise time, heart rate, etc.) and sends it to a server for analysis.

[2078] Data management and advice

[2079] The server centrally manages all data and backs it up in a timely manner. Based on the analysis results, the server also provides specific health maintenance advice to users and their families, such as "It is recommended to take a walk three times a week."

[2080] Specific examples

[2081] Example 1: Early detection of dementia

[2082] monitoring:

[2083] Terminal: The robotic pet observes the user's daily life and records their recent conversation patterns.

[2084] Server: Analyzes changes in conversation content and patterns to detect cognitive decline.

[2085] Rating and Notification:

[2086] Server: If cognitive decline is suspected, a detailed report will be prepared.

[2087] Terminal: The pet robot notifies the user that "We recommend that you see a doctor."

[2088] Server: Notify family members and medical personnel and encourage appropriate action.

[2089] Example 2: Exercise promotion

[2090] Exercise prompt:

[2091] Terminal: In the morning, the pet robot suggests to the user, "Let's go for a walk together."

[2092] User: If you accept the suggestion, you will do some light exercise or a walk with your pet robot.

[2093] Data storage and analysis:

[2094] Terminal: The pet robot records the number of steps and walking speed.

[2095] Server: Stores the collected data and evaluates the user's exercise volume.

[2096] Advice provided:

[2097] Server: Analyzes exercise results and provides feedback to the user and their family.

[2098] Terminal: The pet robot gives feedback to the user, saying, "Today's exercise was very good."

[2099] Prompt sentence for generative AI model

[2100] "This system uses an AI-equipped pet robot to manage and care for the elderly. Please create a program that meets the following requirements: It will monitor the user's daily life and notify them if any abnormalities are detected. It will also suggest moderate exercise and collect data during exercise. The data will be analyzed on the server, and the health status will be evaluated and advice will be provided."

[2101] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2102] Step 1: Initial Setup

[2103] Users enter health information such as their name, age, height, weight, and medical history via their smartphone or PC.

[2104] Input: User health information entered via smartphone or PC.

[2105] How it works: The user enters their health information into a form displayed in the UI.

[2106] Output: The input information is sent to the pet robot's terminal and server.

[2107] Step 2: Register your health information

[2108] The terminal receives the health information input by the user to the pet robot.

[2109] Input: Health information entered and submitted by a user.

[2110] Operation: The device temporarily stores the received health information and prepares to send it to the server.

[2111] Output: Health information is sent to the server.

[2112] Step 3: Save your health information

[2113] The server stores the received health information in a database.

[2114] Input: Health information sent from the device.

[2115] How it works: The server connects to a database and stores health information for each user as a record.

[2116] Output: User's health information stored in a database.

[2117] Step 4: Start monitoring your daily life

[2118] The terminal is a pet robot that monitors the user's daily life.

[2119] Input: Data about the user's everyday movements, speech, and facial expressions.

[2120] How it works: The device collects data using sensors, cameras, microphones, etc. For example, sensors detect the number of steps taken and walking speed, microphones record conversations, and facial recognition cameras capture facial expressions.

[2121] Output: The collected data is sent to the server.

[2122] Step 5: Data analysis

[2123] The server analyzes the data sent from the pet robot in real time.

[2124] Input: Daily life data sent from the device.

[2125] How it works: The server runs data analysis algorithms to detect anomalies, for example, a slower walking speed compared to normal behavior patterns is flagged as an anomaly.

[2126] Output: A flag is set to indicate whether the analysis result is abnormal or not.

[2127] Step 6: Anomaly detection

[2128] The server detects abnormalities based on the analysis results.

[2129] Input: Results of data analysis.

[2130] Operation: If an anomaly is detected, the server flags the anomaly information for the user and proceeds to the next processing step.

[2131] Output: The results of the anomaly detection are sent to the notification system.

[2132] Step 7: Notification

[2133] If an abnormality is detected, the server will notify you as necessary.

[2134] Input: Anomaly detection results.

[2135] Operation: Depending on the type of abnormality, the server will send immediate notification (SMS or app notification) or regular notification (regular report creation). It will also instruct the pet robot to send a local notification.

[2136] Output: Notifications sent to family and medical personnel, and audio notifications from the PetRobo itself.

[2137] Step 8: Regular Health Checks

[2138] The device will have a pet robot perform regular health checks.

[2139] Input: Pre-configured checklist and health questions.

[2140] How it works: The robot will notify the user by voice when it's time to check, ask questions, and record the results.

[2141] Output: The checklist results answered by the user are sent to the server.

[2142] Step 9: Analyze the results

[2143] The server analyzes the results of the periodic health check.

[2144] Input: Checklist result data.

[2145] How it works: The server uses analytical algorithms to assess the user's health status.

[2146] Output: The analysis results are compiled into a detailed report.

[2147] Step 10: Provide feedback

[2148] The server provides detailed feedback based on the analysis results.

[2149] Input: Analysis results report.

[2150] How it works: The server creates feedback content and sends it to the user or family.

[2151] Output: Feedback sent to user and family, audio notification by PetRobo.

[2152] Step 11: Exercise Suggestion

[2153] The device uses a pet robot to suggest exercises to the user.

[2154] Input: Pre-set exercise plan, user's daily activity data.

[2155] How it works: The pet robot will suggest to the user via voice, "Let's go for a walk together."

[2156] Output: Exercise suggestion notification.

[2157] Step 12: Collecting data during exercise

[2158] The device collects data during exercise (number of steps, exercise time, heart rate, etc.).

[2159] Input: User's exercise data.

[2160] How it works: The PetRobo's sensors record data such as steps taken, exercise time, and heart rate.

[2161] Output: The collected movement data is temporarily stored in the pet robot and later sent to the server.

[2162] Step 13: Analyze your exercise data

[2163] The server analyzes the collected exercise data in real time.

[2164] Input: Exercise data sent from the device.

[2165] Operation: The server analyzes the exercise data and evaluates the user's exercise volume.

[2166] Output: The results of the momentum assessment are saved.

[2167] Step 14: Exercise results feedback

[2168] The server analyzes the exercise results and sends feedback to the user and their family.

[2169] Input: Analysis results of movement data.

[2170] Operation: The server creates feedback and notifies the pet robot that "Today's exercise was very good."

[2171] Output: Exercise evaluation feedback communicated to the user and family.

[2172] (Application example 1)

[2173] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2174] Although elderly people need support in both health management and security, no technology to date has been able to comprehensively meet these needs. In particular, there is a need for a system that can consistently monitor health information, detect anomalies, and detect security risks in the elderly's daily lives.

[2175] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2176] In this invention, the server includes means for collecting user health information, means for analyzing the collected health information, means for detecting abnormalities based on the analysis results, means for instructing a response when an abnormality is detected, means for notifying information about the user, means for monitoring the user's living environment, means for detecting security risks, and means for notifying a warning about detected risks, thereby enabling integrated support for health management and security for the elderly.

[2177] "User's health information" is data related to the user's health condition, such as heart rate, number of steps, body temperature, amount of exercise, and medical history.

[2178] "Means for collection" refers to a device or method for acquiring a user's health information using a sensor, camera, or microphone.

[2179] The "analyzing means" is a system that includes algorithms and programs for processing collected health information and determining its condition or abnormality.

[2180] "Means for detecting abnormalities" refers to a device or method for comparing the analysis results with reference values ​​and determining whether there is an abnormality in the health condition.

[2181] The "means for instructing a response" is a device or method for generating instructions to prompt the user and related parties to take an appropriate response when an abnormality is detected.

[2182] The "notification means" is a device or method for transmitting information about abnormalities or health conditions to the user or related parties.

[2183] "Means for monitoring living environments" are devices such as sensors, cameras, and microphones that continuously monitor the behavior and environment of elderly people in their daily lives.

[2184] "Means for detecting security risks" refers to a system that includes sensors and analytical technologies to detect intruders and unusual events in the elderly's living environment.

[2185] A "means for issuing a warning" is a device or method for issuing a warning to a user or other relevant party about a detected security risk.

[2186] This invention is a system that provides support for elderly people in terms of both health management and security. Specifically, it collects and analyzes data on the user's health and living environment, and if an abnormality is detected, it instructs the user to take action and notifies the user of the necessary information.

[2187] System configuration

[2188] The system consists of the following main components:

[2189] 1. Users: Elderly people who use the system to receive health management and security support.

[2190] 2. Terminal: It is configured as a pet robot and is equipped with hardware such as sensors, cameras, microphones, speakers, and AI processors.

[2191] 3. Server: A cloud-based data center that collects, stores, analyzes, and notifies users of their health and security information.

[2192] Initial Setup

[2193] The user will use their smartphone to perform the initial setup of the system, entering the following information to register the pet robot and the server.

[2194] Basic health information such as name, age, height, weight, and medical history

[2195] Family and emergency contacts

[2196] The server stores this information in a database and maintains records for each user.

[2197] Daily Life Monitoring

[2198] The Pet Robot terminal monitors the user's daily life in the following ways:

[2199] Physical activity: Sensors detect steps, walking speed, posture, etc.

[2200] Conversation content: Record what the user says through the microphone and convert it into text data.

[2201] Facial Expressions: The camera captures the user's facial expressions and analyzes changes in emotions.

[2202] Environmental monitoring: Detects abnormalities in living spaces and entry / exit.

[2203] Health and security assessment

[2204] The server analyzes the data sent from the pet robot in real time.

[2205] Health abnormality detection: Compares with normal behavioral patterns to check for abnormalities. For example, it detects slower walking speed, the possibility of falls, and cognitive decline seen in conversations.

[2206] Comprehensive health assessment: Continuously assess the user's health status from collected data, detecting heart rate fluctuations, lack of physical activity, etc.

[2207] Security anomaly detection: Detect suspicious behavior and intruders in users' living spaces.

[2208] Alerts and Notifications

[2209] If an abnormality is detected, the server will respond by the following means.

[2210] Real-time notifications: If a serious abnormality (such as a fall or a break-in) is detected, emergency contacts will be notified in real time.

[2211] Regular reports: Minor abnormalities (such as changes in walking pattern) are compiled into regular reports and sent to family members or care facilities.

[2212] Local notifications: The robotic pet will notify the user via voice, such as "We recommend that you see a doctor."

[2213] Regular health checks and exercise promotion

[2214] PetRobo also includes features for regular health checks and encouraging exercise.

[2215] Regular health checks: The robot will give voice notifications and ask questions and conduct reaction tests based on the user's health checklist. The results are sent to the server for analysis.

[2216] Exercise promotion: The robotic pet will suggest appropriate exercise to the user, saying things like, "Good morning, let's go for a walk together!" Data collected during exercise is also sent to a server for analysis.

[2217] Data management and advice

[2218] The server centrally manages all data, backs it up in a timely manner, and provides specific health and security advice to users and their associates based on the analysis results.

[2219] Specific examples

[2220] Example of combining cognitive abnormalities and security alerts

[2221] Monitoring: The robotic pet monitors the user's daily activities using cameras and sensors to detect suspicious activity (such as home invasions).

[2222] Evaluation and notification: Based on the analysis results, an abnormal behavior detection report is generated, and the pet robot notifies the elderly person that an intruder has been detected, and also sends an alert to emergency contacts.

[2223] Example prompts for generative AI models

[2224] This system monitors the living environment of the elderly and detects abnormal daily behavior and security risks in real time. Data analyzed by the AI ​​model is immediately notified in the event of an emergency and is output as regular reports during normal times. As a specific example of how the system works, it detects a suspicious intrusion in the middle of the night and notifies the elderly and their emergency contacts.

[2225] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2226] Step 1:

[2227] The user performs the initial setup using a smartphone. The data entered here is basic information such as name, age, height, weight, medical history, family and emergency contact information, etc. This data is sent to the server, which then stores it in a database.

[2228] Step 2:

[2229] The pet robot terminal monitors the user's daily life. Specifically, sensors detect the number of steps, walking speed, and posture, and a camera captures facial expressions. In addition, conversations are recorded via a microphone and converted into text data. This data is sent from the terminal to a server. The input is the user's daily activity data, and the output is data sent to the server.

[2230] Step 3:

[2231] The server analyzes the received data. An AI model (such as TensorFlow) is used here. Specifically, the server compares it with normal behavioral patterns and detects abnormalities in walking speed, heart rate, conversation content, etc. The input is the data sent from the device, and the output is the analysis results.

[2232] Step 4:

[2233] The server detects anomalies based on the analysis results. If an anomaly is detected, the server determines how to respond depending on the type of anomaly. The input is the analysis results, and the output is the anomaly detection status and its type.

[2234] Step 5:

[2235] If an abnormality is detected, the server instructs the appropriate response. Specifically, in the case of a serious abnormality (such as a fall or a break-in), emergency contacts (family members or medical personnel) are notified in real time. In addition, minor abnormalities (such as a change in walking pattern) are compiled into a regular report and sent. The input is the abnormality detection status and type, and the output is notification data.

[2236] Step 6:

[2237] In the event of an emergency, the server will send a notification. Notifications to emergency contacts are sent via SMS or app notifications. At the same time, the pet robot device will also send a local notification to the user via voice, such as "We recommend that you see a doctor." The input is the notification data, and the output is the actual notification content.

[2238] Step 7:

[2239] The robotic pet is set to perform regular health checks. The server sends a checklist to the robotic pet, which then notifies the user in advance by voice and asks questions and conducts reaction tests based on the checklist. The results are sent back to the server, which analyzes them. The input is the checklist instructions from the server, and the output is the check results.

[2240] Step 8:

[2241] The server centrally manages data and backs it up in a timely manner. Furthermore, based on the analysis results, the system provides specific advice on health maintenance and security measures to users and their associates. The input is all of the user's data and the analysis results, and the output is advice content.

[2242] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2243] The present invention is a system for managing and caring for the health of elderly people using a pet robot equipped with AI, and also combines it with an emotion engine that recognizes the user's emotions. Specific embodiments of the system are described below.

[2244] System configuration

[2245] This system mainly consists of the following three components, which work in conjunction with each other to support the lives of the elderly.

[2246] 1. Users: Elderly people who use the system to receive health management and care.

[2247] 2. Terminal: The pet robot itself. It contains hardware such as sensors, cameras, microphones, speakers, AI processors, and emotion engines.

[2248] 3. Server: A cloud-based data center that collects, stores, and analyzes users' health information and notifies them of the results.

[2249] Initial Setup

[2250] The user uses a smartphone or PC to perform the initial setup of the system. This involves entering health information such as name, age, height, weight, and medical history, and registering the pet robot with the server. The server stores this information in a database and manages records for each user.

[2251] Daily Life Monitoring

[2252] PetRobo monitors the user's daily life and collects the following data:

[2253] Physical activity: Sensors detect steps, walking speed, posture, etc.

[2254] Conversation content: What the user says is recorded through the microphone and converted into text data.

[2255] Facial Expressions and Emotions: The camera captures the user's facial expressions and the emotion engine recognizes their emotions, allowing the robot to respond according to the user's emotional state.

[2256] Health assessment

[2257] The server analyzes the data sent from the pet robot in real time, for example, by performing the following processes:

[2258] Anomaly detection: Compares with normal behavioral patterns to see if there are any abnormalities, such as slower walking speed, possible falls, or cognitive decline in conversation.

[2259] Health Assessment: Based on regularly collected data, the device comprehensively assesses the user's health status, such as detecting heart rate fluctuations and lack of physical activity.

[2260] Emotion assessment: Analyzes user emotions recognized by the emotion engine to detect early signs of stress or anxiety.

[2261] Alerts and Notifications

[2262] If an abnormality is detected, the server will respond by the following means.

[2263] Instant Notification: If a serious abnormality (e.g., a fall) is detected, an SMS or app notification will be sent to ...

Claims

1. a means for collecting health information of a user; a means of analyzing the collected health information; means for detecting anomalies based on the analysis results; A means for instructing a response when an abnormality is detected; means for notifying information about a user; A system including:

2. a means for monitoring a user's speech and behavior to detect cognitive decline; The system according to claim 1, further comprising means for early detection of dementia based on the detection results.

3. a means for encouraging a user to exercise; 10. The system of claim 1, further comprising means for collecting exercise data and evaluating the amount of exercise.

Images