Health care system, method, storage medium and computer program product

Abstract

The present application discloses a healthy elderly care system, method, storage medium and computer program product, which relates to the field of elderly care service technology. The healthy elderly care system includes a user information collection module for collecting user voice information and user visual information, a voice analysis agent for performing voice analysis on user voice information, a visual analysis agent for performing visual analysis on user visual information, a mental health agent for performing mental health analysis based on the voice analysis results and the visual analysis results, a central control agent for generating digital human interaction information by integrating the analysis results of each agent, and a digital human interaction module for outputting digital human interaction information. The present application can effectively monitor and improve the mental health of the elderly.

Description

Technical Field

[0001] The present application relates to the field of elderly care service technology, and in particular to a healthy elderly care system, method, storage medium and computer program product. Background Art

[0002] With the acceleration of the aging process of society, the health management and care of the elderly has become a social issue that has received increasing attention. Traditional elderly care services mainly focus on maintaining the physiological health of the elderly, including regular physical examinations, disease prevention and treatment, and other measures.

[0003] However, while paying attention to the physical health of the elderly, their mental health should not be neglected either. The elderly often face problems such as increased loneliness and reduced social activities, which not only affect their quality of life, but may also cause a series of psychological disorders, such as depression and anxiety.

[0004] Therefore, how to effectively monitor and improve the mental health of the elderly has become an important issue that needs to be urgently addressed in the current elderly care service field. Summary of the invention

[0005] The main purpose of this application is to provide a healthy elderly care system, method, storage medium and computer program product, aiming to solve the technical problem of inadequate mental health management of the elderly in traditional elderly care services.

[0006] To achieve the above objectives, the present application provides a healthy elderly care system, the method comprising:

[0007] The user information collection module includes a voice information collection unit and a visual information collection unit, wherein the voice information collection unit is used to collect user voice information, and the visual information collection unit is used to collect user visual information;

[0008] A speech analysis agent, used to perform speech analysis on the user's speech information and generate a speech analysis result;

[0009] A visual analysis agent, used to perform visual analysis on the user's visual information and generate visual analysis results;

[0010] A mental health agent, used to perform mental health analysis based on the speech analysis result and the visual analysis result, and generate a mental health analysis result;

[0011] A central control agent, configured to generate digital human interaction information according to the speech analysis result, the visual analysis result and the mental health analysis result, wherein the digital human interaction information includes at least one of digital human speech interaction information and digital human visual interaction information;

[0012] The digital human interaction module is used to output the digital human interaction information.

[0013] In one embodiment, the user information collection module further includes a physiological information collection unit, and the physiological information collection unit is used to collect user physiological information;

[0014] The system also includes a physiological health intelligent agent, which is used to perform physiological health analysis based on the user's physiological information and generate physiological health analysis results;

[0015] The central control intelligent agent is also used to generate digital human interaction information based on the voice analysis results, the visual analysis results, the mental health analysis results and the physiological health analysis results.

[0016] In one embodiment, the user physiological information includes basic physiological index information and medical examination index information;

[0017] The basic physiological index information includes height, weight, heart rate, pulse, blood sugar, blood pressure and blood oxygen;

[0018] The medical examination index information includes blood test results, urine test results, medical biochemical indicators and medical imaging data.

[0019] In one embodiment, the physiological health analysis result includes a physiological health report and a physiological health guide;

[0020] The physical health report includes:

[0021] The status of basic physiological indicators, the status of medical examination indicators, the evaluation results of basic physiological indicators, the evaluation results of medical examination indicators, the analysis results of abnormal indicators, the results of chronic disease risk assessment, the results of exercise capacity assessment, and the comprehensive evaluation results of physiological health;

[0022] The physical health guidance includes:

[0023] Dietary advice, exercise advice, guidance on medication use, lifestyle adjustment advice, regular physical examination planning, and emergency intervention advice for physical health;

[0024] The digital human interaction module is also used to output the physiological health report and the physiological health guidance.

[0025] In one embodiment, the speech analysis results include speech-to-text recognition results, keyword extraction results, topic analysis results, emotion recognition results, stress level assessment results, cognitive function monitoring results, language fluency analysis results and social interaction pattern analysis results.

[0026] In one embodiment, the visual analysis results include facial expression recognition results, micro-expression analysis results, head posture and body posture reports, behavior recognition results, eye movement trajectories, activity trajectories, activity level summaries, and environmental inspection reports.

[0027] In one embodiment, the mental health analysis results include a mental health report and mental health guidance;

[0028] The mental health report includes:

[0029] Emotional trend charts, emotional stability assessment results, depression tendency screening results, stress level assessment results, cognitive function assessment results, social interaction evaluation, abnormal emotion detection results, mental illness risk assessment results, and comprehensive mental health assessment results;

[0030] The mental health guidance includes:

[0031] Emotion regulation suggestions, relaxation and stress relief suggestions, cognitive training suggestions, social activity suggestions, and emergency mental health intervention suggestions;

[0032] The digital human interaction module is also used to output the mental health report and the mental health guidance.

[0033] In addition, to achieve the above-mentioned purpose, the present application also provides a healthy elderly care method, which is applied to the healthy elderly care system as described above, wherein the system includes a user information collection module, a voice analysis agent, a visual analysis agent, a mental health agent, a central control agent and a digital human interaction module, wherein the user information collection module includes a voice information collection unit and a visual information collection unit;

[0034] The method comprises:

[0035] Collecting user voice information through the voice information collection unit, and collecting user visual information through the visual information collection unit;

[0036] Calling the speech analysis agent to perform speech analysis on the user speech information and generate a speech analysis result;

[0037] Calling the visual analysis agent to perform visual analysis on the user's visual information and generate a visual analysis result;

[0038] Calling the mental health agent to perform mental health analysis based on the speech analysis result and the visual analysis result to generate a mental health analysis result;

[0039] Calling the central control agent to generate digital human interaction information according to the speech analysis result, the visual analysis result and the mental health analysis result;

[0040] The digital human interaction information is outputted through the digital human interaction module.

[0041] In addition, to achieve the above-mentioned purpose, the present application also provides a storage medium, which is a computer-readable storage medium, and a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, the steps of the healthy aging method described above are implemented.

[0042] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the healthy aging method as described above are implemented.

[0043] The present application provides a healthy elderly care system, method, storage medium and computer program product, the healthy elderly care system includes a user information collection module for collecting user voice information and user visual information, a voice analysis agent for voice analysis of user voice information, a visual analysis agent for visual analysis of user visual information, a mental health agent for mental health analysis based on the voice analysis results and visual analysis results, a central control agent for generating digital human interaction information by integrating the analysis results of each agent, and a digital human interaction module for outputting digital human voice interaction information and digital human visual interaction information. Through the healthy elderly care system, the present application can effectively monitor and improve the mental health of the elderly, thereby solving the technical problem of inadequate mental health management of the elderly in traditional elderly care services. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0045] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0046] Figure 1 A structural diagram of the first embodiment of the health care system for the present application;

[0047] Figure 2 A structural diagram of the second embodiment of the health care system for the present application;

[0048] Figure 3 A schematic diagram of the structure of a health care system for the specific implementation of this application;

[0049] Figure 4 A flowchart diagram is provided for this application of healthy elderly care method.

[0050] Description of Figure Numbers:

[0051] 100. Health care system for the elderly; 1. User information collection module; 11. Voice information collection unit; 12. Visual information collection unit; 13. Physiological information collection unit; 2. Voice analysis agent; 3. Visual analysis agent; 4. Mental health agent; 5. Central control agent; 6. Digital human interaction module; 7. Physiological health agent.

[0052] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0053] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0054] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0055] At present, traditional elderly care services mainly focus on maintaining the physical health of the elderly, including regular physical examinations, disease prevention and treatment, etc., but lack the management of the mental health of the elderly.

[0056] The main solution of the embodiment of the present application is a healthy elderly care system, which includes: a user information collection module, including a voice information collection unit and a visual information collection unit, the voice information collection unit is used to collect user voice information, and the visual information collection unit is used to collect user visual information; a voice analysis agent, used to perform voice analysis on the user voice information and generate a voice analysis result; a visual analysis agent, used to perform visual analysis on the user visual information and generate a visual analysis result; a mental health agent, used to perform mental health analysis based on the voice analysis result and the visual analysis result, and generate a mental health analysis result; a central control agent, used to generate digital human interaction information based on the voice analysis result, the visual analysis result and the mental health analysis result, wherein the digital human interaction information includes at least one of digital human voice interaction information and digital human visual interaction information; a digital human interaction module, used to output the digital human interaction information.

[0057] The embodiment of the present application can effectively monitor and improve the mental health of the elderly through the healthy elderly care system, thereby solving the technical problem of inadequate mental health management of the elderly in traditional elderly care services.

[0058] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0059] This application proposes a health care system for the first embodiment, please refer to Figure 1 , Figure 1 This is a structural diagram of the first embodiment of the health care system for the present application.

[0060] In this embodiment, the healthy elderly care system 100 includes: a user information collection module 1, including a voice information collection unit 11 and a visual information collection unit 12, wherein the voice information collection unit 11 is used to collect user voice information, and the visual information collection unit 12 is used to collect user visual information; a voice analysis agent 2, used to perform voice analysis on the user voice information and generate a voice analysis result; a visual analysis agent 3, used to perform visual analysis on the user visual information and generate a visual analysis result; a mental health agent 4, used to perform mental health analysis based on the voice analysis result and the visual analysis result, and generate a mental health analysis result; a central control agent 5, used to generate digital human interaction information based on the voice analysis result, the visual analysis result and the mental health analysis result, wherein the digital human interaction information includes at least one of digital human voice interaction information and digital human visual interaction information; a digital human interaction module 6, used to output the digital human interaction information.

[0061] In this embodiment, the user information collection module 1 is responsible for collecting the user's voice information and visual information, and includes two sub-units, wherein the voice information collection unit 11 records the user's voice information, that is, the user's language information, through a microphone or other audio capture device, and the visual information collection unit 12 records the user's facial expressions, body movements and other visual information, that is, the user's visual information, through a camera or other image capture device.

[0062] In this embodiment, the speech analysis agent 2 is a special software, algorithm or model for processing and analyzing the speech data (ie, user speech information) acquired by the speech information acquisition unit 11 and generating speech analysis results.

[0063] In a feasible implementation, the speech analysis results include speech-to-text recognition results, keyword extraction results, topic analysis results, emotion recognition results, stress level assessment results, cognitive function monitoring results, language fluency analysis results, and social interaction pattern analysis results.

[0064] In this embodiment, the speech analysis results generated by the speech analysis agent 2 include information in multiple dimensions, which can comprehensively reflect the user's speech characteristics and psychological state from different aspects.

[0065] It should be noted that speech-to-text recognition is the process of converting the user's voice signal into text form through automatic speech recognition. The speech-to-text recognition result provides a text record of what the user said, which is convenient for subsequent processing and archiving, and provides a data basis for subsequent text processing tasks such as keyword extraction and topic analysis, so that nursing staff or systems can more intuitively understand the specific expression of the user.

[0066] Keyword extraction is to extract key words or phrases representing the main content from the speech-to-text recognition results through the keyword extraction algorithm in natural language processing. The keyword extraction results can help the system quickly grasp the main content and focus of the user's expression, help determine the specific topics discussed by the user, understand the user's needs, and provide direction for subsequent analysis.

[0067] Topic analysis uses topic modeling technology to analyze speech-to-text recognition results to determine the subject or topic category of the user's conversation. The topic analysis results classify the user's conversation content into different topics for easy management and analysis. It can help the system discover the user's interests and areas of concern, provide a basis for personalized services, and can also be used to track user topic changes over the long term and discover potential trends and patterns.

[0068] Emotion recognition is a process of using sentiment analysis technology, combining the acoustic features in the user's voice information (such as pitch and speaking speed) and the text features in the speech-to-text recognition results (such as word choice), and using machine learning models to determine the user's emotional state when speaking, such as happiness, sadness, anger, etc. The emotion recognition results can be used to monitor the user's emotional changes in real time, detect psychological problems in a timely manner, and combine with other analysis results to comprehensively evaluate the user's mental health status.

[0069] Stress level assessment uses machine learning to use speech features (such as speaking speed, pauses, tone, etc.) in user voice information to assess the user's stress level. The stress level assessment results can be used to monitor the user's stress level in real time and detect high stress states in a timely manner.

[0070] Cognitive function monitoring is to analyze the user's speech-to-text results and user voice information over a period of time through machine learning to evaluate the user's cognitive abilities, such as memory, attention, language comprehension, etc. The cognitive function monitoring results can be used to detect changes in the user's cognitive functions in real time.

[0071] Language fluency analysis is to analyze speech features, combine natural language processing technology, and use statistical methods or machine learning models to evaluate the fluency of user language expression, including whether there are repetitions, pauses, grammatical errors, etc. The results of language fluency analysis can be used to detect whether the user has language barriers or other related diseases.

[0072] Social interaction pattern analysis uses conversation analysis and social psychology theory combined with machine learning models to analyze users' social behavior patterns in conversations, such as whether they actively participate in conversations, whether they have avoidance behaviors, etc. The results of social interaction pattern analysis can be used to understand users' social skills and social needs, and to promptly detect whether users have social anxiety or loneliness.

[0073] This implementation method uses advanced speech analysis technology to comprehensively monitor the user's mental health status from multiple dimensions, and provides a comprehensive user portrait through meticulous analysis results, so that the system can more accurately identify the user's emotional changes, stress levels, cognitive functions, etc., and improve the accuracy of mental health assessment. Through the digital human interaction module 6, a more personalized mental health management is provided to the user in a natural and humanized interactive way, and then through continuous monitoring and timely intervention, the mental health status of the elderly is improved, loneliness and depression are reduced, and physical and mental health is promoted.

[0074] In this embodiment, the visual analysis agent 3 is a specialized software, algorithm or model for processing and analyzing the visual data (ie, user visual information) acquired by the visual information acquisition unit 12 and generating visual analysis results.

[0075] In a feasible implementation, the visual analysis results include facial expression recognition results, micro-expression analysis results, head posture and body posture reports, behavior recognition results, eye movement trajectories, activity trajectories, activity level summaries and environmental inspection reports.

[0076] In this embodiment, the speech analysis results generated by the visual analysis agent 3 include information in multiple dimensions, which can comprehensively reflect the user's characteristics and psychological state from different aspects.

[0077] It should be noted that facial expression recognition is to extract the user's facial features from the user's visual information and use machine learning to identify the user's main facial expressions, such as happiness, sadness, anger, surprise, etc. The results of facial expression recognition can be used to monitor the user's emotional state in real time and detect psychological problems in a timely manner.

[0078] Micro-expression analysis is to extract subtle changes in facial expressions from user visual information and use machine learning to identify the user's true emotional state. The results of micro-expression analysis can be used to discover the emotions that users may hide, thereby more accurately capturing the user's true emotions, improving the accuracy of mental health assessments, and providing more comprehensive mental health support.

[0079] Head posture and body posture estimation uses posture estimation technology and machine learning to analyze the user's head and body posture, including head tilt angle, body posture, etc. Head posture and body posture reports can be used to understand the user's posture changes and determine their comfort and activity status.

[0080] Behavior recognition is the process of identifying user behaviors and actions through machine learning to determine the user's current behavior or action. The results of behavior recognition can be used to understand the user's daily behavior patterns, provide personalized mental health advice and support, and detect abnormal behaviors, thereby promptly warning of potential safety issues.

[0081] Eye movement trajectories are obtained by tracking the user's eye movement trajectories (including gaze points, scanning paths, etc.) through eye tracking and trajectory analysis. They can be used to understand the user's attention distribution and evaluate the user's cognitive function.

[0082] The activity trajectory is obtained by recording the user's movement trajectory and activity range within a certain period of time through location tracking and trajectory analysis. It can be used to monitor the user's activity range and frequency, evaluate their activity level, and discover abnormal activity trajectories, thereby promptly warning of potential security risks.

[0083] The activity level summary is a summary report of the user's activity level generated by comprehensively analyzing the user's activity trajectory and behavior patterns. It can be used to understand the user's daily life patterns and evaluate the user's overall activity level.

[0084] The environmental inspection report is an analysis of the conditions of the user's environment, including light, temperature, obstacles, etc. It can be used to discover safety hazards in the environment so that timely measures can be taken to eliminate them. It can also be used to evaluate the comfort of the user's environment. Combined with other analysis results, it can be used to analyze the user's mental health and even physical health, and make recommendations for the environment.

[0085] This implementation method uses advanced visual analysis technology to comprehensively monitor the user's mental health status from multiple dimensions, and provides a comprehensive user portrait through meticulous analysis results, so that the system can more accurately identify the user's emotional changes, behavioral patterns, environmental conditions, etc., and improve the accuracy of mental health assessment. Through the digital human interaction module 6, a more personalized mental health management is provided to the user in a natural and humanized interactive way, and then through continuous monitoring and timely intervention, the mental health status of the elderly is improved, loneliness and depression are reduced, and physical and mental health is promoted.

[0086] In this embodiment, the mental health agent 4 is a specialized software, algorithm or model that is used to perform a mental health analysis on the user based on input information (such as the speech analysis results generated by the speech analysis agent 2 and the visual analysis results generated by the visual analysis agent 3) and generate a mental health analysis result.

[0087] In a feasible implementation, the mental health analysis results include a mental health report and mental health guidance; the mental health report includes: an emotion trend chart, an emotion stability assessment result, a depression tendency screening result, a stress level assessment result, a cognitive function assessment result, a social interaction evaluation, an abnormal emotion detection result, a mental illness risk assessment result, and a comprehensive mental health assessment result; the mental health guidance includes: emotion regulation suggestions, relaxation and stress relief suggestions, cognitive training suggestions, social activity suggestions, and mental health emergency intervention suggestions; the digital human interaction module 6 is also used to output the mental health report and the mental health guidance.

[0088] In this embodiment, the digital human interaction module 6 can output the mental health report and mental health guidance through a display screen, printer, etc., and can also be associated with the user's mobile phone to output the mental health report and mental health guidance through text messages, emails, etc.

[0089] It should be noted that the mental health report in this embodiment is a detailed document generated based on comprehensive analysis, which aims to provide the user's current mental health status and its changing trends.

[0090] Among them, the mood trend chart is used to show the trend of users' mood changes over a period of time; the mood stability assessment results are used to determine the stability of users' emotions and judge whether their mood fluctuations are within the normal range; the depression tendency screening results are used to screen whether users have depression tendencies and provide a preliminary depression risk assessment; the stress level assessment results are used to determine the user's stress level and judge whether they are in a high-stress state; the cognitive function assessment results are used to determine the user's cognitive function level, such as memory, attention, language comprehension, etc., and judge whether the user has cognitive impairment; the social interaction evaluation is used to understand the user's social status and judge their social skills and social needs; the abnormal emotion detection results are used to detect whether the user has abnormal emotions, such as extreme mood swings, persistent negative emotions, etc., to facilitate timely detection of abnormal emotions, provide emergency intervention suggestions, and prevent emotional problems from worsening; the mental illness risk assessment results are used to determine the user's risk of mental illness, such as anxiety, depression, etc., thereby providing mental illness risk warnings and suggesting that users seek professional consultation and treatment; the comprehensive mental health assessment results combine all mental health indicators to provide a comprehensive mental health status assessment.

[0091] It should also be noted that the mental health guidance in this embodiment is specific suggestions generated based on the mental health report, which aims to help users improve their mental health.

[0092] Among them, the emotion regulation suggestion is a personalized emotion regulation suggestion generated by combining the emotion trend chart and the emotion stability assessment results. It provides specific emotion regulation methods, such as deep breathing, meditation, mindfulness exercises, etc., which can help users learn to effectively manage emotions and improve emotional stability. Relaxation and decompression suggestions are personalized relaxation and decompression suggestions generated by combining the stress level assessment results. It provides specific relaxation and decompression methods, such as progressive muscle relaxation, yoga, music therapy, etc., which can help users reduce stress and improve psychological comfort. Cognitive training suggestions are personalized cognitive training suggestions generated by combining the cognitive function assessment results. It provides cognitive training methods and suggestions, such as memory training, attention training, etc., which can help users improve cognitive function and prevent cognitive decline. Social activity suggestions are personalized social activity suggestions generated by combining the social interaction evaluation results. It provides specific social activity suggestions, such as participating in community activities, interacting with family and friends, etc., which can help users enhance their social skills and reduce loneliness and social anxiety. Mental health emergency intervention suggestions are emergency intervention suggestions generated by combining the abnormal emotion detection results and the mental illness risk assessment results. It provides psychological intervention measures that should be taken in an emergency, such as contacting a psychological counselor, emergency help, etc., which can provide users with timely and effective intervention in an emergency to prevent psychological problems from worsening.

[0093] This implementation method utilizes advanced mental health analysis technology and integrates the analysis results generated by other intelligent agents to comprehensively monitor the user's mental health status from multiple dimensions, so that the system can more accurately identify the user's mental health status and improve the accuracy of mental health assessment. Based on a more comprehensive, detailed and accurate mental health report, the digital human interaction module 6 provides users with more personalized mental health management in a natural and humanized interactive way, and then through continuous monitoring and timely intervention, improves the mental health of the elderly, reduces loneliness and depression, and promotes physical and mental health.

[0094] In this embodiment, the central control intelligent agent 5 is a special software, algorithm or model used to integrate the analysis results generated by each intelligent agent and generate digital human interaction information, so as to interact with the user in a natural and humanized interactive way through the digital human interaction module 6, provide users with more personalized mental health management, and thus improve the mental health of the elderly.

[0095] It should be noted that the digital human interaction information includes but is not limited to the digital human voice interaction information (i.e. the digital human's synthesized voice) and the digital human visual interaction information (such as the digital human's expression and movement). The digital human interaction information is intended to provide users with more personalized mental health management in a natural and humanized interactive way, thereby improving the mental health of the elderly.

[0096] In this embodiment, the digital human interaction module 6 is responsible for direct interactive communication with the user, and includes at least a display screen for displaying the digital human image and a speaker for outputting the digital human voice.

[0097] Among them, the display screen displays a specific digital human image, including the digital human's expression and movements, according to the digital human visual interaction information generated by the central control intelligent body 5, and the audio outputs a specific digital human voice according to the digital human voice interaction information generated by the central control intelligent body 5. Thus, through the cooperation of the display screen and the audio, a natural and humanized interactive method is used to provide users with more personalized mental health management and improve the mental health of the elderly.

[0098] Through the healthy elderly care system 100, the present application can effectively monitor and improve the mental health of the elderly, thereby solving the technical problem of inadequate mental health management of the elderly in traditional elderly care services.

[0099] Based on the above embodiments, the present application proposes a health care system 100 according to a second embodiment.

[0100] In this embodiment, the same or similar contents as those in the above embodiments can be referred to the above introduction and will not be described in detail later.

[0101] Please refer to Figure 2 , Figure 2 This is a structural diagram of the second embodiment of the health care and elderly care system of the present application.

[0102] In this embodiment, the user information acquisition module 1 also includes a physiological information acquisition unit 13, which is used to collect user physiological information; the system also includes a physiological health intelligent agent 7, which is used to perform physiological health analysis based on the user's physiological information and generate physiological health analysis results; the central control intelligent agent 5 is also used to generate digital human interaction information based on the voice analysis results, the visual analysis results, the mental health analysis results and the physiological health analysis results.

[0103] In this embodiment, the user information collection module 1 is also responsible for collecting the user's physiological information, and includes another subunit, namely the physiological information collection unit 13. The physiological information collection unit 13 collects the user's physiological information, that is, the user's language information, through health indicator monitoring devices such as health bracelets, blood glucose meters, and weight scales.

[0104] In this embodiment, the physiological health agent 7 is a special software, algorithm or model for processing and analyzing the physiological data (ie, the user's physiological information) acquired by the physiological information acquisition unit 13 and generating physiological health analysis results.

[0105] In a feasible implementation manner, the user physiological information includes basic physiological indicator information and medical examination indicator information; the basic physiological indicator information includes height, weight, heart rate, pulse, blood sugar, blood pressure and blood oxygen; the medical examination indicator information includes blood test results, urine test results, medical biochemical indicators and medical imaging data.

[0106] It should be noted that basic physiological indicator information refers to data on the user's basic vital signs and daily health status obtained through non-invasive or simple measurement methods, and medical examination indicator information refers to data on the concentration or functional status of specific substances in the user's body obtained through laboratory tests or other professional medical equipment.

[0107] It is understandable that basic physiological indicator information may also include sleep quality (sleep duration, deep sleep time, light sleep time, etc.).

[0108] In a feasible implementation, the physiological health analysis results include a physiological health report and physiological health guidance; the physiological health report includes: basic physiological indicator status, medical examination indicator status, basic physiological indicator evaluation results, medical examination indicator evaluation results, abnormal indicator analysis results, chronic disease risk evaluation results, exercise capacity evaluation results, and physiological health comprehensive evaluation results; the physiological health guidance includes: dietary advice, exercise advice, drug use guidance, lifestyle adjustment advice, regular physical examination planning, and physiological health emergency intervention advice; the digital human interaction module 6 is also used to output the physiological health report and the physiological health guidance.

[0109] In this embodiment, the digital human interaction module 6 can output physiological health reports and physiological health guidance through a display screen, printer, etc., and can also be associated with the user's mobile phone to output physiological health reports and physiological health guidance through text messages, emails, etc.

[0110] It should be noted that the physiological health report in this embodiment is a detailed document generated based on comprehensive analysis, and is intended to provide the user's current physiological health status and its changing trends.

[0111] Among them, the basic physiological index status is used to display the specific values ​​of the user's basic physiological indicators (such as heart rate, blood pressure, blood oxygen saturation, body temperature, etc.), which can help the user and the system intuitively understand the user's basic physiological status. The medical test index status is used to display the specific values ​​of the user's medical test indicators (such as blood sugar, blood lipids, liver function indicators, etc.), which can help the system understand the concentration or functional status of specific substances in the user's body. The basic physiological index evaluation results are the results of evaluating the user's basic physiological indicators to determine whether they are within the normal range, providing a quantitative evaluation of the basic physiological indicators, which helps to discover abnormal conditions in a timely manner. The medical test index evaluation results are the results of evaluating the user's medical test indicators to determine whether they are within the normal range, providing a quantitative evaluation of the medical test indicators, which helps to discover potential health problems in a timely manner. The abnormal indicator analysis results are obtained after identifying and analyzing the abnormal values ​​in the user's physiological indicators, providing an abnormal indicator report with detailed data, which helps to discover abnormal indicators in a timely manner and provide targeted intervention suggestions. The chronic disease risk assessment results provide chronic disease risk warnings, which can be used to assess the risk of users suffering from chronic diseases (such as hypertension, diabetes, heart disease, etc.). The exercise capacity assessment results provide the user's exercise capacity assessment, which can be used to assess the user's exercise capacity and physical condition. The comprehensive physiological health assessment results integrate all physiological indicators and assessment results to generate an overall physiological health assessment report, providing a comprehensive physiological health status assessment, which helps to provide users with personalized health management suggestions.

[0112] It should also be noted that the physiological health guidance in this embodiment is a specific suggestion generated based on the physiological health report, which is intended to help the user improve his physiological health status.

[0113] Among them, dietary advice is a personalized dietary advice generated by combining the user's physiological indicators and living habits, providing specific dietary advice, such as a balanced diet, a low-salt and low-fat diet, etc., aiming to help users adjust their eating habits and improve their physical health. Exercise advice is a personalized exercise advice generated by combining the user's athletic ability and health status, providing specific exercise advice, such as exercise methods and exercise duration, etc., aiming to help users strengthen their physical fitness and improve their athletic ability. Medication use guidance is a personalized medication use guidance generated by combining the user's medical examination indicators and doctor's prescriptions, providing specific guidance on medication use, such as medication time, dosage, precautions, etc., aiming to ensure that users use medication correctly and avoid drug abuse or misuse. Lifestyle adjustment advice is a personalized lifestyle adjustment advice generated by combining the user's physiological indicators and living habits, providing specific lifestyle adjustment advice, such as quitting smoking, limiting alcohol, regular work and rest, etc., aiming to help users improve their lifestyle and improve their quality of life. Regular physical examination planning is a personalized physical examination planning generated by combining the user's physiological indicators and health status, providing a specific plan for regular physical examinations, including physical examination items, frequency, etc., aiming to remind users to undergo regular physical examinations and promptly discover and deal with health problems. Physical health emergency intervention recommendations are generated by combining the abnormal indicator analysis results and chronic disease risk assessment results. They provide physical health intervention measures that should be taken in emergency situations, such as immediate medical treatment, emergency contacts, etc., to provide users with timely and effective intervention in emergency situations to prevent health problems from worsening.

[0114] Based on mental health management, this embodiment further provides users with physical health maintenance, and can input the physiological health analysis results into the mental health intelligent agent 4, and combine the physiological health analysis results to estimate the user's mental health status more comprehensively and accurately, thereby providing more limited mental health management and more deeply improving the mental health of the elderly.

[0115] In order to facilitate understanding of the technical solutions and concepts of the above embodiments of the present application, a specific embodiment is listed below:

[0116] like Figure 3 As shown, the specific scheme of this specific embodiment is designed as follows:

[0117] 1. Use local or cloud-based ASR (Automatic Speech Recognition) models, LLM (Large Language Model) models, and large visual models to build an Agent that runs in the background, combined with a virtual digital human image as a front-end interactive display.

[0118] 2. Use the controller to connect multiple health indicator detection devices, pre-process the data locally, and then report it to the cloud or local server.

[0119] 3. Using the multi-agent collaboration model, first there is an agent named "Honghong" (i.e., the central control intelligent agent 5) to manage and dispatch other agents. By publishing and receiving messages, various functions can be completed. At the same time, "Honghong" will connect to the digital human (i.e., the digital human interaction module 6), and the digital human will broadcast the information to the user.

[0120] 4. Voice analysis Agent (i.e., voice analysis agent 2): can analyze and process the audio information received by the microphone (i.e., the user voice information collected by the voice information collection unit 11), recognize and analyze the user's voice commands in real time, and synchronize the user commands and analysis results to the "Honghong" Agent.

[0121] 5. Visual Analysis Agent (i.e. Visual Analysis Agent 3): It can analyze the camera image (i.e. the user visual information collected by the visual information collection unit 12), track the elderly's actions and environmental changes in real time, and generate feedback messages in a fixed format, which are synchronized to the "Honghong" Agent. At the same time, it accepts the visual analysis initiated actively and identifies and analyzes the objects in the image in combination with the user's instructions.

[0122] 6. Physical health Agent (i.e. physiological health agent 7): By reading the data from the controller in real time, whenever the health detection equipment reports the measurement results such as heart rate, blood oxygen and weight (i.e. the user's physiological information collected by the physiological information collection unit 13), it records and analyzes the current data, and generates a health report (i.e. physiological health report) output according to a certain period (weekly, monthly, etc.), and provides appropriate health advice (i.e. physiological health guidance) based on the user's characteristics, and synchronizes the result message to the "Honghong" Agent.

[0123] 7. Mental Health Agent (i.e. Mental Health Agent 4): An agent with professional knowledge that can perform mental health analysis and counseling. Through comprehensive analysis of the daily conversation content between the user and the digital human (i.e. voice analysis results), daily activity trajectories (i.e. visual analysis results), physical health indicators (i.e. physiological health analysis results), etc., it generates a health report (i.e. mental health report) output according to a certain period (weekly, monthly, etc.), provides users with appropriate mental health counseling (i.e. mental health guidance), and provides sufficient emotional value.

[0124] It should be noted that the above examples are only used to assist in understanding the present application and do not constitute a limitation on the cross-device application transfer method of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0125] In addition, the present application also provides a healthy elderly care method, which is applied to the healthy elderly care system in the above-mentioned embodiment, the system includes a user information collection module, a voice analysis agent, a visual analysis agent, a mental health agent, a central control agent and a digital human interaction module, and the user information collection module includes a voice information collection unit and a visual information collection unit;

[0126] like Figure 4 As shown, the healthy elderly care method provided by this application includes steps S100 to S600:

[0127] Step S100, collecting user voice information through the voice information collection unit, and collecting user visual information through the visual information collection unit;

[0128] Step S200, calling the voice analysis agent to perform voice analysis on the user voice information and generate a voice analysis result;

[0129] Step S300, calling the visual analysis agent to perform visual analysis on the user's visual information and generate a visual analysis result;

[0130] Step S400, calling the mental health agent to perform mental health analysis according to the speech analysis result and the visual analysis result to generate a mental health analysis result;

[0131] Step S500, calling the central control agent to generate digital human interaction information according to the speech analysis result, the visual analysis result and the mental health analysis result;

[0132] Step S600: outputting the digital human interaction information through the digital human interaction module.

[0133] The healthy elderly care method provided by this application can solve the technical problem of inadequate mental health management of the elderly in traditional elderly care services. Compared with the prior art, the beneficial effects of the healthy elderly care method provided by this application are the same as the beneficial effects of the healthy elderly care system provided by the above embodiment, which will not be repeated here.

[0134] In addition, the present application also provides a storage medium, which is a computer-readable storage medium and has computer-readable program instructions (i.e., computer programs) stored thereon, and the computer-readable program instructions are used to execute the healthy aging method in the above-mentioned embodiment.

[0135] The storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0136] The above storage medium may be included in the health care and elderly care system; or it may exist independently without being assembled into the health care and elderly care system.

[0137] The above-mentioned storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the health and elderly care system, the health and elderly care system: collects user voice information through the voice information collection unit, and collects user visual information through the visual information collection unit; calls the voice analysis agent to perform voice analysis on the user voice information and generate voice analysis results; calls the visual analysis agent to perform visual analysis on the user visual information and generate visual analysis results; calls the mental health agent to perform mental health analysis based on the voice analysis results and the visual analysis results, and generates mental health analysis results; calls the central control agent to generate digital human interaction information based on the voice analysis results, the visual analysis results and the mental health analysis results; outputs the digital human interaction information through the digital human interaction module.

[0138] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0139] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0140] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0141] The storage medium provided in this application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned healthy elderly care method, and can solve the technical problem of inadequate mental health management of the elderly in traditional elderly care services. Compared with the prior art, the beneficial effects of the storage medium provided in this application are the same as those of the healthy elderly care method provided in the above-mentioned embodiment, and will not be elaborated here.

[0142] In addition, the present application also provides a computer program product, including a computer program, which implements the steps of the healthy aging method as described above when executed by a processor.

[0143] The computer program product provided by this application can solve the technical problem of inadequate mental health management of the elderly in traditional elderly care services. Compared with the prior art, the beneficial effects of the computer program product provided by this application are the same as those of the healthy elderly care method provided by the above embodiment, and will not be repeated here.

[0144] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0145] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A healthy elderly care system, characterized in that: The system comprises: The user information collection module includes a voice information collection unit and a visual information collection unit, wherein the voice information collection unit is used to collect user voice information, and the visual information collection unit is used to collect user visual information; A speech analysis agent, used to perform speech analysis on the user's speech information and generate a speech analysis result; A visual analysis agent, used to perform visual analysis on the user's visual information and generate visual analysis results; A mental health agent, used to perform mental health analysis based on the speech analysis result and the visual analysis result, and generate a mental health analysis result; A central control agent, used to generate digital human interaction information according to the speech analysis result, the visual analysis result and the mental health analysis result, wherein the digital human interaction information includes at least one of digital human speech interaction information and digital human visual interaction information; The digital human interaction module is used to output the digital human interaction information.

2. The health care system for the elderly as claimed in claim 1, characterized in that: The user information collection module also includes a physiological information collection unit, and the physiological information collection unit is used to collect user physiological information; The system also includes a physiological health intelligent agent, which is used to perform physiological health analysis based on the user's physiological information and generate physiological health analysis results; The central control intelligent agent is also used to generate digital human interaction information based on the voice analysis results, the visual analysis results, the mental health analysis results and the physiological health analysis results.

3. The health care system for the aged according to claim 2, characterized in that: The user's physiological information includes basic physiological index information and medical examination index information; The basic physiological index information includes height, weight, heart rate, pulse, blood sugar, blood pressure and blood oxygen; The medical examination index information includes blood test results, urine test results, medical biochemical indicators and medical imaging data.

4. The health care system for the aged according to claim 2, characterized in that: The physiological health analysis results include physiological health reports and physiological health guidance; The physical health report includes: The status of basic physiological indicators, the status of medical examination indicators, the evaluation results of basic physiological indicators, the evaluation results of medical examination indicators, the analysis results of abnormal indicators, the results of chronic disease risk assessment, the results of exercise capacity assessment, and the comprehensive evaluation results of physiological health; The physical health guidance includes: Dietary advice, exercise advice, guidance on medication use, lifestyle adjustment advice, regular physical examination planning, and emergency intervention advice for physical health; The digital human interaction module is also used to output the physiological health report and the physiological health guidance.

5. The health care system for the aged according to claim 1, characterized in that: The speech analysis results include speech-to-text recognition results, keyword extraction results, topic analysis results, emotion recognition results, stress level assessment results, cognitive function monitoring results, language fluency analysis results and social interaction pattern analysis results.

6. The health care system for the aged according to claim 1, characterized in that: The visual analysis results include facial expression recognition results, micro-expression analysis results, head posture and body posture reports, behavior recognition results, eye movement trajectories, activity trajectories, activity level summaries and environmental inspection reports.

7. The health care system for the aged according to claim 1, characterized in that: The mental health analysis results include mental health reports and mental health guidance; The mental health report includes: Emotional trend charts, emotional stability assessment results, depression tendency screening results, stress level assessment results, cognitive function assessment results, social interaction evaluation, abnormal emotion detection results, mental illness risk assessment results, and comprehensive mental health assessment results; The mental health guidance includes: Emotion regulation suggestions, relaxation and stress relief suggestions, cognitive training suggestions, social activity suggestions, and emergency mental health intervention suggestions; The digital human interaction module is also used to output the mental health report and the mental health guidance.

8. A healthy elderly care method, characterized in that: The method is applied to a health care system according to any one of claims 1 to 7, wherein the system comprises a user information collection module, a voice analysis agent, a visual analysis agent, a mental health agent, a central control agent and a digital human interaction module, wherein the user information collection module comprises a voice information collection unit and a visual information collection unit; The method comprises: Collecting user voice information through the voice information collection unit, and collecting user visual information through the visual information collection unit; Calling the speech analysis agent to perform speech analysis on the user speech information and generate a speech analysis result; Calling the visual analysis agent to perform visual analysis on the user's visual information and generate a visual analysis result; Calling the mental health agent to perform mental health analysis based on the speech analysis result and the visual analysis result to generate a mental health analysis result; Calling the central control agent to generate digital human interaction information according to the speech analysis result, the visual analysis result and the mental health analysis result; The digital human interaction information is outputted through the digital human interaction module.

9. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the healthy elderly care method according to claim 8 are implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the healthy aging method according to claim 8 are implemented.

Images