Intelligent immersive outpatient nursing system based on AR display

Abstract

The present invention discloses an intelligent immersive outpatient nursing system based on AR display, including a patient-side AR device, a data center, a cloud server and an interactive platform, wherein the patient-side AR device is used to receive nursing information from the server side and present it to the patient in the form of AR; the data center is used to collect and process the patient's personal information, health data, nursing needs and other information; the cloud server is used to manage and schedule the information of the data center and send nursing information to the patient side. The present invention can provide patients with intuitive and convenient nursing guidance, help patients better execute medical orders, improve the quality of nursing, provide personalized reminder services and interactive experience, help improve patient compliance, have automated management and data analysis capabilities, reduce the workload of medical staff, and enable them to focus more on key tasks.

Description

Technical Field

[0001] The present invention belongs to the field of medical health technology, and specifically relates to an intelligent immersive outpatient nursing system based on AR display. Background Art

[0002] With the aging trend of society and people's growing demand for health, traditional in-hospital care can no longer fully meet the needs of patients. Especially for patients with chronic diseases, continuous care after discharge becomes particularly important.

[0003] However, traditional outpatient nursing services face many challenges, including: information asymmetry, which leads to untimely and insufficient information transmission between patients and caregivers; insufficient personalized services, which makes it difficult to personalize existing nursing services according to the specific circumstances of each patient; lack of interactivity, which leads to the lack of interactivity in traditional nursing methods, which is not conducive to improving patient compliance and satisfaction; weak data processing capabilities, which leads to a lack of effective data collection and analysis methods, making it difficult to achieve refined management. For this reason, we propose an intelligent immersive outpatient nursing system based on AR display. Summary of the invention

[0004] The purpose of the present invention is to provide an intelligent immersive outpatient care system based on AR display to solve the problems raised in the above-mentioned background technology.

[0005] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: an intelligent immersive outpatient nursing system based on AR display, comprising a patient-side AR device, a data center, a cloud server and an interactive platform, wherein the patient-side AR device is used to receive nursing information from the server and present it to the patient in the form of AR; the data center is used to collect and process the patient's personal information, health data, nursing needs and other information; the cloud server is used to manage and dispatch the information of the data center and send nursing information to the patient; the interactive platform is used for communication between patients and nursing staff, and supports multiple interactive modes such as voice, text and video;

[0006] The patient-side AR device includes hardware modules and software modules. The hardware modules include AR glasses, smart phones, and tablet computers that are compatible with AR functions, and have built-in cameras, gyroscopes, and accelerometers for capturing the environment and user movements; the software modules are used for medication reminders, rehabilitation training guidance, intelligent conversations, follow-up appointments, environmental perception, biometric monitoring, emotion recognition, location tracking, and health diary recording.

[0007] Preferably, the patient-side AR device includes a medication reminder unit, a rehabilitation training guidance unit, an intelligent dialogue unit, a follow-up appointment unit and an environment perception unit;

[0008] The medication reminder unit is used to project medication reminder information directly in front of the patient through AR display technology to remind the patient to take the medication on time;

[0009] The rehabilitation training guidance unit is used to provide AR-based rehabilitation training videos and graphic guidance for patients to follow the virtual coach to exercise at home;

[0010] The intelligent dialogue unit is used to realize human-computer dialogue through natural language processing technology to answer patients' questions about treatment and rehabilitation;

[0011] The follow-up appointment unit is used to display the time and location information of the next follow-up visit and remind the patient through AR when the date is approaching;

[0012] The environmental perception unit is used to perceive the environment around the patient through cameras and sensors to optimize the AR display effect. The surrounding environment includes light intensity and noise level.

[0013] Preferably, the patient-side AR device further includes a biometric monitoring unit, an emotion recognition unit, a location tracking unit, and a health diary recording unit;

[0014] The biometric monitoring unit is used to integrate biometric monitoring functions such as heart rate and blood oxygen saturation to monitor the patient's health status in real time;

[0015] The emotion recognition unit is used to judge the patient's emotional state through facial expression recognition technology and provide appropriate psychological support to the patient;

[0016] The location tracking unit is used to track the patient's location using GPS or indoor positioning technology to ensure the patient's safety;

[0017] The health diary recording unit is used by patients to record their daily health conditions and feelings, so that doctors and nursing staff can understand the changes of patients in a timely manner.

[0018] Preferably, the data center includes a data collection unit, a data analysis unit, a security unit and a health record management unit;

[0019] The data acquisition unit is used to collect the patient's physiological data through the patient-side AR device;

[0020] The data analysis unit is used to analyze the collected data using big data and machine learning technology to provide personalized care recommendations for patients;

[0021] The security assurance unit is used to protect the security and privacy of all personal data;

[0022] The health record management unit is used to establish and maintain the patient's health record, and record the patient's medical history, medication records and other information.

[0023] Preferably, the data center further includes a data synchronization unit, a trend prediction unit and an anomaly detection unit;

[0024] The data synchronization is used to synchronize data with the hospital information system to ensure the accuracy and consistency of the information;

[0025] The trend prediction unit is used to predict the health trend of the patient based on historical data and take preventive measures in advance;

[0026] The abnormality detection unit is used to automatically detect abnormalities in the patient's health data and promptly alert doctors and nursing staff.

[0027] Preferably, the cloud server includes an information management unit, a scheduling and coordination unit, an intelligent recommendation unit, an emergency response unit, a data mining unit and a resource scheduling unit;

[0028] The information management unit is used to integrate the data provided by the data center, form a nursing plan and push it to the patient-side AR device;

[0029] The scheduling and coordination unit is used to adjust the nursing plan according to the patient's recovery progress and coordinate the doctor and nurse resources;

[0030] The intelligent recommendation unit is used to recommend personalized nursing plans based on the patient's health data and behavioral habits;

[0031] The emergency response unit is used to automatically notify medical personnel for emergency treatment when an abnormal health condition is detected;

[0032] The data mining unit is used to use machine learning algorithms to mine hidden patterns in the data and provide more accurate nursing advice to patients;

[0033] The resource scheduling unit is used to optimize the allocation of medical resources to ensure that patients can receive timely nursing services.

[0034] Preferably, the interactive platform includes an online consultation unit, a community sharing unit, an emergency call unit, a family member access unit, an education database, a psychological consultation unit, and a nutrition advice unit;

[0035] The online consultation unit is used for patients to communicate with doctors or nursing staff through voice, text or video;

[0036] The community sharing unit is used for patients to share their own rehabilitation experiences and interact with other patients;

[0037] The emergency call unit is used for patients to contact medical staff through a one-touch call function in an emergency situation;

[0038] The family member access unit is used to allow family members to join the nursing team and participate in the patient's rehabilitation process;

[0039] The educational database is used to provide a wealth of health education materials, including videos, articles, etc., to help patients understand disease knowledge;

[0040] The psychological counseling unit is used to provide psychological health counseling services to help patients cope with emotional problems;

[0041] The nutrition suggestion unit is used to provide personalized nutrition suggestions according to the patient's health status and eating habits.

[0042] Preferably, the biometric monitoring unit performs blood oxygen saturation detection including the following formula:

[0043]

[0044] Wherein, SpO2 is the blood oxygen saturation; AC is the alternating component, i.e., the amplitude of the red and infrared light signals; DC is the direct current component, i.e., the baseline of the red and infrared light signals; R is the ratio of the red and infrared light signals; R ref is the reference ratio, that is, the ratio of red light to infrared light signals of healthy blood at a specific saturation.

[0045] Preferably, the abnormality detection unit detects abnormal conditions, including the following formula:

[0046] Anomaly=}x i -μ>kσ;

[0047] Among them, Anomaly is the abnormal detection result; x i is the i-th data point; μ is the mean of the data set; σ is the standard deviation of the data set; k is the threshold, usually 3.

[0048] Preferably, the intelligent recommendation unit recommends a personalized care plan, including the following formula:

[0049]

[0050] in, Give user u a predicted score for item i; is the average rating of user u; b u is the deviation of user u; b i is the deviation of item i;

[0051] The resource scheduling unit optimizes the allocation of medical resources, specifically including the following formula:

[0052] Fitness=Objective Function(x);

[0053] Among them, Fitness is the fitness of the individual; Objective Function (x) is the objective function, where x is the vector of solutions;

[0054] The psychological counseling unit provides psychological health counseling services, specifically including the following formula:

[0055] SentimentScore=∑w i s i ;

[0056] Among them, SentimentScore is the sentiment score; w i is the weight of word i; s i is the sentiment polarity of word i.

[0057] Compared with the prior art, the present invention has the following beneficial effects:

[0058] (1) The present invention can provide patients with intuitive and convenient nursing guidance, help patients better implement doctor's orders, improve nursing quality, provide personalized reminder services and interactive experience, help improve patient compliance, have automated management and data analysis capabilities, reduce the workload of medical staff, and enable them to focus more on key tasks;

[0059] (2) The present invention can reduce the number of unnecessary hospital visits and medical expenses. Through continuous monitoring and feedback, it can promote patients' self-health management, provide psychological counseling services, help patients deal with emotional problems, and improve their mental health. Through emotion recognition technology, it can provide patients with timely psychological support, and family members can participate in the patient's recovery process, enhance family support, and improve the patient's overall care experience.

[0060] (3) The present invention improves the response speed to emergencies through intelligent monitoring and emergency response mechanisms, and can provide psychological counseling services to help patients cope with emotional problems and improve their mental health. In addition, it provides nutritional advice based on the patient's specific situation to promote overall recovery, thereby improving patients' satisfaction with nursing services. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] Figure 1 It is a structural block diagram of the present invention;

[0062] Figure 2 It is a structural block diagram of the patient-side AR device of the present invention;

[0063] Figure 3It is a structural block diagram of the data center of the present invention. DETAILED DESCRIPTION

[0064] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0065] See also Figure 1-Figure 3 The present invention provides a technical solution: an intelligent immersive outpatient nursing system based on AR display, including a patient-side AR device, a data center, a cloud server and an interactive platform, wherein the patient-side AR device is used to receive nursing information from the server and present it to the patient in the form of AR; the data center is used to collect and process the patient's personal information, health data, nursing needs and other information; the cloud server is used to manage and dispatch the information of the data center and send nursing information to the patient; the interactive platform is used for communication between patients and nursing staff, and supports multiple interactive modes such as voice, text and video;

[0066] The patient-side AR device includes hardware modules and software modules. The hardware modules include AR glasses, smart phones, and tablet computers that are compatible with AR functions, and have built-in cameras, gyroscopes, and accelerometers for capturing the environment and user movements; the software modules are used for medication reminders, rehabilitation training guidance, intelligent conversations, follow-up appointments, environmental perception, biometric monitoring, emotion recognition, location tracking, and health diary recording.

[0067] In this embodiment, preferably, the patient-side AR device includes a medication reminder unit, a rehabilitation training guidance unit, an intelligent dialogue unit, a follow-up appointment unit and an environment perception unit;

[0068] The medication reminder unit is used to project medication reminder information directly in front of the patient through AR display technology to remind the patient to take the medication on time;

[0069] The rehabilitation training guidance unit is used to provide AR-based rehabilitation training videos and graphic guidance for patients to follow the virtual coach to exercise at home;

[0070] The intelligent dialogue unit is used to realize human-computer dialogue through natural language processing technology to answer patients' questions about treatment and rehabilitation;

[0071] The follow-up appointment unit is used to display the time and location information of the next follow-up visit and remind the patient through AR when the date is approaching;

[0072] The environmental perception unit is used to perceive the environment around the patient through cameras and sensors to optimize the AR display effect. The surrounding environment includes light intensity and noise level.

[0073] In this embodiment, preferably, the patient-side AR device further includes a biometric monitoring unit, an emotion recognition unit, a location tracking unit, and a health diary recording unit;

[0074] The biometric monitoring unit is used to integrate biometric monitoring functions such as heart rate and blood oxygen saturation to monitor the patient's health status in real time;

[0075] The emotion recognition unit is used to judge the patient's emotional state through facial expression recognition technology and provide appropriate psychological support to the patient;

[0076] The location tracking unit is used to track the patient's location using GPS or indoor positioning technology to ensure the patient's safety;

[0077] The health diary recording unit is used by patients to record their daily health conditions and feelings, so that doctors and nursing staff can understand the changes of patients in a timely manner.

[0078] In this embodiment, preferably, the data center includes a data collection unit, a data analysis unit, a security unit and a health record management unit;

[0079] The data acquisition unit is used to collect the patient's physiological data through the patient-side AR device;

[0080] The data analysis unit is used to analyze the collected data using big data and machine learning technology to provide personalized care recommendations for patients;

[0081] The security assurance unit is used to protect the security and privacy of all personal data;

[0082] The health record management unit is used to establish and maintain the patient's health record, and record the patient's medical history, medication records and other information.

[0083] In this embodiment, preferably, the data center further includes a data synchronization unit, a trend prediction unit and an anomaly detection unit;

[0084] The data synchronization is used to synchronize data with the hospital information system to ensure the accuracy and consistency of the information;

[0085] The trend prediction unit is used to predict the health trend of the patient based on historical data and take preventive measures in advance;

[0086] The abnormality detection unit is used to automatically detect abnormalities in the patient's health data and promptly alert doctors and nursing staff.

[0087] In this embodiment, preferably, the cloud server includes an information management unit, a scheduling and coordination unit, an intelligent recommendation unit, an emergency response unit, a data mining unit and a resource scheduling unit;

[0088] The information management unit is used to integrate the data provided by the data center, form a nursing plan and push it to the patient-side AR device;

[0089] The scheduling and coordination unit is used to adjust the nursing plan according to the patient's recovery progress and coordinate the doctor and nurse resources;

[0090] The intelligent recommendation unit is used to recommend personalized nursing plans based on the patient's health data and behavioral habits;

[0091] The emergency response unit is used to automatically notify medical personnel for emergency treatment when an abnormal health condition is detected;

[0092] The data mining unit is used to use machine learning algorithms to mine hidden patterns in the data and provide more accurate nursing advice to patients;

[0093] The resource scheduling unit is used to optimize the allocation of medical resources to ensure that patients can receive timely nursing services.

[0094] In this embodiment, preferably, the interactive platform includes an online consultation unit, a community sharing unit, an emergency call unit, a family member access unit, an education database, a psychological consultation unit, and a nutrition advice unit;

[0095] The online consultation unit is used for patients to communicate with doctors or nursing staff through voice, text or video;

[0096] The community sharing unit is used for patients to share their own rehabilitation experiences and interact with other patients;

[0097] The emergency call unit is used for patients to contact medical staff through a one-touch call function in an emergency situation;

[0098] The family member access unit is used to allow family members to join the nursing team and participate in the patient's rehabilitation process;

[0099] The educational database is used to provide a wealth of health education materials, including videos, articles, etc., to help patients understand disease knowledge;

[0100] The psychological counseling unit is used to provide psychological health counseling services to help patients cope with emotional problems;

[0101] The nutrition suggestion unit is used to provide personalized nutrition suggestions according to the patient's health status and eating habits.

[0102] In this embodiment, preferably, the biometric monitoring unit performs blood oxygen saturation detection including the following formula:

[0103]

[0104] Wherein, SpO2 is the blood oxygen saturation; AC is the alternating component, i.e., the amplitude of the red and infrared light signals; DC is the direct current component, i.e., the baseline of the red and infrared light signals; R is the ratio of the red and infrared light signals; R ref is the reference ratio, that is, the ratio of red light to infrared light signals of healthy blood at a specific saturation.

[0105] In this embodiment, preferably, the abnormality detection unit detects the abnormal situation, including the following formula:

[0106] Anomaly=}x i -μ>kσ;

[0107] Among them, Anomaly is the abnormal detection result; x i is the i-th data point; μ is the mean of the data set; σ is the standard deviation of the data set; k is the threshold, usually 3.

[0108] In this embodiment, preferably, the intelligent recommendation unit recommends a personalized nursing plan, including the following formula:

[0109]

[0110] in, Give user u a predicted score for item i; is the average rating of user u; b u is the deviation of user u; b i is the deviation of item i;

[0111] The resource scheduling unit optimizes the allocation of medical resources, specifically including the following formula:

[0112] Fitness=Objective Function(x);

[0113] Among them, Fitness is the fitness of the individual; Objective Function (x) is the objective function, where x is the vector of solutions;

[0114] The psychological counseling unit provides psychological health counseling services, specifically including the following formula:

[0115] SentimentScore=∑w i s i ;

[0116] Among them, SentimentScore is the sentiment score; w i is the weight of word i; s i is the sentiment polarity of word i.

[0117] Principles and advantages of the present invention:

[0118] The present invention can provide patients with intuitive and convenient nursing guidance, help patients better execute doctor's orders, improve the quality of nursing, provide personalized reminder services and interactive experience, help improve patient compliance, have automated management and data analysis capabilities, reduce the workload of medical staff, and enable them to focus more on key tasks; it can reduce the number of unnecessary hospital visits, reduce medical expenses, promote patient self-health management through continuous monitoring and feedback, provide psychological counseling services, help patients cope with emotional problems, and improve mental health; through emotion recognition technology, provide patients with psychological support in a timely manner, and family members can participate in the patient's rehabilitation process, enhance family support, and improve the patient's overall nursing experience; through intelligent monitoring and emergency response mechanisms, the response speed to emergencies is improved, psychological counseling services can be provided, help patients cope with emotional problems, and improve mental health; in addition, nutritional advice is provided according to the patient's specific situation to promote overall rehabilitation, thereby improving the patient's satisfaction with nursing services.

[0119] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. The intelligent immersive outpatient nursing system based on AR display is characterized by: It includes a patient-side AR device, a data center, a cloud server and an interactive platform. The patient-side AR device is used to receive nursing information from the server and present it to the patient in the form of AR; the data center is used to collect and process the patient's personal information, health data, nursing needs and other information; the cloud server is used to manage and dispatch the information of the data center and send nursing information to the patient; the interactive platform is used for communication between patients and nursing staff, and supports multiple interactive methods such as voice, text and video; The patient-side AR device includes hardware modules and software modules. The hardware modules include AR glasses, smart phones, and tablet computers that are compatible with AR functions, and have built-in cameras, gyroscopes, and accelerometers for capturing the environment and user movements; the software modules are used for medication reminders, rehabilitation training guidance, intelligent conversations, follow-up appointments, environmental perception, biometric monitoring, emotion recognition, location tracking, and health diary recording.

2. The intelligent immersive outpatient nursing system based on AR display according to claim 1 is characterized in that: The patient-side AR device includes a medication reminder unit, a rehabilitation training guidance unit, an intelligent dialogue unit, a follow-up appointment unit, and an environment perception unit; The medication reminder unit is used to project medication reminder information directly in front of the patient through AR display technology to remind the patient to take the medication on time; The rehabilitation training guidance unit is used to provide AR-based rehabilitation training videos and graphic guidance for patients to follow the virtual coach to exercise at home; The intelligent dialogue unit is used to realize human-computer dialogue through natural language processing technology to answer patients' questions about treatment and rehabilitation; The follow-up appointment unit is used to display the time and location information of the next follow-up visit and remind the patient through AR when the date is approaching; The environmental perception unit is used to perceive the environment around the patient through cameras and sensors to optimize the AR display effect. The surrounding environment includes light intensity and noise level.

3. The intelligent immersive outpatient nursing system based on AR display according to claim 2 is characterized in that: The patient-side AR device also includes a biometric monitoring unit, an emotion recognition unit, a location tracking unit, and a health diary recording unit; The biometric monitoring unit is used to integrate biometric monitoring functions such as heart rate and blood oxygen saturation to monitor the patient's health status in real time; The emotion recognition unit is used to judge the patient's emotional state through facial expression recognition technology and provide appropriate psychological support to the patient; The location tracking unit is used to track the patient's location using GPS or indoor positioning technology to ensure the patient's safety; The health diary recording unit is used by patients to record their daily health conditions and feelings, so that doctors and nursing staff can understand the changes of patients in a timely manner.

4. The intelligent immersive outpatient nursing system based on AR display according to claim 1 is characterized in that: The data center includes a data collection unit, a data analysis unit, a security unit and a health record management unit; The data acquisition unit is used to collect the patient's physiological data through the patient-side AR device; The data analysis unit is used to analyze the collected data using big data and machine learning technology to provide personalized care recommendations for patients; The security assurance unit is used to protect the security and privacy of all personal data; The health record management unit is used to establish and maintain the patient's health record, and record the patient's medical history, medication records and other information.

5. The intelligent immersive outpatient nursing system based on AR display according to claim 4 is characterized in that: The data center also includes a data synchronization unit, a trend prediction unit and an anomaly detection unit; The data synchronization is used to synchronize data with the hospital information system to ensure the accuracy and consistency of the information; The trend prediction unit is used to predict the health trend of the patient based on historical data and take preventive measures in advance; The abnormality detection unit is used to automatically detect abnormalities in the patient's health data and promptly alert doctors and nursing staff.

6. The intelligent immersive outpatient nursing system based on AR display according to claim 1 is characterized in that: The cloud server includes an information management unit, a scheduling and coordination unit, an intelligent recommendation unit, an emergency response unit, a data mining unit and a resource scheduling unit; The information management unit is used to integrate the data provided by the data center, form a nursing plan and push it to the patient-side AR device; The scheduling and coordination unit is used to adjust the nursing plan according to the patient's recovery progress and coordinate the doctor and nurse resources; The intelligent recommendation unit is used to recommend personalized nursing plans based on the patient's health data and behavioral habits; The emergency response unit is used to automatically notify medical personnel for emergency treatment when an abnormal health condition is detected; The data mining unit is used to use machine learning algorithms to mine hidden patterns in the data and provide more accurate nursing advice to patients; The resource scheduling unit is used to optimize the allocation of medical resources to ensure that patients can receive timely nursing services.

7. The intelligent immersive outpatient nursing system based on AR display according to claim 1 is characterized in that: The interactive platform includes an online consultation unit, a community sharing unit, an emergency call unit, a family member access unit, an education database, a psychological consultation unit, and a nutrition advice unit; The online consultation unit is used for patients to communicate with doctors or nursing staff through voice, text or video; The community sharing unit is used for patients to share their own rehabilitation experiences and interact with other patients; The emergency call unit is used for patients to contact medical staff through a one-touch call function in an emergency situation; The family member access unit is used to allow family members to join the nursing team and participate in the patient's rehabilitation process; The educational database is used to provide a wealth of health education materials, including videos, articles, etc., to help patients understand disease knowledge; The psychological counseling unit is used to provide psychological health counseling services to help patients cope with emotional problems; The nutrition suggestion unit is used to provide personalized nutrition suggestions according to the patient's health status and eating habits.

8. The intelligent immersive outpatient nursing system based on AR display according to claim 3 is characterized in that: The biometric monitoring unit performs blood oxygen saturation detection including the following formula: Wherein, SpO2 is the blood oxygen saturation; AC is the alternating component, i.e., the amplitude of the red and infrared light signals; DC is the direct current component, i.e., the baseline of the red and infrared light signals; R is the ratio of the red and infrared light signals; R ref is the reference ratio, that is, the ratio of red light to infrared light signals of healthy blood at a specific saturation.

9. The intelligent immersive outpatient nursing system based on AR display according to claim 5 is characterized in that: The abnormality detection unit detects abnormal conditions, including the following formula: Anomaly=|x i -μ>kσ; Among them, Anomaly is the abnormal detection result; x i is the i-th data point; μ is the mean of the data set; σ is the standard deviation of the data set; k is the threshold, usually 3.

10. The intelligent immersive outpatient nursing system based on AR display according to claim 6, characterized in that: The intelligent recommendation unit recommends a personalized care plan, including the following formula: in, Give user u a predicted score for item i; is the average rating of user u; b u is the deviation of user u; b i is the deviation of item i; The resource scheduling unit optimizes the allocation of medical resources, specifically including the following formula: Fitness=Objective Function(x); Among them, Fitness is the fitness of the individual; Objective Function (x) is the objective function, where x is the vector of solutions; The psychological counseling unit provides psychological health counseling services, specifically including the following formula: SentimentScore=∑w i s i ; Among them, SentimentScore is the sentiment score; w i is the weight of word i; s i is the sentiment polarity of word i.

Images