Intelligent interaction equipment for cognitive decline old people based on AR glasses
Through intelligent interactive devices based on AR glasses, combined with modules such as health management and cognitive activation, personalized and comprehensive intervention strategies are provided, which solves the problem of unable to delay the cognitive decline of the elderly in the existing technology, and improves the quality of life and health status of the elderly.
Patent Information
- Application Number
- CN202510319483.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-18
- Publication Date
- 2025-07-04
AI Technical Summary
Existing intelligent interactive devices cannot effectively delay the cognitive decline of the elderly.
Intelligent interactive devices for cognitive decline elderly people based on AR glasses, including AR glasses module, intelligent interaction device module and cloud server module, real-time data exchange and synchronization through wireless communication, integrating modules such as health management, cognitive activation, emotional activation, diet activation, exercise activation, social activation and accessibility interaction to provide personalized and comprehensive intervention strategies.
Personalized and precise intervention has been achieved, the quality of life and health of the elderly have been improved, and the physical and mental development of users has been improved through comprehensive and comprehensive intervention strategies, providing intelligent and convenient operation experience, and supporting remote monitoring and collaborative management between multiple parties.
Smart Images

Figure CN120260868A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of intelligent interaction devices, and particularly to an intelligent interaction device for the elderly with cognitive decline based on AR glasses. Background Art
[0002] With its excellent interaction performance, rich and diverse functions, and full sense of technology, intelligent interaction devices can display rich teaching courseware in the education field and stimulate students' learning interest through interactive functions; in commercial exhibitions, they can play high-definition advertising videos, display product details, attract customers' attention, and at the same time provide services such as product query and online ordering; in the office scenario, participants can directly touch, write, and zoom files on the screen, greatly improving communication efficiency.
[0003] In the prior art, intelligent interaction devices cannot delay the cognitive decline of the elderly. Therefore, we propose an intelligent interaction device for the elderly with cognitive decline based on AR glasses to solve the above problems. Summary of the Invention
[0004] The purpose of the present invention is to provide an intelligent interaction device for the elderly with cognitive decline based on AR glasses to solve the drawback in the prior art that intelligent interaction devices cannot delay the cognitive decline of the elderly.
[0005] To achieve the above purpose, the present invention adopts the following technical solutions:
[0006] An intelligent interaction device for the elderly with cognitive decline based on AR glasses includes an AR glasses module, an intelligent interaction device module, and a cloud server module. The AR glasses module, the intelligent interaction device module, and the cloud server module perform real-time data exchange and synchronization through wireless communication technology. The cloud server module includes a user interface, a core processing unit, a family member side collaborative management mini-program, and a nursing management module. The nursing management includes a nursing closed-loop management module. The user interface includes a health management module, a cognitive activation module, an emotion activation module, a diet activation module, a sports activation module, a social activation module, and a barrier-free interaction module. The intelligent interaction device module includes a smart phone, a tablet computer, and a mounting bracket.
[0007] The AR glasses module is used to accurately superimpose virtual information on the real field of view according to the user's real-time environment, providing an immersive experience for the user.
[0008] The intelligent interaction device module is used to process user input, send instructions to the AR glasses, receive data from the AR glasses, run the supporting application program, and provide rich functions and interfaces.
[0009] The cloud server module is used to store and manage a large amount of user data, including personal information, training content, health data, and intervention plans. It runs advanced data analysis algorithms to deeply mine and analyze the collected data, so as to provide users with more accurate and personalized training plans and suggestions, share data with other medical institutions, research institutions or family members, achieve multi-party collaborative intervention and management, and improve the intervention effect and efficiency.
[0010] Preferably, the health management module is used for health monitoring, cognitive health screening, abnormal index warning and long-term health analysis.
[0011] Preferably, the cognitive activation module dynamically generates a list of products with appropriate difficulty according to the MMSE score of the elderly. The AR projects a realistic shelf and navigation light strip to guide the elderly to experience shopping and exercise their cognitive and motor abilities; a digital matrix is projected on the ground, and the user is required to step on it according to specific rules. If there is an error, the touch screen will vibrate immediately to remind, strengthening the training of digital memory and reaction ability; the intelligent medicine box uses RFID to identify drugs, and the AR glasses superimpose an animation guide for taking medicine.
[0012] Preferably, the emotion activation module uses AI technology to perform 3D reconstruction based on old photos to generate virtual images of relatives, supports emotional conversations, creates a warm communication atmosphere through voice emotion analysis and micro-expression feedback, and alleviates the loneliness of the elderly; carefully collects the oral stories of the elderly, uses AI to automatically generate animated videos, and family members can edit the scene details through a small program to enrich the spiritual life of the elderly and promote emotional expression; AR superimposes dynamic labels, voice recognition generates text records, which are synchronized to the cloud family file, and the patterns drawn on the tablet are projected into the AR environment in real time to cooperate to complete the virtual jigsaw puzzle.
[0013] Preferably, the diet activation module is as follows:
[0014] Intelligent kitchen guidance: The cooking process is projected step by step through AR. For example, the steps of frying an egg are: heating the pan → pouring oil → beating the egg. The spectral sensor closely monitors the oil temperature and triggers a voice alarm in time when it exceeds the limit to ensure cooking safety and standardization;
[0015] Nutritional analysis algorithm: With the help of image recognition and weight sensing technology, it accurately calculates the intake of protein and dietary fiber and generates a detailed nutritional score report to provide a scientific basis for the dietary health of the elderly;
[0016] Food visual enhancement: Use image processing technology to enhance the vision of food, making it look fresher and more attractive, and improving the appetite and eating desire of the elderly;
[0017] Kitchen safety training: Simulate an oil pan fire, and the AR guides the steps of using a fire extinguisher.
[0018] Preferably, the exercise activation module is as follows:
[0019] Virtual outdoor scene: AR projects a park trail, and a pressure mat simulates the touch of a pebble path;
[0020] Virtual coach gait correction: Combining real-time feedback from the pressure mat to provide accurate gait guidance for the elderly, helping them improve their walking posture and stability;
[0021] Anti-fall safety enhancement training: Using AR to simulate dangerous scenarios, such as slippery ground conditions, to train the elderly's emergency response capabilities; at the same time, conduct safety knowledge quizzes, and play teaching videos when the answers are incorrect to enhance safety awareness and response skills;
[0022] Personal self-care training: AR guides the steps of dressing. There are arrows on the AR glasses for guidance, and a tactile glove simulates the touch of fabric;
[0023] Travel simulation training: AR generates a bus stop scene with voice prompts for getting on the bus steps.
[0024] Preferably, the social activation module includes
[0025] Holographic relative interaction: The light field projection technology realizes life-sized holographic images, supporting gesture interaction;
[0026] Interest social platform: Virtual interest groups, AR projection collaborative tasks.
[0027] Preferably, the barrier-free interaction module includes
[0028] Visually impaired mode: Convert the AR scene into a sound field, with the position of the commodity corresponding to the stereo azimuth, and the distance reflected as the volume attenuation gradient; Set up tactile navigation, through Braille button vibration coding, to facilitate visually impaired elderly people to operate and perceive the environment, bone conduction navigation to prompt the direction, and tactile map;
[0029] Hearing impaired mode: The AR subtitles can adaptively adjust the font size according to the emotional pressure; Set up light effect warnings to ensure that hearing impaired elderly people can clearly receive information prompts and instructions, and real-time subtitle generation.
[0030] Preferably, the mounting bracket includes a base, a support sleeve is fixedly installed on the top of the base, a lifting rod is slidably installed in the support sleeve, a locking bolt is threadedly installed on the support sleeve, a lifting plate is fixedly installed on the top of the lifting rod, two side plates are fixedly installed on the top of the lifting plate, rotating grooves are formed on one side of the two side plates, rotating blocks are rotatably installed in the two rotating grooves, one ends of the two rotating blocks are fixedly installed with the same placing plate, a bottom support plate is fixedly installed on one side of the placing plate, two clamping plates are slidably installed on one side of the placing plate, two sliding grooves are formed on one side of the placing plate, sliders are slidably installed in the two sliding grooves, the two sliders are respectively fixedly connected with the two clamping plates, limiting rods are fixedly installed in the two sliding grooves, the two sliders are respectively slidably connected with the two limiting rods, one ends of first springs are fixedly installed on one side of the two sliders, and the other ends of the first springs are fixedly connected with the inner walls of one sides of the sliding grooves.
[0031] Preferably, a rectangular groove is formed at the other end of one of the two rotating blocks, a rectangular block is slidably installed in the rectangular groove, a pulling plate is fixedly installed on one side of the rectangular block, a locking block is fixedly installed on one side of the pulling plate, a plurality of annularly distributed locking grooves are formed on one side of the side plate, one side of the locking block is clamped with the corresponding locking groove, one end of a second spring is fixedly installed on the inner wall of one side of the rectangular groove, the other end of the second spring is fixedly connected with the rectangular block, a handheld device is arranged on the top of the placing plate, a display screen, a glasses groove and a stylus are arranged on the handheld device, a charging port is arranged on one side of the handheld device, a luminous strip is arranged at the bottom of the handheld device, a speaker is arranged on the other side of the handheld device, and glasses are arranged in the glasses groove.
[0032] In the present invention, the beneficial effects of the intelligent interaction device for cognitively declining elderly people based on AR glasses are as follows:
[0033] Personalized and precise intervention: Through the closed-loop management of the nursing assessment program and big data analysis technology, the system can accurately evaluate the cognitive status and living needs of users, and provide personalized intervention plans for users. This precise intervention method can more effectively meet the actual needs of users, improve the intervention effect and satisfaction.
[0034] Comprehensive and integrated intervention strategy: The system not only focuses on the cognitive function of users, but also covers multiple aspects such as emotion, diet, exercise, and social interaction, realizing a full-dimensional activation intervention for users. This comprehensive and integrated intervention strategy can more comprehensively improve the quality of life and health status of users, and promote the overall physical and mental development.
[0035] Intelligent and convenient operation experience: AR glasses and intelligent interaction devices make the system operation simpler, more intuitive and convenient. Users can complete various tasks through voice commands or simple touch operations without complex training or guidance. At the same time, the system can also be adaptively adjusted according to the usage habits and preferences of users, improving the user experience and comfort.
[0036] Remote monitoring and multi-party collaboration: The cloud server can achieve remote monitoring and management of users, facilitating family members, medical staff, or researchers to understand the user's condition and progress in real time. At the same time, the system can also share data and conduct collaborative interventions with other medical institutions, community service centers, or family members, forming a multi-party linkage intervention mechanism to improve the intervention effect and efficiency.
[0037] Scientific and standardized management process: The system ensures the scientific and standardized intervention process through standardized nursing assessment procedures and scientific intervention methods, which helps to improve the accuracy and effectiveness of the intervention, reduce the interference and errors of human factors. At the same time, the system can also quantitatively evaluate and feedback the intervention effect, providing a basis for further optimizing the intervention plan.
[0038] Covering eight major modules of health management, cognitive activation, emotional activation, diet activation, exercise activation, social activation, barrier-free interaction, and nursing closed-loop management, it provides comprehensive intervention for patients with mild cognitive impairment and Alzheimer's disease, delaying cognitive decline and improving the quality of life. Brief Description of the Drawings
[0039] Figure 1 It is a block diagram of the intelligent interaction device for cognitively declining elderly based on AR glasses proposed by the present invention;
[0040] Figure 2 It is a block diagram of the cloud server module of the intelligent interaction device for cognitively declining elderly based on AR glasses proposed by the present invention;
[0041] Figure 3 It is a block diagram of the user interface of the intelligent interaction device for cognitively declining elderly based on AR glasses proposed by the present invention;
[0042] Figure 4 It is a structural diagram of the mounting bracket of the intelligent interaction device for cognitively declining elderly based on AR glasses proposed by the present invention;
[0043] Figure 5 It is a side view of the mounting bracket of the intelligent interaction device for cognitively declining elderly based on AR glasses proposed by the present invention;
[0044] Figure 6 It is for the intelligent interaction device for cognitively declining elderly based on AR glasses proposed by the present invention Figure 4 The enlarged structural schematic diagram of part A;
[0045] Figure 7 It is for the intelligent interaction device for cognitively declining elderly based on AR glasses proposed by the present invention Figure 4 The structural schematic diagram after adding the handheld device;
[0046] Figure 8 The structural schematic diagram of the glasses of the intelligent interaction device for cognitively declining elderly based on AR glasses proposed by the present invention.
[0047] In the figure: 1, base; 2, support sleeve; 3, lifting rod; 4, lifting plate; 5, locking bolt; 6, side plate; 7, placement plate; 8, clamping plate; 9, bottom support plate; 10, chute; 11, limiting rod; 12, slider; 13, first spring; 14, rotating groove; 15, rotating block; 16, rectangular groove; 17, rectangular block; 18, pulling plate; 19, locking block; 20, locking groove; 21, second spring; 22, handheld device; 23, display screen; 24, glasses slot; 25, stylus; 26, charging port; 27, speaker; 28, luminous strip. Specific implementation manners
[0048] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments.
[0049] Embodiment 1
[0050] Refer to Figures 1-8 , the intelligent interaction device for cognitively declining elderly based on AR glasses includes an AR glasses module, an intelligent interaction device module, and a cloud server module. The AR glasses module, the intelligent interaction device module, and the cloud server module perform real-time data exchange and synchronization through wireless communication technology. The cloud server module includes a user interface, a core processing unit, a family member cooperation management applet, and a nursing management module. The nursing management includes a nursing closed-loop management module; the user interface includes a health management module, a cognitive activation module, an emotion activation module, a diet activation module, a sports activation module, a social activation module, and a barrier-free interaction module. The intelligent interaction device module includes a smartphone, a tablet computer, and a mounting bracket;
[0051] The AR glasses module is used to accurately superimpose virtual information on the real field of view according to the user's real-time environment, providing an immersive experience for the user;
[0052] The intelligent interaction device module is used to process user input, send instructions to the AR glasses, and receive data from the AR glasses, run the supporting application program, and provide rich functions and interfaces;
[0053] The cloud server module is used to store and manage a large amount of user data, including personal information, training content, health data, and intervention plans. It runs advanced data analysis algorithms to deeply mine and analyze the collected data, so as to provide more accurate and personalized training plans and suggestions for users, share data with other medical institutions, research institutions, or family members, realize multi-party collaborative intervention and management, and improve the intervention effect and efficiency.
[0054] In this embodiment, the health management module is used for health monitoring, cognitive health screening, abnormal index warning, and long-term health analysis.
[0055] In this embodiment, the cognitive activation module dynamically generates a commodity list with appropriate difficulty according to the MMSE score of the elderly, projects a realistic shelf and navigation light strip by AR to guide the elderly to have a shopping experience and exercise their cognitive and action abilities; projects a digital matrix on the ground and requires the user to step on it according to specific rules. If there is an error, the touch screen will vibrate immediately to remind, strengthening the training of digital memory and reaction ability; the intelligent medicine box uses RFID to identify drugs, and the AR glasses superimpose an animation guide for taking medicine.
[0056] In this embodiment, the emotion activation module uses AI technology to perform 3D reconstruction based on old photos to generate virtual images of relatives, supports emotional conversations, creates a warm communication atmosphere through voice emotion analysis and micro-expression feedback, and alleviates the loneliness of the elderly; carefully collects the oral stories of the elderly and uses AI to automatically generate animated videos. Family members can edit the scene details through a small program to enrich the spiritual life of the elderly and promote emotional expression; AR superimposes dynamic labels, voice recognition generates text records and synchronizes them to the cloud family file, and the patterns drawn on the tablet are projected into the AR environment in real time to cooperate to complete the virtual jigsaw puzzle.
[0057] In this embodiment, the diet activation module is as follows:
[0058] Intelligent kitchen guidance: Project the cooking process step by step through AR. For example, the steps of frying an egg are: heating the pan → pouring oil → cracking the egg. The spectral sensor closely monitors the oil temperature and triggers a voice alarm in time when it exceeds the limit to ensure cooking safety and standardization;
[0059] Nutritional analysis algorithm: Relying on image recognition and weight sensing technology, accurately calculate the intake of protein and dietary fiber, and generate a detailed nutritional score report to provide a scientific basis for the dietary health of the elderly;
[0060] Food visual enhancement: Use image processing technology to enhance the vision of food, making it look fresher and more attractive, and improving the appetite and eating desire of the elderly;
[0061] Kitchen safety training: Simulate a cooking oil fire and use AR to guide the steps of using a fire extinguisher.
[0062] In this embodiment, the exercise activation module is as follows:
[0063] Virtual outdoor scene: AR projects a park trail, and a pressure mat simulates the touch of a pebble road;
[0064] Virtual coach gait correction: Combining real-time feedback from the pressure mat to provide accurate gait guidance for the elderly, helping them improve their walking posture and stability;
[0065] Anti-fall safety enhancement training: Using AR to simulate dangerous scenarios, such as a slippery ground condition, to train the elderly's emergency response ability; at the same time, conduct safety knowledge quizzes, and play teaching videos when the answers are incorrect to enhance safety awareness and response skills;
[0066] Personal self-care training: AR guides the steps of dressing, with arrows on the AR glasses for guidance, and a tactile glove simulates the touch of fabric;
[0067] Travel simulation training: AR generates a bus stop scene with voice prompts for getting on the bus steps.
[0068] In this embodiment, the social activation module includes
[0069] Holographic relative interaction: The light field projection technology realizes life-sized holographic images, supporting gesture interaction;
[0070] Interest social platform: Virtual interest groups, AR projection collaborative tasks.
[0071] In this embodiment, the barrier-free interaction module includes
[0072] Visually impaired mode: Convert the AR scene into a sound field, with the position of the commodity corresponding to the stereo azimuth, and the distance reflected as the volume attenuation gradient; Set up tactile navigation, through Braille button vibration coding, to facilitate visually impaired elderly people to operate and perceive the environment, bone conduction navigation to prompt the direction, and tactile map;
[0073] Hearing impaired mode: The AR subtitles can adaptively adjust the font size according to the emotional stress; Set up light effect warnings to ensure that hearing impaired elderly people can clearly receive information prompts and instructions, and real-time subtitle generation.
[0074] In this embodiment, the mounting bracket includes a base 1. A support sleeve 2 is fixedly installed on the top of the base 1. A lifting rod 3 is slidably installed in the support sleeve 2. A locking bolt 5 is threadedly installed on the support sleeve 2. A lifting plate 4 is fixedly installed on the top of the lifting rod 3. Two side plates 6 are fixedly installed on the top of the lifting plate 4. Rotation grooves 14 are formed on one side of the two side plates 6. Rotating blocks 15 are rotatably installed in the two rotation grooves 14. One end of the two rotating blocks 15 is fixedly installed with the same placing plate 7. A bottom support plate 9 is fixedly installed on one side of the placing plate 7. Two clamping plates 8 are slidably installed on one side of the placing plate 7. Two sliding grooves 10 are formed on one side of the placing plate 7. Sliding blocks 12 are slidably installed in the two sliding grooves 10. The two sliding blocks 12 are respectively fixedly connected with the two clamping plates 8. Limiting rods 11 are fixedly installed in the two sliding grooves 10. The two sliding blocks 12 are respectively slidably connected with the two limiting rods 11. One end of a first spring 13 is fixedly installed on one side of the two sliding blocks 12. The other end of the first spring 13 is fixedly connected with the inner wall of one side of the sliding groove 10. A rectangular groove 16 is formed at the other end of one of the two rotating blocks 15. A rectangular block 17 is slidably installed in the rectangular groove 16. A pulling plate 18 is fixedly installed on one side of the rectangular block 17. A locking block 19 is fixedly installed on one side of the pulling plate 18. A plurality of locking grooves 20 distributed in a ring shape are formed on one side of the side plate 6. One side of the locking block 19 is clamped with the corresponding locking groove 20. One end of a second spring 21 is fixedly installed on the inner wall of one side of the rectangular groove 16. The other end of the second spring 21 is fixedly connected with the rectangular block 17. A handheld device 22 is arranged on the top of the placing plate 7. A display screen 23, an eyeglass groove 24, and a stylus 25 are arranged on the handheld device 22. A charging port 26 is arranged on one side of the handheld device 22. A luminous strip 28 is arranged at the bottom of the handheld device 22. A speaker is arranged on the other side of the handheld device 22. Glasses are arranged in the eyeglass groove 24;
[0075] Specifically, during use, pull the clamping plate 8 to move horizontally. The clamping plate 8 drives the sliding block 12 to compress the first spring 13. Place the smartphone or tablet computer between the two clamping plates 8. The bottom of the smartphone or tablet computer contacts the top of the bottom support plate 9. Then release the clamping plate 8, and the first spring 13 resets to clamp and fix the smartphone or tablet computer;
[0076] Pull the pulling plate 18 to move leftward. The pulling plate 18 drives the rectangular block 17 to stretch the second spring 21, and at the same time makes the locking block 19 disengage from the locking groove 20 to release the fixation of the rotating block 15. At this time, the placing plate 7 can be flipped, and then the viewing angle of the smartphone or tablet computer can be adjusted. Then, just snap the locking block 19 into a new locking groove 20.
[0077] In this embodiment, the nursing closed-loop management module is specifically as follows:
[0078] (1) Assessment: The system automatically generates a multi-dimensional care assessment report, covering key indicators such as ADL, MMSE, and nutritional index, to comprehensively present the health status and needs of the elderly.
[0079] Data collection: Collect the elderly’s physiological data (such as heart rate, blood pressure, sleep quality, etc.), behavioral data (such as activity trajectories, operation records, etc.) and cognitive data (such as cognitive test scores, memory performance, etc.) through AR glasses and smart interactive devices.
[0080] Comprehensive assessment: Use professional assessment algorithms to conduct a comprehensive analysis of the collected data to assess the elderly’s health status, cognitive level, self-care ability, etc., and determine the elderly’s care needs and potential health risks.
[0081] (2) Diagnosis: Use intelligent algorithms to accurately match NANDA-I nursing problems, such as "environmental cognitive impairment" and "social isolation risk", to provide a basis for personalized nursing plans.
[0082] Multimodal data fusion analysis: The multi-source data collected during the evaluation phase are fused and analyzed, combined with clinical knowledge and expert experience, using machine learning and deep learning algorithms to accurately diagnose the type, degree, and development trend of cognitive decline in the elderly.
[0083] Develop personalized care plans: Based on the diagnosis results, tailor a personalized care plan for each elderly person, clarifying the care goals, intervention measures and expected results.
[0084] (3) Planning: Based on the evaluation and diagnosis results, a PDCA intervention plan is dynamically generated, i.e., a daily task list, to clearly define the various intervention tasks and goals.
[0085] Nursing plan formulation: According to the personalized nursing plan, detailed planning of the elderly's daily nursing activities, including health monitoring plan, cognitive training plan, rehabilitation training plan, social activity plan, etc. The nursing plan fully considers the individual differences and living habits of the elderly to ensure the feasibility and effectiveness of the plan.
[0086] Resource allocation and scheduling: Reasonably arrange nursing staff, rehabilitation equipment, medicines and other resources to ensure the smooth implementation of the nursing plan. At the same time, dynamically adjust resource allocation according to the actual situation and changes in needs of the elderly.
[0087] (4) Implementation: The intervention plan is executed collaboratively by multiple devices, and AR prompts, tactile feedback, and environmental linkage are used to ensure that the intervention measures are effectively implemented.
[0088] AR Glass Intervention: Use AR glasses to provide immersive cognitive training, visual assistance, and environmental perception services for the elderly. For example, conduct cognitive training through virtual supermarket scenarios, improve memory through digital memory games, and help the elderly better adapt to the living environment through the environmental perception module.
[0089] Intelligent Interaction Device Assistance: With the help of the age-friendly touch screen, barrier-free interaction module, and voice broadcast function of intelligent interaction devices, it is convenient for the elderly to interact with the system, obtain information and services. For example, the elderly can operate intelligent kitchen equipment through the touch screen for kitchen safety training; listen to health knowledge and precautions through the voice broadcast function.
[0090] (5) Evaluation: Adopt a quantitative analysis method, focus on evaluating key indicators such as the cognitive function retention rate and the accident decline rate, accurately measure the intervention effect, and provide strong support for subsequent optimization.
[0091] Effect Evaluation: Regularly evaluate the effect of nursing intervention. By comparing indicators such as the health status, cognitive level, and self-care ability of the elderly before and after the intervention, evaluate the effectiveness and rationality of the nursing plan.
[0092] Feedback and Adjustment: According to the evaluation results, timely collect the feedback opinions of the elderly and their families, and adjust and optimize the nursing plan. If new problems or changes in needs of the elderly are found, update the nursing plan and intervention measures in a timely manner to ensure the continuity and pertinence of nursing services.
[0093] The specific content of the health management module is as follows:
[0094] (1) Health Monitoring: Use the PPG module of AR glasses to continuously monitor vital sign data such as heart rate and blood oxygen saturation, and at the same time collect body temperature information in combination with a forehead temperature sensor. With the help of the pressure mat of the intelligent interaction device, accurately analyze gait stability, including key indicators such as walking speed, stride length, and center of gravity shift, and comprehensively master the physical movement status of the elderly.
[0095] (2) Cognitive Health Screening
[0096] Adopt a dynamic MMSE evaluation method. Through AR projection of a standardized test scenario, a virtual version of the MoCA test (spatial orientation AR maze, clock drawing task), use voice recognition and eye movement tracking technology to calculate the recall accuracy rate, and at the same time record the task completion time by the touch screen. Once the error exceeds the threshold, immediately trigger a cognitive decline warning.
[0097] (3) Abnormal Indicator Warning and Long-term Health Analysis
[0098] Based on the time series model (LSTM), deeply analyze the collected health data, predict health trends such as the risk of falling in the next 7 days, and issue early warnings.
[0099] Generate a weekly health report regularly, covering aspects such as sleep quality, activity level, and balanced nutrition intake, providing detailed references for the health management of the elderly. The health report is transmitted to the family member's mini-program.
[0100] Safety detection: Use the infrared thermal imaging of the AR glasses to scan the environment in real time, accurately mark the high-temperature areas (such as the stove top > 80°C) as red danger zones; use image recognition technology to quickly identify sharp objects such as knives, and quickly trigger a voice alarm when the user approaches: "Please pay attention to the safe distance" to effectively prevent accidents.
[0101] Falling monitoring: Use millimeter-wave radar to accurately capture the movement trajectory, and combine it with the data of the pressure mat (sudden pressure disappearance → possibility of falling) for comprehensive analysis to timely detect the risk of falling.
[0102] Abnormal behavior monitoring: Closely monitor the activity trajectory through the radar. When the elderly person is stationary for more than 30 minutes, the AR prompts "It is recommended to get up and move around"; use the path complexity calculation (when the entropy value > the threshold is determined as abnormal wandering) to trigger a notification to the family member side to ensure the safety and normality of the elderly person's behavior.
[0103] Emergency response protocol: Develop rigorous response measures according to the risk level.
[0104] First-level warning (heart rate > 120 bpm): The AR prompts to rest, and a notification is synchronously pushed to the family member side.
[0105] Second-level warning (sitting for more than 2 hours): A standing reminder pops up on the touch screen, and a virtual exercise task is started.
[0106] Third-level warning (falling detection): Automatically call the emergency contact, and at the same time, the AR displays first-aid guidelines to ensure the life safety and timely treatment of the elderly in case of emergency.
[0107] 1. AR glasses (NeuroVi s ion AR)
[0108] As the front-end display and interaction device of the system, the AR glasses integrate functions such as high-definition display, voice recognition, bone conduction output, and a camera. It can accurately superimpose virtual information on the real field of view according to the user's real-time environment, providing an immersive experience for the user. For example, in cognitive training tasks, the AR glasses can display direction indicators, step reminders, 3D models, etc. to help users better understand and complete tasks.
[0109] (1) Augmented reality glasses (AR glasses)
[0110] Optical display module: Light field display technology: Seamless integration of virtual and real scenes (transmittance ≥ 85%), supporting dynamic focal length adjustment (0.5m - 5m).
[0111] (2) Brain-computer interface: Adopting advanced brain-computer interface technology, it can monitor the brain activity status of the elderly in real time, such as attention concentration, anxiety emotions, etc. By analyzing electroencephalogram signals, the system can accurately understand the cognitive state of the elderly and provide a basis for subsequent personalized intervention. Non-invasive EEG electrodes on the forehead (sampling rate 256Hz) to monitor attention and emotional fluctuations in real time.
[0112] (3) Eye-tracking camera: Sampling rate of 120Hz, accuracy of ±0.5°, used for attention assessment and interactive control.
[0113] (4) Biosensing module: Near-infrared forehead temperature sensor (error ±0.1°C); Photoplethysmogram (PPG) module: Monitor heart rate (error ±1bpm) and blood oxygen saturation (error ±2%) in real time.
[0114] (5) Interactive control module: Bone conduction speaker: Directional voice prompts to avoid environmental interference; Infrared thermal imaging: Detect dangerous heat sources (such as high-temperature cooking stoves) and trigger AR warnings. Integrate multiple sensors, including head movement tracking sensors, eye tracking sensors, ambient light sensors, etc. The head movement tracking sensor can capture the actions of the elderly's head in real time to achieve precise positioning and interaction; the eye tracking sensor can monitor the elderly's fixation points, which helps to optimize the display of content and interaction logic; the ambient light sensor can automatically adjust the brightness of the display screen according to the ambient light intensity to ensure the best visual effect.
[0115] (6) Face recognition module: High-definition camera: Capture the user's facial features in real time, support kinship recognition and emotion analysis; Security authentication: Iris recognition to initiate personalized configuration (diopter, interface layout).
[0116] (7) Audio module: Have clear audio playback and speech recognition functions. The audio module can provide clear voice prompts and feedback for the elderly, facilitating voice interaction between the elderly and the system. At the same time, it can also play various sound effects to enhance the realism of the AR experience
[0117] 2. Intelligent interaction device module
[0118] As the operation and control center of the system, the intelligent interaction device is responsible for processing user input, sending commands to the AR glasses, and receiving data from the AR glasses. It can also run supporting applications to provide rich functions and interfaces, such as training records, progress tracking, social interaction, health management, etc. In addition, the intelligent interaction device also supports connection with other external devices, such as heart rate monitors, blood pressure monitors, smart bracelets, etc., to obtain more comprehensive health data and provide a basis for personalized intervention.
[0119] (1) Elderly-friendly touch screen: Designed with large size and high sensitivity according to the vision and operation characteristics of the elderly. The screen interface is simple and clear, with large and clear icons and text for easy operation by the elderly. At the same time, the touch screen supports multi-touch and can perform gesture operations such as zooming and panning to improve the operation experience of the elderly. 10-inch anti-glare capacitive screen, icon size ≥ 2 cm 2 , supports gesture zooming (pinch / slide); Dynamic UI adjustment: Simplify the interface according to the cognitive level (only 3 main function keys are retained in the primary mode).
[0120] (2) Barrier-free interaction module: Considering that some elderly people may have vision or hearing impairments, this module provides a variety of barrier-free interaction methods. For example, for visually impaired elderly people, the device is equipped with voice navigation and voice interaction functions, guiding the elderly to complete operations through voice prompts; for hearing-impaired elderly people, subtitle display and vibration reminder functions are provided to ensure that they can use the device smoothly. Braille button matrix: 4×4 layout, compliant with ISO 17351 standard, supports vibration coding feedback (frequency = operation status); Bone conduction microphone array: Voice command recognition (supports dialect adaptation), signal-to-noise ratio ≥ 80 dB.
[0121] (3) Environment perception module: Utilize sensors such as cameras and microphones to real-time sense the surrounding environment information. The camera can identify indoor items and spatial layouts to help the elderly better understand their surroundings; the microphone can receive sound signals in the environment to achieve voice control and voice interaction functions. Millimeter-wave radar: Monitor the activity trajectory within 5 m and identify abnormal behaviors (such as staying still for a long time); Multispectral sensor: Analyze the food components on the plate (identify 6 types of nutrients).
[0122] Smart light strip:
[0123] Integrate the smart light strip into the smart interaction device, such as the touch screen border or bracket, and connect it to AR glasses. The sensor and the processor cooperate to real-time sense the device state and environmental light. When the elderly operate, the light strip automatically adjusts the color and brightness according to the device mode and environmental light to ensure a clear and eye-protecting screen. At night or in the dark, the infrared sensor detects the movement of the elderly, and the light strip lights up with warm light to guide the way and prevent falls. The brightness and color can be personalized, and there is also a timing-off function, which is energy-saving and meets the different scene needs of the elderly, improving the convenience and safety of life.
[0124] (4) Announcement function: Built-in intelligent voice announcement system, which can announce important information to the elderly in voice. For example, when there is new information or a task, the system will automatically issue a voice prompt to ensure that the elderly do not miss important content. Voice synthesis engine: Supports bilingual (Chinese and English) announcement, and the speech rate is adjustable (slow / medium / fast three gears); Task reminder: Timely announce the task progress (such as "It is 10 am now, and it is time for rehabilitation training").
[0125] Cloud server module: As the core processing unit of the system, the cloud server is responsible for storing and managing a large amount of user data, including personal information, training content, health data, intervention plans, etc. It can also run advanced data analysis algorithms to deeply mine and analyze the collected data, so as to provide more accurate and personalized training plans and suggestions for users. At the same time, the cloud server can also share data with other medical institutions, research institutions or family members to achieve multi-party collaborative intervention and management, improving the intervention effect and efficiency.
[0126] Family member side collaborative management mini-program:
[0127] Data dashboard: Real-time display of patient physiological data (heart rate / blood oxygen / activity level), task completion rate;
[0128] Remote control: Adjust the AR scene difficulty, set medication reminders, receive emergency alarms;
[0129] Memory bank management: Upload old photos / videos, and the AI generates 3D virtual narrative scenes (such as restoring family gatherings).
[0130] Embodiment 2
[0131] The difference between this embodiment and Embodiment 1 is that a plurality of universal wheels are installed at the bottom of the base 1. The setting of the universal wheels facilitates the movement of the mounting bracket.
[0132] The rest is the same as Embodiment 1.
[0133] The above is only a preferred specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention, according to the technical solution and inventive concept of the present invention, makes equivalent substitutions or changes, and should be covered by the protection scope of the present invention.
Claims
1. An intelligent interaction device for the elderly with cognitive decline based on AR glasses, characterized in that, It includes an AR glasses module, an intelligent interaction device module, and a cloud server module. The AR glasses module, the intelligent interaction device module, and the cloud server module conduct real-time data exchange and synchronization through wireless communication technology. The cloud server module includes a user interface, a core processing unit, a family member side collaborative management mini-program, and a nursing management module. The nursing management includes a nursing closed-loop management module; the user interface includes a health management module, a cognitive activation module, an emotion activation module, a diet activation module, an exercise activation module, a social activation module, and a barrier-free interaction module. The intelligent interaction device module includes a smartphone, a tablet computer, and a mounting bracket; The AR glasses module is used to accurately superimpose virtual information on the real field of vision according to the user's real-time environment, providing the user with an immersive experience; The intelligent interaction device module is used to process user input, send instructions to the AR glasses, and receive data from the AR glasses, run the supporting application program, and provide rich functions and interfaces; The cloud server module is used to store and manage a large amount of user data, including personal information, training content, health data, and intervention plans, run advanced data analysis algorithms, deeply mine and analyze the collected data, so as to provide more accurate and personalized training plans and suggestions for users, share data with other medical institutions, research institutions, or family members, realize multi-party collaborative intervention and management, and improve the intervention effect and efficiency.
2. The intelligent interactive device for the elderly with cognitive decline based on AR glasses according to claim 1, characterized in that The health management module is used for health monitoring, cognitive health screening, abnormal index warning, and long-term health analysis.
3. The intelligent interaction device for the elderly with cognitive decline based on AR glasses according to claim 2, wherein The cognitive activation module dynamically generates a list of products with appropriate difficulty according to the MMSE score of the elderly. The AR projects a realistic shelf and navigation light strip to guide the elderly to experience shopping and exercise their cognitive and action abilities; project a digital matrix on the ground and require the user to step on it according to specific rules. If there is an error, the touch screen will vibrate immediately to remind, strengthening the digital memory and reaction ability training; the intelligent medicine box uses RFID to identify drugs, and the AR glasses superimpose an animation guide for taking medicine.
4. The intelligent interaction device for the elderly with cognitive decline based on AR glasses according to claim 3, characterized in that, The emotion activation module uses AI technology to perform 3D reconstruction based on old photos, generates virtual images of relatives, supports emotional conversations, creates a warm communication atmosphere through voice emotion analysis and micro-expression feedback, and alleviates the loneliness of the elderly; carefully collects the oral stories of the elderly, uses AI to automatically generate animated videos, and family members edit scene details through the mini-program to enrich the spiritual life of the elderly and promote emotional expression; the AR superimposes dynamic labels, the voice recognition generates text records and synchronizes them to the cloud family file, and the patterns drawn on the tablet are projected into the AR environment in real time to cooperate to complete the virtual jigsaw puzzle.
5. The intelligent interaction device for the elderly with cognitive decline based on AR glasses according to claim 4, characterized in that, The diet activation module is as follows: Intelligent kitchen guidance: Project the cooking process step by step through AR. For example, the steps of frying an egg: heat the pan → pour oil → beat the egg. The spectral sensor closely monitors the oil temperature and triggers a voice alarm in time when it exceeds the limit to ensure cooking safety and standardization; Nutritional analysis algorithm: Relying on image recognition and weight sensing technology, accurately calculate the intake of protein and dietary fiber, and generate a detailed nutritional score report to provide a scientific basis for the dietary health of the elderly; Food Visual Enhancement: Using image processing technology to enhance the visual appearance of food, making it look fresher and more appealing, and increasing the appetite and desire to eat of the elderly; Kitchen Safety Training: Simulating an oil pan fire and guiding the steps of using a fire extinguisher through AR.
6. The intelligent interaction device for the elderly with cognitive decline based on AR glasses according to claim 5, characterized in that, The specific description of the motion activation module is as follows: Virtual Outdoor Scenario: AR projects a park trail, and a pressure mat simulates the touch of a pebble road; Virtual Coach Gait Correction: Combining real-time feedback from the pressure mat to provide accurate gait guidance for the elderly, helping them improve their walking posture and stability; Anti-fall Safety Enhancement Training: Using AR to simulate dangerous scenarios, such as a slippery ground condition, to train the elderly's emergency response ability; at the same time, conducting safety knowledge quizzes and playing teaching videos when the answers are incorrect to enhance safety awareness and response skills; Personal Self-care Training: AR guides the steps of dressing, with arrows on the AR glasses for guidance, and a tactile glove simulates the touch of fabric; Travel Simulation Training: AR generates a bus stop scenario and provides voice prompts for boarding steps.
7. The intelligent interaction device for the elderly with cognitive decline based on AR glasses according to claim 6, characterized in that, The social activation module includes Holographic Relative Interaction: Using light field projection technology to achieve life-sized holographic images and supporting gesture interaction; Interest Social Platform: Virtual interest groups and AR projection collaborative tasks.
8. The intelligent interaction device for the elderly with cognitive decline based on AR glasses according to claim 7, characterized in that, The barrier-free interaction module includes Visually Impaired Mode: Converting the AR scene into a sound field, with the position of the commodity corresponding to the stereo azimuth, and the distance being reflected as the volume attenuation gradient; Setting up tactile navigation, encoding vibrations through Braille buttons for the convenience of visually impaired elderly to operate and perceive the environment, using bone conduction navigation to prompt directions, and having a tactile map; Hearing Impaired Mode: The AR subtitles can adaptively adjust the font size according to emotional stress; Setting up light effect warnings to ensure that hearing impaired elderly can clearly receive information prompts and instructions, and generating real-time subtitles.
9. The intelligent interaction device for the elderly with cognitive decline based on AR glasses according to claim 8, characterized in that, The installation bracket includes a base (1), a support sleeve (2) is fixedly installed at the top of the base (1), a lifting rod (3) is slidably installed in the support sleeve (2), a locking bolt (5) is threadedly installed on the support sleeve (2), a lifting plate (4) is fixedly installed at the top of the lifting rod (3), two side plates (6) are fixedly installed at the top of the lifting plate (4), a rotating groove (14) is opened on one side of each of the two side plates (6), a rotating block (15) is rotatably installed in each of the two rotating grooves (14), one end of each of the two rotating blocks (15) is fixedly installed with the same placement plate (7), a bottom support plate (9) is fixedly installed on one side of the placement plate (7), two clamping plates (8) are slidably installed on one side of the placement plate (7), two sliding grooves (10) are opened on one side of the placement plate (7), a slider (12) is slidably installed in each of the two sliding grooves (10), the two sliders (12) are respectively fixedly connected to the two clamping plates (8), a limiting rod (11) is fixedly installed in each of the two sliding grooves (10), the two sliders (12) are respectively slidably connected to the two limiting rods (11), one end of a first spring (13) is fixedly installed on one side of each of the two sliders (12), and the other end of the first spring (13) is fixedly connected to the inner wall of one side of the sliding groove (10).
10. The intelligent interaction device for the elderly with cognitive decline based on AR glasses according to claim 9, characterized in that, One end of one of the two rotating blocks (15) is provided with a rectangular groove (16). A rectangular block (17) is slidably installed in the rectangular groove (16). One side of the rectangular block (17) is fixedly installed with a pulling plate (18). One side of the pulling plate (18) is fixedly installed with a locking block (19). A plurality of locking grooves (20) distributed in a ring shape are provided on one side of the side plate (6). One side of the locking block (19) is clamped with the corresponding locking groove (20). One end of a second spring (21) is fixedly installed on one inner wall of the rectangular groove (16). The other end of the second spring (21) is fixedly connected with the rectangular block (17). A handheld device (22) is provided on the top of the placing plate (7). A display screen (23), a glasses groove (24), and a stylus (25) are provided on the handheld device (22). A charging port (26) is provided on one side of the handheld device (22). A luminous strip (28) is provided at the bottom of the handheld device (22). A speaker is provided on the other side of the handheld device (22). Glasses are provided in the glasses groove (24).
Citation Information
Cited By
Intelligent task management method and system for cognitive impairment user
CN122335244A
