Cognitive weakness diagnosis system and method based on virtual reality technology

Through virtual reality technology, cognitive evaluation is performed using VR somatosensory devices and cloud software, which solves the problems of strong subjectivity and time-consuming and labor-intensive traditional evaluation methods, and achieves more accurate and convenient diagnosis of cognitive weakness, early identification and Delay the progression of the disease.

CN118919058APending Publication Date: 2024-11-08YANBIAN UNIV
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411056438.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-02
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Traditional cognitive function assessment methods are based on questionnaires and standardized tests. They are subjective, time-consuming and labor-intensive, and cannot quickly and conveniently conduct cognitive assessments, especially in the elderly, which is difficult to identify the risk of cognitive weakness in the early stage.

Method used

Using a cognitive weakness diagnosis system based on virtual reality technology, through VR somatosensory devices and software backend cloud, simulate real scenes for cognitive evaluation, including shopping, traffic navigation and other scenarios, use sensors and cameras to collect data, and analyze users in the virtual environment. behaviors and reactions provide objective and quantitative evaluation results.

Benefits of technology

It improves the objectivity and standardization of the assessment, reduces the influence of subjective factors, allows the elderly to undergo testing at home, reduces psychological stress, provides the possibility of early diagnosis and intervention, delays disease progression, and improves patients' quality of life.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118919058A_ABST
    Figure CN118919058A_ABST
Patent Text Reader

Abstract

The invention discloses a cognitive weakness diagnosis system and method based on a virtual reality technology, and relates to the technical field of network medical diagnosis, and the system comprises a VR somatosensory device, a software background cloud and a virtual reality APP. The VR somatosensory device comprises an MCU, a communication module, a power management module, a power charging module, a switch, a Type-C interface, a display screen, a camera, a microphone, a loudspeaker, a controller and a sensor. The sensor, the display screen and the loudspeaker are in one-way connection with the MCU; the camera, the microphone and the controller are bidirectionally connected with the MCU; the MCU is in one-way connection with the power management module; real scenes and various scenes such as shopping and traffic navigation in real life are simulated through the virtual reality technology, the cognition function of a subject can be evaluated more accurately through the naturalness and authenticity of the environment, especially in the aspects of memory, attention, decision-making ability and the like, the influence of subjective factors is reduced, and the cognitive function of the subject can be evaluated more accurately. And the objectivity of the diagnosis result is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of network medical diagnosis, and in particular relates to a cognitive impairment diagnosis system and method based on virtual reality technology. Background Art

[0002] Cognitive decline is a new hot topic in the field of geriatric medicine and geriatric health research. It refers to the simultaneous existence of physical weakness and mild cognitive impairment in an individual without dementia. Cognitive decline is the core of geriatric syndrome research, which brings many negative impacts to individuals, families and society, and significantly increases adverse health outcomes such as falls, fractures, re-hospitalization, disability and death in the elderly. At the same time, because cognitive decline occurs in the intermediate stage between age-related cognitive changes and neurodegenerative diseases, it has a higher risk of progression to dementia. Therefore, it is considered to be a functional decline state before Alzheimer's disease. Its development is reversible and is an important "window period" for the prevention and treatment of dementia. Therefore, it is particularly important to effectively identify which group of people are more likely to be at risk of cognitive decline.

[0003] In recent years, studies have shown that social and environmental factors can explain about 80% of the health outcomes of human individuals. A large number of studies have shown that the occurrence of cognitive decline is not only related to physical and mental health factors, but social factors are also important determinants of its occurrence. Han Jiaying and other studies have found that the risk of cognitive decline in the elderly with poor social relationships or who do not often participate in social activities will increase. Therefore, social factors provide a broader approach to understanding the mechanism of cognitive decline, including social isolation. Social isolation refers to the state in which an individual's social network is reduced, social contact and social interaction are lacking, and there is also a lack of high-quality relationships with social belonging and satisfaction, including both subjective and objective aspects. It is one of the research hotspots in the field of elderly health that has received much attention. More and more studies have shown that due to the lack of social roles, the reduction of social connections and the decline of physical functions, the elderly face social isolation in various interpersonal and intergenerational relationships, which has a profound adverse effect on physical and mental health. Neurobiological studies have shown that social isolation can lead to a reduction in the volume of the prefrontal lobe that controls decision-making and social interaction in the elderly. At the same time, the hippocampal volume of elderly people in social isolation is lower than normal, and the concentration of brain-derived neurotrophic factor is lower-both of which are related to impaired learning and memory functions.

[0004] Cognitive decline refers to a mild decline in cognitive function, with symptoms including memory loss, inattention, executive dysfunction, etc., which usually do not affect daily life. With the aging of the population, the prevalence of cognitive decline is increasing year by year. Early diagnosis and intervention are crucial to delay the progression of the disease and improve the quality of life of patients. Traditional cognitive function assessment methods are usually based on questionnaires and standardized tests, which have the disadvantages of being highly subjective, time-consuming and labor-intensive, and cannot quickly and conveniently conduct cognitive assessments. Therefore, we propose a cognitive decline diagnosis system and method based on virtual reality technology. Summary of the invention

[0005] The purpose of the present invention is to provide a cognitive impairment diagnosis system based on virtual reality technology. By wearing VR somatosensory equipment, the problem that traditional cognitive function assessment methods are usually based on questionnaires and standardized tests, have the disadvantages of strong subjectivity, time-consuming and labor-intensive, and cannot conduct cognitive assessment quickly and conveniently is solved.

[0006] In order to solve the above technical problems, the present invention is achieved through the following technical solutions:

[0007] The present invention is a cognitive impairment diagnosis system based on virtual reality technology, including VR somatosensory equipment, software background cloud and virtual reality APP;

[0008] The VR somatosensory device includes an MCU, a communication module, a power management module, a power charging module, a switch, a Type-C interface, a display, a camera, a microphone, a speaker, a controller and a sensor; the sensor, camera, display and speaker are unidirectionally connected to the MCU; the sensor is bidirectionally connected to the heart rate monitoring bracelet; the camera is bidirectionally connected to the eye tracking sensor; the microphone and the controller are unidirectionally connected to the MCU; the controller is bidirectionally connected to the handgripper; the MCU is bidirectionally connected to the Vientiane treadmill; the Vientiane treadmill is unidirectionally connected to the focus module; the MCU is unidirectionally connected to the power management module; the power management module is unidirectionally connected to the switch; the power management module is unidirectionally connected to the power charging module; the Type-C interface is unidirectionally connected to the power charging module; the MCU is bidirectionally connected to the communication module; the communication module is bidirectionally connected to the WIFI antenna, and the software background cloud includes a signal transceiver module, a scene construction module, a task design module, a task indicator ... The invention relates to a guidance module, an environment interaction module, a behavior capture module and a cognitive assessment module; the signal transceiver module is bidirectionally connected to the WiFi module; the communication module and the signal transceiver module transmit signals through the WiFi antenna; the signal transceiver module is bidirectionally connected to the scene construction module; the scene construction module is bidirectionally connected to the task design module; the task design module is bidirectionally connected to the task guidance module; the task guidance module is bidirectionally connected to the environment interaction module; the environment interaction module is bidirectionally connected to the behavior capture module; the behavior capture module is unidirectionally connected to the cognitive assessment module, and the virtual reality APP includes a data acquisition module, a data analysis module, a data generation module, a data storage module and a data comparison module; the cognitive assessment module is unidirectionally connected to the data acquisition module; the data acquisition module is unidirectionally connected to the data analysis module; the data analysis module is unidirectionally connected to the data generation module; the data generation module is unidirectionally connected to the data storage module; the data storage module is unidirectionally connected to the data comparison module.

[0009] As a preferred technical solution, the MCU is responsible for sending signals to sensors, display screens and speakers, and receiving signals from cameras, microphones, controllers and power management modules for logical processing. The sensor is responsible for collecting signals from the MCU, and after signal analysis, it causes different sensations on the body, thereby simulating the physical senses in reality. The speaker is responsible for receiving signals from the MCU and converting electrical signals into sound signals, so that the user can hear various sounds. The display screen has a resolution of 1080p, and is responsible for receiving text, graphics, videos and other information processed by the MCU and presenting them to the user in a visual form, so that the user can intuitively see different display screens. The controller is responsible for providing users with the ability to interact with virtual reality, and uploading them to the MCU for operation execution, which greatly enhances the user's sense of immersion and reality, helps users interact with the virtual environment, and facilitates users to diagnose cognitive impairment. The camera has a resolution of 1080p and is responsible for monitoring the patient's current status and facial expressions for the background. The microphone is responsible for receiving the sound emitted by the user, so as to facilitate communication with the user. The power management module is responsible for powering the MCU, thereby powering the VR somatosensory device for use. The switch is responsible for controlling the start and stop of the current of the power management module, thereby controlling the switch state of the VR somatosensory device. The power charging module is responsible for providing a stable power supply to the power management module and effectively managing the charging of the battery. This configuration ensures that the electronic device can obtain appropriate energy support in various working modes, thereby improving the overall performance and power utilization efficiency. The Type-C interface is responsible for receiving power from the power charging module to charge the power management module. The communication module is responsible for sending the signal transmitted to the MCU to the background through the WiFi antenna.

[0010] As a preferred technical solution, the signal receiving module is responsible for receiving and reading the signal transmitted by the WiFi antenna, the scene construction module is responsible for building scenes in virtual reality to evaluate the patient's cognitive function, and the constructed scenes include shopping scenes, cooking scenes, traffic navigation scenes, financial management scenes, daily maintenance scenes, social interaction scenes, emergency response scenes, drug management scenes, time management scenes, environmental adaptation scenes, etc. The task design module is responsible for formulating various tasks in the virtual reality environment, which can be adjusted according to the different difficulty levels and duration of the tasks, so as to test the user's cognitive ability. The task guidance module is responsible for guiding the user in the task, prompting the progress of the task, and facilitating the user to interpret the task. The environment interaction module is responsible for sending the interaction signal between the environment, and transmitting the signal to the MCU via WiFi so as to feed it back to the sensor, and simulating the user's body sensation. The behavior capture module is responsible for monitoring the user's current behavior in virtual reality in the background and analyzing the behavior. The cognitive evaluation module is responsible for analyzing the different behaviors generated by the user, and analyzing and calculating the completion progress of tasks of different difficulty levels and the duration used by the user, so as to make an overall evaluation.

[0011] As a preferred technical solution, the data acquisition module is responsible for collecting multiple groups of evaluations conducted by the cognitive assessment module, the data analysis module is responsible for analyzing different assessment data and classifying symptoms of different degrees to see whether the user's current cognition has symptoms, the data generation module is responsible for generating and displaying the analyzed data on the companion's mobile phone, the analyzed data is convenient for the companion to distinguish the user's current condition, the data storage module is to store the generated data, and it is convenient for the companion to view and compare the previous data, and the data comparison module is responsible for comparing the current usage data with the previous data to determine whether the user's current condition has improved or deteriorated. People who are currently entering the frail period lack contact with others due to situational factors, such as a small social network size, less social interaction or lack of participation in social activities, which reflects the degree to which people are objectively "disconnected" from the social network and lack a sense of social belonging and a satisfying, high-quality relationship.

[0012] A method for a cognitive impairment diagnosis system based on virtual reality technology comprises the following steps:

[0013] S1: Turn on the switch to power the VR device. The software background cloud builds a virtual reality scene and transmits it to the MCU via WiFi signals. The MCU then transmits the display signal to the display screen for users to watch the scene.

[0014] S2: After the scene is constructed, the task design module transfers the designed task to the current scene, provides task guidance based on the current scene, and explains the task to the user.

[0015] S3: After the user understands the task, he interacts according to the current scene task and operates the controller he wears to issue instructions to the character in the virtual reality and perform the instruction operation.

[0016] S4: The operations performed by the user are observed and analyzed by the cognitive assessment module. The analyzed data are collected by the accompanying person's mobile phone APP, and the collected data are generated. The generated data is uploaded to the accompanying person's mobile phone for observation and storage. The stored data can be analyzed and compared with previous data.

[0017] The present invention has the following beneficial effects:

[0018] The present invention simulates real scenes through virtual reality technology. Virtual reality technology can create an extremely realistic test environment, simulating various scenes in real life, such as shopping, traffic navigation, etc. The naturalness and authenticity of this environment help to more accurately evaluate the cognitive function of the subject, especially in terms of memory, attention and decision-making ability, reduce the influence of subjective factors, and improve the objectivity of the diagnostic results. The test conditions can be precisely controlled to ensure that each subject is tested in the same environment, which helps to reduce the inconsistency of test results due to environmental differences, thereby improving the standardization and comparability of the test, designing a variety of virtual activity scenes, such as daily life simulation, emergency response, etc., and observing the performance of the elderly in these scenes. The activity ability is evaluated by indicators such as task completion and reaction speed in the VR environment, and the overall performance of the elderly in the virtual environment, such as task completion efficiency, movement coordination, reaction speed, etc., is combined to comprehensively evaluate the activity ability of the elderly, so as to judge the physical weakness of the elderly.

[0019] The present invention allows cognitive asthenia testing to be performed at home by wearing VR somatosensory equipment and a controller at home, without going to a medical institution or laboratory. This not only saves transportation time, but also reduces the psychological pressure of the subjects, making the testing process more relaxed and comfortable. Testing at home does not require worrying about personal information and illness being known to others, thus protecting personal privacy and improving convenience.

[0020] The present invention allows doctors or accompanying personnel to remotely monitor the virtual reality test process and adjust the test parameters in real time as needed. This flexibility makes the test more personalized and can be adjusted according to the specific circumstances of the subjects. The APP can automatically record all operations and reactions of the user and generate objective and quantitative data. These data are easy to store, analyze and compare, providing doctors with a strong basis for diagnosis. Through regular virtual reality cognitive assessments, signs of cognitive decline can be detected early, providing the possibility for early intervention, which is of great significance for delaying disease progression and improving the quality of life of patients.

[0021] In 2000, Harvard scholar Lisa F. Berkman proposed a theoretical model of social network influence on health outcomes. This model is recognized as a theoretical framework to guide the study of the mechanism of social factors and health outcomes. In this model, social network, as a core variable affecting health outcomes, affects the social structure "upward" and "downward" through a series of social physiological mechanisms, which then have an effect on health effects or health outcomes. In the "downward" pathway, social network affects the occurrence and development of health behaviors through four paths: provision of social support, social influence, social interaction and social integration, and acquisition of resources and materials; after being affected by the network, the subsequent social physiological changes will have a direct effect on health outcomes. In this study, social isolation refers to the shrinkage of social networks. Therefore, it is proposed that social isolation may directly affect cognitive decline, or indirectly affect cognitive decline by causing corresponding changes in physical health, mental health and health behaviors. Therefore, we constructed a situational interaction without leaving the social network, thereby preventing patients from being disconnected from society, and being able to interact with normal behaviors when facing similar social situations, thereby achieving the behavior of reducing cognitive decline and significantly reducing adverse health outcomes such as falls, fractures, re-hospitalization, disability and death in the elderly.

[0022] Of course, any product implementing the present invention does not necessarily need to achieve all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for describing the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0024] Figure 1 The present invention discloses a cognitive impairment diagnosis system based on virtual reality technology. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0026] See also Figure 1 As shown, the present invention is a cognitive impairment diagnosis system based on virtual reality technology, including VR somatosensory equipment, software background cloud and virtual reality APP;

[0027] The VR somatosensory device includes an MCU, a communication module, a power management module, a power charging module, a switch, a Type-C interface, a display, a camera, a microphone, a speaker, a controller and a sensor; the sensor, camera, display and speaker are unidirectionally connected to the MCU; the sensor is bidirectionally connected to the heart rate monitoring bracelet; the camera is bidirectionally connected to the eye tracking sensor; the microphone and the controller are unidirectionally connected to the MCU; the controller is bidirectionally connected to the handgripper; the MCU is bidirectionally connected to the Vientiane treadmill; the Vientiane treadmill is unidirectionally connected to the focus module; the MCU is unidirectionally connected to the power management module; the power management module is unidirectionally connected to the switch; the power management module is unidirectionally connected to the power charging module; the Type-C interface is unidirectionally connected to the power charging module; the MCU is bidirectionally connected to the communication module; the communication module is bidirectionally connected to the WIFI antenna, and the software background cloud includes a signal transceiver module, a scene construction module, a task design module, a task indicator ... The invention relates to a guidance module, an environment interaction module, a behavior capture module and a cognitive assessment module; the signal transceiver module is bidirectionally connected to the WiFi module; the communication module and the signal transceiver module transmit signals through the WiFi antenna; the signal transceiver module is bidirectionally connected to the scene construction module; the scene construction module is bidirectionally connected to the task design module; the task design module is bidirectionally connected to the task guidance module; the task guidance module is bidirectionally connected to the environment interaction module; the environment interaction module is bidirectionally connected to the behavior capture module; the behavior capture module is unidirectionally connected to the cognitive assessment module, and the virtual reality APP includes a data acquisition module, a data analysis module, a data generation module, a data storage module and a data comparison module; the cognitive assessment module is unidirectionally connected to the data acquisition module; the data acquisition module is unidirectionally connected to the data analysis module; the data analysis module is unidirectionally connected to the data generation module; the data generation module is unidirectionally connected to the data storage module; the data storage module is unidirectionally connected to the data comparison module.

[0028] The MCU is responsible for sending signals to sensors, displays and speakers, and receiving signals from cameras, microphones, controllers and power management modules for logical processing. The sensors are responsible for collecting signals from the MCU, analyzing the signals and causing different sensations on the body, thereby simulating the physical senses in reality. The speakers are responsible for receiving signals from the MCU and converting electrical signals into sound signals, allowing users to hear a variety of sounds. The display resolution is 1080p, and it is responsible for receiving text, graphics, videos and other information processed by the MCU and presenting them to users in a visual form, allowing users to intuitively see different display images. The controller is responsible for providing users with the ability to interact with virtual reality and uploading them to the MCU for operation and execution, greatly enhancing the user's sense of immersion and reality, helping users interact with the virtual environment, and facilitating users to diagnose cognitive impairment. The camera resolution is 1080p, and it is responsible for monitoring the patient's current status and facial expressions for the background. The microphone is responsible for receiving the sound emitted by the user, thereby facilitating communication with the user. The power management module is responsible for powering the MCU, thereby powering the VR somatosensory device for use. The switch is responsible for controlling the start and stop of the current of the power management module, thereby controlling the switching state of the VR somatosensory device. The power charging module is responsible for providing a stable power supply to the power management module and effectively managing the charging of the battery. This configuration ensures that the electronic equipment can get proper energy support in various working modes, thereby improving the overall performance and power utilization efficiency. The Type-C interface is responsible for receiving power from the power charging module to charge the power management module. The communication module is responsible for sending the signal transmitted to the MCU to the background through the WiFi antenna.

[0029] The signal receiving module is responsible for receiving and reading the signal transmitted by the WiFi antenna. The scene construction module is responsible for building scenes in virtual reality to evaluate the patient's cognitive function. The constructed scenes include shopping scenes, cooking scenes, traffic navigation scenes, financial management scenes, daily maintenance scenes, social interaction scenes, emergency response scenes, drug management scenes, time management scenes, environmental adaptation scenes, etc. The task design module is responsible for formulating various tasks in the virtual reality environment, which can be adjusted according to the different difficulty levels and duration of the tasks to test the user's cognitive ability. The task guidance module is responsible for guiding the user in the task, prompting the progress of the task, and facilitating the user to interpret the task. The environmental interaction module is responsible for sending interactive signals with the environment, and transmitting the signals to the MCU via WiFi to feed back to the sensor to simulate the user's body sensation. The behavior capture module is responsible for monitoring the user's current behavior in virtual reality in the background and analyzing the behavior. The cognitive evaluation module is responsible for analyzing the different behaviors generated by the user, and analyzing and calculating the completion progress of tasks of different difficulty levels and the duration used by the user, so as to make an overall evaluation.

[0030] The data acquisition module is responsible for collecting multiple groups of evaluations conducted by the cognitive assessment module. The data analysis module is responsible for analyzing different evaluation data and classifying symptoms of different degrees to see whether the user's current cognition has symptoms. The data generation module is responsible for generating and displaying the analyzed data on the companion's mobile phone. The analyzed data is convenient for the companion to distinguish the user's current condition. The data storage module stores the generated data to facilitate the companion to view and compare previous data. The data comparison module is responsible for comparing the current usage data with previous data to determine whether the user's current condition has improved or worsened. A method for a cognitive impairment diagnosis system based on virtual reality technology includes the following steps:

[0031] S1: Turn on the switch to power the VR device. The software background cloud builds a virtual reality scene and transmits it to the MCU via WiFi signals. The MCU then transmits the display signal to the display screen for users to watch the scene.

[0032] S2: After the scene is constructed, the task design module transfers the designed task to the current scene, provides task guidance based on the current scene, and explains the task to the user.

[0033] S3: After the user understands the task, he interacts according to the current scene task and operates the controller he wears to issue instructions to the character in the virtual reality and perform the instruction operation.

[0034] S4: The operations performed by the user are observed and analyzed by the cognitive assessment module. The analyzed data are collected by the accompanying person's mobile phone APP, and the collected data are generated. The generated data is uploaded to the accompanying person's mobile phone for observation and storage. The stored data can be analyzed and compared with previous data.

[0035] A specific application of this embodiment is: the user wears the VR somatosensory device and starts the device through the cloud-based software background. The APP transmits the constructed simulation scene to the MCU through WiFi, and parses and uploads it to the display. The designed task prompts the user with simple operations through guidance. The user's operations and the user's current state are detected by the camera and behavior capture module. According to the user's operations, the software background performs cognitive assessment, and by adjusting different virtual reality scenes and task difficulty levels, multiple groups of cognitive decline assessments and physical decline assessments are obtained respectively. The multiple groups of data are collected and analyzed by the software in the mobile phone of the accompanying person, and the analyzed data are divided by symptoms and uploaded for the accompanying person to observe intuitively. After the uploaded data is stored, the previous detection data is analyzed and compared with the current data in multiple groups of different tests, so as to determine whether the user's current cognitive decline and physical decline have improved or worsened.

[0036] It is worth noting that in the above system embodiment, the various units included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0037] In addition, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiments can be completed by instructing related hardware through a program, and the corresponding program can be stored in a computer-readable storage medium.

[0038] The preferred embodiments of the present invention disclosed above are only used to help illustrate the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can understand and use the present invention well. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. A cognitive impairment diagnosis system based on virtual reality technology, including VR somatosensory equipment, software background cloud and virtual reality APP, Features: The VR somatosensory device includes an MCU, a communication module, a power management module, a power charging module, a switch, a Type-C interface, a display screen, a camera, a microphone, a speaker, a controller and a sensor; the sensor, camera, display screen and speaker are unidirectionally connected to the MCU; the sensor is bidirectionally connected to the heart rate monitoring bracelet; the camera is bidirectionally connected to the eye tracking sensor; the microphone and the controller are unidirectionally connected to the MCU; the controller is bidirectionally connected to the handgrip; the MCU is bidirectionally connected to the Vientiane treadmill; the Vientiane treadmill is unidirectionally connected to the focus module; the MCU is unidirectionally connected to the power management module; the power management module is unidirectionally connected to the switch; the power management module is unidirectionally connected to the power charging module; the Type-C interface is unidirectionally connected to the power charging module; the MCU is bidirectionally connected to the communication module; the communication module is bidirectionally connected to the WIFI antenna; The software backend cloud includes a signal transceiver module, a scene construction module, a task design module, a task guidance module, an environment interaction module, a behavior capture module and a cognitive assessment module; the signal transceiver module is bidirectionally connected to the WiFi module; the communication module and the signal transceiver module transmit signals through the WiFi antenna; the signal transceiver module is bidirectionally connected to the scene construction module; the scene construction module is bidirectionally connected to the task design module; the task design module is bidirectionally connected to the task guidance module; the task guidance module is bidirectionally connected to the environment interaction module; the environment interaction module is bidirectionally connected to the behavior capture module; the behavior capture module is unidirectionally connected to the cognitive assessment module; The virtual reality APP includes a data acquisition module, a data analysis module, a data generation module, a data storage module and a data comparison module; the cognitive assessment module is unidirectionally connected to the data acquisition module; the data acquisition module is unidirectionally connected to the data analysis module; the data analysis module is unidirectionally connected to the data generation module; the data generation module is unidirectionally connected to the data storage module; the data storage module is unidirectionally connected to the data comparison module.

2. According to claim 1, a cognitive impairment diagnosis system based on virtual reality technology, It is characterized in that The MCU is responsible for sending signals to sensors, display screens and speakers, and receiving signals from cameras, microphones, controllers and power management modules for logical processing; The sensor is responsible for collecting the signals sent by the MCU, and after signal analysis, it causes different sensations on the body, thereby simulating the physical senses in reality; The heart rate monitoring bracelet is responsible for monitoring the user's heart rate based on the pulse, thereby determining the strength of the user's heartbeat. A drop in heart rate may indicate fatigue in the user; The speaker is responsible for receiving the signal sent by the MCU and converting the electrical signal into an acoustic signal, so that the user can hear a variety of sounds; The display screen has a resolution of 1080p and is responsible for receiving text, graphics, video and other information processed by the MCU and presenting it to the user in a visual form, so that the user can intuitively see different display images; The controller is responsible for providing users with the ability to interact with virtual reality and uploading it to the MCU for operation execution, which greatly enhances the user's sense of immersion and reality, helps users interact with the virtual environment, and facilitates users to diagnose cognitive impairment. The gripper is responsible for measuring the deformation of an object when it is subjected to an external force through a strain gauge, thereby indirectly measuring the grip force; The camera has a resolution of 1080p and is responsible for monitoring the patient's current status and facial expressions for the background; The eye tracking sensor is responsible for monitoring the user's eye movement through the built-in camera of the VR headset and analyzing the user's concentration and fatigue status; The Vientiane treadmill is equipped with sensors that can monitor the user's running speed, cadence, heart rate and other data in real time, helping the user to better understand their exercise status and adjust the exercise intensity accordingly; The weight measurement module is responsible for detecting the weight of the user when the user is on the Vientiane treadmill; The microphone is responsible for receiving the sound emitted by the user, thereby facilitating communication with the user; The power management module is responsible for supplying power to the MCU, thereby supplying power to the VR somatosensory device for use. The switch is responsible for controlling the start and stop of the current of the power management module, thereby controlling the switch state of the VR somatosensory device. The power charging module is responsible for providing a stable power supply to the power management module and effectively managing the charging of the battery. This configuration ensures that the electronic device can obtain appropriate energy support in various working modes, thereby improving the overall performance and power utilization efficiency. The Type-C interface is responsible for receiving power from the power charging module, thereby charging the power management module. The communication module is responsible for sending the signal transmitted to the MCU through the WiFi antenna to the background.

3. According to claim 1, a cognitive impairment diagnosis system based on virtual reality technology, It is characterized in that The signal receiving module is responsible for receiving and reading the signal transmitted by the WiFi antenna; The scenario construction module is responsible for constructing scenarios in virtual reality to evaluate the patient's cognitive function, such as shopping scenarios, cooking scenarios, traffic navigation scenarios, financial management scenarios, daily maintenance scenarios, social interaction scenarios, emergency response scenarios, drug management scenarios, time management scenarios, and environmental adaptation scenarios; The task design module is responsible for formulating various tasks in the virtual reality environment, which can be adjusted according to the different difficulty and duration of the tasks, so as to test the cognitive ability of the user; The task guidance module is responsible for guiding the user in the task, prompting the progress of the task, and facilitating the user to interpret the task; The environment interaction module is responsible for sending interaction signals with the environment, and transmitting the signals to the MCU via WiFi so as to feed back to the sensor, simulating the user's body sensation; The behavior capture module is responsible for monitoring the user's current behavior in the virtual reality and analyzing the behavior; The cognitive assessment module is responsible for analyzing different behaviors generated by users, and analyzing and calculating the completion progress of tasks of different difficulty levels and the time taken by users, so as to make an overall assessment.

4. According to claim 1, a cognitive impairment diagnosis system based on virtual reality technology, It is characterized in that The data acquisition module is responsible for collecting multiple groups of evaluations performed by the cognitive evaluation module. The data analysis module is responsible for analyzing different evaluation data and classifying symptoms of different degrees to see whether the user's current cognition has symptoms; The data generation module is responsible for generating and displaying the analyzed data in the accompanying person's mobile phone. The analyzed data is convenient for the accompanying person to distinguish the current status of the user; The data storage module stores the generated data, making it convenient for the accompanying person to view and compare the previous data. The data comparison module is responsible for comparing the current usage data with the previous data to determine whether the user's current situation has improved or deteriorated.

5. A method for diagnosing cognitive impairment based on virtual reality technology according to any one of claims 1 to 9, It is characterized in that The following steps are involved: S1: Turn on the switch to power the VR device. The software background cloud builds a virtual reality scene and transmits it to the MCU via WiFi signals. The MCU then transmits the display signal to the display screen for users to watch the scene. S2: After the scene is constructed, the task design module transfers the designed task to the current scene, provides task guidance based on the current scene, and explains the task to the user. S3: After the user understands the task, he interacts according to the current scene task and operates the controller he wears to issue instructions to the character in the virtual reality and perform the instruction operation. S4: The operations performed by the user are observed and analyzed by the cognitive assessment module. The analyzed data are collected by the accompanying person's mobile phone APP, and the collected data are generated. The generated data is uploaded to the accompanying person's mobile phone for observation and storage. The stored data can be analyzed and compared with previous data.

Citation Information

Patent Citations

  • Cognitive function training system for scene interaction and application method thereof

    CN103268392A

  • Cognitive assessment method and system based on virtual reality

    CN106599558A

  • Social function evaluation training system based on virtual environment and virtual characters

    CN110070944A

  • Space cognitive ability intelligent evaluation system and method based on virtual reality

    CN114664442A