Old people cognitive health management system based on virtual reality technology
By based on the cognitive health management system based on virtual reality technology, the problem of cognitive health management and errors of diagnostic results in existing technologies have been solved. Adjustment.
Patent Information
- Application Number
- CN202411398949.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-09
- Publication Date
- 2025-01-21
- Estimated Expiration
- 2044-10-09
AI Technical Summary
The existing cognitive health management technology of the elderly is complicated, and the elderly communicate with doctors less often, resulting in errors in the diagnosis results.
Adopt the cognitive health management system based on virtual reality technology, obtain user selection data through the initial login module, the scene acquisition module acquisition interactive scene, the data acquisition module collects the body and audio and video data in real time, the cognitive health assessment module analysis data, the decision generation generation generates the generation of decision generation Module generates training decisions to recognize the health management module to adjust the rehabilitation training plan.
The accuracy of cognitive health assessment has been improved, the number of times and diagnostic time to go to the hospital has been reduced, the diagnostic efficiency is improved, and the user's personalized rehabilitation training needs are met.
Smart Images

Figure CN119339946A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of cognitive health management, and in particular to a cognitive health management system for the elderly based on virtual reality technology. Background Art
[0002] Cognitive health of the elderly mainly refers to the cognitive health of the brain of the elderly. Brain cognitive health means that the brain has cognitive functions and mental and psychological states that match the age, and there are no brain diseases that affect the normal function of the brain. Brain cognitive health management refers to the whole process of comprehensive monitoring, evaluation, health consultation and guidance of the brain cognitive health of individuals or groups, and intervention for patients with cognitive impairment and people at high risk of cognitive impairment. It is an important means to prevent and delay the progression of cognitive impairment, and an important part of health management.
[0003] Brain cognitive health management covers the screening, assessment and intervention of brain cognitive health status. Brain cognitive health screening refers to the use of cognitive function screening tools, auxiliary tests and imaging examinations to conduct preliminary examinations of cognitive functions and other conditions of potential patients. Brain cognitive health assessment refers to the comprehensive assessment of brain cognitive health status and risk factors based on preliminary screening results and population stratification, providing a basis for guiding the implementation of intervention strategies. Brain cognitive health intervention refers to improving brain cognitive health levels through intervention measures such as lifestyle intervention, risk factor management, cognitive digital therapy, and regular follow-up, dynamic assessment and other management.
[0004] At present, the existing cognitive health management of the elderly generally requires the elderly and their families to go to the hospital for examination first, and then communicate with the doctor after waiting for the test results to determine the specific situation. The examination process is cumbersome and takes a lot of time. In addition, the elderly and doctors communicate less frequently, and the cognitive health level of the elderly cannot be accurately determined based on the examination data alone, which will lead to errors in the diagnosis results.
[0005] Therefore, the present invention provides a cognitive health management system for the elderly based on virtual reality technology to solve the above problems. Summary of the invention
[0006] In view of the above situation, in order to overcome the defects of the prior art, the present invention provides a cognitive health management system for the elderly based on virtual reality technology, so as to solve the problem that the elderly have less communication with doctors and the cognitive health level of the elderly cannot be accurately determined based on the examination data alone, which will lead to errors in the diagnosis results.
[0007] In order to achieve the above object, the technical solution adopted by the present invention is:
[0008] The cognitive health management system for the elderly based on virtual reality technology includes:
[0009] The initial login module obtains the selection data selected by the user when the user logs in for the first time; the scene acquisition module obtains the interactive scene of cognitive health assessment based on the selection data; the data acquisition module collects the user's various physical data in real time when the user interacts in the various interactive scenes, and collects the audio and video data of each interactive scene; the cognitive health assessment module is used to analyze the various physical data and audio and video data to obtain the user's cognitive health assessment result; the decision generation module analyzes the abnormal data in the cognitive health assessment result when the cognitive health level in the cognitive health assessment result is less than the preset health level, and determines the cause of the abnormality; matches the corresponding initial decision based on the abnormal cause and the preset information library; and generates cognitive health training decisions based on each initial decision; the cognitive health management module is used to obtain the scene training decision in the cognitive health training decision, match the corresponding rehabilitation training scene and rehabilitation training plan based on the scene training decision and user feedback information, and regularly use the cognitive health assessment module to evaluate the results of rehabilitation training to adjust the rehabilitation training plan based on the evaluation results.
[0010] Preferably, the scene acquisition module includes: screening out multiple scenes matching each selection data in sequence from a scene database according to the selection order of each selection data; randomly selecting a preset number of scenes from each scene of the preset type using a simple random sampling method according to the preset type of the scene; the preset number of scenes form various interactive scenes for cognitive health assessment in the cognitive health assessment module.
[0011] Preferably, the cognitive health assessment module includes: using an audio and video analysis model to perform voice and image analysis on audio and video data to obtain user performance data; storing various body data and corresponding performance data in a recorded data set of the corresponding interaction scene in chronological order; performing fusion evaluation and analysis on the corresponding recorded data set based on a preset scene analysis model of each interaction scene to obtain an average score of each cognitive evaluation indicator; using a weighted average method to process the average score of each cognitive evaluation indicator to obtain the user's cognitive health; and obtaining the user's cognitive health assessment result based on the cognitive health, the average score of each cognitive evaluation indicator and a preset cognitive health assessment library.
[0012] Preferably, the processing process of the preset scenario analysis model includes: processing the record data set using the hierarchical analysis method; specifically including: a data processing layer, dividing the record data set according to a set time interval, and averaging the record data set within the set time interval to obtain a first data set arranged in chronological order; a factor data acquisition layer, according to the influencing factors corresponding to each cognitive evaluation indicator, inputting the data in the first data set into the corresponding influencing factor data set; a score determination layer, fusing the respective influencing factor data sets according to the preset analysis rules of each cognitive evaluation indicator to obtain the average score of each cognitive evaluation indicator.
[0013] Preferably, the decision generation module analyzes the abnormal data in the cognitive health assessment results to determine the cause of the abnormality, specifically including: obtaining a first record data set whose average score of each cognitive evaluation indicator is lower than the corresponding preset standard score; obtaining an abnormal data set in the first record data set that is lower than the corresponding preset standard value; determining the abnormal influencing factor according to the degree of deviation between the abnormal data set and the corresponding preset standard value, and determining the abnormal level according to the degree of deviation and the degree of deviation from the preset standard; and obtaining the cause of the abnormality according to the abnormal data set, the abnormal influencing factor and the abnormal level.
[0014] Preferably, the determining of the abnormal influencing factor according to the degree of deviation between the abnormal data set and the corresponding preset standard value includes: the calculation formula of the degree of deviation d between the abnormal data set and the corresponding preset standard value is:
[0015]
[0016] Among them, n is the number of abnormal data of the same type sorted in chronological order, a i is the i-th abnormal data among the same abnormal data, a i1 for a i The corresponding preset upper limit value or preset lower limit value, a i0 for a i The corresponding preset standard value; when the deviation degree is greater than the corresponding preset deviation degree value, the abnormal data set corresponding to the deviation degree is the abnormal impact data set, and the abnormal impact factor is determined according to the corresponding relationship between each abnormal impact data set and the associated information library of the abnormal impact factor.
[0017] Preferably, the cognitive health management module includes: screening out corresponding rehabilitation training scenarios from a preset rehabilitation scenario training library according to the required scenarios in the scenario training decision; generating an initial rehabilitation training plan according to the correspondence between the scenario training decision, the rehabilitation training scenario and the preset rehabilitation training plan; adjusting the initial rehabilitation training plan according to user feedback information to obtain a rehabilitation training plan that meets user needs.
[0018] Preferably, the data acquisition module includes: using an audio acquisition device provided on a VR helmet to collect the user's audio data in real time; and synchronizing the audio data in real time to a VR video of the recorded interactive scene to form audio and video data; using a VR helmet, a VR handle and multiple detection devices to collect various body data of the user in real time.
[0019] Preferably, a cognitive health management system for the elderly based on virtual reality technology also includes: a scene generation module, which is used to generate corresponding scenes based on newly added scene database data; specifically including: classifying the newly added scene database data according to preset types to obtain newly added scene data; according to the newly added scene data, adjusting the preset scene template of the preset type constructed based on virtual reality technology to generate a scene corresponding to the newly added scene data.
[0020] Preferably, the preset scene templates include at least a preset character template, a preset communication template, a preset audio template, a preset video template and a preset environment template.
[0021] The beneficial effects of the present invention are:
[0022] 1. The present invention adopts an initial login module to obtain various selection data of the user and understand the overall information of the user, so that the scene acquisition module can obtain the interactive scene that fits the user's cognitive health assessment in a targeted manner according to the various selection data, thereby improving the accuracy of the cognitive health assessment; when the user interacts in various interactive scenes, the data acquisition module collects various physical data of the user in real time, and collects audio and video data of various interactive scenes in real time, so that the cognitive health assessment module analyzes various physical data and audio and video data to obtain the user's cognitive health assessment result; and then the decision generation module processes the cognitive health assessment result whose cognitive health degree is less than the preset health degree, that is, the abnormal data in the cognitive health assessment result is analyzed and processed, the cause of the abnormality is determined, and then the cognitive health training decision is obtained according to the abnormal cause and the preset information library; finally, the scene training decision and user feedback information in the cognitive health training decision are processed by the cognitive health management module to obtain a rehabilitation training scene and rehabilitation training plan that meets the user's needs, so that the user can perform cognitive rehabilitation training. The present invention can solve the problem that the elderly have less communication with doctors and their cognitive health level cannot be accurately determined based on examination data alone, resulting in errors in diagnosis results, by means of the above-mentioned method, and improve the accuracy of cognitive health assessment; and obtain the user's rehabilitation training scenario and rehabilitation training plan through the decision generation module and the cognitive health management module, thereby reducing the number of visits to the hospital and the diagnosis time, and improving the diagnosis efficiency.
[0023] 2. In the cognitive health assessment module of the present invention, the audio and video analysis model is first used to perform voice and image analysis on the audio and video data to obtain the user's performance data; then the preset scene analysis model of each interactive scene is used to perform fusion evaluation and analysis on the corresponding physical data and performance data to obtain the average score of each cognitive evaluation index; the weighted average method is used to process the average score of each cognitive evaluation index to obtain the user's cognitive health; finally, according to the correspondence between cognitive health, the average score of each cognitive evaluation index and the preset cognitive health assessment library, the user's cognitive health assessment result is obtained. The cognitive health assessment module of the present invention not only analyzes the physical data, but also integrates and analyzes the user's performance data in the audio and video data, so that the cognitive health assessment result obtained by the cognitive health assessment module is more accurate and fits the user's actual situation.
[0024] 3. In the cognitive health management module, the present invention combines scenario training decisions and user feedback information, and can adjust the initial rehabilitation training plan according to the user feedback information to obtain a rehabilitation training plan that meets the user's needs, thereby fitting the user's actual situation and improving the user's satisfaction. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] Figure 1 This is a schematic module diagram of a cognitive health management system for the elderly based on virtual reality technology in the present invention. DETAILED DESCRIPTION
[0026] The following will refer to the attached Figure 1 The embodiments of the present invention are described in detail. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.
[0027] In one embodiment of the present invention, a cognitive health management system for the elderly based on virtual reality technology is provided. Figure 1 As shown, the system includes an initial login module, a scene acquisition module, a data acquisition module, a cognitive health assessment module, a decision generation module and a cognitive health management module.
[0028] The initial login module is used to obtain the selection data selected by the user when the user logs in for the first time.
[0029] Specifically, after the user puts on the VR device and various testing instruments, when the user logs in for the first time, the user will be asked to make some choices in order to initially understand the user's overall information. Among them, the various selection data include but are not limited to the user's education level, the user's familiar geographical location, the user's familiar living environment, the user's familiar work, and the user's age.
[0030] Preferably, the users described in the present invention are mainly elderly people, but may also be people of other age groups.
[0031] The scenario acquisition module is used to acquire the interactive scenario of cognitive health assessment according to each selection data.
[0032] In the scene acquisition module, based on the selected data, interactive scenes that fit the user's cognition and living habits are screened out step by step to improve the accuracy of the user's cognitive health assessment.
[0033] The data acquisition module collects the user's physical data in real time when the user interacts in various interactive scenes, and collects the audio and video data of each interactive scene.
[0034] Specifically, when users interact in various interactive scenarios, the interaction methods include but are not limited to handle operation, voice determination, the position of pupil focus, etc.
[0035] The cognitive health assessment module is used to analyze various physical data and audio and video data to obtain the user's cognitive health assessment results.
[0036] Preferably, various body data include but are not limited to blood pressure, heart rate, brain waves, pupil status, blood oxygen saturation, etc. Audio and video data are audio data of users interacting in various interactive scenes and video data of interactive scenes constructed by virtual reality technology. Cognitive health assessment results include but are not limited to the user's cognitive health, the average score corresponding to each cognitive evaluation indicator, and the overall assessment result corresponding to cognitive health and the indicator assessment result corresponding to the average score of each cognitive evaluation indicator in the preset cognitive health assessment library.
[0037] The decision generation module analyzes the abnormal data in the cognitive health assessment results to determine the cause of the abnormality when the cognitive health level in the cognitive health assessment results is less than the preset health level; matches the corresponding initial decision based on the abnormal cause and the preset information library; and generates cognitive health training decisions based on each initial decision.
[0038] Among them, each abnormal cause corresponds to at least one initial decision, and the initial decisions can be the same or different. When generating cognitive health training decisions based on the initial decisions, the initial decisions with high repetition times are given priority as the content of the cognitive training decision; when the content added in the cognitive health training decision covers all abnormal causes, no new content will be added, and the final cognitive health training decision will be directly formed.
[0039] Preferably, the preset health level is usually 60, which can be adjusted according to actual conditions. Initial decisions include but are not limited to scenario training decisions, diet decisions, and exercise decisions. Cognitive health training decisions include but are not limited to scenario training decisions, diet decisions, and exercise decisions. The preset information library is an information library of the correspondence between various abnormal causes and initial decisions established by experts in cognitive health management.
[0040] The cognitive health management module is used to obtain scenario training decisions in cognitive health training decisions, match corresponding rehabilitation training scenarios and rehabilitation training plans based on scenario training decisions and user feedback information, and regularly use the cognitive health assessment module to evaluate the results of rehabilitation training to adjust the rehabilitation training plan based on the assessment results.
[0041] In the cognitive health management module, scenario training decisions and user feedback information are combined, and the initial rehabilitation training plan can be adjusted according to user feedback information to obtain a rehabilitation training plan that meets user needs, thereby fitting the user's actual situation and improving user satisfaction.
[0042] In this embodiment, the present invention adopts an initial login module to obtain various selection data of the user and understand the overall information of the user, so that the scene acquisition module can obtain the interactive scene that fits the user's cognitive health assessment in a targeted manner according to the various selection data, thereby improving the accuracy of the cognitive health assessment; when the user interacts in various interactive scenes, the data acquisition module collects various physical data of the user in real time, and collects audio and video data of various interactive scenes in real time, so that the cognitive health assessment module analyzes various physical data and audio and video data to obtain the user's cognitive health assessment result; and then the decision generation module processes the cognitive health assessment result whose cognitive health degree is less than the preset health degree, that is, the abnormal data in the cognitive health assessment result is analyzed and processed, the cause of the abnormality is determined, and then the cognitive health training decision is obtained according to the abnormal cause and the preset information library; finally, the scene training decision and user feedback information in the cognitive health training decision are processed by the cognitive health management module to obtain a rehabilitation training scene and rehabilitation training plan that meets the user's needs, so that the user can perform cognitive rehabilitation training. The present invention can solve the problem that the elderly have less communication with doctors and their cognitive health level cannot be accurately determined based on examination data alone, resulting in errors in diagnosis results, by means of the above-mentioned method, and improve the accuracy of cognitive health assessment; and obtain the user's rehabilitation training scenario and rehabilitation training plan through the decision generation module and the cognitive health management module, thereby reducing the number of visits to the hospital and the diagnosis time, and improving the diagnosis efficiency.
[0043] In one embodiment of the present invention, the scene acquisition module includes: according to the selection order of each selection data, sequentially screening out multiple scenes matching each selection data from the scene database; according to the preset type of the scene, using a simple random sampling method to randomly select a preset number of scenes from each scene of the preset type; the preset number of scenes form various interactive scenes for cognitive health assessment in the cognitive health assessment module.
[0044] Preferably, the preset types include but are not limited to education background, geographical location, living environment, and job category.
[0045] Each scene has at least one preset type. In the scene database, virtual scenes corresponding to various common real scenes are stored, and with the increase of cases, they are constantly enriched and improved.
[0046] In this embodiment, the present invention can obtain the scene that best fits the user's living habits through the scene acquisition method of this embodiment, thereby helping to improve the accuracy of cognitive health assessment.
[0047] In one embodiment of the present invention, the cognitive health assessment module includes: using an audio and video analysis model to perform voice and image analysis on audio and video data to obtain user performance data; storing various body data and corresponding performance data in a recorded data set of the corresponding interaction scene in chronological order; performing fusion evaluation analysis on the corresponding recorded data set based on a preset scene analysis model of each interaction scene to obtain an average score of each cognitive evaluation indicator; using a weighted average method to process the average score of each cognitive evaluation indicator to obtain the user's cognitive health; obtaining the user's cognitive health assessment result based on the cognitive health, the average score of each cognitive evaluation indicator and a preset cognitive health assessment library.
[0048] Preferably, cognitive evaluation indicators include attention indicators, orientation indicators, memory indicators, calculation indicators, language ability indicators, visual-spatial ability indicators, executive function indicators and abstract thinking indicators. Performance data include, but are not limited to, interactive reaction time, reaction action, accuracy of answering questions, number of repeated answers, etc. There is no restriction on the construction method of the audio and video analysis model, which can be a model based on historical data and convolutional neural network, or a model based on machine learning and historical data, so as to realize the analysis process of this embodiment and obtain the user's performance data.
[0049] In this embodiment, in the cognitive health assessment module of the present invention, firstly, an audio and video analysis model is used to perform voice and image analysis on the audio and video data to obtain the user's performance data; then, the preset scene analysis model of each interactive scene is used to perform fusion evaluation and analysis on the corresponding physical data and performance data to obtain the average score of each cognitive evaluation index; the weighted average method is used to process the average score of each cognitive evaluation index to obtain the user's cognitive health; finally, according to the correspondence between cognitive health, the average score of each cognitive evaluation index and the preset cognitive health assessment library, the user's cognitive health assessment result is obtained. The cognitive health assessment module of the present invention not only analyzes the physical data, but also integrates and analyzes the user's performance data in the audio and video data, so that the cognitive health assessment result obtained by the cognitive health assessment module is more accurate and fits the user's actual situation.
[0050] In one embodiment of the present invention, the processing process of the preset scenario analysis model includes: processing the record data set using the hierarchical analysis method; specifically including: a data processing layer, dividing the record data set according to a set time interval, and averaging the record data set within the set time interval to obtain a first data set arranged in chronological order; a factor data acquisition layer, according to the influencing factors corresponding to each cognitive evaluation indicator, inputting the data in the first data set into the corresponding influencing factor data set; a score determination layer, fusing the respective influencing factor data sets according to the preset analysis rules of each cognitive evaluation indicator to obtain the average score of each cognitive evaluation indicator.
[0051] Preferably, the set time interval can be 5s, 10s, 15s, 20s, 60s, etc., and can be set according to the actual time interval requirements of the scene. In addition, the time intervals of different time periods in the scene are different and can be adjusted.
[0052] Specifically, the preset analysis rules of the cognitive evaluation index include but are not limited to ① weighted average according to the preset weights corresponding to each influencing factor and the initial scores corresponding to each influencing factor data to obtain the average score of the cognitive evaluation index; ② according to the correspondence between the influencing factor data and the initial score, the average calculation of each influencing factor data is performed to obtain the average score of the cognitive evaluation index. Each cognitive evaluation indicator performs a fusion process on the influencing factor data set according to the preset analysis rules to determine the final average score of each cognitive evaluation indicator.
[0053] In this embodiment, the preset scenario analysis model adopted by the present invention can comprehensively and accurately obtain the average score of each cognitive evaluation indicator based on the richness of the record data set.
[0054] In one embodiment of the present invention, the decision generation module analyzes the abnormal data in the cognitive health assessment results to determine the cause of the abnormality, specifically including: obtaining a first record data set in which the average score of each cognitive evaluation indicator is lower than the corresponding preset standard score; obtaining an abnormal data set in the first record data set that is lower than the corresponding preset standard value; determining the abnormal influencing factor based on the degree of deviation between the abnormal data set and the corresponding preset standard value, and determining the abnormal level based on the degree of deviation and the degree of deviation from the preset standard; obtaining the cause of the abnormality based on the abnormal data set, the abnormal influencing factor and the abnormal level.
[0055] In this embodiment, the abnormal influencing factor is determined according to the degree of deviation between the abnormal data set and the corresponding preset standard value, including: the calculation formula of the degree of deviation d between the abnormal data and the corresponding preset standard value is:
[0056]
[0057] Among them, n is the number of abnormal data of the same type sorted in chronological order, a i is the i-th abnormal data among the same abnormal data, a i1 for a i The corresponding preset upper limit value or preset lower limit value, a i0 for a i The corresponding preset standard value; when the deviation degree is greater than the corresponding preset deviation degree value, the abnormal data set corresponding to the deviation degree is the abnormal impact data set, and the abnormal impact factor is determined according to the corresponding relationship between each abnormal impact data set and the associated information library of the abnormal impact factor.
[0058] Preferably, the abnormality level is determined according to the deviation degree and the preset standard deviation degree as follows: the corresponding initial abnormality level is determined according to the preset interval where the difference between the deviation degree and the preset standard deviation degree lies; and the average value of each initial abnormality level is calculated to obtain the final abnormality level.
[0059] The method of this embodiment of the present invention can accurately identify the abnormal causes in the user's cognitive health assessment results, thereby facilitating the decision generation module to formulate targeted cognitive health training decisions based on the abnormal causes and the preset information library to facilitate user recovery.
[0060] In one embodiment of the present invention, the cognitive health management module includes: selecting corresponding rehabilitation training scenarios from a preset rehabilitation scenario training library according to the required scenarios in the scenario training decision; generating an initial rehabilitation training plan according to the correspondence between the scenario training decision, the rehabilitation training scenario and the preset rehabilitation training plan; adjusting the initial rehabilitation training plan according to user feedback information to obtain a rehabilitation training plan that meets user needs.
[0061] Preferably, the preset rehabilitation scene training library includes various virtual scenes for rehabilitation training. A corresponding relationship library is established between the scene training decision, the rehabilitation training scene and the preset rehabilitation training plan, and the corresponding preset rehabilitation training plan can be matched from the corresponding relationship library according to the scene training decision and the rehabilitation training scene. The preset rehabilitation training plan includes the training date, training duration, training stage, etc. of each rehabilitation training scene.
[0062] The initial rehabilitation training plan is adjusted based on user feedback information, including the training date, training duration, set reminder time, etc. of the rehabilitation training scenario, so as to meet the user's daily needs without affecting daily work.
[0063] In this embodiment, the present invention combines scenario training decisions and user feedback information in the cognitive health management module, and can adjust the initial rehabilitation training plan according to the user feedback information to obtain a rehabilitation training plan that meets the user's needs, thereby fitting the user's actual situation and improving the user's satisfaction.
[0064] In one embodiment of the present invention, the data acquisition module includes: using an audio acquisition device set on a VR helmet to collect the user's audio data in real time; and synchronizing the audio data in real time to the recorded VR video of the interactive scene to form audio and video data; using a VR helmet, a VR handle and multiple detection devices to collect various body data of the user in real time.
[0065] In this embodiment, the present invention uses the above-mentioned equipment to comprehensively obtain the user's blood pressure, heart rate, brain waves, pupil state, blood oxygen saturation and other physical data in real time, and stores the various physical data and audio and video data in chronological order in the database corresponding to the data acquisition module, so as to be used for a comprehensive assessment of the cognitive health status of the elderly.
[0066] In one embodiment of the present invention, the cognitive health management system for the elderly based on virtual reality technology also includes a scene generation module, which is used to generate corresponding scenes based on the newly added scene database data; specifically including: classifying the newly added scene database data according to preset types to obtain newly added scene data; according to the newly added scene data, adjusting the preset scene template of the preset type constructed based on virtual reality technology to generate a scene corresponding to the newly added scene data.
[0067] In this embodiment, the present invention can generate corresponding scenes according to the newly added scene database data through the scene generation module, enrich the scene content in the scene database, so that the selected scene is more in line with the user's living habits, thereby helping to improve the accuracy of cognitive health assessment results.
[0068] In one embodiment of the present invention, the preset scene templates at least include a preset character template, a preset communication template, a preset audio template, a preset video template and a preset environment template.
[0069] In this embodiment, various virtual templates are pre-constructed in the preset scene templates, including preset character templates of various heights and various work clothes, dialog box communication templates, voice broadcast communication templates, preset audio templates of various sound types, preset environment templates of various environments, and various video templates related to cognitive evaluation, so as to generate scenes.
[0070] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0071] It should be noted that in the description of the present invention, the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer" and the like indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings, which are only for the convenience of description, and do not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.
[0072] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0073] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0074] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0075] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0076] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.
[0077] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.
[0078] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.
Claims
1. A cognitive health management system for the elderly based on virtual reality technology, characterized in that the system include: The initial login module obtains the data of the various selections selected by the user when the user logs in for the first time; A scenario acquisition module acquires interactive scenarios for cognitive health assessment based on selected data; The data acquisition module collects the user's physical data in real time when the user interacts in various interactive scenes, and collects the audio and video data of each interactive scene; The cognitive health assessment module is used to analyze various physical data and audio and video data to obtain the user's cognitive health assessment results; The decision generation module analyzes the abnormal data in the cognitive health assessment result to determine the abnormal cause when the cognitive health degree in the cognitive health assessment result is less than the preset health degree; and matches the corresponding initial decision according to the abnormal cause and the preset information library; and generating cognitive health training decisions based on each initial decision; The cognitive health management module is used to obtain scenario training decisions in cognitive health training decisions, match corresponding rehabilitation training scenarios and rehabilitation training plans based on scenario training decisions and user feedback information, and regularly use the cognitive health assessment module to evaluate the results of rehabilitation training to adjust the rehabilitation training plan based on the assessment results.
2. The cognitive health management system according to claim 1, characterized in that: The scenario acquisition module includes: screening out multiple scenarios matching each selection data in sequence from a scenario database according to the selection order of each selection data; randomly selecting a preset number of scenarios from each scene of the preset type using a simple random sampling method according to the preset type of the scenario; the preset number of scenarios forming various interactive scenarios for cognitive health assessment in the cognitive health assessment module.
3. The cognitive health management system according to claim 1, characterized in that: The cognitive health assessment module includes: using an audio and video analysis model to perform voice and image analysis on audio and video data to obtain user performance data; storing various body data and corresponding performance data in a record data set of the corresponding interaction scene in chronological order; performing fusion evaluation analysis on the corresponding record data set based on a preset scene analysis model of each interaction scene to obtain an average score of each cognitive evaluation indicator; using a weighted average method to process the average score of each cognitive evaluation indicator to obtain the user's cognitive health; and obtaining the user's cognitive health assessment result based on the cognitive health, the average score of each cognitive evaluation indicator and a preset cognitive health assessment library.
4. The cognitive health management system according to claim 3, characterized in that: The processing process of the preset scenario analysis model includes: processing the record data set by using the hierarchical analysis method; specifically including: a data processing layer, dividing the record data set according to a set time interval, and averaging the record data set within the set time interval to obtain a first data set arranged in chronological order; a factor data acquisition layer, according to the influencing factors corresponding to each cognitive evaluation indicator, inputting the data in the first data set into the corresponding influencing factor data set; a score determination layer, fusing the respective influencing factor data sets according to the preset analysis rules of each cognitive evaluation indicator to obtain the average score of each cognitive evaluation indicator.
5. The cognitive health management system according to claim 3, characterized in that: The decision generation module analyzes the abnormal data in the cognitive health assessment results to determine the cause of the abnormality, specifically including: obtaining a first record data set whose average score of each cognitive evaluation indicator is lower than the corresponding preset standard score; obtaining an abnormal data set in the first record data set that is lower than the corresponding preset standard value; determining the abnormal influencing factor according to the degree of deviation between the abnormal data set and the corresponding preset standard value, and determining the abnormal level according to the degree of deviation and the degree of deviation from the preset standard; and obtaining the cause of the abnormality according to the abnormal data set, the abnormal influencing factor and the abnormal level.
6. The cognitive health management system according to claim 5, characterized in that: The determining of the abnormal influencing factor according to the degree of deviation between the abnormal data set and the corresponding preset standard value includes: the calculation formula of the degree of deviation d between the abnormal data set and the corresponding preset standard value is: Among them, n is the number of abnormal data of the same type sorted in chronological order, a i is the i-th abnormal data among the same abnormal data, a i1 for a i The corresponding preset upper limit value or preset lower limit value, a i0 for a i The corresponding preset standard value; when the deviation degree is greater than the corresponding preset deviation degree value, the abnormal data set corresponding to the deviation degree is the abnormal impact data set, and the abnormal impact factor is determined according to the corresponding relationship between each abnormal impact data set and the associated information library of the abnormal impact factor.
7. The cognitive health management system according to claim 1, characterized in that: The cognitive health management module includes: selecting corresponding rehabilitation training scenarios from a preset rehabilitation scenario training library according to the required scenarios in the scenario training decision; generating an initial rehabilitation training plan according to the correspondence between the scenario training decision, the rehabilitation training scenario and the preset rehabilitation training plan; and adjusting the initial rehabilitation training plan according to user feedback information to obtain a rehabilitation training plan that meets user needs.
8. The cognitive health management system according to claim 1, characterized in that: The data acquisition module includes: using an audio acquisition device set on a VR helmet to collect the user's audio data in real time; and synchronizing the audio data in real time to the VR video of the recorded interactive scene to form audio and video data; using a VR helmet, a VR handle and multiple detection devices to collect various body data of the user in real time.
9. The cognitive health management system according to claim 1 or 2, characterized in that: Also includes: The scene generation module is used to generate corresponding scenes according to the newly added scene database data; specifically, it includes: classifying the newly added scene database data according to preset types to obtain the newly added scene data; According to the newly added scene data, the preset scene template of the preset type built based on the virtual reality technology is adjusted to generate a scene corresponding to the newly added scene data.
10. The cognitive health management system according to claim 9, characterized in that: The preset scene templates at least include a preset character template, a preset communication template, a preset audio template, a preset video template and a preset environment template.
Citation Information
Patent Citations
Cognitive function training system for scene interaction and application method thereof
CN103268392A
VR-based cognitive memory training evaluation system and method, and storage medium
CN110827953A
Virtual reality-based cancer-related cognitive disorder assessment and rehabilitation training system
CN113413532A
Cognitive function evaluation system and method based on virtual reality
CN113521723A
Cognitive impairment assessment system based on virtual reality
CN114694803A