Remote rehabilitation intelligent evaluation system

Abstract

The invention relates to the technical field of medical rehabilitation, in particular to a remote rehabilitation intelligent evaluation system. The system comprises a rehabilitation monitoring module, a remote service module, an interaction feedback module and an intelligent evaluation module. The rehabilitation monitoring module comprises an emotional signal monitoring module, a physiological signal monitoring module and a gamification performance monitoring module and is used for monitoring the emotional condition, the physiological condition and the response condition of a patient; the remote service module is connected with the rehabilitation monitoring module, the interactive feedback module and the intelligent evaluation module; the interactive feedback module is used for information interactive feedback among the patient, the rehabilitatrist and the remote service module; and the intelligent evaluation module is used for analyzing and evaluating the rehabilitation index data and the optimized rehabilitation information which are processed by the remote service module. By comprehensively monitoring the emotional condition, the physiological condition and the reaction condition of the patient, remote, comprehensive and refined intelligent assessment of the rehabilitation condition of the patient is achieved.

Description

Technical Field

[0001] The present invention relates to the field of medical rehabilitation technology, and in particular to a remote rehabilitation intelligent evaluation system. Background Art

[0002] With the aging of the population and the increase in the number of patients with chronic diseases, the demand for rehabilitation medicine is growing. Traditional rehabilitation assessment and treatment usually requires patients to go to medical institutions in person for face-to-face guidance and assessment by professional rehabilitation therapists. However, this method is not only limited by time and space, but may also cause patients to miss the best time for rehabilitation training due to inconvenient transportation and schedule conflicts. In recent years, remote rehabilitation technology has gradually emerged, providing patients with more convenient and efficient rehabilitation services.

[0003] In the prior art, a variety of rehabilitation assessment technologies have been proposed, including respiratory and limb rehabilitation assessment systems. These technologies solve the problem of not being able to remotely monitor and evaluate the effects of patient rehabilitation training and follow-up, and thus not being able to formulate corresponding rehabilitation plans based on the patient's rehabilitation training. However, there are still many shortcomings: First, the rehabilitation of the patient's main symptoms and secondary complications is not considered at the same time, and the weighted data processing of the main symptoms and the secondary complications is not performed, making it difficult to achieve a comprehensive assessment of the patient's rehabilitation; second, the setting of a single threshold makes it difficult to achieve an automated and detailed assessment of the patient's rehabilitation progress at each stage; third, there is a lack of in-depth data analysis of multiple condition parameters and intelligent weight algorithms, making the assessment results inaccurate; fourth, the patient's physiological condition, emotional condition and reaction condition are not comprehensively considered, making it difficult to achieve an integrated assessment of the rehabilitation of multiple symptoms.

[0004] At present, there is not much research on remote rehabilitation intelligent technology, and there is no specific and refined remote rehabilitation intelligent assessment system that takes into account the rehabilitation of both the patient's main symptoms and secondary complications. Summary of the invention

[0005] In view of the defects in the prior art, the present invention provides a remote rehabilitation intelligent assessment system.

[0006] The remote rehabilitation intelligent evaluation system provided by the present invention includes a rehabilitation monitoring module, a remote service module, an interactive feedback module and an intelligent evaluation module; the rehabilitation monitoring module includes an emotional signal monitoring module, a physiological signal monitoring module and a gamification performance monitoring module, which are used to monitor the patient's emotional condition, physiological condition and reaction condition; the remote service module is connected to the rehabilitation monitoring module, the interactive feedback module and the intelligent evaluation module, and is used to receive, store and process the rehabilitation data monitored by the rehabilitation monitoring module, the rehabilitation information fed back by the interactive feedback module and the analysis and evaluation results returned by the intelligent evaluation module; the interactive feedback module is used for information interaction and feedback between the patient, the rehabilitation therapist and the remote service module; the intelligent evaluation module is used to analyze and evaluate the rehabilitation index data and optimized rehabilitation information processed by the remote service module. The present invention realizes remote intelligent evaluation of the patient's rehabilitation condition by monitoring the patient's emotional condition, physiological condition and reaction condition in real time, obtaining the patient's rehabilitation data, and processing, analyzing and evaluating the rehabilitation data; comprehensively considering the rehabilitation effect of the patient's main symptoms and complications, and realizing a comprehensive intelligent evaluation of the patient's rehabilitation condition; by setting multiple condition thresholds, a refined intelligent evaluation of the patient's rehabilitation condition is realized.

[0007] Optionally, the emotion signal monitoring module includes a voice monitoring unit and a facial expression monitoring unit; the voice monitoring unit is used to monitor the patient's voice changes; the facial expression monitoring unit is used to monitor the patient's facial expression changes. The present invention utilizes the emotion signal monitoring module to perform dual monitoring of voice and facial expression, providing comprehensive and accurate data support for the evaluation of the patient's emotional state, which is conducive to providing a more personalized solution for the patient's comprehensive rehabilitation.

[0008] Optionally, the physiological signal monitoring module includes a heart rate monitoring unit, a blood pressure monitoring unit, a body temperature monitoring unit, a blood oxygen saturation monitoring unit, a respiratory rate monitoring unit, a human electrical signal monitoring unit and an activity monitoring unit; the heart rate monitoring unit is used to monitor the patient's heart rate; the blood pressure monitoring unit is used to monitor the patient's systolic and diastolic blood pressure; the body temperature monitoring unit is used to monitor the patient's body temperature; the blood oxygen saturation monitoring unit is used to monitor the patient's blood oxygen saturation; the respiratory rate monitoring unit is used to monitor the patient's respiratory frequency and breathing pattern; the human electrical signal monitoring unit is used to monitor the patient's electrocardiogram, electroencephalogram and electromyography signals; the activity monitoring unit is used to monitor the patient's limb activity state. The physiological signal monitoring module provided by the present invention is an all-round and multifunctional health monitoring system that integrates multiple monitoring units such as heart rate, blood pressure, body temperature, blood oxygen saturation, respiratory rate, human electrical signals and activity. The heart rate monitoring unit tracks the patient's heartbeat rhythm in real time, and the blood pressure monitoring unit accurately measures systolic and diastolic blood pressure to ensure blood pressure safety. The body temperature monitoring unit pays close attention to body temperature fluctuations to prevent fever risks. The blood oxygen saturation monitoring unit goes deep into the blood level to protect respiratory health. The respiratory rate monitoring unit not only monitors the speed of breathing, but also analyzes the breathing pattern to ensure respiratory health. The human electrical signal monitoring unit comprehensively covers electrocardiogram, electroencephalogram and electromyography, providing data support for the nervous system and muscle activity. The activity monitoring unit evaluates the activity status of the patient's limbs and helps the rehabilitation process. The physiological signal monitoring module, with its comprehensiveness and accuracy, builds a solid line of defense for the patient's physiological health.

[0009] Optionally, the remote service module has built-in emotion fusion algorithm model, physiological fusion algorithm model and reaction fusion algorithm model; the emotion fusion algorithm model satisfies the following expression: + + in, represents the comprehensive emotional recovery index, represents the emotion function based on the speech digital signal, represents the emotion function based on the digital signal of facial expression, represents the interaction function between facial expressions and speech signals, Represents the characteristic parameters of the speech signal, Feature parameters representing facial expressions, , , represents the weight coefficient; the physiological fusion algorithm model satisfies the following expression: in, represents the comprehensive physiological recovery index, represents the normalized value of the patient's heart rate, Indicates the stability index of the patient's blood pressure. represents the normalized value of the patient's body temperature, represents the weighted value of the patient's blood oxygen saturation, represents the normalized value of the patient's respiratory rate, An index representing the regularity of the patient's potential activity, Represents the patient's activity index, Indicates The actual value of the physiological parameter, Indicates The ideal value of a physiological parameter, Indicates the number of data involved in the calculation; the reaction fusion algorithm model satisfies the following expression: in, represents the comprehensive response recovery index, represents the inverse of the reaction time, Indicates the accuracy, Indicates the degree of task completion. Indicates emotional stability, , , Represents the weight coefficient. The remote service module provided by the present invention integrates the emotional fusion algorithm model, the physiological fusion algorithm model and the reaction fusion algorithm model to form a highly intelligent health management and service system; the emotional fusion algorithm model can deeply analyze the patient's emotional data, accurately capture emotional changes, and provide strong support for mental health; the physiological fusion algorithm model comprehensively integrates the patient's various physiological indicators, and realizes real-time monitoring and early warning of health status through big data analysis and machine learning technology; the reaction fusion algorithm model further integrates the patient's behavioral response data, and predicts and evaluates the patient's health status change trend through intelligent analysis. Therefore, the present invention not only improves the accuracy of health management, but also greatly enhances the personalization and intelligence level of services, providing patients with more comprehensive, detailed and efficient remote health services.

[0010] Optionally, the intelligent evaluation module includes an indicator analysis module and a comprehensive evaluation module; the indicator analysis module is connected to the remote service module, receives the rehabilitation index data sent by the remote service module, analyzes the threshold interval of the rehabilitation index data, and obtains the analysis result; the comprehensive evaluation module is connected to the indicator analysis module and the remote service module, receives and uses the analysis result and the optimized rehabilitation information, comprehensively evaluates the patient's rehabilitation situation, and returns the evaluation result to the remote service module. The intelligent evaluation module provided by the present invention integrates the indicator analysis module and the comprehensive evaluation module, realizes the efficient and accurate evaluation of the patient's rehabilitation progress; the indicator analysis module, as the front end of the intelligent evaluation, is closely connected with the remote service module, receives and processes the rehabilitation index data in real time, and provides scientific analysis results for the rehabilitation process through accurate threshold interval judgment; the comprehensive evaluation module, as the back-end support, not only receives the output results of the indicator analysis module, but also makes full use of the optimized rehabilitation information in the remote service module to conduct a comprehensive and in-depth comprehensive evaluation of the patient's overall rehabilitation situation. Therefore, the present invention not only ensures the accuracy and objectivity of the evaluation, but also realizes dynamic monitoring and timely adjustment of the rehabilitation process through real-time interaction of data, providing strong technical support for the patient's rehabilitation journey.

[0011] Optionally, the index analysis module has a built-in interval comparison algorithm model for judging and analyzing whether the comprehensive emotional rehabilitation index falls within a threshold interval; the comparison algorithm model satisfies the following expression: , in, represents the comprehensive emotional recovery index, comprehensive physiological recovery index or comprehensive reaction recovery index, , represents the threshold parameter, represents the comprehensive emotional recovery index, represents the comprehensive physiological recovery index, represents the comprehensive response recovery index, , . The index analysis module provided by the present invention is a key component of the intelligent evaluation system. It has a built-in advanced interval comparison algorithm model, which is specifically used to judge and analyze whether the comprehensive emotional rehabilitation index falls within the preset threshold interval; the index analysis module receives the rehabilitation index data from the remote service module, accurately calculates the comprehensive emotional rehabilitation index, and then uses the interval comparison algorithm to accurately compare the comprehensive emotional rehabilitation index, so as to accurately judge whether the patient's emotional rehabilitation status is within the normal range. Therefore, the present invention not only improves the accuracy and scientificity of emotional rehabilitation assessment, but also provides strong data support for subsequent comprehensive assessments; through the use of the interval comparison algorithm model, the index analysis module can realize real-time monitoring and dynamic analysis of the patient's emotional rehabilitation status, and provide an important reference basis for the formulation and optimization of rehabilitation plans.

[0012] Optionally, the comprehensive evaluation module has a built-in rehabilitation evaluation algorithm model for evaluating the overall rehabilitation effect of the patient; the rehabilitation evaluation algorithm model satisfies the following expression: in, represents the comprehensive rehabilitation assessment index, represents the comprehensive emotional recovery index, represents the comprehensive physiological recovery index, represents the comprehensive response recovery index, , , Represents the weight coefficient. The comprehensive evaluation module provided by the present invention is the core link of the intelligent evaluation system, and has a built-in advanced rehabilitation evaluation algorithm model, which focuses on comprehensively and objectively evaluating the overall rehabilitation effect of the patient; the rehabilitation evaluation algorithm model receives and integrates the analysis results from the index analysis module and the optimized rehabilitation information from the remote service module, and uses complex algorithm logic and data processing technology to conduct in-depth analysis and comprehensive evaluation of the patient's rehabilitation process. Therefore, the present invention not only ensures the accuracy and comprehensiveness of the evaluation results, but also provides a scientific decision-making basis for rehabilitation therapists, helping them to better understand the patient's rehabilitation status, formulate and adjust personalized rehabilitation plans; through the use of the rehabilitation evaluation algorithm model, the comprehensive evaluation module can achieve accurate quantification of the patient's overall rehabilitation effect, and provide strong technical support for the continuous optimization of the rehabilitation process.

[0013] Optionally, the index analysis module includes the following steps for determining the threshold interval of the rehabilitation index and dividing the patient's rehabilitation effect: determining the threshold interval of the comprehensive emotional rehabilitation index, the comprehensive physiological rehabilitation index or the comprehensive reaction rehabilitation index according to the patient's historical rehabilitation data; and dividing the patient's rehabilitation effect into five levels: excellent, good, general, poor, and very poor according to the threshold interval. The index analysis module provided by the present invention follows a set of scientific and rigorous methods and steps when determining and judging the threshold interval of the comprehensive rehabilitation index, which not only intuitively reflects the patient's rehabilitation status, but also provides a clear evaluation basis for the rehabilitation therapist, which helps to formulate more accurate rehabilitation plans and intervention measures; through this series of steps, the index analysis module ensures the accuracy and effectiveness of the rehabilitation evaluation.

[0014] Optionally, the interactive feedback module includes a patient visual interaction interface and a rehabilitation therapist visual interaction interface; the patient visual interaction interface is connected to the remote service module, and is used for the patient to send subjective rehabilitation information to the remote service module and obtain a patient rehabilitation assessment report from the remote service module; the rehabilitation therapist visual interaction interface is connected to the patient visual interaction interface and the remote service module, and is used for the rehabilitation therapist to evaluate the patient's rehabilitation progress, and send the rehabilitation information obtained by the evaluation to the remote service module and obtain a patient rehabilitation assessment report from the remote service module. The interactive feedback module provided by the present invention is a highly integrated system component, which cleverly integrates the patient visual interaction interface and the rehabilitation therapist visual interaction interface, and realizes efficient communication and information exchange between the patient and the rehabilitation therapist; through the visual interaction interface, the patient can not only conveniently send personal subjective rehabilitation information to the remote service module in real time, but also obtain the personalized rehabilitation assessment report generated by the module in a timely manner; through the visual interaction interface, the rehabilitation therapist can comprehensively review the patient's rehabilitation progress, accurately evaluate the rehabilitation effect, and transmit the important information obtained by the evaluation back to the remote service module, and at the same time receive and review the patient's detailed rehabilitation assessment report. Therefore, the present invention greatly improves the efficiency and quality of rehabilitation services, ensures information synchronization and sharing between patients and rehabilitation therapists, and provides solid technical support for precise rehabilitation.

[0015] Optionally, the interactive feedback module also includes a report printing unit and a voice broadcast unit; the report printing unit is connected to the remote service module for printing the patient's subjective report, the rehabilitation therapist's diagnosis report and the rehabilitation assessment report; the voice broadcast unit is connected to the remote service module for broadcasting the progress of the patient's rehabilitation. The interactive feedback module provided by the present invention includes a report printing unit and a voice broadcast unit, which greatly improves the user experience and rehabilitation efficiency; the report printing unit seamlessly connects to the remote service module, and can print the patient's subjective report, the rehabilitation therapist's professional diagnosis report and the comprehensive rehabilitation assessment report with one click, and the paper version of the information is convenient for the patient and the rehabilitation therapist to consult and discuss at any time; the voice broadcast unit uses intelligent voice technology to connect to the remote service module in real time, and broadcasts the patient's rehabilitation progress in a clear and friendly voice, which provides great convenience for patients with limited vision and rehabilitation therapists who want to quickly understand the rehabilitation situation in a busy schedule. Therefore, the present invention not only enhances the accessibility and interactivity of information, but also reflects the deep care for the personalized needs of patients, adding more warmth and convenience to the rehabilitation process. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A schematic diagram of the structure of a remote rehabilitation intelligent assessment system according to an embodiment of the present invention; Figure 2 A schematic diagram of the data information transmission direction of the intelligent evaluation module according to an embodiment of the present invention; Figure 3 Schematic diagram of data information transmission direction of the interactive feedback module according to an embodiment of the present invention. DETAILED DESCRIPTION

[0017] The specific embodiments of the present invention will be described in detail below. It should be noted that the embodiments described herein are only for illustration and are not intended to limit the present invention. In the following description, a large number of specific details are set forth in order to provide a thorough understanding of the present invention. However, it is obvious to those of ordinary skill in the art that these specific details do not need to be adopted to implement the present invention. In other examples, in order to avoid confusing the present invention, known circuits, software or methods are not specifically described.

[0018] Throughout the specification, references to "one embodiment," "an embodiment," "an example," or "an example" mean that a particular feature, structure, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment of the present invention. Therefore, the phrases "in one embodiment," "in an embodiment," "an example," or "an example" appearing in various places throughout the specification do not necessarily all refer to the same embodiment or example. In addition, particular features, structures, or characteristics may be combined in one or more embodiments or examples in any suitable combination and / or subcombination. In addition, it should be understood by those of ordinary skill in the art that the figures provided herein are for illustrative purposes and that the figures are not necessarily drawn to scale.

[0019] See also Figure 1 , an embodiment of the present invention provides a remote rehabilitation intelligent assessment system, the system includes a rehabilitation monitoring module, a remote service module, an interactive feedback module and an intelligent assessment module; The rehabilitation monitoring module includes an emotional signal monitoring module, a physiological signal monitoring module and a gamification performance monitoring module, which are used to monitor the patient's emotional condition, physiological condition and reaction condition; The remote service module is connected to the rehabilitation monitoring module, the interactive feedback module and the intelligent evaluation module, and is used to receive, store and process the rehabilitation data monitored by the rehabilitation monitoring module, the rehabilitation information fed back by the interactive feedback module and the analysis and evaluation results returned by the intelligent evaluation module; The interactive feedback module is used for information interactive feedback between patients, rehabilitation therapists and remote service modules; The intelligent evaluation module is used to analyze and evaluate the rehabilitation index data and optimized rehabilitation information processed by the remote service module.

[0020] Specifically, the emotion signal monitoring module includes: a voice monitoring unit and a facial expression monitoring unit.

[0021] Wherein, the voice monitoring unit includes but is not limited to a microphone array and an audio acquisition card.

[0022] In one embodiment, a high-sensitivity, low-noise microphone array is used to ensure that the patient's voice signal can be clearly captured in different environments such as home and clinic. The microphone array supports directional sound pickup and reduces background noise interference.

[0023] Furthermore, the analog audio signal captured by the microphone is converted into a digital signal and transmitted to the data processing module for processing.

[0024] The facial expression monitoring unit includes but is not limited to a high-definition camera and an image acquisition card.

[0025] In one embodiment, a high-definition camera with a wide-angle field of view is used to clearly capture the details of the patient's facial expression. The high-definition camera supports automatic focus and light adjustment to ensure that high-quality images can be obtained under different lighting conditions.

[0026] Furthermore, the image captured by the high-definition camera is converted into a digital signal using an image acquisition card and transmitted to the data processing module for processing.

[0027] The physiological signal monitoring module includes a heart rate monitoring unit, a blood pressure monitoring unit, a body temperature monitoring unit, a blood oxygen saturation monitoring unit, a respiratory rate monitoring unit and a bioelectric signal monitoring unit.

[0028] The heart rate monitoring unit includes but is not limited to a wearable heart rate monitoring device.

[0029] In one embodiment, a smart watch capable of monitoring heart rate is used, and the smart watch monitors the patient's heart rate changes in real time through photoplethysmography (PPG).

[0030] Furthermore, the device transmits the heart rate data to a remote server via Bluetooth, Wi-Fi or a mobile data network.

[0031] The blood pressure monitoring unit includes but is not limited to a portable electronic blood pressure monitor and a wearable blood pressure monitoring device.

[0032] In one embodiment, a smart bracelet that can monitor blood pressure is used.

[0033] Specifically, the patient wears a smart bracelet and ensures that the device is correctly connected to the remote server.

[0034] Furthermore, the smart bracelet records the patient's blood pressure data at different times in real time and automatically uploads it to a remote server.

[0035] The body temperature monitoring unit includes but is not limited to a wearable body temperature monitoring device.

[0036] In one embodiment, a body temperature monitoring unit is built into a smart bracelet, using a contact temperature sensor to ensure accurate and comfortable measurements.

[0037] Furthermore, the smart bracelet records the patient's body temperature data at different times in real time and automatically uploads it to a remote server.

[0038] The blood oxygen saturation monitoring unit includes but is not limited to a blood oxygen saturation sensor, which is integrated into a smart bracelet, a finger-clip monitor or a wearable patch light device to ensure that the patient can easily wear it and continuously monitor the blood oxygen level in daily life.

[0039] In one embodiment, the patient follows instructions to wear a smart device containing a blood oxygen saturation sensor.

[0040] Furthermore, the blood oxygen saturation monitoring function is activated through a button on the device or a mobile application.

[0041] Furthermore, the sensor starts to continuously collect the patient's pulse wave signal and calculates the blood oxygen saturation value through algorithm analysis.

[0042] Furthermore, the calculated blood oxygen saturation data is transmitted to a remote server in real time via a wireless network.

[0043] The respiratory rate monitoring unit includes but is not limited to a highly sensitive respiratory motion sensor, which includes a chest strap sensor, an abdominal pressure sensor, and a non-contact respiratory monitoring sensor based on a thermal sensitive principle. These sensors can accurately capture the patient's respiratory motion, thereby calculating the respiratory rate.

[0044] In one embodiment, the patient follows the instructions to properly wear the abdominal pressure sensor.

[0045] Further, the respiratory rate monitoring function is automatically started by a button on the device, a mobile application or the system.

[0046] Furthermore, the sensor starts to continuously collect the patient's respiratory motion signals and calculates the respiratory rate through built-in algorithm analysis. The algorithm includes identifying the rising and falling edges of the respiratory waveform and calculating the time interval between two adjacent breaths.

[0047] Furthermore, the calculated respiratory rate data is transmitted to a remote server in real time via a wireless network.

[0048] The bioelectric signal monitoring unit includes but is not limited to high-precision, low-noise integrated sensors, which include electrocardiogram, electromyography and electroencephalogram integrated sensors. The integrated sensors are designed to be lightweight and comfortable wearable devices, such as chest straps, patches or integrated into smart clothing, ensuring that patients can wear them for a long time without affecting their daily life.

[0049] In one embodiment, the patient follows the instructions to correctly wear the ECG, EMG and EEG integrated sensor device.

[0050] Furthermore, the ECG, EMG and EEG monitoring functions are automatically activated through a button on the device, a mobile application or the system.

[0051] Furthermore, the integrated sensor starts to continuously collect the patient's electrocardiogram, electromyography and electroencephalogram signals, and performs preliminary processing through the built-in signal processing module.

[0052] Furthermore, the processed signal data is transmitted to a remote server in real time via a wireless network.

[0053] The gamification performance monitoring module includes a data collection unit and a data processing unit.

[0054] In one embodiment, the data collection unit is mainly used to collect the patient's performance data in the rehabilitation assessment game, specifically involving the time endpoints before and after the patient's reaction, the accuracy number of times, the task score and the emotional value. The data processing unit processes the data collected by the data collection unit to obtain the patient's reaction time, accuracy, task completion and emotional stability in the rehabilitation assessment game.

[0055] The implementation features of this embodiment are as follows: First, through the gamification elements, the rehabilitation training process is made more interesting and attractive, which helps patients overcome the monotony and boredom in the training process; second, through the design of gamification scenes and tasks, the interactivity and sense of participation between patients and rehabilitation training are enhanced, and the training effect is improved; third, it can generate personalized training plans and feedback suggestions based on the patient's specific situation and rehabilitation progress to ensure the effectiveness and pertinence of the training; fourth, it can monitor the patient's physiological parameters and movement data in real time, provide feedback and adjustment suggestions in a timely manner, and help patients adjust their training methods and intensity in a timely manner; fifth, with the help of Internet technology, rehabilitation therapists can remotely monitor the patient's rehabilitation training process and provide patients with timely and professional guidance.

[0056] The remote service module includes the remote server.

[0057] In one embodiment, the remote server adopts a distributed architecture to ensure high availability, scalability and data security. The system is mainly composed of a front-end interface layer, a business logic layer, a data storage layer and a security protection layer.

[0058] Specifically, the front-end interface layer provides interfaces such as RESTful API and WebSocket for data interaction between terminal devices (such as wearable devices, smart phones, etc.) and front-end applications. It supports HTTP / HTTPS protocols to ensure the security of data transmission.

[0059] The business logic layer contains multiple microservices, each of which is responsible for handling specific business logic. For example, there are dedicated services for receiving and parsing physiological signals, emotional signals, and gamification performance data, services for data preprocessing and feature extraction, and services for performing complex algorithmic analysis, such as machine learning model prediction.

[0060] The data storage layer uses a combination of relational databases (such as MySQL) and non-relational databases (such as MongoDB) to store data. Relational databases are used to store structured data, such as user information, rehabilitation plans, etc. Non-relational databases are used to store semi-structured or unstructured data, such as raw signals, processed feature data, etc. At the same time, data warehouses (such as Hadoop HDFS) are used for large-scale data storage and analysis.

[0061] The security protection layer deploys firewalls, intrusion detection systems (IDS), data encryption and other technologies to ensure the security of data transmission and storage.

[0062] Furthermore, the remote server establishes a long connection with the terminal device through real-time communication technologies such as WebSocket, and receives emotional signals, physiological signals, and performance signals in rehabilitation games in real time. At the same time, it supports breakpoint resuming mechanism to ensure the integrity and reliability of data during transmission.

[0063] Furthermore, after receiving the raw data, the server first performs pre-processing operations such as denoising and filtering on the data to improve the data quality. Then, according to the data type and analysis requirements, feature extraction and conversion are performed to convert the raw data into a format that can be used for analysis.

[0064] Furthermore, the processed data is stored in the corresponding database. For data with high real-time requirements, it can be stored in the memory database to improve access speed; for historical data, it is stored in disk or cloud storage for long-term preservation and subsequent analysis.

[0065] The remote service module has a built-in emotion fusion algorithm model, and the emotion fusion algorithm model satisfies the following expression: + + in, represents the comprehensive emotional recovery index, represents the emotion function based on the speech digital signal, represents the emotion function based on the digital signal of facial expression, represents the interaction function between facial expressions and speech signals, Represents the characteristic parameters of the speech signal, Feature parameters representing facial expressions, , , Represents the weight coefficient.

[0066] It should be noted that Used to quantify the patient's emotional state, with a range of ,in, represents extremely negative emotions, 0 represents neutral emotions, and 1 represents extremely positive emotions; Including but not limited to pitch, speaking speed, volume and degree of voice tremor, the relevant parameters are extracted through speech recognition and speech emotion analysis algorithms; Including but not limited to the position of eyebrows, the curvature of the mouth corners and the degree of eye opening and closing, the relevant parameters are extracted through the facial recognition algorithm; Used to evaluate the synergy between facial expressions and speech signals. This function can be designed based on the temporal synchronization and emotional consistency of facial expressions and speech signals. , , Used to adjust the relative importance of facial expressions, voice signals, and interactive effects in the overall emotion index, these coefficients can be adjusted according to specific rehabilitation goals, patient characteristics, or monitoring data.

[0067] The remote service module has a built-in physiological fusion algorithm model, which satisfies the following expression: in, represents the comprehensive physiological recovery index, represents the normalized value of the patient's heart rate, Indicates the stability index of the patient's blood pressure. represents the normalized value of the patient's body temperature, represents the weighted value of the patient's blood oxygen saturation, represents the normalized value of the patient's respiratory rate, An index representing the regularity of the patient's potential activity, Represents the patient's activity index, Indicates The actual value of the physiological parameter, Indicates The ideal value of a physiological parameter, Indicates the number of data involved in the calculation.

[0068] It should be noted that the dataset Satisfies the following relationship: Dataset Satisfies the following relationship: Among them, the data set The physiological parameters contained in the data set are actual values. The physiological parameters included are ideal values ​​and consistent with the dataset There is a corresponding relationship between the physiological parameters in the

[0069] In addition, heart rate is an important indicator for evaluating cardiovascular function. Adjust the heart rate to a range corresponding to the average heart rate of ordinary people or specific rehabilitation goals; body temperature is an important indicator for assessing the body's metabolic and infection status. Compare this to the normal body temperature range; It is a blood pressure assessment index, which is determined based on the comprehensive score of blood pressure value and blood pressure variability. For example, according to the deviation from the normal blood pressure range, it is divided into five blood pressure index assessment intervals: low, lower, normal, higher, and high, corresponding to the blood pressure assessment index of , , , , ; It is a key parameter for measuring lung function and blood circulation efficiency, which is particularly important for rehabilitation patients. It can be directly measured by chemical analysis based on a blood gas analyzer to measure the blood oxygen saturation in arterial blood; Reflects the body's state of relaxation and energy needs, which can be measured using a ventilator; Satisfies the following expression: in, Represents real-time brain potential, Indicates real-time cardiac potential. Indicates real-time myoelectric potential, represents the numerical constant of brain potential, Represents the numerical constant of cardiac potential, represents the numerical constant of myoelectric potential, , , Represents the weight coefficient, which can be obtained by fitting historical data; Satisfies the following expression: in, It indicates the ratio of the patient's actual output force to his or her expected or theoretical maximum force, which can be obtained through a muscle strength tester. The joint range of motion index is the ratio of the sum of the maximum angles of each joint in flexion, extension, adduction, abduction, rotation, etc. during the patient's rehabilitation process to the sum of the maximum angles of each joint in flexion, extension, adduction, abduction, rotation, etc. when the patient is fully recovered or normal. The angle can be obtained by an angle measuring instrument. It represents the comprehensive performance index of the patient in completing specific rehabilitation tasks. and Represents the weight coefficient, which can be obtained by fitting historical data.

[0070] It should be noted that The method for obtaining is as follows: according to the rehabilitation training requirements, the number and placement of training game targets are pre-set, and the virtual reality program drives the objects in the rehabilitation game to move left or right or up and down according to the angle data to obtain or avoid the game targets. According to the situation that the patient obtains the game targets more than the predetermined number of times in the game, a percentage evaluation is performed. The percentage evaluation divides the patient's performance into five levels: excellent, good, general, poor, and extremely poor. When it is good or excellent, it means that the patient is fully recovered, when it is general, it means that the patient's recovery is relatively good, and when it is extremely poor or poor, it means that the patient's recovery is poor. Finally, the evaluation index corresponding to the patient's performance is used as the comprehensive performance index.

[0071] The remote service module has a built-in reaction fusion algorithm model, which satisfies the following expression: in, represents the comprehensive response recovery index, represents the inverse of the reaction time, Indicates the accuracy, Indicates the degree of task completion. Indicates emotional stability, , , Represents the weight coefficient.

[0072] It should be noted that the comprehensive reaction rehabilitation index is used to evaluate the patient's performance in the rehabilitation assessment game. The content of the rehabilitation assessment game is as follows: the patient completes a series of simple cognitive and motor tasks within a limited time. It is divided into three tasks, namely reaction tasks, memory tasks and coordination tasks. The reaction task means that when a specific symbol appears on the screen, the patient needs to quickly press the corresponding button; the memory task means that the patient needs to remember a series of numbers or symbols and repeat them later; the coordination task means that the character needs to be controlled by the keyboard or handle to complete specific actions, such as jumping, avoiding obstacles, etc. Each task has a fixed time limit, and the patient must complete the task within the specified time. Points are given according to the speed and accuracy of task completion.

[0073] in addition, It is obtained by recording the time difference from the start of the task (such as the appearance of the symbol) to the patient completing the task and pressing the key. It is obtained by calculating the ratio of the number of times the patient completes the task correctly to the total number of times the task is completed. A score between 0 and 1 is given based on the patient's performance in the coordination task, such as whether the action is completed successfully, whether it collides with obstacles, etc. By observing the player's facial expressions, voice, etc. during the game, the therapist will give a score between 0 (very unstable) and 1 (very stable). , , By collecting game data from a large number of patients, statistical methods (such as regression analysis) are used to determine whether the model can best reflect the patient's actual recovery status.

[0074] The intelligent evaluation module includes two submodules, namely the indicator analysis module and the comprehensive evaluation module. Figure 2 The index analysis module receives the rehabilitation index data sent by the remote service module, makes a threshold interval judgment of the index according to the rehabilitation index data, obtains an analysis result, and further sends the analysis result to the comprehensive evaluation module.

[0075] Regarding the threshold interval judgment of the index, specifically, the index analysis module has a built-in interval comparison algorithm model for judging and analyzing the situation where the comprehensive emotional rehabilitation index falls into the threshold interval.

[0076] It should be noted that before the formal rehabilitation assessment, the threshold range of the single symptom rehabilitation index has been determined. The specific determination method is as follows: Based on a large amount of historical rehabilitation data, rehabilitation index data of the patient's emotional condition, physiological condition and reaction condition are determined, and the rehabilitation index data are further used to determine five threshold intervals of the comprehensive rehabilitation index, which are respectively , , , , According to the threshold range, the rehabilitation effects of different types of patients are divided into five levels, as follows: When the single symptom recovery index falls into the threshold range , indicating that the patient's recovery effect in this single category of conditions is extremely poor; When the single symptom recovery index falls into the threshold range , indicating that the patient's recovery effect in this single category of conditions is poor; When the single symptom recovery index falls into the threshold range , indicating that the patient's recovery effect in this single category of conditions is average; When the single symptom recovery index falls into the threshold range , indicating that the patient's recovery effect in this single category of conditions is good; When the single symptom recovery index falls into the threshold range , indicating that patients have excellent recovery outcomes in this single category of conditions.

[0077] The single symptom rehabilitation index includes a comprehensive emotional rehabilitation index, a comprehensive physiological rehabilitation index or a comprehensive reaction rehabilitation index. That is, the threshold intervals of the above three rehabilitation indices are determined in the same way.

[0078] It should be noted that , , , It is the threshold parameter determined by the rehabilitation therapist based on the patient's historical rehabilitation data. After determination, it is input on the rehabilitation therapist's visual interactive interface and fed back to the remote service module, and further fed back to the intelligent evaluation module.

[0079] Furthermore, the interval comparison algorithm model satisfies the following expression: in, , The threshold interval is determined as the threshold interval into which the comprehensive emotional rehabilitation index falls.

[0080] The comprehensive evaluation module receives and utilizes the analysis results of the index analysis module and the optimized rehabilitation information sent by the remote service module to conduct a comprehensive evaluation of the patient's rehabilitation status, and returns the evaluation results to the remote service module.

[0081] Specifically, the comprehensive evaluation module has a built-in rehabilitation evaluation algorithm model, which fully considers the weight of the patient's disease type. The rehabilitation evaluation algorithm model satisfies the following expression: in, represents the comprehensive rehabilitation assessment index, , , Represents the weight coefficient of each rehabilitation index. It should be noted that , , The determination of is very important for this system, which fully considers the recovery of secondary complications caused by the main symptoms. Specifically, , , The method of determining is as follows: Determine the patient's rehabilitation symptoms and types, wherein the rehabilitation symptoms include the patient's emotional, physiological and mental problems that lead to emotional, physiological and reaction conditions; and the rehabilitation types include emotional rehabilitation, physiological rehabilitation and reaction rehabilitation.

[0082] Targeted weight enhancement is performed based on the patient's rehabilitation symptoms and types. For example, when a patient has emotional problems, it will also cause physiological and mental changes, but the physiological and mental changes are relatively small. Therefore, the weight of the emotional type rehabilitation coefficient needs to be enhanced, that is, , In the process of strengthening treatment, the weight coefficient of strengthening rehabilitation for the patient's rehabilitation type is introduced. Specifically, the weight coefficients of emotional, physiological and mental rehabilitation strengthening are set as , , It should be noted that the reinforcement weight coefficient can be obtained by classifying the rehabilitation data of patients with emotional, physiological and mental problems and then training the rehabilitation assessment model.

[0083] The historical data is used to train the rehabilitation assessment algorithm model to obtain the basic rehabilitation weight coefficient. The historical data has no specific classification, including mixed rehabilitation data of patients with emotional, physiological, mental or cross-type problems; the basic rehabilitation weight coefficient is a fixed value, including the basic emotional rehabilitation weight coefficient, the basic physiological rehabilitation weight coefficient and the basic reaction rehabilitation weight coefficient, which are respectively , , .

[0084] According to the enhanced rehabilitation weight coefficient and the basic rehabilitation weight coefficient, we can obtain , , The specific expressions that are satisfied are as follows: It should be noted that using the comprehensive rehabilitation assessment index to evaluate the patient's rehabilitation status is equivalent to conducting a corrective assessment based on the assessment of each category index.

[0085] In one embodiment, a large amount of historical comprehensive rehabilitation assessment index data is used to set the threshold interval of the comprehensive rehabilitation assessment index. The threshold interval is divided into five categories: , , , , According to the threshold range, the overall rehabilitation effect of patients is divided into five levels, as follows: When the comprehensive rehabilitation assessment index falls into the threshold range , indicating that the overall recovery effect of the patients was extremely poor; When the comprehensive rehabilitation assessment index falls into the threshold range , indicating that the overall rehabilitation effect of the patients was poor; When the comprehensive rehabilitation assessment index falls into the threshold range , indicating that the overall recovery effect of the patients was average; When the comprehensive rehabilitation assessment index falls into the threshold range , indicating that the overall recovery effect of the patients is good; When the comprehensive rehabilitation assessment index falls into the threshold range , indicating that the overall recovery effect of the patients is excellent.

[0086] It should be noted that the role of the comprehensive rehabilitation assessment index is to provide a comprehensive assessment of the patient's emotional, physiological and reactive rehabilitation status. , , , It is the threshold parameter determined by the rehabilitation therapist based on the patient's historical rehabilitation data. After determination, it is input on the rehabilitation therapist's visual interactive interface and fed back to the remote service module, and further fed back to the intelligent evaluation module.

[0087] The interactive feedback module includes a patient visual interaction interface, a rehabilitation therapist visual interaction interface, a report printing unit and a voice broadcasting unit. The patient visual interaction interface is connected to the remote service module, and is used for the patient to send subjective rehabilitation information to the remote service module and obtain a patient rehabilitation assessment report from the remote service module; the rehabilitation therapist visual interaction interface is connected to the patient visual interaction interface and the remote service module, and is used for the rehabilitation therapist to evaluate the patient's rehabilitation progress, and send the rehabilitation information obtained from the evaluation to the remote service module and obtain a patient rehabilitation assessment report from the remote service module; the report printing unit is connected to the remote service module, and is used to print the patient's subjective report, the rehabilitation therapist's diagnosis report and the rehabilitation assessment report; the voice broadcasting unit is connected to the remote service module, and is used to broadcast the patient's rehabilitation progress. The specific information transmission direction is as follows: Figure 3 shown.

[0088] The patient visualization interactive interface is designed to provide a friendly, intuitive, and easy-to-use operating environment, allowing patients to easily understand the rehabilitation plan, record rehabilitation progress, and receive immediate feedback. The interface design follows the principles of simplicity and clarity, reducing the patient's learning cost and improving the user experience.

[0089] In one embodiment, the patient visual interaction interface is set on a wearable device. The patient inputs subjective feelings and question information on the visual interaction interface according to his actual rehabilitation situation, which provides a certain reference for the intelligent evaluation module to evaluate the patient's rehabilitation situation. At the same time, it is also helpful for the rehabilitation therapist to understand the patient's rehabilitation situation in a timely manner.

[0090] The visual interactive interface for rehabilitation therapists focuses on data analysis, program adjustment and remote guidance. The interface design should emphasize the intuitive display and efficient processing of data so that rehabilitation therapists can quickly understand the patient's condition and make corresponding decisions. In addition, the visual interactive interface supports remote video calls between rehabilitation therapists and patients to achieve face-to-face communication and guidance. During the video call, the rehabilitation therapist can observe the patient's movements and performance in real time and give immediate feedback and suggestions.

[0091] In one embodiment, the visual interaction interface for rehabilitation therapists is set on a wearable device. The interactive interface allows rehabilitation therapists to customize the interface layout and shortcuts according to personal habits and work needs to improve work efficiency; using advanced visualization technology, complex data is converted into intuitive and easy-to-understand charts and graphics to help rehabilitation therapists quickly understand the information behind the data; it supports the simultaneous processing of data and requests of multiple patients, ensuring that rehabilitation therapists can efficiently cope with the busy work rhythm.

[0092] In summary, the present invention acquires the patient's rehabilitation data by real-time monitoring of the patient's emotional state, physiological state and reaction state, and processes, analyzes and evaluates the rehabilitation data, thereby realizing remote intelligent evaluation of the patient's rehabilitation status; comprehensively considering the rehabilitation effects of the patient's main symptoms and secondary complications, realizing comprehensive intelligent evaluation of the patient's rehabilitation status; and realizing refined intelligent evaluation of the patient's rehabilitation status by setting multiple condition thresholds.

[0093] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. These modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention, and they should all be included in the scope of the claims and specification of the present invention.

Claims

1. A remote rehabilitation intelligent assessment system, characterized in that: The system includes a rehabilitation monitoring module, a remote service module, an interactive feedback module and an intelligent evaluation module; The rehabilitation monitoring module includes an emotional signal monitoring module, a physiological signal monitoring module and a gamification performance monitoring module, which are used to monitor the patient's emotional condition, physiological condition and reaction condition; The remote service module is connected to the rehabilitation monitoring module, the interactive feedback module and the intelligent evaluation module, and is used to receive, store and process the rehabilitation data monitored by the rehabilitation monitoring module, the rehabilitation information fed back by the interactive feedback module and the analysis and evaluation results returned by the intelligent evaluation module; The interactive feedback module is used for information interactive feedback between patients, rehabilitation therapists and remote service modules; The intelligent evaluation module is used to analyze and evaluate the rehabilitation index data and optimized rehabilitation information processed by the remote service module.

2. A remote rehabilitation intelligent assessment system according to claim 1, characterized in that: The emotion signal monitoring module includes a voice monitoring unit and a facial expression monitoring unit; The speech monitoring unit is used to monitor the speech change of the patient; The facial expression monitoring unit is used to monitor the facial expression changes of the patient.

3. A remote rehabilitation intelligent assessment system according to claim 1, characterized in that: The physiological signal monitoring module includes a heart rate monitoring unit, a blood pressure monitoring unit, a body temperature monitoring unit, a blood oxygen saturation monitoring unit, a respiratory rate monitoring unit, a human electrical signal monitoring unit and an activity monitoring unit; The heart rate monitoring unit is used to monitor the patient's heart rate; The blood pressure monitoring unit is used to monitor the systolic and diastolic blood pressure of the patient; The body temperature monitoring unit is used to monitor the body temperature of the patient; The blood oxygen saturation monitoring unit is used to monitor the patient's blood oxygen saturation; The respiratory rate monitoring unit is used to monitor the patient's respiratory rate and respiratory pattern; The human body electrical signal monitoring unit is used to monitor the patient's electrocardiogram, electroencephalogram and electromyography signals; The activity monitoring unit is used to monitor the activity status of the patient's limbs.

4. A remote rehabilitation intelligent assessment system according to claim 1, characterized in that: The remote service module has built-in emotion fusion algorithm model, physiological fusion algorithm model and reaction fusion algorithm model; the emotion fusion algorithm model satisfies the following expression: + + in, represents the comprehensive emotional recovery index, represents the emotion function based on the speech digital signal, represents the emotion function based on the digital signal of facial expression, represents the interaction function between facial expressions and speech signals, Represents the characteristic parameters of the speech signal, Feature parameters representing facial expressions, , , represents the weight coefficient; the physiological fusion algorithm model satisfies the following expression: in, represents the comprehensive physiological recovery index, represents the normalized value of the patient's heart rate, Indicates the stability index of the patient's blood pressure. represents the normalized value of the patient's body temperature, represents the weighted value of the patient's blood oxygen saturation, represents the normalized value of the patient's respiratory rate, Represents the regularity index of the patient's potential activity, Represents the patient's activity index, Indicates The actual value of the physiological parameter, Indicates The ideal value of a physiological parameter, Indicates the number of data involved in the calculation; the reaction fusion algorithm model satisfies the following expression: in, represents the comprehensive reaction recovery index, represents the inverse of the reaction time, Indicates accuracy, Indicates the degree of task completion. Indicates emotional stability, , , Represents the weight coefficient.

5. The remote rehabilitation intelligent assessment system according to claim 1, characterized in that: The intelligent evaluation module includes an index analysis module and a comprehensive evaluation module; The index analysis module is connected to the remote service module, receives the rehabilitation index data sent by the remote service module, analyzes the rehabilitation index data to see if it falls within a threshold interval, and obtains an analysis result; The comprehensive evaluation module is connected to the index analysis module and the remote service module, receives and uses the analysis results and the optimized rehabilitation information, conducts a comprehensive evaluation of the patient's rehabilitation status, and returns the evaluation results to the remote service module.

6. A remote rehabilitation intelligent assessment system according to claim 5, characterized in that: The index analysis module has a built-in interval comparison algorithm model for judging and analyzing the situation where the comprehensive emotional rehabilitation index falls into the threshold interval; the interval comparison algorithm model satisfies the following expression: ， in, represents the comprehensive emotional recovery index, comprehensive physiological recovery index or comprehensive reaction recovery index, , represents the threshold parameter, represents the comprehensive emotional recovery index, represents the comprehensive physiological recovery index, represents the comprehensive response recovery index, , .

7. A remote rehabilitation intelligent assessment system according to claim 5, characterized in that: The comprehensive evaluation module has a built-in rehabilitation evaluation algorithm model for evaluating the overall rehabilitation effect of the patient; the rehabilitation evaluation algorithm model satisfies the following expression: in, represents the comprehensive rehabilitation assessment index, represents the comprehensive emotional recovery index, represents the comprehensive physiological recovery index, represents the comprehensive reaction recovery index, , , Represents the weight coefficient.

8. The remote rehabilitation intelligent assessment system according to claim 1, characterized in that: The index analysis module determines the threshold interval of the rehabilitation index and divides the patient's rehabilitation effect into the following steps: Determine the threshold intervals of the comprehensive emotional recovery index, comprehensive physiological recovery index, and comprehensive reaction recovery index based on the patient's historical recovery data; According to the threshold range, the patient's rehabilitation effect is divided into five levels: excellent, good, average, poor, and very poor.

9. A remote rehabilitation intelligent assessment system according to claim 1, characterized in that: The interactive feedback module includes a patient visual interactive interface and a rehabilitation therapist visual interactive interface; The patient visual interaction interface is connected to the remote service module, and is used for the patient to send subjective rehabilitation information to the remote service module and obtain a patient rehabilitation assessment report from the remote service module; The rehabilitation therapist's visual interaction interface is connected to the patient's visual interaction interface and the remote service module, and is used by the rehabilitation therapist to evaluate the patient's rehabilitation progress, send the rehabilitation information obtained from the evaluation to the remote service module, and obtain the patient's rehabilitation evaluation report from the remote service module.

10. The remote rehabilitation intelligent assessment system according to claim 1, characterized in that: The interactive feedback module also includes a report printing unit and a voice broadcasting unit; The report printing unit is connected to the remote service module and is used to print the patient's subjective report, the rehabilitation therapist's diagnosis report and the rehabilitation assessment report; The voice broadcast unit is connected to the remote service module and is used to broadcast the progress of the patient's recovery.

Images