Methods, systems and electronic devices for synergistic rhythm and dual-task rehabilitation training in stroke

Abstract

This invention provides a method, system, and electronic device for stroke-related rhythmic and dual-task rehabilitation training. The method includes: establishing a training session; assigning a first user to a guiding device and a second user to an execution device; in a single training round, the guiding device responds to the first user's operational commands, triggering a rhythmic guidance signal and generating a rhythmic event package; generating a cognitive task package based on the rhythmic state, movement target, and cognitive task difficulty, and displaying the cognitive stimulus information on the execution device; collecting the second user's limb movement data and cognitive response data; performing joint matching judgment to obtain movement completion results, rhythmic matching results, cognitive response results, and dual-task coordination results; generating a comprehensive training score; outputting training feedback based on the comprehensive training score; and updating training parameters. This invention improves the stability and reliability of training evaluation results.

Description

Technical Field

[0001] This invention relates to the field of digital healthcare and intelligent rehabilitation technology, specifically to a method, system, and electronic device for stroke coordinating rhythm and dual-task rehabilitation training. Background Technology

[0002] Stroke is a major cause of motor dysfunction and decreased ability to live independently in adults. After acute treatment, patients typically require a long period of rehabilitation, particularly in areas such as upper limb motor control, coordination, rhythmic response, and sustained movement execution, necessitating repeated, standardized, and long-term functional reconstruction. Currently, stroke rehabilitation is mainly divided into two scenarios: professional in-hospital rehabilitation and home / community-based self-rehabilitation. In-hospital rehabilitation relies heavily on on-site guidance from therapists to ensure proper movement. Home and community-based rehabilitation generally employs video instruction, printed manuals, and simple rehabilitation equipment combined with movement imitation. With the development of digital technologies such as virtual reality, motion capture, and haptic interaction, several intelligent rehabilitation training systems for stroke patients have emerged. These systems enhance the fun of training through virtual scenarios, gamified tasks, and motion recognition technology, while incorporating external cues such as rhythm and sound / light to help patients establish movement rhythms. This has become the mainstream development direction in the field of intelligent rehabilitation.

[0003] However, existing digital rehabilitation or virtual reality rehabilitation programs are still mainly based on single-user training, lacking interactive guidance mechanisms for two-person collaboration. The training process lacks companionship, easily leading to decreased patient motivation and poor long-term rehabilitation compliance. Secondly, existing technologies have a single dimension for evaluating training effectiveness, typically focusing on indicators such as whether posture meets standards, whether movement trajectories closely resemble templates, and whether tasks are completed. They fail to identify and assess the temporal coupling relationship between rhythmic guidance signals and patient movement responses, making it impossible to accurately judge the patient's rhythmic control ability and movement response delay. The evaluation results cannot comprehensively reflect the true level of rehabilitation. Furthermore, in existing rehabilitation training technologies, cognitive training and physical training are often set up separately, lacking a unified task organization structure and synchronous coupling mechanism. This makes it difficult for patients to simultaneously complete cognitive judgments and physical movement execution under complex task conditions that closely resemble real-life activities.

[0004] In summary, existing intelligent rehabilitation training technologies for stroke suffer from technical problems such as poor training effectiveness and low patient participation due to their limited training and interaction modes, insufficient rhythmic guidance, and separation of cognitive and physical training. Summary of the Invention

[0005] In view of this, it is necessary to provide a method, system and electronic device for stroke coordinated rhythm and dual-task rehabilitation training to solve the technical problems in the existing technology, such as poor training effect and low patient participation due to the single training and interaction mode, insufficient rhythm guidance and separation of cognitive training and limb training.

[0006] To address the aforementioned technical problems, in a first aspect, the present invention provides a method for stroke coordinating rhythm and dual-task rehabilitation training, comprising: Establish a training session, assign the first user participating in the training session to the bootstrap device, and assign the second user participating in the training session to the execution device; In a single training round of the training session, the guiding end triggers a rhythmic guiding signal and generates a rhythmic event package; in the same training round, a cognitive task package is generated based on the rhythmic state, action target, and cognitive task difficulty, and the cognitive stimulus information in the cognitive task package is displayed on the execution end device; Collect limb movement data and cognitive response data of the second user corresponding to the execution terminal device in response to the rhythmic guidance signal and cognitive task stimulus information; Based on the rhythmic event package, cognitive task package, limb movement data, and cognitive response data, a joint matching judgment is performed to obtain the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result; Based on the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result, a comprehensive training score is generated. Based on the comprehensive training score, training feedback is output to the guidance device and the execution device, and the training parameters for the next training round are updated.

[0007] In one possible implementation, the joint matching determination based on the rhythmic event package, cognitive task package, limb movement data, and cognitive response data to obtain the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result includes: The limb movement data is spatially matched with a preset movement template to obtain the movement completion result; The motion response time in the limb motion data is matched with the rhythm guidance time in the rhythm event package to obtain the rhythm matching result. By comparing the cognitive response data with the correct answer codes in the cognitive task package, the cognitive response result is obtained. The dual-task collaborative result is obtained based on the combined completion of the action completion result and the cognitive response result within the same training round.

[0008] In one possible implementation, the step of spatially matching the limb movement data with a preset movement template to obtain the movement completion result includes: Calculate the posture deviation between the actual motion vector in the limb motion data and the target direction vector in the preset motion template; Calculate the amplitude deviation between the actual displacement length in the limb movement data and the target displacement length in the preset movement template; Calculate the trajectory deviation between the actual movement trajectory in the limb movement data and the reference trajectory in the preset movement template; The action completion score is calculated by weighting the posture deviation, amplitude deviation, trajectory deviation, and whether the duration of the action is maintained.

[0009] In one possible implementation, the step of time-matching the action response time in the limb movement data with the rhythm guidance time in the rhythm event package to obtain a rhythm matching result includes: Calculate the action initiation delay relative to the rhythm guidance time; Calculate the time delay of action completion relative to the timing of rhythm guidance; When the action start delay is within the preset action response window, the rhythm synchronization score is calculated by weighting the deviation between the action start delay and the target reference start delay, and the deviation between the action completion delay and the target reference completion delay.

[0010] In one possible implementation, comparing the cognitive response data with the correct answer code in the cognitive task package to obtain the cognitive response result includes: The difference between the cognitive response time and the stimulus start time is taken as the cognitive response delay; When the cognitive response value matches the code of the correct answer and the cognitive response delay is within the preset cognitive response window, the cognitive response is determined to be correct. The cognitive task score is calculated by weighting the cognitive response determination result and the cognitive response delay.

[0011] In one possible implementation, obtaining the dual-task collaborative result based on the combined completion of the action completion result and the cognitive response result within the same training round includes: Determine whether the action completion result is higher than a preset action threshold and whether the action response is within a valid window to obtain the action task achievement result; Determine whether the cognitive response result is correct and whether the cognitive response is within the valid window to obtain the cognitive task achievement result; Determine whether the action task and the cognitive task are completed together within the specified window of the same training round to obtain the result of simultaneous completion of the two tasks; The dual-task synergy score is calculated by weighting the achievement results of the action task, the achievement results of the cognitive task, and the results of the simultaneous completion of the two tasks.

[0012] In one possible implementation, the step of outputting training feedback to the guiding device and the executing device based on the comprehensive training score includes: Based on the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result in the comprehensive training score, differentiated feedback is output to the execution end device and the guidance end device, respectively. The feedback output to the execution device includes prompts for correct action, prompts for too fast a beat, prompts for too slow a beat, prompts for correct cognitive judgment, prompts for incorrect cognitive judgment, prompts for completion of dual tasks, and prompts for retry. The feedback output to the guidance device includes rhythm trigger validity prompts, execution end response status prompts, current task load adaptation prompts, and next round suggestion prompts.

[0013] In one possible implementation, the training parameters include beat interval, action response window, action amplitude requirement, cognitive task difficulty, cognitive stimulus complexity, cue intensity, and pass threshold.

[0014] On the other hand, the present invention also provides a stroke coordinating rhythm and dual-task rehabilitation training system, comprising: The data acquisition module is used to collect in real time the limb movement data and cognitive response data of the second user corresponding to the execution terminal device; The training control module, connected to the data acquisition module, includes: The session establishment and role management module is used to establish training sessions, assign the first user participating in the training session to the guiding end device, and assign the second user participating in the training session to the execution end device; The rhythmic event package and cognitive task package generation module is used to trigger a rhythmic guidance signal and generate a rhythmic event package in a single training round of the training session; and to generate a cognitive task package based on the rhythmic state, action target and cognitive task difficulty in the same training round, and to display the cognitive stimulus information in the cognitive task package on the execution end device. The matching and determination module is used to perform joint matching and determination based on the rhythmic event package, cognitive task package, limb movement data and cognitive response data to obtain the action completion result, rhythm matching result, cognitive response result and dual-task collaboration result; The training feedback module is used to generate a comprehensive training score based on the action completion result, rhythm matching result, cognitive response result and dual-task collaboration result, output training feedback to the guidance end device and the execution end device based on the comprehensive training score, and update the training parameters for the next training round. The display module, connected to the training control module, is used to display cognitive stimulus information, training images, action prompts, rhythm prompts, and training feedback content.

[0015] Secondly, the present invention also provides an electronic device, comprising: Data acquisition equipment is used to collect in real time the limb movement data and cognitive response data of the second user corresponding to the execution terminal device; The display is used to show cognitive stimulus information, training images, motion cues, rhythmic cues, and training feedback content. Memory, used to store programs; The processor, coupled to the data acquisition device, the display, and the memory, is used to execute the program stored in the memory to implement the steps in the stroke synergistic rhythm and dual-task rehabilitation training method described in any of the above implementations.

[0016] The beneficial effects of this invention are as follows: The stroke-coordinated rhythm and dual-task rehabilitation training method provided by this invention first establishes a training session, assigning the first user participating in the training session to the guiding device and the second user to the executing device. The guiding device actively triggers rhythmic guidance signals, changing the traditional single-person, one-way, passive training format and constructing an interactive training scenario, thereby improving the patient's long-term training motivation and compliance. Then, in the same training round, rhythmic guidance signals and cognitive stimulation information are output synchronously, enabling the second user corresponding to the executing device to simultaneously complete limb movements and cognitive responses. By analyzing the matching relationship between the guidance signal timing and the movement response timing, the training evaluation can simultaneously cover the quality of movement completion and rhythmic synchronization, helping to strengthen the patient's training effects in movement initiation, rhythm control, movement continuity, and response coordination, which better meets the actual needs of motor control and rhythm reconstruction in stroke rehabilitation. Furthermore, through joint matching judgment, a comprehensive evaluation is conducted from four dimensions: action completion, rhythm matching, cognitive response, and dual-task coordination. Since the evaluation dimensions simultaneously cover the quality of action completion, rhythm response, cognitive task completion, and dual-task coordination performance, the evaluation results are comprehensive and objective, accurately reflecting the actual performance of the execution end during training, thus improving the stability and reliability of the training evaluation results. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 A schematic flowchart of an embodiment of the stroke synergistic rhythm and dual-task rehabilitation training method provided by the present invention; Figure 2 For the present invention Figure 1 A schematic diagram of an embodiment of S104; Figure 3 For the present invention Figure 2 A schematic diagram of an embodiment of S201; Figure 4 For the present invention Figure 2 A schematic diagram of an embodiment of S202; Figure 5 For the present invention Figure 2 A schematic diagram of an embodiment of S203; Figure 6 For the present invention Figure 2 A schematic diagram of an embodiment of S204; Figure 7 A schematic diagram of an embodiment of the stroke synergistic rhythm and dual-task rehabilitation training system provided by the present invention; Figure 8 A schematic diagram of an embodiment of the electronic device provided by the present invention. Detailed Implementation

[0019] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0020] In the description of the embodiments of the present invention, unless otherwise stated, "multiple" means two or more. "And / or" describes the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone.

[0021] The terms "first," "second," etc., used in the embodiments of this invention are for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a technical feature defined with "first" or "second" may explicitly or implicitly include at least one of that feature.

[0022] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0023] Before demonstrating the embodiments, the following terms will be explained.

[0024] The first terminal device operated by the first user participating in the training session.

[0025] Execution device: refers to the second terminal device operated by the second user participating in the training session.

[0026] Rhythm guidance signal: A command signal generated by the guidance device to set the training rhythm.

[0027] Cognitive task stimulus information: Parallel task content used to test and train patients’ attention, judgment and reaction abilities, including but not limited to color recognition, direction judgment, target selection and sequential response.

[0028] Joint matching judgment: refers to linking rhythmic event packages, cognitive task packages, limb movement data, and cognitive response data onto the same time axis to conduct comprehensive analysis and judgment in spatial and temporal dimensions.

[0029] This invention provides a method, system, and electronic device for stroke coordinating rhythm and dual-task rehabilitation training, which will be described below.

[0030] Figure 1 This is a schematic flowchart of an embodiment of the stroke synergistic rhythm and dual-task rehabilitation training method provided by the present invention. The executing entity of the method of the present invention can be a rehabilitation training system, mainly applied to the rehabilitation training of stroke patients. Figure 1 As shown, the stroke synergistic rhythm and dual-task rehabilitation training method includes: S101. Establish a training session, assign the first user participating in the training session to the bootstrap device, and assign the second user participating in the training session to the execution device.

[0031] This invention establishes a dual-subject collaborative training mechanism by setting up two training roles: a guiding user and an execution user. One role is responsible for generating rhythmic guidance signals, while the other role is responsible for completing corresponding rehabilitation movements. This enhances the interactive guidance effect during the training process.

[0032] S102. In a single training round of the training session, the guiding device triggers a rhythmic guidance signal and generates a rhythmic event package; in the same training round, a cognitive task package is generated based on the rhythmic state, action target, and cognitive task difficulty, and the cognitive stimulus information in the cognitive task package is displayed on the execution device.

[0033] It should be noted that the guiding device triggers the rhythmic guidance signal via virtual reality controller buttons, preset gestures, or voice commands. The rhythmic event package includes at least: a session identifier, a round identifier, a rhythmic signal type, a rhythmic guidance time, a cue intensity, and the current beat number. The rhythmic guidance signal can be output visually, audio-visually, or tactilely. Visual methods include beat iris, target area highlighting, and trajectory flashing; audio methods include beat tones and cue tones; and tactile methods include controller vibration. The cognitive task package includes at least: a session identifier, a round identifier, a task number, a task type, a stimulus content identifier, a correct answer code, a stimulus start time, and a stimulus end time.

[0034] S103. Collect limb movement data and cognitive response data of the second user corresponding to the execution terminal device in response to the rhythm guidance signal and cognitive task stimulus information.

[0035] It should be noted that in this embodiment of the invention, the user on the execution end wears a virtual reality headset and holds left and right controllers to collect six-degree-of-freedom pose data of the head and hands at the execution end according to the device's native refresh rate or a preset sampling rate. The limb motion data includes at least: timestamp, head position, head posture, left hand position, left hand posture, right hand position, and right hand posture. Furthermore, the instantaneous velocity, displacement, duration of the action, and start and end times of the action can be further calculated. To reduce the impact of jitter, continuous sampling points can be processed by moving average or low-pass filtering before forming the motion sampling sequence.

[0036] It should also be noted that, in this embodiment of the invention, the execution device completes the cognitive response through controller buttons, gesture selection, gaze lingering or target pointing; the cognitive response data includes at least: session identifier, round identifier, task number, response value, cognitive response time and response method.

[0037] S104. Perform joint matching judgment based on the rhythm event package, cognitive task package, limb movement data and cognitive response data to obtain the action completion result, rhythm matching result, cognitive response result and dual task collaboration result.

[0038] S105. Based on the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result, generate a comprehensive training score, output training feedback to the guidance device and execution device based on the comprehensive training score, and update the training parameters for the next training round.

[0039] In summary, the stroke-coordinated rhythm and dual-task rehabilitation training method provided in this embodiment of the invention first establishes a training session, assigning the first user participating in the session to the guiding device and the second user to the executing device. The guiding device actively triggers rhythmic guidance signals, changing the traditional single-person, one-way, passive training format and constructing an interactive training scenario, thereby improving the patient's long-term training motivation and compliance. Then, in the same training round, rhythmic guidance signals and cognitive stimulation information are output synchronously, enabling the second user corresponding to the executing device to simultaneously complete limb movements and cognitive responses. By analyzing the matching relationship between the timing of the guidance signal and the timing of the movement response, the training evaluation can simultaneously cover the quality of movement completion and rhythmic synchronization, helping to strengthen the patient's training effect in terms of movement initiation, rhythm control, movement continuity, and response coordination, which is more in line with the actual needs of motor control and rhythm reconstruction in stroke rehabilitation. Furthermore, through joint matching judgment, a comprehensive evaluation is conducted from four dimensions: action completion, rhythm matching, cognitive response, and dual-task coordination. Since the evaluation dimensions simultaneously cover the quality of action completion, rhythm response, cognitive task completion, and dual-task coordination performance, the evaluation results are comprehensive and objective, accurately reflecting the actual performance of the execution end during training, thus improving the stability and reliability of the training evaluation results.

[0040] To address the technical problem in existing technologies where cognitive training is typically conducted independently of motor training, making it difficult to simulate the complex task requirements of patients simultaneously performing sensory judgment, rhythmic response, and limb movement execution in real rehabilitation scenarios, this invention introduces parallel cognitive task threads during rhythmic guidance and limb movement training. This allows the user to perform recognition, judgment, selection, or response-type cognitive tasks while completing the target movement, thereby achieving synchronous coupling between cognitive and limb training. In some embodiments of this invention, such as... Figure 2 As shown, step S104 includes: S201. Spatial matching of the limb movement data with a preset movement template to obtain the movement completion result; S202. Time-match the action response time in the limb motion data with the rhythm guidance time in the rhythm event package to obtain the rhythm matching result; S203. Compare the cognitive response data with the correct answer codes in the cognitive task package to obtain the cognitive response results; S204. Based on the combined completion of the action completion results and the cognitive response results within the same training round, obtain the dual-task collaborative result.

[0041] In this embodiment of the invention, the action template includes, but is not limited to, target hand identifier, target direction vector, target displacement range, target posture range, target trajectory reference, action holding duration, and action response window. The action template is derived from the semantic transformation of rehabilitation training actions. For example, rehabilitation actions such as "extend, lift, abduction, retraction, and pause" are defined as parameterized templates to facilitate quantitative comparison between the execution end action and the template.

[0042] In some embodiments of the present invention, such as Figure 3 As shown, step S201 includes: S301. Calculate the posture deviation between the actual motion vector in the limb motion data and the target direction vector in the preset motion template; S302. Calculate the amplitude deviation between the actual displacement length in the limb movement data and the target displacement length in the preset movement template; S303. Calculate the trajectory deviation between the actual movement trajectory in the limb movement data and the reference trajectory in the preset movement template; S304. Based on the posture deviation, amplitude deviation, and trajectory deviation, as well as whether the duration of the action is maintained meets the standard, a weighted score for the action completion is calculated.

[0043] The formula for calculating the attitude deviation is as follows:

[0044]

[0045] In the formula, For attitude deviation, For the actual action vector, Let the target direction vector be... The position where the action ends. This is the starting position of the action.

[0046] The formula for calculating the amplitude deviation is:

[0047] In the formula, For amplitude deviation, This represents the actual displacement length during the action. The target displacement length.

[0048] The formula for calculating the trajectory deviation is:

[0049] In the formula, For trajectory deviation, For the actual movement trajectory, For reference trajectory, This represents the shortest distance from the sampling point to the reference trajectory. This is the normalized baseline length.

[0050] To avoid meaningless calculations when the execution device does not generate a valid action, the actual displacement must satisfy:

[0051] in, If the minimum displacement threshold is not preset, it is directly judged as an invalid action response, the attitude deviation angle is no longer calculated, and the action completion score is set to the lowest score or zero.

[0052] To map the aforementioned deviation values ​​to action completion scores, the system performs normalized scoring mapping on the posture deviation, amplitude deviation, and trajectory deviation, respectively. In one embodiment of the invention, the following mapping method can be used:

[0053]

[0054]

[0055] in, , , These are the maximum permissible thresholds for attitude deviation, amplitude deviation, and trajectory deviation, respectively. , , The scores are for attitude deviation, amplitude deviation, and trajectory deviation, respectively.

[0056] Let the indicator for whether the duration of the action is maintained be... The value is 1 if the duration of the action meets the template requirements, and 0 otherwise. This determines the action completion score. It can be represented as:

[0057] in, , , , For the corresponding weights, and satisfying: .

[0058] In some embodiments of the present invention, such as Figure 4 As shown, step S202 includes: S401. Calculate the action initiation delay relative to the rhythm guidance time. S402. Calculate the time delay of action completion relative to the rhythm guidance time; S403. When the action start delay is within the preset action response window, the rhythm synchronization score is calculated by weighting the deviation between the action start delay and the target reference start delay, and the deviation between the action completion delay and the target reference completion delay.

[0059] The formula for calculating the action start delay is as follows:

[0060] In the formula, For the delay of action initiation, The moment of the start of the action. To guide the timing of rhythm.

[0061] The formula for calculating the delay in completing the action is:

[0062] In the formula, For the delay of action completion, When the action is in place, To guide the timing of rhythm.

[0063] When the action is initiated, there is a delay. When the device is within the preset action response window, it is determined that the execution end has made a valid response in terms of rhythm; then, based on the action start delay... The deviation from the target reference delay generates a rhythm synchronization score.

[0064] In this embodiment of the invention, the target reference startup delay is set to... The target reference completion time is Then, the initiation rhythm scoring function and the completion rhythm scoring function can be defined separately:

[0065]

[0066] in, To initiate the rhythm scoring function, To complete the rhythm score function, and These are the allowable window widths for start-up delay and completion delay, respectively. Then, the rhythm synchronization score is calculated. It can be represented as:

[0067] in, and Let the weights be and satisfy: .

[0068] If the start time or the finish time of the action exceeds the corresponding time window, the rhythm synchronization score will decrease, or it will be directly judged as an invalid rhythm response.

[0069] This invention, by introducing rhythmic guidance signals on top of motion acquisition, analyzes the matching relationship between the timing of the guidance signal and the timing of the motion response, enabling training evaluation to simultaneously cover both motion completion quality and rhythmic synchronization. This requires patients not only to complete the specified motion but also to complete the motion response within a defined rhythmic window, which helps to enhance the training effect on motion initiation, rhythm control, motion continuity, and response coordination, better meeting the actual needs of motor control and rhythm reconstruction in stroke rehabilitation.

[0070] In some embodiments of the present invention, such as Figure 5 As shown, step S203 includes: S501. The difference between the cognitive response time and the stimulus start time is taken as the cognitive response delay. S502. When the cognitive response value is consistent with the correct answer code and the cognitive response delay is within the preset cognitive response window, the cognitive response is determined to be correct. S503. Based on the cognitive response judgment result and the cognitive response delay, the cognitive task score is calculated by weighting.

[0071] The formula for calculating the cognitive response delay is as follows:

[0072] In the formula, For cognitive response delay, The moment the stimulus begins, This is the moment of cognitive response.

[0073] Let the cognitive correctness indicator be... The value is 1 when the cognitive task is completed correctly, and 0 otherwise; let the cognitive response delay mapping function be... Then the cognitive task score It can be represented as:

[0074] in, and Let the weights be and satisfy: .

[0075] In this embodiment of the invention, the cognitive response delay mapping function can be defined as:

[0076] in, This represents the upper limit of cognitive response time. This refers to cognitive response delay.

[0077] In some embodiments of the present invention, such as Figure 6 As shown, step S204 includes: S601. Determine whether the action completion result is higher than the preset action threshold and whether the action response is within the valid window, and obtain the action task achievement result. S602. Determine whether the cognitive response result is correct and whether the cognitive response is within the valid window to obtain the cognitive task achievement result. S603. Determine whether the action task and the cognitive task are completed together within the specified window of the same training round to obtain the result of simultaneous completion of the two tasks. S604. Based on the achievement results of the action task, the achievement results of the cognitive task, and the results of the simultaneous completion of the two tasks, a weighted calculation is performed to obtain the synergy score of the two tasks.

[0078] It should be noted that, in this embodiment of the invention, the indicator for whether the action task is met is set as follows: The value is 1 when the action completion score is higher than the action threshold and the action response is within the valid window; otherwise, the value is 0. Let the indicator for whether the cognitive task is met be... The value is 1 when the cognitive task is completed correctly and the cognitive response is within the valid window; otherwise, it is 0. Let the indicator of whether the two are completed together within the same round's specified window be... The value is 1 if the condition is met, otherwise the value is 0.

[0079] Then the dual-task synergy score It can be represented as:

[0080] in, , , Let the weights be and satisfy:

[0081] When the action task meets the target indicators =1. Cognitive task achievement indicators =1 and indicators that are completed jointly by action and cognitive tasks. When the score is 1, the round can be considered as a valid completion of the dual tasks; when any of the three is 0, the score for the synergy of the dual tasks decreases accordingly.

[0082] Compared to most traditional rehabilitation systems that only focus on whether a movement is completed or whether the posture closely resembles a standard template, lacking effective judgment on whether the patient responds at an appropriate rhythm, this invention fails to accurately reflect the patient's rehabilitation status in terms of movement initiation, rhythm control, and continuous response. This invention establishes a matching mechanism between the timing of the guiding signal and the timing of the movement response, comprehensively analyzing movement response delay, rhythmic synchronization, and continuous completion, thereby achieving a temporal evaluation of the rehabilitation training process.

[0083] Based on the score of the action completion Rhythm Synchronization Score Cognitive task score Dual-task synergy score A weighted average is used to generate a comprehensive training score, calculated using the following formula:

[0084] In the formula, For comprehensive training scoring, , , , The preset weights are used, and the following conditions are met: It should be understood that the weights involved in this invention can be adjusted according to the actual situation.

[0085] This invention generates a comprehensive training score by spatially matching motion data, temporally matching rhythmic guidance and motion response, judging the correctness and response latency of cognitive responses, and further combining the results of cognitive-motor dual-task collaboration. Since the evaluation dimensions simultaneously cover motion completion quality, rhythmic response, cognitive task completion, and dual-task collaboration performance, it can more accurately reflect the actual performance of the execution end during training. At the same time, this invention also improves the stability and reliability of training evaluation results by setting minimum displacement thresholds, motion response windows, and cognitive response windows to filter invalid actions, timeout responses, and abnormal inputs.

[0086] To address the technical problem that existing training feedback is typically generated based on motion trajectories or posture deviations, making it difficult to simultaneously reflect motion quality, rhythm coordination, and training stability, resulting in incomplete feedback and insufficient basis for subsequent training adjustments, this invention integrates motion space matching results with rhythm time matching results to output a comprehensive training score. Based on this score, differentiated feedback information is generated for the guiding and executing devices, improving the completeness and guidance of the training feedback. In some embodiments of this invention, outputting training feedback to the guiding and executing devices based on the comprehensive training score includes: Based on the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result in the comprehensive training score, differentiated feedback is output to the execution end device and the guidance end device, respectively. The feedback output to the execution device includes prompts for correct action, prompts for too fast a beat, prompts for too slow a beat, prompts for correct cognitive judgment, prompts for incorrect cognitive judgment, prompts for completion of dual tasks, and prompts for retry. The feedback output to the guidance device includes rhythm trigger validity prompts, execution end response status prompts, current task load adaptation prompts, and next round suggestion prompts.

[0087] This invention, after obtaining a comprehensive score, can output targeted feedback information based on the action completion score, rhythm synchronization score, cognitive task score, and dual-task coordination score. For example, when the action completion score is low, it outputs an action correction prompt; when the rhythm synchronization score is low, it outputs a prompt that the beat is too fast or too slow; when the cognitive task score is low, it outputs a prompt that the cognitive judgment is incorrect or the reaction is slow; and when the dual-task coordination score is low, it outputs a prompt that the dual-task coordination is insufficient. Therefore, the execution device can more clearly identify the source of the problem and make adjustments, and the guidance device can also optimize subsequent rhythm triggering and training coordination methods accordingly, thereby improving the relevance of the feedback and the training guidance value.

[0088] To address the technical problem that existing training programs often employ fixed movement content and rhythm requirements, lacking flexibility to adapt to different rehabilitation stages and training performance, thus hindering the formation of a gradual rehabilitation process, this invention improves the adaptability and individualization of the training program by recording data on movement completion, rhythm synchronization, movement response delay, cognitive accuracy, cognitive response delay, cognitive-motor dual-task synergy, and historical performance during training. This allows for the adjustment of the rhythm speed, movement difficulty, cognitive task difficulty, cue intensity, and scoring threshold for subsequent training tasks. In some embodiments of this invention, the training parameters include beat interval, movement response window, movement amplitude requirements, cognitive task difficulty, cognitive stimulus complexity, cue intensity, and completion threshold.

[0089] It should be understood that when the comprehensive training score is above the first threshold for several consecutive rounds, the beat interval can be shortened, the action window tightened, and the cognitive task difficulty increased; when the action completion score is low, the action amplitude threshold can be relaxed or the action response window extended; when the rhythm synchronization score is low, the beat frequency can be reduced or the rhythm cue intensity increased; when the cognitive task score is low, the cognitive task complexity can be reduced or the number of simultaneous stimuli can be decreased; when the dual-task coordination score is low, the time window for simultaneous completion of dual tasks should be relaxed first. The adjusted parameters are then rewritten into the next round of training.

[0090] The embodiments of the present invention, through a training adjustment mechanism, can update the training parameters for the next round based on the comprehensive score results and individual score results of the current round or several consecutive rounds. This can adapt to the actual needs of different patients, different rehabilitation stages and different training states, and improve the individualization and continuity of the training program.

[0091] This invention, through the construction of a complete training process including guidance, execution, judgment, feedback, and adjustment, enables the continuous recording and structured output of rehabilitation training results. This ensures that the rehabilitation training process simultaneously possesses synergy, rhythm, cognitive-motor parallelism, evaluability, and adjustability, thereby improving the interactive quality, training effectiveness, and long-term value of rehabilitation training. It effectively solves the technical problem that patients often lack access to continuous and standardized training guidance in home rehabilitation settings, and that training effects are difficult to accumulate and track.

[0092] To better implement the stroke synergistic rhythm and dual-task rehabilitation training method in this invention embodiment, based on the stroke synergistic rhythm and dual-task rehabilitation training method, correspondingly, as follows: Figure 7 As shown, this embodiment of the invention also provides a stroke synergistic rhythm and dual-task rehabilitation training system. The stroke synergistic rhythm and dual-task rehabilitation training system 700 includes: The data acquisition module 701 is used to collect in real time the limb movement data and cognitive response data of the second user corresponding to the execution end.

[0093] Training control module 702, connected to data acquisition module 701, includes: The session establishment and role management module is used to establish training sessions, assign roles, and generate session parameters. At the start of training, this module receives user login information, device connection status, and training mode selection information. It assigns the first user participating in the training session to the guiding device and the second user to the execution device, and generates a session identifier for the current session. The session parameters are then sent as output to the training scenario configuration module for initializing subsequent training tasks. These parameters include: session identifier, role identifier, execution device identification information, training start time, and current training mode.

[0094] The training scenario configuration module is used to load training scenarios, action templates, cognitive task templates, rhythm parameters, and scoring thresholds based on session parameters, and generate a session parameter package. This session parameter package includes at least: scenario identifier, action template number, cognitive task type, cognitive task difficulty, beat interval, action response window, cognitive response window, various scoring weights, and various threshold parameters. This module pre-stores scenario configuration tables, action template tables, cognitive task template tables, rhythm parameter tables, and threshold parameter tables. After training begins, it calls the corresponding action template, cognitive task type, beat interval, action response window, cognitive response window, and scoring weights based on the scenario identifier and training level.

[0095] In one embodiment of the present invention, the action template is derived from the semantic transformation of rehabilitation actions and is used to describe the target direction, target amplitude, target trajectory, and action maintenance requirements of actions such as extension, lifting, abduction, retraction, and pausing; the cognitive task template is used to describe task types such as color recognition, direction judgment, target selection, and sequential response. This module outputs a session parameter package to the rhythm event package and cognitive task package generation module, the matching judgment module, and the training feedback module.

[0096] The rhythmic event package and cognitive task package generation module is used to trigger a rhythmic guidance signal and generate a rhythmic event package in a single training round of the training session; and to generate a cognitive task package based on the rhythmic state, action target and cognitive task difficulty in the same training round, and to display the cognitive stimulus information in the cognitive task package on the execution end device.

[0097] It should be noted that the rhythmic event package and cognitive task package generation module includes a rhythmic event package generation module and a cognitive task package generation module. The rhythmic event package generation module is used to generate the rhythmic guidance signal for the current round based on the session parameter package issued by the training scenario configuration module and the trigger operation of the guidance end. After receiving the trigger event, the system generates a rhythmic event package and records the rhythmic guidance time. This module sends the rhythmic event package to the synchronization matching judgment module on the one hand, and sends the rhythmic prompt to the execution end display and interaction interface on the other hand. The cognitive task package generation module is used to generate cognitive task stimulus information corresponding to the current round of training based on the rhythmic state, action target, and cognitive task difficulty of the current round. This module pre-stores a cognitive task material library and divides the materials into color recognition, direction judgment, target selection, and sequential response categories according to task type. Each cognitive task template corresponds to at least one task type, one correct answer code, and one stimulus display window. At the beginning of each round of training, the current task type is selected from the cognitive task template table, and the corresponding stimulus content is called from the material library to generate a cognitive task package. This module sends the cognitive task package to the synchronization matching and determination module, and displays the corresponding cognitive stimulus information in the virtual scene at the execution end. Preferably, the cognitive stimuli and rhythmic cues appear synchronously in time, or appear sequentially according to a preset offset time, to form a dual-task load.

[0098] The matching and determination module is used to perform joint matching and determination based on the rhythm event package, cognitive task package, limb movement data and cognitive response data to obtain the action completion result, rhythm matching result, cognitive response result and dual-task collaboration result.

[0099] The training feedback module is used to generate a comprehensive training score based on the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result. Based on the comprehensive training score, it outputs training feedback to the guidance device and the execution device, and updates the training parameters for the next training round.

[0100] The display module 703 is connected to the training control module 702 and is used to display cognitive stimulus information, training screen, action prompts, rhythm prompts and training feedback content.

[0101] It should be noted that the data processed by each module within the system carries at least a session identifier and a round identifier to ensure the data correspondence between different training rounds. The session identifier distinguishes different training sessions, while the round identifier marks the current training round within the same session. Rhythm signal data, cognitive task data, motion acquisition data, and cognitive response data are associated in the synchronization matching and determination module using the session identifier and round identifier.

[0102] The stroke synergistic rhythm and dual-task rehabilitation training system 700 provided in the above embodiments can realize the technical solutions described in the above embodiments of the stroke synergistic rhythm and dual-task rehabilitation training method. The specific implementation principles of each module or unit can be found in the corresponding content in the above embodiments of the stroke synergistic rhythm and dual-task rehabilitation training method, which will not be repeated here.

[0103] like Figure 8 As shown, the present invention also provides an electronic device 800. The electronic device 800 includes: Data acquisition device 801 is used to collect in real time the limb movement data and cognitive response data of the second user corresponding to the execution terminal device; Display 802 is used to display cognitive stimulus information, training images, motion prompts, rhythm prompts, and training feedback content. Memory 803 is used to store programs; The processor 804 is coupled to the data acquisition device 801, the display 802, and the memory 803, respectively, and is used to execute the program stored in the memory 803 to implement the steps in the stroke synergistic rhythm and dual-task rehabilitation training method described in any of the above implementations. Figure 8 Only some components of the sub-device 800 are shown; however, it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0104] In some embodiments, processor 804 may be a central processing unit (CPU), microprocessor, or other data processing chip, used to run program code stored in memory 803 or process data, such as the stroke synergistic rhythm and dual-task rehabilitation training method of the present invention.

[0105] In some embodiments, processor 804 may be a single server or a group of servers. The server group may be centralized or distributed. In some embodiments, processor 804 may be local or remote. In some embodiments, processor 804 may be implemented on a cloud platform. In one embodiment, the cloud platform may include a private cloud, public cloud, hybrid cloud, community cloud, distributed cloud, intranet, multi-cloud, etc., or any combination thereof.

[0106] In some embodiments, memory 803 may be an internal storage unit of electronic device 800, such as a hard disk or memory of electronic device 800. In other embodiments, memory 803 may also be an external storage device of electronic device 800, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc. equipped on electronic device 800.

[0107] Furthermore, the memory 803 may include both internal storage units of the electronic device 800 and external storage devices. The memory 803 is used to store application software and various types of data installed on the electronic device 800.

[0108] In some embodiments, display 802 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, or an OLED (Organic Light-Emitting Diode) touchscreen. Display 802 is used to display information from electronic device 800 and to display a visual user interface. Components 801-804 of electronic device 800 communicate with each other via a system bus.

[0109] In one embodiment, when the processor 804 executes the stroke synergistic rhythm and dual-task rehabilitation training program stored in the memory 803, the following steps can be implemented: Establish a training session, assign the first user participating in the training session to the bootstrap device, and assign the second user participating in the training session to the execution device; In a single training round of the training session, the guiding device triggers a rhythmic guiding signal and generates a rhythmic event package; in the same training round, a cognitive task package is generated based on the rhythmic state, action target, and cognitive task difficulty, and the cognitive stimulus information in the cognitive task package is displayed on the execution device. Collect limb movement data and cognitive response data of the second user corresponding to the execution terminal device in response to the rhythmic guidance signal and cognitive task stimulus information; Based on the rhythmic event package, cognitive task package, limb movement data, and cognitive response data, a joint matching judgment is performed to obtain the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result; Based on the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result, a comprehensive training score is generated. Based on the comprehensive training score, training feedback is output to the guidance device and the execution device, and the training parameters for the next training round are updated.

[0110] It should be understood that when the processor 804 executes the stroke synergistic rhythm and dual-task rehabilitation training program in the memory 803, in addition to the functions mentioned above, it can also perform other functions, as can be found in the description of the corresponding method embodiments above.

[0111] Those skilled in the art will understand that all or part of the processes of the methods described in the above embodiments can be implemented by a computer program instructing related hardware (such as a processor, controller, etc.), and the computer program can be stored in a computer-readable storage medium. The computer-readable storage medium may be a disk, optical disk, read-only memory, or random access memory, etc.

[0112] The above provides a detailed description of the stroke synergistic rhythm and dual-task rehabilitation training method, system, and electronic equipment provided by this invention. Specific examples have been used to illustrate the principles and implementation methods of this invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of this invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this invention. Therefore, the content of this specification should not be construed as a limitation of this invention.

Claims

1. A method for stroke coordinating rhythm and dual-task rehabilitation training, characterized in that, include: Establish a training session, assign the first user participating in the training session to the bootstrap device, and assign the second user participating in the training session to the execution device; In a single training round of the training session, the guiding device triggers a rhythmic guiding signal and generates a rhythmic event package; in the same training round, a cognitive task package is generated based on the rhythmic state, action target, and cognitive task difficulty, and the cognitive stimulus information in the cognitive task package is displayed on the execution device. Collect limb movement data and cognitive response data of the second user corresponding to the execution terminal in response to the rhythmic guidance signal and cognitive task stimulus information; Based on the rhythmic event package, cognitive task package, limb movement data, and cognitive response data, a joint matching judgment is performed to obtain the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result; Based on the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result, a comprehensive training score is generated. Based on the comprehensive training score, training feedback is output to the guidance device and the execution device, and the training parameters for the next training round are updated.

2. The stroke synergistic rhythm and dual-task rehabilitation training method according to claim 1, characterized in that, The joint matching determination based on the rhythmic event package, cognitive task package, limb movement data, and cognitive response data yields the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result, including: The limb movement data is spatially matched with a preset movement template to obtain the movement completion result; The motion response time in the limb motion data is matched with the rhythm guidance time in the rhythm event package to obtain the rhythm matching result. By comparing the cognitive response data with the correct answer codes in the cognitive task package, the cognitive response result is obtained. The dual-task collaborative result is obtained based on the combined completion of the action completion result and the cognitive response result within the same training round.

3. The stroke synergistic rhythm and dual-task rehabilitation training method according to claim 2, characterized in that, The step of spatially matching the limb movement data with a preset movement template to obtain the movement completion result includes: Calculate the posture deviation between the actual motion vector in the limb motion data and the target direction vector in the preset motion template; Calculate the amplitude deviation between the actual displacement length in the limb movement data and the target displacement length in the preset movement template; Calculate the trajectory deviation between the actual movement trajectory in the limb movement data and the reference trajectory in the preset movement template; The action completion score is calculated by weighting the posture deviation, amplitude deviation, trajectory deviation, and whether the duration of the action is maintained.

4. The stroke synergistic rhythm and dual-task rehabilitation training method according to claim 2, characterized in that, The step of matching the action response time in the limb movement data with the rhythm guidance time in the rhythm event package to obtain the rhythm matching result includes: Calculate the action initiation delay relative to the rhythm guidance time; Calculate the time delay of action completion relative to the timing of rhythm guidance; When the action start delay is within the preset action response window, the rhythm synchronization score is calculated by weighting the deviation between the action start delay and the target reference start delay, and the deviation between the action completion delay and the target reference completion delay.

5. The stroke synergistic rhythm and dual-task rehabilitation training method according to claim 2, characterized in that, The process of comparing the cognitive response data with the correct answer codes in the cognitive task package to obtain the cognitive response result includes: The difference between the cognitive response time and the stimulus start time is taken as the cognitive response delay; When the cognitive response value matches the code of the correct answer and the cognitive response delay is within the preset cognitive response window, the cognitive response is determined to be correct. The cognitive task score is calculated by weighting the cognitive response determination result and the cognitive response delay.

6. The stroke synergistic rhythm and dual-task rehabilitation training method according to claim 2, characterized in that, The method of obtaining a dual-task collaborative result based on the combined completion of the action completion result and the cognitive response result within the same training round includes: Determine whether the action completion result is higher than a preset action threshold and whether the action response is within a valid window to obtain the action task achievement result; Determine whether the cognitive response result is correct and whether the cognitive response is within the valid window to obtain the cognitive task achievement result; Determine whether the action task and the cognitive task are completed together within the specified window of the same training round to obtain the result of simultaneous completion of the two tasks; The dual-task synergy score is calculated by weighting the achievement results of the action task, the achievement results of the cognitive task, and the results of the simultaneous completion of the two tasks.

7. The stroke synergistic rhythm and dual-task rehabilitation training method according to claim 1, characterized in that, The step of outputting training feedback to the guidance device and the execution device based on the comprehensive training score includes: Based on the action completion result, rhythm matching result, cognitive response result, and dual-task collaboration result in the comprehensive training score, differentiated feedback is output to the execution end device and the guidance end device, respectively. The feedback output to the execution device includes prompts for correct action, prompts for too fast a beat, prompts for too slow a beat, prompts for correct cognitive judgment, prompts for incorrect cognitive judgment, prompts for completion of dual tasks, and prompts for retry. The feedback output to the guidance device includes rhythm trigger validity prompts, execution end response status prompts, current task load adaptation prompts, and next round suggestion prompts.

8. The stroke synergistic rhythm and dual-task rehabilitation training method according to claim 1, characterized in that, The training parameters include beat interval, action response window, action amplitude requirement, cognitive task difficulty, cognitive stimulus complexity, cue intensity, and pass threshold.

9. A stroke-related rhythmic and dual-task rehabilitation training system, characterized in that, include: The data acquisition module is used to collect in real time the limb movement data and cognitive response data of the second user corresponding to the execution terminal device; The training control module, connected to the data acquisition module, includes: The session establishment and role management module is used to establish training sessions, assign the first user participating in the training session to the guiding end device, and assign the second user participating in the training session to the execution end device; The rhythmic event package and cognitive task package generation module is used to trigger a rhythmic guidance signal and generate a rhythmic event package in a single training round of the training session; and to generate a cognitive task package based on the rhythmic state, action target and cognitive task difficulty in the same training round, and to display the cognitive stimulus information in the cognitive task package on the execution end device. The matching and determination module is used to perform joint matching and determination based on the rhythmic event package, cognitive task package, limb movement data and cognitive response data to obtain the action completion result, rhythm matching result, cognitive response result and dual-task collaboration result; The training feedback module is used to generate a comprehensive training score based on the action completion result, rhythm matching result, cognitive response result and dual-task collaboration result, output training feedback to the guidance end device and the execution end device based on the comprehensive training score, and update the training parameters for the next training round. The display module, connected to the training control module, is used to display cognitive stimulus information, training images, action prompts, rhythm prompts, and training feedback content.

10. An electronic device, characterized in that, include: Data acquisition equipment is used to collect in real time the limb movement data and cognitive response data of the second user corresponding to the execution terminal device; The display is used to show cognitive stimulus information, training images, motion cues, rhythmic cues, and training feedback content. Memory, used to store programs; The processor, coupled to the data acquisition device, the display, and the memory, is used to execute the program stored in the memory to implement the steps of the stroke synergistic rhythm and dual-task rehabilitation training method according to any one of claims 1 to 8.

Images