Wearable device, rehabilitation training system and method, storage medium and program product

Abstract

The embodiment of the invention provides wearable equipment, a rehabilitation training system and method, a storage medium and a program product. According to the scheme provided by the embodiment of the invention, the rehabilitation trainee can select the favorite rehabilitation training scene after wearing the wearable device, and the wearable device can also obtain the training prescription corresponding to the rehabilitation trainee from the server; the control device of the wearable device can fuse and play the training guidance animation of the training prescription and the rehabilitation training scene, so that the rehabilitation trainee has a sense of immersion, the rehabilitation training becomes more interesting, and the training enthusiasm of the rehabilitation trainee can be effectively improved. Meanwhile, according to the scheme, the first physiological parameters of the rehabilitation trainee in the training process can be collected, the adaptation degree of the rehabilitation trainee and the training prescription can be evaluated according to the first physiological parameters, the training prescription is adjusted according to the adaptation degree, and the training prescription is more suitable for the rehabilitation trainee instead of exceeding the ability range of the rehabilitation trainee; and the training is safer and more effective.

Description

Technical Field

[0001] The present application relates to the technical fields of electronic devices and computer technologies, and particularly relates to a wearable device, a rehabilitation training system and method, a storage medium, and a program product. Background Art

[0002] Rehabilitation training is an important means to help patients (such as heart recovery patients, stroke patients, etc.) recover or improve their physical functions and improve their quality of life. The traditional methods of rehabilitation training are that rehabilitation doctors assist patients in doing rehabilitation training hand in hand, or use mechanical aids to do rehabilitation training for patients. For some other patients, doctors tell the patients to walk more at home, walk for half an hour or an hour every day, etc. It completely relies on the patient's family members to assist the patient in doing rehabilitation training at home.

[0003] It can be seen that the existing rehabilitation training methods have low treatment efficiency, poor rehabilitation training effects, and the training process is monotonous and boring, which in turn affects the patient's willingness to do rehabilitation training. Summary of the Invention

[0004] In view of the above problems, the present application provides a solution that can solve or improve the problems, that is, a wearable device, a rehabilitation training system and method, a storage medium, and a program product.

[0005] In the first embodiment of the present application, a wearable device for rehabilitation training is provided. The wearable device includes: A wearable device having a display screen and a speaker; At least one sensor disposed on the wearable device for contacting the skin of the rehabilitation trainer after the rehabilitation trainer wears the wearable device to detect a first physiological parameter of the rehabilitation trainer; An interaction device disposed on the wearable device for interacting with the rehabilitation trainer to obtain an interaction instruction of the rehabilitation trainer and / or send an interaction message to the rehabilitation trainer; A control device disposed on the wearable device, configured with a plurality of training scenarios for the rehabilitation trainer to select; Wherein, the interaction device is used to select a target training scenario from the plurality of training scenarios in response to a selection instruction of the rehabilitation trainer; the control device is used to obtain a training prescription corresponding to the rehabilitation trainer from a server, obtain a training guidance animation according to the training prescription; retrieve the audio and video corresponding to the target training scenario, fuse the audio and video with the training guidance animation, control the display screen and the speaker to play the fused audio and video; and evaluate the suitability of the training prescription and the rehabilitation trainer according to the first physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability.

[0006] Optionally, when the control device fuses the audio-visual content with the training guidance animation, it is specifically configured to: Identify the video images in the audio-visual content; In the video images, identify the target positions suitable for the standing virtual instructor; Using the matting technology, extract the virtual instructor animation from the training guidance animation; At the target positions, fuse the virtual instructor animation into the target training scenario.

[0007] Optionally, when the control device fuses the audio-visual content with the training guidance animation, it is specifically configured to: Use artificial intelligence image synthesis technology to fuse the training guidance animation with the audio-visual content.

[0008] Optionally, the at least one sensor includes: An electroencephalogram signal collector for collecting the electroencephalogram signals of the rehabilitation trainer; A sweat sensor for detecting the sweating amount and sweat information of the rehabilitation trainer.

[0009] Optionally, the wearable device for rehabilitation training further includes: a vital sign detection device; The vital sign detection device, communicatively connected to the control device, is configured to detect the second physiological parameters of the rehabilitation trainer after the rehabilitation trainer wears the vital sign detection device; When the control device evaluates the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter and adjusts the training prescription of the rehabilitation trainer according to the suitability, it comprehensively evaluates the suitability of the training prescription for the rehabilitation trainer based on the first physiological parameter and the second physiological parameter, and adjusts the training prescription of the rehabilitation trainer according to the suitability; Wherein, the second physiological parameter includes at least one of the following: heart rate information, blood pressure, body temperature.

[0010] Optionally, the vital sign detection device is: a smart watch or a wearable vital sign monitor.

[0011] Optionally, the wearable device is: a virtual reality (VR) glasses, or an augmented reality (AR) glasses, or a mixed reality (MR) glasses.

[0012] In the second embodiment of the present application, a rehabilitation training system is provided. The system includes: A wearable device, including a wearable unit, the wearable unit having a display screen and a speaker, and at least one sensor is further provided on the wearable unit for contacting the skin of a rehabilitation trainer after the rehabilitation trainer wears the wearable unit to detect a first physiological parameter of the rehabilitation trainer; an interaction device and a control device are further provided on the wearable unit, and the control device is configured with multiple training scenarios for the rehabilitation trainer to select; the interaction device is used to respond to a selection instruction of the rehabilitation trainer and select a target training scenario from the multiple training scenarios; the control device is used to obtain a training prescription corresponding to the rehabilitation trainer from a server, obtain a training guidance animation according to the training prescription; retrieve the audio and video corresponding to the target training scenario, fuse the audio and video with the training guidance animation, control the display screen and the speaker to play the fused audio and video; and send the first physiological parameter to the server; The server is used to evaluate the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability; and send the adjusted training prescription to the wearable device.

[0013] Optionally, the wearable device further includes a vital sign detection device; The vital sign detection device is communicatively connected to the control device and is used to detect a second physiological parameter of the rehabilitation trainer after the rehabilitation trainer wears the vital sign detection device; The control device is further used to send the second physiological parameter to the server; When the server evaluates the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter and adjusts the training prescription of the rehabilitation trainer according to the suitability, it comprehensively evaluates the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter and the second physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability; Wherein, the first physiological parameter includes at least one of the following: electroencephalogram signal, sweating amount and sweat information; the second physiological parameter includes at least one of the following: heart rate information, blood pressure, body temperature.

[0014] In the third embodiment of the present application, a rehabilitation training method is provided. The method includes: Respond to a selection instruction of a rehabilitation trainer and select a target training scenario from multiple training scenarios; Obtain a training prescription corresponding to the rehabilitation trainer; Obtain a training guidance animation according to the training prescription; Retrieve the audio and video corresponding to the target training scenario, and fuse the audio and video with the training guidance animation; Play the fused audio and video.

[0015] Optionally, the method provided in this embodiment may further include: Collect the first physiological parameter and the second physiological parameter of the rehabilitation trainer during the training process following the fused audio and video; Evaluate the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter and the second physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability; Wherein, the first physiological parameter includes at least one of the following: electroencephalogram signal, sweating amount and sweat information; the second physiological parameter includes at least one of the following: heartbeat information, blood pressure, body temperature.

[0016] Optionally, adjusting the training prescription of the rehabilitation trainer according to the suitability includes: If the suitability reflects that the rehabilitation trainer can easily complete the training tasks in the training prescription, increase the training volume in the training prescription; If the suitability reflects that the rehabilitation trainer cannot complete the training tasks in the training prescription, reduce the training volume in the training prescription.

[0017] Optionally, fusing the audio and video with the training guidance animation includes: Identify the video image in the audio and video; in the video image, identify the target position suitable for the standing virtual instructor; use the image matting technology to cut out the virtual instructor animation from the training guidance animation; at the target position, fuse the virtual instructor animation in the target training scene; or Use artificial intelligence image synthesis technology to fuse the training guidance animation with the audio and video.

[0018] In the fourth embodiment of the present application, a computer-readable storage medium is provided. The storage medium stores computer instructions, and when the instructions are executed by a processor, the steps in the above method embodiments can be implemented.

[0019] The fifth embodiment of the present application also provides a computer program product, which includes a computer program or instruction. When the computer program or instruction is executed by a processor, the processor is caused to execute the steps in the above method embodiments.

[0020] With the technical solution provided in the embodiments of the present application, after a rehabilitation trainer wears the wearable device, he or she can select his or her favorite rehabilitation training scenario. The wearable device can also obtain the corresponding training prescription of the rehabilitation trainer from the server. The control device of the wearable device can integrate the training guidance animation of the training prescription with the rehabilitation training scenario and play it. For example, the guidance animation (the movements of doing Tai Chi) of a virtual instructor (such as a Tai Chi teacher) can be integrated into a park scene, so that the rehabilitation trainer feels as if he or she is doing Tai Chi with the Tai Chi teacher in the park; this makes the rehabilitation training more interesting and can effectively improve the training enthusiasm of the rehabilitation trainer. At the same time, the solution of the present application can also collect the first physiological parameters (such as electroencephalogram information, sweating amount or sweat information, etc.) of the rehabilitation trainer during the training process, and can evaluate the suitability of the rehabilitation trainer and the training prescription according to the first physiological parameters, so as to adjust the training prescription according to the suitability, making the training prescription more suitable for the rehabilitation trainer instead of exceeding the ability range of the rehabilitation trainer, and making the training safer and more effective. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0022] Figure 1 Structural schematic diagram of a wearable device provided in an embodiment of the present application; Figure 2a Schematic diagram of integrating a target training scenario with a training guidance animation provided in an embodiment of the present application; Figure 2b Schematic diagram of displaying the integrated audio and video on the wearable device; Figure 3 Structural schematic diagram of a wearable device provided in another embodiment of the present application; Figure 4 Structural schematic diagram of a rehabilitation training system provided in an embodiment of the present application; Figure 5 Flow schematic diagram of a rehabilitation training method provided in an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0023] The following will further elaborate on the present application in conjunction with the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the present application, rather than limiting the present application. Additionally, it should be noted that for the sake of convenience of description, only the parts related to the present application rather than all the structures are shown in the drawings.

[0024] In the description of the present application, unless otherwise clearly specified and defined, the terms "connected", "connected to", and "fixed" shall be understood in a broad sense. For example, it may be a fixed connection, a detachable connection, or integrated; it may be a mechanical connection or an electrical connection; it may be directly connected or indirectly connected through an intermediate medium, and it may be the communication inside two components or the interaction relationship between two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to specific circumstances. In the present application, unless otherwise clearly specified and defined, the first feature being "above" or "below" the second feature may include the direct contact between the first and second features, or may include the situation where the first and second features are not in direct contact but in contact through other features between them. Moreover, the first feature being "above", "above", and "on top of" the second feature includes that the first feature is directly above and obliquely above the second feature, or merely indicates that the horizontal height of the first feature is higher than that of the second feature. The first feature being "below", "beneath", and "underneath" the second feature includes that the first feature is directly below and obliquely below the second feature, or merely indicates that the horizontal height of the first feature is less than that of the second feature. In the description of this embodiment, the orientation or positional relationships such as "above", "below", "right", etc. are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of description and simplifying the operation, rather than indicating or implying that the device or component referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus cannot be understood as a limitation to the present application. In addition, the terms "first" and "second" are only used for distinction in description and have no special meaning.

[0025] Figure 1 The structural schematic diagram of a wearable device for rehabilitation training provided by an embodiment of the present application is shown. As Figure 1 shown, the wearable device for rehabilitation training may include: a wearable device 1, at least one sensor 2, an interaction device 3, and a control device 4. Among them, the wearable device 1 has a display screen and a speaker. At least one sensor 2 is disposed on the wearable device 1 and is used to contact the skin of the rehabilitation trainer after the rehabilitation trainer wears the wearable device to detect the first physiological parameter of the rehabilitation trainer. The interaction device 3 is disposed on the wearable device 1 and is used to interact with the rehabilitation trainer to obtain the interaction instruction of the rehabilitation trainer and / or send interaction information to the rehabilitation trainer. The control device 4 is disposed on the wearable device 1 and is configured with a plurality of training scenarios for the rehabilitation trainer to select.

[0026] Specifically, the interaction device 3 is used to select a target training scenario from the plurality of training scenarios in response to the selection instruction of the rehabilitation trainer; the control device 4 is used to obtain the training prescription corresponding to the rehabilitation trainer from the server, and obtain the training guidance animation according to the training prescription (see Figure 2aas shown); retrieve the audio and video corresponding to the target training scenario (see Figure 2a as shown), fuse the audio and video with the training guidance animation, and control the display screen and the speaker to play the fused audio and video (see Figure 2b as shown); and evaluate the suitability of the training prescription for the rehabilitation trainee according to the first physiological parameter, so as to adjust the training prescription of the rehabilitation trainee according to the suitability.

[0027] In another case, the control device 4 in the wearable device can send the first physiological parameter to the server, and the server evaluates the suitability of the training prescription for the rehabilitation trainee, so as to adjust the training prescription of the rehabilitation trainee according to the suitability.

[0028] The wearable device 1 can be, but is not limited to: a virtual reality (VR) glasses or helmet, or an augmented reality (AR) glasses or helmet, or a mixed reality (MR) glasses or helmet.

[0029] The interaction device 3 can include, but is not limited to: a voice recognition module, at least one control (such as a touch control, a mechanical control, etc.), a gesture recognition module (such as a camera is provided on the wearable device, the camera collects the user's gestures, and determines the user's instructions through gesture recognition), etc. The specific implementation of the voice recognition module and the gesture recognition module, etc., is not specifically limited in this embodiment, and can be implemented with reference to related technologies.

[0030] With the technical solution provided in this embodiment, after the rehabilitation trainee wears the wearable device, he can select his favorite rehabilitation training scenario. The wearable device can also obtain the training prescription corresponding to the rehabilitation trainee from the server. The control device of the wearable device can fuse and play the training guidance animation of the training prescription with the rehabilitation training scenario. For example, the guidance animation (the movement of playing tai chi) of a virtual instructor (such as a tai chi teacher) is fused into the park scene, so that the rehabilitation trainee feels as if he is playing tai chi with the tai chi teacher in the park; making the rehabilitation training more interesting and effectively improving the training enthusiasm of the rehabilitation trainee. At the same time, the solution of this embodiment can also collect the first physiological parameters (such as electroencephalogram information, sweating amount or sweat information, etc.) of the rehabilitation trainee during the training process, and can evaluate the suitability of the rehabilitation trainee and the training prescription according to the first physiological parameter, so as to adjust the training prescription according to the suitability, making the training prescription more suitable for the rehabilitation trainee, rather than exceeding the ability range of the rehabilitation trainee, and making the training safer and more effective.

[0031] In a feasible technical solution, when the control device fuses the audio and video with the training guidance animation, it can be specifically used for: Identify the video image in the audio-video; In the video image, identify the target position suitable for the standing virtual instructor; Adopt a matte extraction technique to extract the virtual instructor animation from the training guidance animation; At the target position, fuse the virtual instructor animation into the target training scene.

[0032] For example, the training prescription is dumbbell training. Correspondingly, the training guidance animation corresponding to this training prescription can be: an animation of a virtual instructor (or virtual coach) demonstrating dumbbell training movements. The rehabilitation trainer selects a gym training scene. Correspondingly, the audio-video of the gym training scene can be: an audio-video of the interior of a virtual or real gym shot by the network side. A video image recognition module is pre-installed in the control device, which can recognize each frame of the video image and then determine the position suitable for the virtual instructor to stand. Then, frame-by-frame processing is performed. Using the matte extraction technique, the virtual instructor in the animation of the virtual instructor demonstrating dumbbell training movements is extracted frame by frame; finally, the multiple frames of the virtual instructor extracted frame by frame are respectively fused with the corresponding video frames in the audio-video of the interior of the gym to obtain a fused audio-video of the virtual instructor demonstrating dumbbell training movements in the interior of the gym. The control device controls the display screen and speaker of the wearable device to play the fused audio-video. In this way, the rehabilitation trainer has a sense of immersion in training in the gym with the guidance of a dedicated personal trainer.

[0033] It should be added here that: the audio-video of the interior of the gym shot by the network side can be a third-party gym that has signed a corresponding cooperation agreement with the hospital or organization in advance. This third-party gym allows shooting and sending it to the hospital-side server through the network, and then the server sends it to the wearable device. It can also be the audio-video of the interior of the gym collected by the gym within the rehabilitation hospital.

[0034] Take another example. For instance, if the training prescription is to walk slowly for one hour, correspondingly, the training guidance animation for this training prescription can be: an animation of a virtual instructor demonstrating slow walking, which demonstrates the walking speed for the rehabilitation trainer to refer to for training. The rehabilitation trainer selects the park training scenario. Correspondingly, the audio and video of the park training scenario can be: virtual or real-shot park audio and video on the network side. A video image recognition module is preset in the control device, which can recognize each frame of the video image and then determine the position suitable for the virtual instructor to stand. Then, frame-by-frame processing is performed, and the keying technology is used to key out the virtual instructor in the animation of the virtual instructor demonstrating dumbbell training actions frame by frame. Finally, the multiple frames of the virtual instructor keyed out frame by frame are respectively fused with the corresponding video frames in the audio and video of the gym interior scene to obtain a fused audio and video of the virtual instructor walking on the park walkway leading the rehabilitation trainer to walk. The control device controls the display screen and speaker of the wearable device to play the fused audio and video. In this way, the rehabilitation trainer has an immersive feeling of walking slowly in the park following the leader.

[0035] In addition to dumbbell and walking training, the training guidance animation corresponding to the training prescription may also include, but is not limited to: an animation of a virtual instructor demonstrating slow walking, an animation of a virtual instructor demonstrating Tai Chi, an animation of a virtual instructor demonstrating limb movement exercises, an animation of a virtual instructor demonstrating equipment operation actions, and so on.

[0036] Furthermore, the embodiment of the present application can also provide an intelligent dialogue function. For example, an intelligent dialogue model is preset in the control device of the wearable device. The intelligent dialogue model can recognize the speech of the rehabilitation trainer and generate reply information based on the speech, so that the rehabilitation trainer has an immersive feeling of chatting while training, enhancing the fun. No specific limitation is imposed on the intelligent dialogue model in this embodiment. It can be any intelligent dialogue model implemented by artificial intelligence technology and can make a reply based on the speech of the interlocutor. The control device can display the reply information of the intelligent dialogue model through the display screen and / or play the reply information of the intelligent dialogue model through the speaker.

[0037] In another implementable technical solution, when the control device fuses the audio and video with the training guidance animation, it is specifically used for: using artificial intelligence image synthesis technology to fuse the training guidance animation with the audio and video.

[0038] That is, in this embodiment, the existing artificial intelligence image synthesis technology can be directly used to perform the image fusion (or synthesis) function. For example, a trained image synthesis model is pre-installed on the server side of the rehabilitation hospital. The control device of the wearable device can send the target training scenario selected by the user and the training guidance animation corresponding to the training prescription to the server side. The server side uses the audio-visual content corresponding to the target training scenario and the training guidance animation as the input of the image synthesis model, and executes the image synthesis model to output the fused audio-visual content. The server side sends the fused audio-visual content to the wearable device for playback through the display screen and speaker of the wearable device.

[0039] In specific implementation, at least one of the following sensors can be set on the wearable device provided in this embodiment, such as an electroencephalogram signal collector, a sweat sensor, etc. Among them, the electroencephalogram signal collector is used to collect the electroencephalogram signals of the rehabilitation trainer. The sweat sensor is used to detect the sweating amount and sweat information of the rehabilitation trainer.

[0040] The sweat sensor can monitor and analyze the sweat components and also monitor the sweating amount. For example, a detachable sweat towel is provided in the area of the wearable device that contacts the skin of the rehabilitation trainer. The rehabilitation trainer can install a clean sweat towel on the wearable device through Velcro or snap buttons before training. The sweat sensor can be set on the sweat towel and can be in contact with the rehabilitation trainer. The sweat sensor provides information about physical health by detecting various components in the sweat, such as electrolytes, lactate, glucose, etc. The working principle of the sweat sensor is mainly based on electrochemical analysis technology. The sweat sensor includes multiple electrodes and a processor. Among them, the multiple electrodes can be set on the sweat towel, and the processor can be set on the wearable device. The multiple electrodes can detect specific components in the sweat and convert them into electrical signals; the processor then converts these electrical signals into data, such as the fluid loss rate, electrolyte content, etc. The sweat sensor can combine with the exercise function to provide the exercise intensity and calorie consumption. The sweat sensor can also detect components such as lactate and glucose in the sweat, and the changes in these components can reflect certain health conditions of the body. For example, the lactate concentration in the sweat can be used as a sensitive marker for the vitality of the corresponding tissue.

[0041] An electroencephalogram (EEG) signal collector is a device used to record and analyze brain activities. It generates an electroencephalogram (EEG) by capturing the electrical signals generated by brain neurons, thereby enabling an understanding of the brain's functions and states. The EEG signal collector may include: electrodes, amplifiers, analog-to-digital converters (ADCs), etc. There may be multiple electrodes, distributed at multiple positions on the wearable device that come into contact with the rehabilitation trainee. Of course, the EEG signal collector may also be provided on a sweat towel, and multiple electrodes may be arranged at intervals. During exercise, certain regions of the brain generate higher-frequency brain waves, such as beta waves and gamma waves. These high-frequency waves are usually related to alertness, attention, and cognitive activities. Exercise can also cause changes in the amplitude of brain waves. Different types of exercise cause changes in the spatial distribution of brain waves in different regions of the brain. For example, hand movements mainly affect the brain waves in the central region, while leg movements mainly affect the brain waves in the parietal region. By monitoring and analyzing the brain waves of the rehabilitation trainee, the cognitive state and mental state of the rehabilitation trainee can be understood, which helps to develop a more personalized training prescription and improve the effectiveness of the rehabilitation training for the rehabilitation trainee.

[0042] In the embodiments of the present application, the brain wave signals of the rehabilitation trainee can be collected before, during, and after the rehabilitation training, and the brain wave signals can be used as a reference for formulating a training prescription, as a reference for adjusting the training prescription during the training, and as a reference for formulating a training prescription for the next training after the training.

[0043] If the wearable device is a helmet, the sweat towel can be the area corresponding to the forehead of the rehabilitation trainee or the inner wall of the entire helmet, that is, the sweat towel covers the inner wall of the entire helmet. Since the sweat towel is detachable, designing the sweat towel to cover the inner wall of the entire helmet is cleaner and more hygienic. When different rehabilitation trainees use the wearable device, they can install their own exclusive sweat towel.

[0044] If the wearable device is glasses, the sweat towel can be the area corresponding to the forehead of the rehabilitation trainee.

[0045] In order to further improve the accuracy of the evaluation, as Figure 3 shown, the wearable device for rehabilitation training provided in this embodiment further includes a vital sign detection device 5. The vital sign detection device 5 is communicatively connected to the control device 4 and is used to detect the second physiological parameters of the rehabilitation trainee after the rehabilitation trainee wears the vital sign detection device 5. Correspondingly, when the control device 4 evaluates the suitability of the training prescription for the rehabilitation trainee according to the first physiological parameter and adjusts the training prescription of the rehabilitation trainee according to the suitability, the control device 4 comprehensively evaluates the suitability of the training prescription for the rehabilitation trainee based on the first physiological parameter and the second physiological parameter, and adjusts the training prescription of the rehabilitation trainee according to the suitability. Wherein, the second physiological parameter includes at least one of the following: heartbeat information, blood pressure, body temperature, etc.

[0046] In practical applications, the vital sign detection device 5 can be: a smart watch or a wearable vital sign monitor. As Figure 3 shown in an example, the wearable vital sign monitor may include but is not limited to: a main unit 51, an electrocardiogram collector 52, a blood pressure collector 53, and a body temperature collector (not shown in the figure). Among them, the electrocardiogram collector 52, the blood pressure collector 53, and the body temperature collector are all connected to the main unit 51. The electrocardiogram collector 52 can be electrode clips and / or electrode patches. The rehabilitation trainer can wear the main unit 51 on the body, clip the electrode clips on the fingers, wrists or ankles, etc.; and / or stick the electrode patches on the chest. The blood pressure collector 53 can have a pressure measuring strap. Before the training, the rehabilitation trainer can tie the pressure measuring strap on the upper arm. One feasible solution is that the main unit 51 can be arranged on the pressure measuring strap, so that the rehabilitation trainer completes the wearing by tying the pressure measuring strap on the arm. During the training process, the main unit 51 can measure the blood pressure of the rehabilitation trainer through the pressure measuring strap at regular intervals (such as every 10 minutes). The body temperature collector can be arranged on the pressure measuring strap, or the body temperature collector is a separate body temperature collection patch, and this embodiment does not make specific limitations on this.

[0047] Of course, the main unit 51 can also be integrated into the wearable device 1. From the perspective of the product appearance, the wearable device 1 is connected with an electrocardiogram collector 52, a blood pressure collector 53, a body temperature collector, etc. The electrocardiogram signal collected by the electrocardiogram collector 52, the blood pressure value collected by the blood pressure collector 53, the body temperature information collected by the body temperature collector, etc. can all be displayed on the display screen of the wearable device 1, which is convenient for the rehabilitation trainer to view.

[0048] Furthermore, it should be noted that: the control device 4 is preset with a preset evaluation model or calculation program. After receiving the first physiological parameter and the second physiological parameter, the control device can evaluate whether the current training prescription is suitable for the rehabilitation trainer by using the evaluation model or calculation program.

[0049] For example, for patients undergoing cardiac rehabilitation, medical staff will formulate a training prescription for the rehabilitation trainer based on experience. Or, the service end uses an existing training prescription formulation model to formulate a training prescription for the rehabilitation trainer based on information such as the gender, age, and underlying diseases of the rehabilitation trainer. However, in actual training, there will still be situations where the rehabilitation trainer cannot complete the training volume in the training prescription. For example, both the first physiological parameter and the second physiological parameter collected during the training indicate that the rehabilitation trainer sweats too much, has a too fast heart rate, and has a large body temperature change, etc., indicating that the training task of this training prescription is too large, and the training load should be stopped, slowed down, or reduced, etc.

[0050] In addition, there will be cases where the rehabilitation trainer can easily complete the training volume in the training prescription. For example, after completing the training tasks in the training prescription, both the first physiological parameter and the second physiological parameter collected during the entire training process indicate that the rehabilitation trainer is slightly sweating or not sweating, the heart rate increase is not much, the blood pressure change is not significant, and the body temperature change is not much. In this case, it can be determined that the training tasks in the training prescription are relatively easy for the rehabilitation trainer and do not achieve a good training purpose.

[0051] Therefore, it is necessary to adjust the training prescription in a timely manner according to the first physiological parameter and the second physiological parameter of the rehabilitation trainer. For example, the training prescription is to walk slowly for one hour, and the slow walking speed in the training prescription is 50 meters per minute. When it is evaluated according to the first physiological parameter and the second physiological parameter of the rehabilitation trainer that the rehabilitation trainer cannot complete the training tasks in the training prescription, the training prescription is adjusted to reduce the slow walking speed to 40 meters per minute or lower. The adjustment process can be adjusted according to a preset adjustment ladder. For example, each adjustment is one ladder, that is, 10 meters per minute.

[0052] Furthermore, in the technical solution provided in this embodiment, the rehabilitation trainer can also adjust the training prescription by himself / herself through the interaction device 3. For example, the rehabilitation trainer can, according to his / her feelings during the training process, say through the interaction device 3, such as in a voice manner, "No, this running speed is too fast. Please help me slow it down." After the voice recognition module of the control device recognizes the user's intention, it adjusts the running speed in the training prescription. Or, the control device outputs through the intelligent dialogue module, "How much do you want to adjust?" The rehabilitation trainer can reply, "Slow it down a bit" or "Adjust it to ** meters per minute", etc. The control device can then adjust the training prescription according to the voice recognition result.

[0053] See Figure 4 shows a rehabilitation training system provided by another embodiment of the present application. The rehabilitation training system includes: Wearable device 100, including a wearable device 1, the wearable device 1 having a display screen and a speaker, and at least one sensor 2 is further provided on the wearable device 1 for contacting the skin of the rehabilitation trainer after the rehabilitation trainer wears the wearable device 1 to detect a first physiological parameter of the rehabilitation trainer; an interaction device 3 and a control device 4 are further provided on the wearable device 1, and the control device 4 is configured with a plurality of training scenarios for the rehabilitation trainer to select; the interaction device 3 is used to respond to the selection instruction of the rehabilitation trainer and select a target training scenario from the plurality of training scenarios; the control device 4 is used to obtain the training prescription corresponding to the rehabilitation trainer from the server 200, obtain a training guidance animation according to the training prescription; retrieve the audio and video corresponding to the target training scenario, fuse the audio and video with the training guidance animation, and control the display screen and the speaker to play the fused audio and video; and send the first physiological parameter to the server 200; The server 200 is used to evaluate the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability; and send the adjusted training prescription to the wearable device 100.

[0054] According to the technical solution provided by the embodiment of the present application, after the rehabilitation trainer wears the wearable device, he can select his favorite rehabilitation training scenario. The wearable device can also obtain the training prescription corresponding to the rehabilitation trainer from the server. The control device of the wearable device can fuse and play the training guidance animation of the training prescription with the rehabilitation training scenario. For example, fuse the guidance animation (Taijiquan movements) of a virtual instructor (such as a Taijiquan teacher) into a park scene, so that the rehabilitation trainer feels like practicing Taijiquan with a Taijiquan teacher in the park; making the rehabilitation training more interesting and effectively improving the training enthusiasm of the rehabilitation trainer. At the same time, the server in the solution of the present application can also evaluate the suitability of the rehabilitation trainer and the training prescription based on the first physiological parameter (such as electroencephalogram information, sweating amount or sweat information, etc.) of the rehabilitation trainer during the training process, so as to adjust the training prescription according to the suitability, making the training prescription more suitable for the rehabilitation trainer, rather than exceeding the ability range of the rehabilitation trainer, and making the training safer and more effective.

[0055] Further, the wearable device in the rehabilitation training system may further include a vital sign detection device 5 (such as Figure 3 shown); The vital sign detection device 5 is communicatively connected to the control device 4 for detecting a second physiological parameter of the rehabilitation trainer after the rehabilitation trainer wears the vital sign detection device; The control device 4 is further used to send the second physiological parameter to the server 200; When the server 200 evaluates the fitness of the training prescription for the rehabilitation trainer according to the first physiological parameter and adjusts the training prescription for the rehabilitation trainer according to the fitness, it comprehensively evaluates the fitness of the training prescription for the rehabilitation trainer based on the first physiological parameter and the second physiological parameter, and adjusts the training prescription for the rehabilitation trainer according to the fitness. Wherein, the first physiological parameter includes at least one of the following: electroencephalogram signal, sweating amount and sweat information; the second physiological parameter includes at least one of the following: heart rate information, blood pressure, body temperature.

[0056] It should be noted here that: the specific structure and related content of the above wearable device can be seen in the description above, and will not be elaborated here.

[0057] Among them, the server 200 can be a server deployed in a hospital, or a virtual server deployed on a server cluster or a cloud server, etc. This embodiment does not make specific limitations on this.

[0058] In addition, the embodiment of the present application also provides a rehabilitation training method. The execution subject of this rehabilitation training method can be the control device in the wearable device. Or, the execution subject of some steps in this rehabilitation training method is the wearable device, and the execution subject of another part of the steps is the server. Specifically, as Figure 5 shown, the method may include: 101. Respond to the selection instruction of the rehabilitation trainer and select a target training scenario from multiple training scenarios; 102. Obtain the training prescription corresponding to the rehabilitation trainer; 103. Obtain a training guidance animation according to the training prescription; 104. Retrieve the audio and video corresponding to the target training scenario and fuse the audio and video with the training guidance animation; 105. Play the fused audio and video.

[0059] Furthermore, the method provided in this embodiment may further include the following steps: 106. Collect the first physiological parameter of the rehabilitation trainer during the training process following the fused audio and video; 107. Evaluate the fitness of the training prescription for the rehabilitation trainer according to the first physiological parameter, and adjust the training prescription for the rehabilitation trainer according to the fitness; Wherein, the first physiological parameter includes at least one of the following: electroencephalogram signal, sweating amount and sweat information.

[0060] Or, furthermore, the method provided in this embodiment may further include the following steps: 106’. Collect the first physiological parameter and the second physiological parameter of the rehabilitation trainer during the training process following the fused audio and video. 107’. Evaluate the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter and the second physiological parameter, and adjust the training prescription of the rehabilitation trainer according to the suitability. Wherein, the first physiological parameter includes at least one of the following: electroencephalogram signal, sweating amount and sweat information; the second physiological parameter includes at least one of the following: heart rate information, blood pressure, body temperature.

[0061] Further, “adjust the training prescription of the rehabilitation trainer according to the suitability” in step 107 or 107’ above may include the following steps: If the suitability reflects that the rehabilitation trainer can easily complete the training tasks in the training prescription, increase the training amount in the training prescription. If the suitability reflects that the rehabilitation trainer cannot complete the training tasks in the training prescription, reduce the training amount in the training prescription.

[0062] The increased or decreased amount can be adjusted according to the set adjustment ladder. For different training items, the adjustment ladder is different. For example, for the training item of lifting dumbbells, the increased or decreased amount may include, but is not limited to: each time the weight of the dumbbell is increased or decreased by 1 kg, each time the number of times of lifting the dumbbell is increased or decreased by 5 times, etc. For the slow walking item, the increased or decreased amount may include, but is not limited to: each time the slow walking speed is increased or decreased by 10 m / min, each time the duration of slow walking is increased or decreased by 10 minutes, etc.

[0063] It should be added here that: only individual training items are listed above, and other training items can be set according to the actual situation, and are not listed one by one in this embodiment.

[0064] In a specific embodiment, “fuse the audio and video with the training guidance animation” in step 104 of this embodiment may include: Identify the video image in the audio and video; in the video image, identify the target position suitable for the standing virtual instructor; use the matte technology to cut out the virtual instructor animation from the training guidance animation; at the target position, fuse the virtual instructor animation in the target training scene; or Use artificial intelligence image synthesis technology to fuse the training guidance animation with the audio and video.

[0065] For the specific implementation of the above steps, reference can be made to the corresponding descriptions in the above text, and details are not described here.

[0066] In summary, in the solution provided by the embodiments of the present application, the wearable device can be an AR, VR, or MR glasses or helmet. A variety of sensors can be arranged on the wearable device, such as sensors for collecting electroencephalogram signals (such as electroencephalogram collectors), sensors for collecting the sweating condition of the head (such as sweat sensors), electrocardiogram collectors, blood pressure collectors, body temperature collectors, and so on. The various training scenarios preset in the wearable device can include but are not limited to: school playgrounds, parks, gyms, and so on. The rehabilitation trainer wears the wearable device to carry out rehabilitation training, and under the visual stimulation of the virtual scenario, the training effect can be improved. The rehabilitation trainer can choose the corresponding scenario by himself / herself to be in a relaxed state and complete the rehabilitation training task. The rehabilitation trainer can set the training scenario. In addition to being able to switch the environment, there can also be a rehabilitation training instructor in the scenario. The rehabilitation patient can follow the guidance of the rehabilitation instructor to do rehabilitation training.

[0067] In addition, a brief introduction to VR, AR, and MR mentioned in this article is given.

[0068] Virtual Reality (VR), also known as virtual environment technology or artificial environment. Virtual Reality uses a computer to simulate and generate a virtual world in three-dimensional space, providing simulations of senses such as vision, hearing, and touch for users.

[0069] Augmented Reality (AR), also known as mixed display. It applies virtual information to the real world through computer technology, and the real environment and virtual objects are superimposed on the same picture or space and exist simultaneously in real time.

[0070] Mix reality (MR) includes both augmented reality and augmented virtuality, referring to a new visual environment generated by merging the real world and the virtual world. In the new visual environment, physical and digital objects interact in real time.

[0071] The emergence of virtual reality technology has opened up a new field for rehabilitation medicine, breaking the limitations of the original rehabilitation means. Patients can use their natural skills to interact with this virtual reality, and the experience results are similar to or the same as those in the corresponding real environment, enabling the immersed users to obtain a sense of presence in the real environment during the interaction experience.

[0072] In addition, the wearable device for rehabilitation training in the embodiments of the present application can also be added with a function of multi-person interaction. For example, through the Internet, the wearable devices worn by multiple rehabilitation trainers who simultaneously select the same target training scenario are connected to the network. In addition to displaying the fused audio and video, the wearable device of any one rehabilitation trainer also displays the virtual rehabilitation training images corresponding to other rehabilitation trainers. Multiple rehabilitation trainers can conduct online interactions, such as voice chats, etc. Compared with human-computer interaction, it has stronger interactivity and can conduct group-mode rehabilitation training.

[0073] An embodiment of the present application also provides a control device. The control device can be installed on the wearable device. The product form of the control device can be a chip. The chip includes a processor and a memory. Among them, the memory is used to store one or more computer programs; the processor is coupled to the memory and is used for the at least one or more computer programs to implement the steps in the methods provided in the embodiments of the present application.

[0074] The above-mentioned memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0075] Correspondingly, an embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a computer, it can implement the method steps or functions provided in the above embodiments of the present application.

[0076] The method in the present application can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. That is, the present application also provides a computer program product. The computer program product includes computer programs / instructions, and when the computer programs / instructions are executed by an electronic component such as a processor, it can execute the steps or functions in the methods provided in the embodiments of the present application in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device, a core network device, an OAM or other programmable devices.

[0077] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the essence of the above technical solution, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0078] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A wearable device for rehabilitation training, characterized in that, Comprising: A wearable device, having a display screen and a speaker; At least one sensor, disposed on the wearable device, for contacting the rehabilitation trainer after the rehabilitation trainer wears the wearable device, and detecting a first physiological parameter of the rehabilitation trainer; An interaction device, disposed on the wearable device, for interacting with the rehabilitation trainer to obtain an interaction instruction of the rehabilitation trainer and / or sending interaction information to the rehabilitation trainer; A control device, disposed on the wearable device, configured with a plurality of training scenarios for the rehabilitation trainer to select; Wherein, the interaction device is used to select a target training scenario from the plurality of training scenarios in response to a selection instruction of the rehabilitation trainer; the control device is used to obtain a training prescription corresponding to the rehabilitation trainer from a server, obtain a training guidance animation according to the training prescription; retrieve the audio-video corresponding to the target training scenario, fuse the audio-video with the training guidance animation, and control the display screen and the speaker to play the fused audio-video; and evaluate the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability.

2. The wearable device for rehabilitation training according to claim 1, wherein, When the control device fuses the audio-video with the training guidance animation, it is specifically used for: Identifying the video image in the audio-video; In the video image, identifying a target position suitable for a standing virtual instructor; Using a matte extraction technique to extract a virtual instructor animation from the training guidance animation; At the target position, fusing the virtual instructor animation into the target training scenario.

3. The wearable device for rehabilitation training according to claim 2, wherein When the control device fuses the audio-video with the training guidance animation, it is specifically used for: Using artificial intelligence image synthesis technology to fuse the training guidance animation with the audio-video.

4. The wearable device for rehabilitation training according to any one of claims 1 to 3, characterized in that, The at least one sensor includes: An electroencephalogram signal collector, for collecting the electroencephalogram signal of the rehabilitation trainer; A sweat sensor, for detecting the sweating amount and sweat information of the rehabilitation trainer.

5. The wearable device for rehabilitation training according to claim 4, characterized in that, Further comprising: A vital sign detection device; The vital sign detection device, communicatively connected to the control device, for detecting a second physiological parameter of the rehabilitation trainer after the rehabilitation trainer wears the vital sign detection device; When the control device evaluates the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability, it comprehensively evaluates the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter and the second physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability; Wherein, the second physiological parameter includes at least one of the following: heart rate information, blood pressure, body temperature.

6. The wearable device for rehabilitation training according to claim 5, wherein, The vital sign detection device is: a smart watch or a wearable vital sign monitor.

7. The wearable device for rehabilitation training according to any one of claims 1 to 3, characterized in that, The wearable device is: a virtual reality (VR) glasses or helmet, or an augmented reality (AR) glasses or helmet, or a mixed reality (MR) glasses or helmet.

8. A rehabilitation training system, characterized in that, Comprising: A wearable device, including a wearable unit, the wearable unit having a display screen and a speaker, and at least one sensor is further provided on the wearable unit for contacting the skin of a rehabilitation trainer after the rehabilitation trainer wears the wearable unit to detect a first physiological parameter of the rehabilitation trainer; an interaction device and a control device are further provided on the wearable unit, and the control device is configured with multiple training scenarios for the rehabilitation trainer to select; the interaction device is used to select a target training scenario from the multiple training scenarios in response to a selection instruction of the rehabilitation trainer; The control device is used to obtain a training prescription corresponding to the rehabilitation trainer from a server, and obtain a training guidance animation according to the training prescription; Retrieve the audio and video corresponding to the target training scenario, fuse the audio and video with the training guidance animation, and control the display screen and the speaker to play the fused audio and video; And send the first physiological parameter to the server; The server is used to evaluate the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability; Send the adjusted training prescription to the wearable device.

9. The rehabilitation training system according to claim 8, characterized in that, The wearable device further includes a vital sign detection device; The vital sign detection device is communicatively connected to the control device for detecting a second physiological parameter of the rehabilitation trainer after the rehabilitation trainer wears the vital sign detection device; The control device is further used to send the second physiological parameter to the server; When the server evaluates the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter so as to adjust the training prescription of the rehabilitation trainer according to the suitability, it comprehensively evaluates the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter and the second physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability; Wherein, the first physiological parameter includes at least one of the following: electroencephalogram signal, sweating amount and sweat information; the second physiological parameter includes at least one of the following: heart rate information, blood pressure, body temperature.

10. A rehabilitation training method, characterized in that, Including: Respond to the selection instruction of the rehabilitation trainer and select a target training scenario from the multiple training scenarios; Obtain the training prescription corresponding to the rehabilitation trainer; Obtain a training guidance animation according to the training prescription; Retrieve the audio and video corresponding to the target training scenario, and fuse the audio and video with the training guidance animation; Play the fused audio and video.

11. The method according to claim 10, characterized in that, Further including: Collect the first physiological parameter and the second physiological parameter of the rehabilitation trainer during the training process following the fused audio and video; Evaluate the suitability of the training prescription for the rehabilitation trainer according to the first physiological parameter and the second physiological parameter, so as to adjust the training prescription of the rehabilitation trainer according to the suitability; Wherein, the first physiological parameter includes at least one of the following: electroencephalogram signal, sweating amount and sweat information; the second physiological parameter includes at least one of the following: heart rate information, blood pressure, body temperature.

12. The method according to claim 10, wherein Adjusting the training prescription of the rehabilitation trainer according to the suitability includes: If the fitness level indicates that the rehabilitation trainee can easily complete the training tasks in the training prescription, increase the training volume in the training prescription; If the fitness level indicates that the rehabilitation trainee cannot complete the training tasks in the training prescription, reduce the training volume in the training prescription.

13. The method according to any one of claims 10 to 12, characterized in that Fusing the audio-video with the training guidance animation includes: Identifying the video images in the audio-video; in the video images, identifying the target positions suitable for the standing virtual instructor; using the image cutout technique to cut out the virtual instructor animation from the training guidance animation; at the target positions, fusing the virtual instructor animation into the target training scene; or Using artificial intelligence image synthesis technology to fuse the training guidance animation with the audio-video.

14. A computer-readable storage medium, characterized in that, A computer instruction is stored on a storage medium, and when the instruction is executed by a processor, the steps in the method described in any one of claims 10 to 13 above can be implemented.

15. A computer program product, characterized in that, The computer program product includes a computer program or instruction, and when the computer program or instruction is executed by a processor, the processor is caused to execute the steps in the method described in any one of claims 10 to 13 above.

Images