Artificial Intelligence-Based Robot-assisted Orthopedic Exercise System and Method for controlling the system
The AI-based robot-assisted orthopedic exercise system addresses the challenge of individual adaptation and therapist dependency by providing personalized and effective gait rehabilitation through AI-driven training plans and evaluations.
Patent Information
- Application Number
- KR1020240112332
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2024-04-01
- Filing Date
- 2024-08-21
- Publication Date
- 2026-11-11
- Estimated Expiration
- 2044-08-21
AI Technical Summary
Existing robot-assisted orthopedic exercise systems for gait rehabilitation face challenges in adapting to individual patient needs and require significant therapist intervention, leading to ineffective training outcomes.
An AI-based robot-assisted orthopedic exercise system that uses an end-effector type pedal, actuator, and a system operating device with AI models for personalized training plans, real-time monitoring, and evaluation, reducing therapist dependency.
Enables efficient, personalized, and patient-friendly rehabilitation by predicting gait evaluation indicators, automating training plans, and accurately evaluating results, thereby enhancing rehabilitation effectiveness.
Smart Images

Figure 112024091452719-PAT00009_ABST
Abstract
Description
Technology Field
[0001] The present disclosure relates to a robot-assisted orthopedic exercise system, and more specifically, to a patient-friendly AI-based assisted orthopedic exercise system and a control method thereof, which is capable of automatically establishing and executing a personalized orthopedic exercise plan based on artificial intelligence (AI), and automatically modifying the exercise plan according to the rehabilitation effect resulting from the exercise. Background Technology
[0002] The robot-assisted orthopedic exercise system was developed as a device to aid in the gait rehabilitation of patients with walking difficulties. This system helps improve walking function and restore lower body muscle strength in patients with mobility impairments; as a so-called end-effector type robotic device, it supports and assists the patient's physical movements, enabling them to undergo gait rehabilitation more safely and effectively.
[0003] This system can be adjusted according to the patient's physical ability and condition, provides gait training by simulating or assisting walking movements, and also detects and corrects the patient's movements to help improve walking ability more safely and efficiently and restore independence in daily life.
[0004] In these existing systems, a therapist is present to guide and assist with the rehabilitation exercise process. However, in some cases, patients are unable to adapt to the operation of the pedals and fail to respond to or comply with the pedal movements, and there are instances where effective rehabilitation is difficult even after a long period of gait training.
[0005] Therefore, the development of a rehabilitation training system that enables safer and more effective training, thereby helping patients rehabilitate quickly and return to daily life, is highly beneficial.
[0006] delete Prior art literature
[0007] 1. Patent Publication 10-2023-0024499 The problem to be solved
[0008] The present disclosure presents an artificial intelligence-based robot-assisted orthopedic exercise system and a method capable of establishing a patient-friendly gait training plan.
[0009] The present disclosure presents an artificial intelligence-based robot-assisted orthopedic exercise system and a method thereof that can reduce therapist intervention based on a medical professional's prescription.
[0010] The present disclosure presents a patient-personalized and friendly AI-based robot-assisted orthopedic exercise system and a method thereof. means of solving the problem
[0011] Artificial intelligence-based robot-assisted orthopedic exercise system according to the present disclosure:
[0012] A walking exercise device having, for example, an end-effector type pedal and an actuator having one or more links that drive the pedal, which a patient steps on for walking training; and a system operating device that controls the main actuator according to a training plan established for each individual to conduct walking training for the patient who has stepped on the pedal;
[0013] The above system operating device; is
[0014] An input unit that receives basic information including personal information and initial walking state information for each patient;
[0015] An indicator prediction unit having an indicator prediction model that receives initial walking state information or walking training result information after walking training and predicts walking evaluation indicators;
[0016] A training planning unit having a training planning model that establishes a training plan for each patient, performed by the gait exercise unit, based on the predicted gait evaluation indicators;
[0017] A training evaluation unit having a training evaluation model that evaluates training results based on training result data according to the results of the rehabilitation training of the patient performed by the gait exercise unit; and
[0018] A reporting unit having a reporting model that performs reporting on training results based on an evaluation of the above training results; is provided.
[0019] According to one or more embodiments, the indicator prediction unit may have at least one model among a Recurrent Neural Network (RNN) model or a Long Short-Term Memory Model (LSTM) as the indicator prediction model.
[0020] According to one or more embodiments, the training planning unit may have a multi-input, multi-or single-output model as a training planning model.
[0021] According to one or more embodiments, the device may further include a detection unit that detects at least one of the following information as training information: Ground Reaction Force (GRF), Body Weight Support (BWS), Upper body inclination or tilting, Joint angle, Cadence, Stride length, and Ankle angle of a patient undergoing gait training.
[0022] According to one or more embodiments, a monitoring unit may be further provided that monitors the state of rehabilitation training performed by the gait exercise unit according to the training plan, acquires information during the training, and generates training state information related to the patient's gait training therefrom.
[0023] According to one or more embodiments, the monitoring unit may present training guidelines or recommended guidelines or the current training status to the patient to improve the gait related to the gait training, based on information during the training.
[0024] According to one or more embodiments, the monitoring unit may further include a Head-Mounted Display (HMD) that presents necessary information related to the patient's walking exercise, training status information, or recommended guidelines related to training to the patient.
[0025] According to one or more embodiments, a Head-Mounted Display (HMD) may be further provided to present to the patient at least one of necessary information related to the patient's walking exercise, training status information, or recommended guidelines related to training.
[0026] According to one or more embodiments, the training evaluation unit may include a time-series information-based anomaly detection model as a training evaluation model, which analyzes current training results or analyzes trends in results following repeated training by analyzing previous training results and current training results to predict future training.
[0027] According to one or more embodiments, the reporting unit can generate report content in the form of text, images, or videos by analyzing previous training results and current training results as a reporting model.
[0028] Artificial intelligence-based robot-assisted orthopedic exercise providing method according to the present disclosure:
[0029] A step in which an input unit receives basic information including personal information and initial walking state information for each patient;
[0030] A step in which an indicator prediction unit receives initial walking state information or walking training result information after walking training and predicts the walking evaluation indicator of the patient;
[0031] A training planning department establishes a training plan for each individual patient based on the above-mentioned gait evaluation indicators;
[0032] A walking exercise device having a pedal on which a patient stands, for example, an end-effector type, a pedal, and an actuator having one or more links that drive the pedal, performs rehabilitation training of the patient according to the training plan;
[0033] A step in which a training evaluation department evaluates training results based on training result data according to the training results; and
[0034] The reporting unit includes the step of performing a report on the training results based on an evaluation of the training results.
[0035] According to one or more embodiments of the above method, the indicator prediction unit may predict the patient's gait evaluation indicator using at least one of an RNN (Recurrent Neural Network) model or an LSTM (Long Short-Term Memory model) as an indicator prediction model.
[0036] According to one or more embodiments of the above method, the training planning unit may establish the training plan using a multi-input, multi-or single-output model.
[0037] According to one or more embodiments of the above method, the detection unit can detect at least one of the following information as training information: Ground Reaction Force (GRF), Body Weight Support (BWS), Upper body inclination or tilting, Joint angle, Cadence, Stride length, and Ankle angle of a patient undergoing gait training.
[0038] According to one or more embodiments of the above method, a monitoring unit can monitor the state of rehabilitation training performed by the gait exercise unit according to the training plan, acquire information during the training, and generate training state information related to the patient's gait training therefrom.
[0039] According to one or more embodiments of the above method, the monitoring unit may present training guidelines or recommended guidelines or the current training status to the patient to improve the gait related to the gait training, based on information during the training.
[0040] According to one or more embodiments of the above method, a Head-Mounted Display (HMD) may present to the patient necessary information related to the patient's walking exercise, training status information, or recommended guidelines related to training.
[0041] According to one or more embodiments of the above method, a time-series information-based anomaly detection model as a training evaluation model can perform future training prediction by analyzing current training results or analyzing the trend of results following repeated training by analyzing previous training results and current training results.
[0042] According to one or more embodiments of the above method, the reporting unit can analyze previous training results and current training results to generate report content in the form of text, images, and videos. Effects of the invention
[0043] According to the present invention, it is possible to establish a patient-friendly gait training plan, reduce the burden on therapists compared to conventional methods, and, in particular, enable efficient personalized and patient-friendly rehabilitation training. Rehabilitation training using this system and method utilizes an artificial intelligence model at every stage to predict accurate gait evaluation indicators, automatically establish training plans based thereon, and more accurately evaluate training results. Brief explanation of the drawing
[0044] FIG. 1 is a block diagram of an artificial intelligence-based robot-assisted orthopedic motion system according to the present disclosure, and FIG. 2 is a schematic perspective view of an artificial intelligence-based robot-assisted orthopedic motion system according to one embodiment of the present disclosure, and FIG. 3 is a side view of an artificial intelligence-based robot-assisted orthopedic motion system according to one embodiment of the present disclosure, and FIG. 4 is a front view of an artificial intelligence-based robot-assisted orthopedic motion system according to one embodiment of the present disclosure, and FIG. 5 illustrates a scene in which a patient trains while wearing a Head-mounted Display (HMD) in a gait training system according to the present disclosure, and FIG. 6 is a schematic excerpt perspective view of a walking motion unit of an artificial intelligence-based robot-assisted walking training system according to the present disclosure. FIG. 7 illustrates a normal walking cycle, showing the posture of the foot, knee, and thigh during normal walking. Figure 8 illustrates the regulations at each position in the walking pattern, FIG. 9 illustrates functional parts based on the software and hardware structure of a system operating device (111) according to the present disclosure, and FIG. 10 illustrates the configuration of a data set applied to a gait evaluation indicator prediction model applied to an artificial intelligence-based robot-assisted orthopedic exercise method and system according to one embodiment of the present disclosure, and FIG. 11 is a flowchart of a training process for a new patient in an artificial intelligence-based robot-assisted orthopedic exercise presentation method according to one embodiment of the present disclosure, and FIG. 12 is an overall flowchart of an artificial intelligence-based robot-assisted orthopedic motion presentation method according to one embodiment of the present disclosure, and FIG. 13 illustrates a code snippet for a class of a Long Short-Term Memory (LSTM) model in an artificial intelligence-based robot-assisted orthotic motion method and system according to one embodiment of the present disclosure, and FIG. 14 illustrates a code snippet defining a forward propagation process of a model in an artificial intelligence-based robot-assisted orthotic motion method and system according to one embodiment of the present disclosure, and FIG. 15 illustrates a code snippet for the definition of a Python class implementing early stopping in an artificial intelligence-based robot-assisted orthopedic exercise method and system according to one embodiment of the present disclosure, and FIG. 16 illustrates a code snippet for the definition of train_model, a function for model training in an artificial intelligence-based robot-assisted orthotic motion method and system according to one embodiment of the present disclosure, and FIG. 17 illustrates a code snippet for a data evaluation function that evaluates new data from a gait training patient and predicts the patient's FAC in an artificial intelligence-based robot-assisted orthopedic exercise method and system according to one embodiment of the present disclosure, FIG. 18 illustrates a code snippet for the execution of an LSTM model in an artificial intelligence-based robot-assisted orthotic motion method and system according to one embodiment of the present disclosure, and FIG. 19 illustrates a graphic interface showing various parameters of gait training, and Figure 20 is a butterfly diagram showing the average plantar pressure distribution of the patient during training as a result of the patient's gait training. Specific details for implementing the invention
[0045] Hereinafter, preferred embodiments of the concept of the present invention will be described in detail with reference to the attached drawings. However, embodiments of the concept of the present invention may be modified in various different forms, and the scope of the concept of the present invention should not be interpreted as being limited by the embodiments described below. It is preferable to interpret the embodiments of the concept of the present invention as being provided to more completely explain the concept of the present invention to those with average knowledge in the art. Identical reference numerals denote identical elements throughout. Furthermore, various elements and areas in the drawings are depicted schematically. Accordingly, the concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.
[0046] Terms such as first, second, etc. may be used to describe various components, but said components are not limited by said terms. These terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the concept of the present invention, the first component may be named the second component, and conversely, the second component may be named the first component.
[0047] The terms used in this application are used merely to describe specific embodiments and are not intended to limit the concept of the invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, expressions such as “comprising” or “having” are intended to indicate the existence of the features, number, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, actions, components, parts, or combinations thereof.
[0048] Unless otherwise defined, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by those skilled in the art to which the concept of the present invention pertains. Furthermore, it will be understood that commonly used terms, such as those defined in advance, should be interpreted as having meanings consistent with their intent in the context of the relevant technology, and should not be interpreted in an overly formal sense unless explicitly defined herein.
[0049] Where an embodiment can be implemented differently, a specific process sequence may be performed differently from the order described. For example, two processes described in succession may be performed substantially simultaneously or in the reverse order of the description.
[0050] FIG. 1 is a block diagram of an artificial intelligence-based robot-assisted orthopedic motion system according to the present disclosure, FIG. 2 illustrates an embodiment of an artificial intelligence-based robot-assisted orthopedic motion system according to the present disclosure, FIG. 3 is a side view thereof, and FIG. 4 is a front view.
[0051] First, referring to FIG. 1, the exercise system (100) comprises a system operating device (111) formed by a complex configuration of hardware and software and a walking exercise unit (105) controlled by it, a main or control monitor (110) that controls the system operating device (111), a status display monitor (113) that displays the patient's exercise status, etc., a complex input unit (114) that inputs various electrical and optical data including a keyboard (112), and an additional option of a Head-Mounted Display (HMD, 115) worn by the patient. The system operating device (111) according to the present disclosure has the structure of a computer system based on a virtual agent comprising one or more models trained in machine learning or deep learning, etc., to perform data processing and prediction.
[0052] The above walking exercise unit (105) is equipped with two left and right pedals on which the patient stands and a left and right driving device that operates the two pedals, and is equipped with a detection unit (105a) equipped with various sensors that detect the patient's condition information during walking training on the walking exercise unit (105) itself or around it.
[0053] The detection unit (105a) may include a sensor that detects a signal, as well as a signal processing unit that generates a signal to be sent to the system operating device (111) from the signal from the sensor. The HMD (115) is a part of the monitor device in the exercise system (100) of the present disclosure, which presents information necessary for a patient during training.
[0054] Additionally, the system operating device (111) may be further equipped with an optical detection device for detecting the patient's movement status, such as a video camera, such as a webcam, which is an optical input device.
[0055] Referring to FIGS. 2 to 4, the exercise system (100) is a type of robot that provides walking training to a patient and provides two walking exercise units (105) for left and right that are controlled by the system operating device (111). The two walking exercise units (105) are positioned between the left main body base (101) and the right main body base (101) which are arranged side by side at a predetermined interval. The two pedals (105a) of the two walking exercise units (105) move in harmony with each other in correspondence with the movement trajectories of both left and right feet during walking, and in some cases, they may intentionally move in disharmony.
[0056] The above pedal moves to enable the patient to perform walking exercises suitable for the patient by means of a control signal from the system operating device (111), and the patient steps on it and walks by complying with the movement of the pedal. An ankle band that can be installed here secures the patient's foot to the pedal appropriately loosely or appropriately tightly so that the patient's foot can move within a certain range on the pedal.
[0057] The movement of these two pedals (105a) is for patient gait training and is controlled by the system operating device to accommodate an abnormal gait pattern while training the gait pattern to be closer to a normal gait pattern.
[0058] For such walking training, the left walking exercise unit (105) is equipped with a pedal (105a) and an operating link (105b) to which it is dynamically connected, and the operating link (105b) is coupled to the left main body base (101) to enable linear reciprocating and rotational movement via a first driving device (105c) provided on the left main body base (101), and the right walking exercise unit (105) is also coupled to the right main body base (101) to enable reciprocating and rotational movement via the first driving device (105c) of the right main body base (101). The pedal (105a) is connected to the operating link (105b) via a driving device, for example, a driving device capable of controlling the rotational angle, and the pedal (105a) is forcibly moved relative to the operating link (105b) by the driving device within a predetermined angle range.
[0059] The linear reciprocating motion of each of the walking motion units (105) by the first driving device is performed independently, but they move away from each other or move closer to each other and cross each other in response to the movement of both left and right feet during walking. The first driving device (105c) causes linear reciprocating motion and rotational motion of the operating link (105b) and may include a plurality of driving devices. For example, the first driving device (105c) may have a combination of a linear motion driving device for controlling the linear reciprocating motion of the operating link or the entire walking motion unit (105) equipped with it, and a rotational or pivotal motion driving device for controlling the rotational motion of the operating link (105b).
[0060] An assembly is provided in front of the above-mentioned walking exercise unit (105) in which a saddle (104) and a safety bar (106) above it, or a fence unit (107) that supports the chest, etc. including the above, are combined as one unit. This assembly is installed via an up-down frame (103) with respect to a lift device (102). The lift device (102) is an assembly lifting and lowering device that adjusts the height of the assembly to match the patient's physical condition. A system status display unit (109) facing the patient is provided at the top of the lift device (102).
[0061] At the foremost part of the system (100) viewed by the patient, a lifting or fixed support column (113a) is installed, and a status display monitor (113) that displays the operating status of the entire system is coupled thereto.
[0062] FIG. 5 illustrates a scene in which a patient (1) trains while wearing an HMD (115) described below in a walking training system (100) according to the present disclosure. As shown in FIG. 5, for example, in the case of a severe patient, the patient (1) can perform walking training while sitting on a saddle (104) and holding a safety bar (106). Depending on the condition of the patient (1), for example in the case of a mild patient, the saddle (104) can be folded, and thus the patient (1) can proceed with walking training without relying on the saddle (104).
[0063] The above pedal (105a) is operated by the system operating device to force the patient to walk regardless of the patient's will. At this time, pressure sensors, etc. are installed on the saddle (104) and the pedal (105a) to detect the load placed on the saddle (104) and the load placed on the pedal during walking training. In particular, a plurality of pressure sensors are provided at the front and rear of the pedal to detect local pressure applied to the pedal, thereby detecting the degree of pressure or contact of the sole of the foot against the pedal.
[0064] FIG. 6 is a schematic excerpt perspective view of the walking movement unit (105) dynamically coupled to the main body base (101).
[0065] Referring to FIG. 6, the operating link (105b) is coupled to the main body base (101) via a first driving device (105c) to enable linear movement (LM) and rotational movement (RM1). According to one embodiment, the first driving device (105c) is a driving motor, and a separate reciprocating movement driving device may be connected to one side or the lower part thereof. Meanwhile, the pedal (105a) is coupled to the operating link (105b) via a second driving device (105d) to enable rotational movement (RM2) of a predetermined angle relative to the operating link (105b), and a band capable of binding the patient's foot or ankle may be installed therein.
[0066] Figure 7 illustrates a normal walking cycle, showing the posture of the foot, knee, and thigh during normal walking, and Figure 8 shows the regulations for each position in the walking pattern.
[0067] Referring to Fig. 7, in one gait cycle, the stance phase is the period when the foot is in contact with the ground, and the swing phase is the period when the foot is lifted off the ground.
[0068] There are three tasks within each walking cycle as follows.
[0069] 1. Weight Acceptance
[0070] This period consists of an initial contact phase (when the foot first touches the ground) and a loading response phase (the moment the sole of the foot steps on the ground).
[0071] 2. Single Limb Support
[0072] During this period, the sole of the foot touches the ground, the mid-stance is the moment the foot of the opposite leg lifts off the ground, and the heel is lifted while the opposite leg swings.
[0073] 3. Limb Advancement
[0074] This period is a period during which the other foot is placed, and includes a free swing in which the toes of the front foot lift off the ground as the back foot lifts off the ground, a mid swing in which the foot that previously touched the ground begins to lift while the feet are together, and a terminal swing in which the heel of the front foot begins to touch the ground while pushing off the back foot that touched the ground.
[0075] The walking pattern described above is a normal walking pattern, and patients are trained to obtain this normal walking pattern.
[0076] However, in the case of patients who have difficulty walking normally, the patient's feet may become discoordinated during walking training, failing to match each cycle. For example, during the mid-stance cycle, the heel of the back foot may remain stuck to the ground instead of lifting off the ground at the time when the heel of the back foot is supposed to lift. This is because the patient's body does not follow a normal walking pattern. The robot disclosed herein can forcibly bend the knee or ankle joints to match the patient's walking pattern during this period, thereby causing the heel of the back foot to lift off the ground. All such forced joint movements can be performed during the cycle, which allows the patient to forcibly adopt a walking pattern similar to a normal one, despite their own physical limitations during walking training.
[0077] Below, a system operating device for effectively, accurately, and efficiently performing gait training for the rehabilitation of a patient as described above is described.
[0078] The system operating device in the present disclosure controls the walking motion unit by means of hardware, while being largely based on software.
[0079] Such a system operating device operates based on hardware, specifically a computer system for the execution of software. Accordingly, the system operating device according to the present disclosure may have all or part of a general computer system. The software utilizes a plurality of artificial intelligence models to predict a patient's gait evaluation index from initial gait state information or gait training result information after gait training, establish a training plan for each individual patient based on the gait evaluation index, evaluate training results based on training result data according to the training results, and report training results based on the evaluation of training results.
[0080] According to the present disclosure, training of a general deep learning-based model is performed with each functional model, and training using the trained models and applying them to establish, execute, evaluate, and report on a patient's training plan, and in this process, the training plan for long-term training is updated.
[0081] FIG. 9 illustrates functional parts based on the software and hardware structure of a system operating device (111) according to the present disclosure.
[0082] As illustrated in FIG. 9, the system operating device (111) includes an input unit (111a), an indicator prediction unit (111b), a training planning unit (111c), a training progress unit (111d), a training evaluation unit (111e), and a reporting unit (111f), etc.
[0083] The above input unit (111a) includes at least a keyboard, or a keyboard, a webcam, and a communication unit, and an indicator prediction model (M1) that predicts the patient's gait evaluation indicators necessary for establishing a patient's training plan.
[0084] The above training planning unit (111c) includes a training planning model (M2) that plans training for individual patients based on patient symptoms by referring to the indicators predicted by the indicator prediction unit (111b).
[0085] The above training progress unit (111d) includes a training progress model (M3) that monitors the training status according to the training plan and provides guidance on the training status.
[0086] The above training evaluation unit (111e) includes an evaluation model (M4) that evaluates the results of training performed by the training progress unit (111d) and predicts future trends.
[0087] The above reporting unit (111f) includes a reporting model (M5) that reports the results of training obtained from the training evaluation unit (111e) in various forms to patients and training personnel.
[0088] In addition to the elements listed above, such system operating devices (111) may further include other additional software and / or hardware depending on the design of the system operating device (111).
[0089] FIG. 10 is a schematic flowchart of a training process by the system operating device (111) in an artificial intelligence-based walking training method according to the present disclosure, which is performed by the exercise system (100) equipped with the system operating device (111) described above.
[0090] Referring to Fig. 10, in the case of a new patient during the training process, the process proceeds to the next step S13 after undergoing the data preparation step of data input (S11) and initial gait evaluation index generation (S12). In the case of an already registered patient, the process proceeds to the above step S13 after verifying personal information and calling up the existing gait evaluation index stored in the system.
[0091] In step S13, a training plan is generated using initial or existing gait evaluation indicators.
[0092] In step S14, the patient's gait training is performed according to the above training plan.
[0093] In stage S15, intermediate gait evaluation indicators are generated based on the current gait training results.
[0094] In the S16 stage, the training results are analyzed by comparing the current gait evaluation indicators based on the current training results with the existing gait evaluation indicators.
[0095] Step S17 involves forming and presenting various types of reports based on the analysis of training results. After completing this step, a decision is made as to whether to continue the training, and the training is either continued or terminated. If continuing the training is selected, the process proceeds to Step S13 or S14, depending on whether the training plan is updated.
[0096] Figure 11 is a flowchart of a more specific training process for new training patients.
[0097] Each step schematically described in FIG. 11 may be used to perform gait training on a patient once or several times by using, for example, five types of models (M1, M2, M3, M4, M5) in a stepwise manner. According to other embodiments, some of the models may be excluded.
[0098] When training begins, new patients proceed from the process of S11 below, and already registered patients proceed from the process of creating and updating the training plan in step S13 below after verifying and selecting their own information. That is, as already mentioned in the description of Fig. 7, processes S11 and S12 are performed only once initially, and thereafter, when training begins, patients whose personal information has been identified proceed from step S13.
[0099] Step S11: An initial test data set for gait training for a patient is entered.
[0100] S12: The input initial test data set is input into the gait evaluation index prediction model (M1) to generate an initial gait evaluation index.
[0101] S13: The above gait evaluation indicators are input into the training plan generation model (M2) to generate a training plan. In this case, if this process is not an initial training plan generation process but a generation process during the iterative training process, the training plan from the preceding process is updated.
[0102] S14: When a training plan is generated or established, walking training for the patient is performed using it. This training is carried out by the walking exercise unit that the patient is riding on. During the training process, monitoring of the training status is performed, and depending on the training status, information is provided to the patient and encouraging sound information and / or text information is presented. In the monitoring process, the patient's walking video is acquired in real time through a webcam or Kinect sensor included as a component of the detection unit, and from this, it is possible to extract skeleton display, joint angle information, and walking trajectory by extracting the patient's major joint positions, such as key points, using a machine learning-based model.
[0103] This information may be presented through a status display monitor (113, FIG. 4), or, on the other hand, through an HMD (115, FIG. 4) worn by the patient. The model M3 applied here may be a conversational model, such as a chatbot, for example.
[0104] S15: In this step, an intermediate gait evaluation index is generated based on the current gait training results. In this step, the gait evaluation index prediction model (M1) used in the initial gait evaluation index prediction above is applied.
[0105] S16: In this step, the training results are analyzed by comparing the current gait evaluation indicators based on the current training results with the existing gait evaluation indicators. At this time, a trained training analysis model (M4) is used to analyze the training results.
[0106] S17: This stage involves forming and presenting various forms of reports based on the analysis of training results. In this stage, a model trained to generate reports from training results, such as a multimodal model (M5), may be applied.
[0107] After this stage, a decision is made as to whether to continue training. If continuing training is selected, the process proceeds to either stage S13 or S14. If the current training results require an update to the training plan, the process proceeds to S13; otherwise, if training is resumed with the current plan, the process proceeds directly to S14, which is the gait training course.
[0108] The aforementioned artificial intelligence models (M1, M2, M3, M4, M5) included in each part of the system operating device are described below.
[0109] I. 모델 1 (M1)
[0110] Model 1 (M1) is a model that predicts the patient's gait evaluation index and may be either a Recurrent Neural Network (RNN) model or a Long Short-Term Memory Model (LSTM).
[0111] One embodiment according to the present disclosure applies an LSTM. The LSTM is a type of recurrent neural network (RNN) and is a model designed to solve long-term dependency problems, having a structure capable of effectively learning sequence information of data.
[0112] In training such an LSTM, dropout and early stopping techniques are applied. Dropout is a regularization technique designed to prevent overfitting of a neural network; it randomly deactivates (drops) some neurons during the training process to prevent the model from overfitting to a specific pattern, and this technique can be applied to the embodiments of the present disclosure. Early stopping is a technique designed to prevent overfitting while the model is training, and it terminates training early if the performance of the validation data does not improve.
[0113] FIG. 12 illustrates the configuration of a data set from a patient to generate an initial gait evaluation index by the gait evaluation index prediction model (M1).
[0114] Basic input data is basic information entered into the exercise device (100) at the medical clinic, and this must be managed in compliance with personal information protection procedures.
[0115] This dataset includes patient information data, such as personal patient information, patient medical condition information, and gait evaluation indicators determined by medical staff (Functional Ambulation Categories (FAC), Berg Balance Scale (BBS)).
[0116] The above patient personal information includes age, gender, height, weight, leg length, foot size, and symptoms (excluding stroke), and the symptom information includes patient information such as symptoms, reference details for each symptom, date of onset of symptoms, and affected areas of the lower extremities (both feet, left foot, right foot).
[0117] In addition, it includes the results of medical diagnosis, such as clinical evaluation indicators utilizing clinical assessment tools like FAC based on medical diagnosis, and pre-gait training data.
[0118] Meanwhile, as gait information data, the data set for measuring gait training results during walking on flat ground before boarding the gait rehabilitation training robot includes information on upper body tilt and lower limb joint angles during walking. Additionally, as the data set for measuring gait training results after boarding the gait rehabilitation training robot includes the data set for training results of boarding the exercise system of the present disclosure. This includes information on average Ground Reaction Force (GRF), Center of Pressure (COP), Body weight support, lower limb joint angles, and left-right balance for each gait cycle (0 to 100%) during walking.
[0119] Meanwhile, as optional input data, information provided by the hospital or patient includes physician comments, gait images, gait training videos (MOV), and training measurement information, such as GRF information measured while walking on a GRF measurement pad, COP-based average (Butterfly Diagram) image information during walking, and upper body tilt information.
[0120] Therefore, Model 1 (M1) is trained to receive the above data as input and output a gait evaluation index.
[0121] FAC, one of the input data, has six indicators and can be summarized as follows.
[0122] FAC 0: Inability to walk - Inability to walk.
[0123] FAC 1: A condition in which walking ability is present but walking capacity is very limited and walking assistance is required.
[0124] FAC 2: Weak walking ability and a condition requiring walking assistance.
[0125] FAC 3: Walking ability has been partially recovered, and some walking assistance is required.
[0126] FAC 4: Walking ability has been almost fully recovered, and independent walking without assistance is possible.
[0127] FAC 5: A state in which functional walking ability is fully recovered and the patient can walk independently without walking assistance.
[0128] Meanwhile, the aforementioned BBS consists of several items designed to evaluate the ability to maintain balance while performing various activities. These items include standing posture, the ability to transition from a seated to a standing posture, the ability to maintain a seated to a standing posture, and the ability to turn the head while standing; each item is rated on a scale of 0 to 4 points, with a total score of 56 points, where a higher score indicates better balance ability.
[0129] Model 1 predicts the gait evaluation indicators of patients undergoing gait rehabilitation training by applying grades that reflect gait evaluation indicator standards (FAC, BBS, etc.) applied in the medical field, and this can be a Recurrent Neural Network (RNN) model or a Long Short-Term Memory (LSTM) model.
[0130] As a model training method to improve judgment resolution in preparation for FAC (applying Grade 6), time-series walking training result data (3 minutes of training each for walking on flat ground and stairs) obtained from a group of non-disabled people (multiple people) using the present initiation exercise system is set as a supervised learning model group (correct answer: 100%), and walking grade can be determined by quantifying the time-series walking training result data of people with walking disabilities using a time-series information-based anomaly detection model (Anomaly Detection model) to a value of 0 to 100%.
[0131] The output data of the model may vary depending on the design. However, when FAC ratings are applied, the determination can be made by comparing the measurement value (%) reflected in the time-series information-based anomaly detection model with the measurement value of a disabled person (100%) corresponding to the measurement value of a non-disabled person as follows.
[0132] yes)
[0133] 0 ~ 20% = FAC 0
[0134] 21 ~ 40% = FAC 1
[0135] 41 ~ 60% = FAC 2
[0136] 61 ~ 70% = FAC 3
[0137] 71 ~ 80% = FAC 4
[0138] 81 ~ 100% = FAC 5
[0140] In cases where the FAC grade is not applied, the gait grade can be determined more precisely by directly applying the measurement value (%) reflected in the Anomaly Detection Model, which is based on time-series information with the measurement value of a disabled person corresponding to the measurement value of a non-disabled person (100%).
[0142] The above-mentioned model is described below as an example.
[0143] Figure 13 illustrates a code snippet for the initialization of the ImprovedLSTMModelWithDropout class, which improves the Long Short-Term Memory (LSTM) model by adding a Dropout layer. This code is written using PyTorch.
[0144] The ImprovedLSTMModelWithDropout class defines an LSTM model by inheriting from nn.Module.
[0145] The parameters of this class are as follows.
[0146] It has initialization methods “__init__” and “forward”.
[0147] The parameters of the initialization method include input_size (number of features in the input data), hidden_size (size of the LSTM hidden state), num_layers (number of LSTM layers), output_size (number of features in the output data), dropout (dropout rate), etc., and the instance variables include self.lstm (defines the LSTM layer), self.fc1 (defines the first fully connected layer), self.dropout (defines the dropout layer), and self.fc2 (defines the second fully connected layer).
[0148] Figure 14 illustrates a code snippet defining the forward propagation process of a model.
[0149] This includes a series of steps that process input data to generate final predicted values, and each step transforms the input data to progressively generate the model's predicted values.
[0150] Meanwhile, the main processing steps of the forward method are as follows.
[0151] (1) Forward Step 1:
[0152] h0 = torch.zeros(self.num_layers, x.size(0), self.hidden_size).to(x.device)
[0153] c0 = torch.zeros(self.num_layers, x.size(0), self.hidden_size).to(x.device)
[0154] - At this stage, the initial hidden state (h0) and cell state (c0) are defined. Objects h0 and c0 are tensors representing the initial hidden state and cell state of the LSTM network, respectively; these are state values set before the network processes the first sequence, providing the initial state for each layer and each element of the LSTM. Additionally, a tensor is created with all elements initialized to zero using the torch.zeros function. These objects, or tensors, have a specific batch size (x.size(0)) and the size of the hidden state (self.hidden_size), and their dimensions are set according to the number of network layers (self.num_layers). Furthermore, the created tensor is moved to the same device as the input data x (e.g., CPU or GPU) using the to(x.device) method.
[0155] (2) Forward Phase 2:
[0156] out, _ = self.lstm(x, (h0, c0))
[0157] In this step, input data x and initial state (h0, c0) are passed to an LSTM layer for processing. Here, x is the input data tensor (batch size, sequence length, number of input features), and out is the output of the LSTM layer, which is a tensor of the form (batch size, sequence length, size of hidden state).
[0158] (3) Forward Step 3:
[0159] out = self.fc1(out[:, -1, :])
[0160] out[:, -1, :]: Uses only the output of the last time step of the LSTM. This output passes through the first fully connected layer (self.fc1).
[0161] (4) Forward Step 4:
[0162] out = torch.relu(out)
[0163] The ReLU activation function is applied to the output of the first fully connected layer. This adds non-linearity to improve the model's expressiveness.
[0164] (5) Forward Step 5:
[0165] self.dropout(out)
[0166] Apply dropout to randomly disable some neurons.
[0167] (6) Forward Step 6:
[0168] self.fc2(out)
[0169] The output of the dropout layer is passed to the second fully connected layer (self.fc2) to generate the final prediction.
[0170] (7) Forward Step 7:
[0171] return out
[0172] Only at this stage is the model's final predicted value returned.
[0174] As such, the forward method defines a process in which input data is transformed into a final output value by passing through an LSTM, a fully connected layer, an activation function, and dropout, and each step plays a role in generating a final prediction by progressively transforming the data.
[0175] Figure 15 illustrates a code snippet for the definition of a Python class that implements Early Stopping.
[0176] This class is used to prevent overfitting and support efficient learning in machine learning models during the training process, and its main components and functions are as follows.
[0177] (1) Initialization method (__init__)
[0178] def __init__(self, patience=15, delta=0.0005):
[0179] - patience (int) : An instance variable that sets how many epochs to wait when performance does not improve, with a default value of 15 passed as a parameter.
[0180] - delta (float) : An instance variable that stores the minimum change amount recognized as a performance improvement. This value defines how much the validation loss must be improved compared to the previous minimum loss, and the default value is 0.0005, which is also passed as a parameter.
[0181] - best_score (float) : This is an instance variable that stores the best observed performance score (the negative value of the validation loss).
[0182] - early_stop (bool) : It is an instance variable that stores a flag indicating whether to terminate early.
[0183] - val_loss_min (float) : This is an instance variable that stores the observed minimum validation loss.
[0184] - counter (int) : It is an instance variable that stores the number of epochs at which performance is not improved.
[0185] (2) Call method (__call__)
[0186] def __call__(self, val_loss, model):
[0187] - val_loss (float) : This is the validation loss at the current epoch.
[0188] - model (torch.nn.Module): A PyTorch model object being evaluated.
[0189] This method evaluates the model's validation loss after each epoch to check for early stopping conditions. If performance does not improve by more than delta compared to the previous best, the counter is incremented; when this counter reaches patience, the early_stop flag is set to True to stop training. However, if performance improves, the counter is reset and the model's state is saved as a checkpoint.
[0191] (3) Checkpoint saving method (save_checkpoint)
[0192] def save_checkpoint(self, val_loss, model):
[0193] This method saves the model's state to a file (checkpoint.pt). It is used when you want to reload the model later or maintain a state with better performance, and updates val_loss_min with the latest validation loss value.
[0194] The main purpose of this early stopping class is to facilitate efficient learning and prevent overfitting, thereby reducing unnecessary training time and helping to maintain the model's generalization ability. This early stopping is one of the important techniques in many machine learning scenarios, and is particularly useful in deep learning models that require high computational costs.
[0195] Figure 16 illustrates a code snippet for the definition of train_model, a function for training a model.
[0196] def train_model(model, X, y, num_epochs=100, learning_rate=0.0001):
[0197] The `train_model` function is used to train a model and takes `model` (PyTorch model object to train), `X` (input data tensor), `y` (output data tensor), `num_epochs` (number of epochs to train, default 100), and `learning_rate` (learning rate, default 0.0001) as parameters.
[0198] (1) Loss function: Mean Squared Error (MSE)
[0199] criterion = nn.MSELoss()
[0200] - A loss function is defined. Here, the Mean Squared Error (MSE) loss function is used. MSE is the average of the squared differences between predicted and actual values, and is primarily used in regression problems.
[0201] (2) Create Optimizer Class
[0202] optimizer = torch.optim.Adam(model.parameters(), lr=learning_rate)
[0203] - Create an Adam optimizer object to update the model's weights using the torch.optim.Adam class. The optimizer adjusts the model's weights along the gradient using the learning rate learning_rate.
[0204] (3) Creating an early termination class instance
[0205] early_stopping = EarlyStopping(patience=15, delta=0.0005)
[0206] - Create an instance of the EarlyStopping class for early termination. patience is the number of epochs to wait even if the loss does not improve, and delta is the minimum change considered as an improvement.
[0207] (4) Learning loop
[0208] for epoch in tqdm(range(num_epochs), desc="Training Progress"):
[0209] - This is a loop where training takes place. It repeats a total of num_epochs and uses the tqdm library to visually display the training progress.
[0210] (4.1) Set the model to training mode
[0211] model.train()
[0212] - Switch the model to training mode. This is necessary to allow layers such as dropout or batch normalization to behave differently in training mode.
[0213] (4.2) Generating Predicted Values
[0214] outputs = model(X)
[0215] - Input data X is passed to the model to generate predicted values. outputs are the model's prediction results.
[0216] (4.3) Optimizer Gradient Initialization
[0217] optimizer.zero_grad()
[0218] - Initializes the optimizer's gradient buffer, which is necessary to initialize the gradient before calculating the gradient through backpropagation.
[0219] (4.4) Loss Calculation
[0220] loss = criterion(outputs, y)
[0221] - The loss between the predicted values (outputs) and the actual values (y) is calculated. Here, the loss value is calculated using the MSE loss function.
[0222] (4.5) Calculate Loss Gradient
[0223] loss.backward()
[0224] - The gradient of the loss is calculated through backpropagation, and the gradient of each parameter is calculated at each step.
[0225] (4.6) Weight Update
[0226] optimizer.step()
[0227] - Update the model's weights using the optimizer based on the calculated gradient.
[0228] (4.7) Save current loss value
[0229] val_loss = loss.item()
[0230] - The current loss value is converted into a scalar value and stored. This is used later as a criterion for early termination.
[0231] (4.8) Check Early Termination Conditions
[0232] early_stopping(val_loss, model)
[0233] - Check the early stopping condition using the loss value of the current epoch. The early_stopping object tracks the number of epochs without improvement, and stops training the model when the condition is met.
[0234] (4.9) Output early termination message
[0235] if early_stopping.early_stop: print("\nEarly stopping")
[0236] - At this stage, if early_stopping.early_stop is True, an early termination message is printed, the loop is exited, and training is stopped.
[0237] (5) Output learning completion message
[0238] print('모델 학습 완료')
[0239] - Finally, output a message indicating that the learning is complete.
[0241] The code snippet described step-by-step above implements a basic framework for training a PyTorch model with early stopping. The use of the MSE loss function and the Adam optimizer is common in regression tasks, and the early stopping mechanism helps prevent overfitting by stopping training when the validation loss is no longer significantly improved.
[0242] Figure 17 illustrates a code snippet for a data evaluation function that evaluates new data from a patient undergoing gait training to predict the patient's FAC.
[0243] The function shown in the example uses a PyTorch model to generate predicted values for new data and calculates similarity by comparing them with actual values.
[0244] (1) Data Load:
[0245] def evaluate_new_data(file_path, model, data_mean, data_std, device):
[0246] The function evaluate_new_data reads a CSV file from file_path, selects only the necessary columns, and converts them into a DataFrame. The necessary columns are, for example, left Current Gait Cycle Rate (p_leftCurrentGaitCycleRate), left Current Ground Reaction Force (p_leftCurrentGRF), right Shape Gait Cycle Rate (p_rightCurrentGaitCycleRate), and right Current GRF (p_rightCurrentGRF).
[0247] # Data Preprocessing:
[0248] new_data['p_leftCurrentGaitCycleRate'] =
[0249] new_data['p_leftCurrentGaitCycleRate'].astype(int)
[0250] new_data [ ' p_rightCurrentGaitCycleRate ' ] =
[0251] new_data['p_rightCurrentGaitCycleRate'].astype(int);
[0252] Convert p_leftCurrentGaitCycleRate and p_rightCurrentGaitCycleRate to integers and then perform normalization.
[0253] (2) Prepare model input data:
[0254] The input data (X_new) and output data (y_new) are separated from the normalized data. The input data includes p_leftCurrentGaitCycleRate and p_rightCurrentGaitCycleRate, and the output data includes p_leftCurrentGRF and p_rightCurrentGRF.
[0255] (2) 모델 예측 :
[0256] The input data is converted into a PyTorch tensor and passed to the model to generate predictions. The model is set to eval mode, and gradient calculation is disabled using torch.no_grad().
[0257] (3) Calculate result:
[0258] The difference between the predicted value and the actual value is calculated in percentages to obtain the average error rate. Based on this, the similarity is calculated.
[0259] (4) FAC rating determination:
[0260] The patient's FAC grade is determined based on similarity. For example, if the similarity is 0–40%, the rules for FAC 1, etc. are followed.
[0261] Figure 18 illustrates a code snippet for the execution of the above LSTM model.
[0262] (1) Specify necessary columns and set file paths
[0263] In this process, the required data columns (required_columns) and file paths (file_path) are specified first.
[0264] - file_paths: Paths to multiple CSV files to be used for model training
[0265] - new_data_path and eval_data_path: Paths for new data and evaluation data.
[0266] - model_save_path: Specifies the path to the checked-point file of the trained model.
[0267] (2) Data Loading and Preprocessing
[0268] combined_data = load_and_combine_csv(file_paths, required_columns);
[0269] X, y, mean_data, std_data = preprocess_data(combined_data);
[0270] - load_and_combine_csv: A function that reads and combines data from multiple CSV files
[0271] - preprocess_data: Preprocesses combined data to return input data X, output data y, data mean data_mean, and data standard deviation data_std.
[0272] (3) Processor (GPU or CPU) usage settings
[0273] device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
[0274] - In this process, release the GPU memory, - set the device to cuda if the GPU is available, or cpu otherwise, and then transfer the data to the set device.
[0275] (4) Model initialization and training
[0276] An improved LSTM model with dropout is created using the ImprovedLSTMModelWithDropout class, and training of the model using training data is performed using the train_model function. In this embodiment, training is performed for 100 epochs, and the learning rate is set to 0.0001.
[0277] (5) Data evaluation
[0278] At this stage, a data evaluation function (e.g., the evaluate_new_data function described earlier) evaluates the data, and the results are stored in the similarity (similarity_percentage) and FAC grade (fac_grade) variables.
[0279] In this step, data evaluation is performed by a data evaluation function, for example, the function evaluate_new_data described earlier, and the results are stored in the similarity_percentage and fac_grade variables.
[0280] This code snippet loads and preprocesses data from a CSV file containing information used for FAC evaluation of a given patient's gait training, trains an LSTM model, evaluates new data using the trained model, and determines the FAC grade by calculating the similarity between the predicted result and the actual result. This can be used for evaluating initial data for a patient's gait training, such as gait analysis, or for evaluating the patient's advanced FAC during subsequent gait training.
[0282] II. Mirror 2 (M2)
[0283] Model 2 derives a training plan based on patient symptoms, and the input data includes data entered during patient registration. It receives currently determined gait evaluation indicators, patient information, and current training result information to derive a training plan, such as training protocols for walking on flat ground, climbing / descending stairs, climbing / descending slopes, etc., training time, training parameters, etc., and this can be a multi-input, multi- or single-output model.
[0284] According to another embodiment, the input is current gait evaluation indicators and patient information, and the output is a standard training model group (Classification); in yet another embodiment, the input is current gait evaluation indicators, patient information, and training information, and the output can be a patient-customized training plan model.
[0285] As output data of Model 2, when applying Expert Systems, the standard protocol for gait training and training plan definition data set for the exercise system of the present disclosure determined (defined) by the medical professional corresponds to patient information and training plan establishment information corresponding to the determined gait grade evaluation indicator.
[0286] Meanwhile, when applying an AI autonomous judgment training plan, the output data consists of a dataset defining the training plan that reflects information on previously performed training results for each patient. Modification of the real-time training plan, which reflects information on the training status during training for each patient, includes changes to training time, training parameters, and training protocols, as well as settings for robot stop / move.
[0288] III. Model 3 (M3)
[0289] Model 3 may be a model that monitors and provides guidance on the training status during gait rehabilitation training, for example, a chatbot-type model. The input data for this model includes patient information, robot status information, and real-time input / output information during gait.
[0290] Figure 19 illustrates a graphic interface showing various parameters of gait training.
[0291] Real-time input / output information during gait training includes the training protocol, training parameters, and training data detected in real-time at fixed step intervals (e.g., including oxygen saturation and heart rate).
[0292] Figure 20 is a butterfly diagram showing the average plantar pressure distribution of the patient during training as a result of the patient's gait training.
[0293] This training data includes at least one of the following information regarding a patient undergoing gait training: Ground Reaction Force (GRF), Body Weight Support (BWS), upper body inclination or tilting, joint angle, cadence, stride length, ankle angle, oxygen saturation data, and heart rate.
[0294] As a separate option, if a front camera (webcam) is installed, the patient's facial expressions, voice and gesture information, as well as the therapist's voice and gesture information, can be acquired and used as input data.
[0295] The output data of the model may be state feedback during training and training parameter modification values. The state feedback may include acoustic feedback such as artificial intelligence voice or beep sound, or status message output to a user interface, for example, a virtual reality (VR) HMD, such as when a patient boards, sound or text such as “Welcome, Mr. / Ms. OOO,” “Your training status today is very good,” “Press your left foot more,” “Straighten your upper body,” “You have improved compared to yesterday,” “Keep going,” or “Your heart rate is rising.” According to another embodiment, a request for a real-time change of training parameters may be made through the user interface based on the results of monitoring the training status.
[0296] This Model 3 can be trained with a Vision-Language Model (VLM), which enables the performance of training support agent functions through real-time interaction with patients / therapists, and can provide feedback on training status information by comparing and judging sequential pre-training results and real-time training results during training.
[0298] IV. Minutes 4 (M4)
[0299] Model 4 is a model that evaluates training results and predicts future trends. The input data can be past training results data and current training results data. In this case, the output data is an analysis of the trends of the previous training results and current training results data and future predictions.
[0300] This Model 4 is a time-series information-based anomaly detection model trained to predict future training by analyzing current training results or analyzing the trends of results following repeated training by analyzing previous training results and current training results.
[0301] This Model 4 outputs a graph showing the average trend line of past training, the average trend line of current training, and the predicted trend analysis graph of future training. To do this, it analyzes the trend of current training results compared to previous training results and analyzes the predicted trend analysis of future training based on the analysis of past training results.
[0303] V. Letter 5 (M5)
[0304] Model 5 is an artificial intelligence model that supports smart training result reporting, and the input data is the training result data before and after and the report generation type, and the output is text, images, videos, etc.
[0305] The input report generation type is a prompt input based on a GPT (Generative Pre-trained Transformer) model that supports simple or multimodal generation types. Specifically, the output includes, for example, text in PDF document format, images of patient-specific training results and status (various backgrounds and progress status), or videos of patient-specific gait trajectories. Another output is video-based results based on the patient gait training analysis, such as virtual avatar movement, self-image movement, or output visualized as a butterfly diagram.
[0306] The "butterfly diagram" in a gait rehabilitation training system is a visual tool primarily used for gait analysis and evaluation. This diagram helps analyze the gait cycle, such as footprint analysis, gait cycle evaluation, measurement of gait effects, and analysis of left-right asymmetry of gait, by visualizing the pattern and pressure of the foot contacting the ground. The diagram is named "butterfly" because it typically depicts the shape of the footprint and pressure distribution similar to the shape of a butterfly's wings, and an example of a butterfly diagram is shown in Fig. 20.
[0307] In the case of multimodal-supported GPT, it will be possible to induce prompt-based report generation (text, images, videos) for the above work.
[0308] In addition, in addition to the outputs mentioned above, tasks such as training and report generation via voice output can be enabled. By doing so, it is expected that support for smart reporting on the patient's condition and results after training will lead to more intuitive and effective delivery of training results to the patient, as well as support for increased training achievement and satisfaction.
[0309] According to the present invention, it is possible to establish a patient-friendly gait training plan, and personalized and patient-friendly rehabilitation training can be efficiently carried out. Rehabilitation training using this system and method utilizes an artificial intelligence model at each stage to predict accurate gait evaluation indicators, automatically establish a training plan based thereon, and more accurately evaluate training results.
[0310] Rehabilitation training using these systems and methods utilizes artificial intelligence models at every stage to predict accurate gait evaluation indicators, automatically establish training plans based on this, and more accurately evaluate training results; thereby, compared to existing methods and systems, it may also reduce the need for therapist intervention according to medical staff prescriptions.
[0311] As described above according to exemplary embodiments, the exemplary embodiments of the present invention have been described in detail; however, a person skilled in the art to which the present invention pertains will be able to modify the present invention in various ways without departing from the spirit and scope of the present invention as defined in the appended claims. Therefore, future modifications to the embodiments of the present invention will not depart from the technology of the present invention.
Claims
Claim 1 An AI-based robot-assisted orthopedic exercise system comprising: a gait exercise unit having a pedal on which a patient stands, one or more actuation links for driving the pedal to force the patient to walk, and a system operating device for controlling the gait exercise unit according to a training plan established for each individual to conduct gait training for the patient standing on the pedal; wherein the system operating device comprises: an input unit receiving basic information including personal information and initial gait state information for each patient; an indicator prediction unit having an indicator prediction model that receives initial gait state information or gait training result information after gait training and predicts a gait evaluation indicator; a training planning unit establishing a training plan for each individual patient to be performed by the gait exercise unit based on the predicted gait evaluation indicator; a training evaluation unit evaluating training results based on training result data according to the results of the patient's rehabilitation training performed by the gait exercise unit; and a reporting unit performing reporting on training results based on the evaluation of training results; wherein the gait exercise unit comprises: a base; a left gait exercise unit installed on the left side of the base; An artificial intelligence-based robot-assisted orthopedic exercise system comprising: a right walking exercise unit installed on the right side of the base; and two left and right walking exercise units: each having a first driving device that reciprocates (LM) with respect to the base and causes rotational movement (RM1) of the operating link; and a second driving device installed at the end of the operating link and causes rotational movement (RM2) of the pedal; wherein the system operating device controls the walking exercise unit so that the pedal, which is moved by the first driving device and the second driving device, moves along a walking trajectory according to the training plan, thereby performing walking training for the patient. Claim 2 In claim 1, the indicator prediction unit has either an RNN (Recurrent Neural Network) model or an LSTM (Long Short-Term Memory model) as the indicator prediction model, an artificial intelligence-based robot-assisted orthotic motion system. Claim 3 In claim 1, the training planning unit is an artificial intelligence-based robot-assisted orthopedic motion system having a multi-input, multi- or single-output model as a training planning model. Claim 4 An artificial intelligence-based robot-assisted orthopedic exercise system according to claim 1, further comprising a detection unit that detects at least one of the following information as training information: Ground Reaction Force (GRF), Body Weight Support (BWS), Upper body inclination or tilting, Joint angle, Cadence, Stride length, and Ankle angle of a patient undergoing gait training. Claim 5 An artificial intelligence-based robot-assisted orthopedic exercise system further comprising, in claim 4, a monitoring unit that monitors the state of rehabilitation training performed by the gait exercise unit according to the training plan, acquires information during the training, and generates training state information related to the patient's gait training therefrom. Claim 6 In claim 5, the monitoring unit presents to the patient training guidelines or recommended guidelines or current training status for improving gait related to the gait training, based on information during the training, an artificial intelligence-based robot-assisted orthopedic exercise system. Claim 7 An artificial intelligence-based robot-assisted orthopedic exercise system according to claim 5 or 6, wherein the monitoring unit further comprises a Head-Mounted Display (HMD) that presents necessary information related to the patient's walking exercise, training status information, or recommended guidelines related to training to the patient. Claim 8 An artificial intelligence-based robot-assisted orthopedic exercise system according to claim 1, further comprising a Head-Mounted Display (HMD) that presents to the patient at least one of necessary information related to the patient's walking exercise, training status information, or recommended guidelines related to training. Claim 9 In claim 1, the training evaluation unit comprises, as a training evaluation model, a time-series information-based anomaly detection model that analyzes current training results or analyzes the trend of results following repeated training by analyzing previous training results and current training results to perform future training prediction, an artificial intelligence-based robot-assisted orthopedic movement system. Claim 10 In claim 1, the reporting unit is an artificial intelligence-based robot-assisted orthopedic movement system that, as a reporting model, analyzes previous training results and current training results to generate report content in the form of text, images, and videos. Claim 11 The method comprises: an input unit receiving basic information including personal information and initial gait state information for each patient; an indicator prediction unit receiving initial gait state information or gait training result information after gait training and predicting a gait evaluation indicator for said patient; a training planning unit establishing a training plan for each patient based on the gait evaluation indicator; a gait exercise unit having an end-effector type pedal forcing the patient's gait and one or more actuation links driving the pedal, performing rehabilitation training for said patient according to the training plan; a training evaluation unit evaluating the training result based on training result data according to the training result; and a reporting unit performing reporting on the training result based on the evaluation of the training result; wherein the gait exercise unit comprises: a base; a left gait exercise unit installed on the left side of the base; and a right gait exercise unit installed on the right side of the base; and each of the two left and right gait exercise units comprises a first driving device that reciprocates (LM) relative to the base and causes rotational movement (RM1) of the actuation link. A method for providing artificial intelligence-based robot-assisted orthopedic exercise, comprising: a second driving device installed at the end of the operating link to cause rotational movement (RM2) of the pedal; and a walking exercise unit such that the pedal, which is moved by the first driving device and the second driving device, moves along a walking trajectory according to the training plan to perform walking training for the patient. Claim 12 In claim 11, the indicator prediction unit is an indicator prediction model in which either a Recurrent Neural Network (RNN) model or a Long Short-Term Memory (LSTM) model predicts the patient's gait evaluation indicator, an artificial intelligence-based robot-assisted orthopedic exercise providing method. Claim 13 In claim 11, the training planning unit establishes the training plan using a Multi-Input, Multi or Single Output model, an artificial intelligence-based method for providing robot-assisted orthopedic exercise. Claim 14 In claim 11, the detection unit detects at least one of the following information as training information: Ground Reaction Force (GRF), Body Weight Support (BWS), Upper body inclination or tilting, Joint angle, Cadence, Stride length, and Ankle angle of a patient undergoing gait training. Claim 15 In claim 14, a method for providing artificial intelligence-based robot-assisted orthopedic exercise, wherein a monitoring unit monitors the state of rehabilitation training performed by the gait exercise unit according to the training plan, acquires information during the training, and generates training state information related to the patient's gait training therefrom. Claim 16 In claim 14, a method for providing artificial intelligence-based robot-assisted orthopedic exercise, wherein a monitoring unit presents to the patient training guidelines or recommended guidelines or current training status for improving gait related to the gait training, based on information during the training. Claim 17 A method for providing artificial intelligence-based robot-assisted orthopedic exercise according to claim 15 or 16, wherein the HMD (Head-Mounted Display) presents to the patient necessary information related to the patient's gait exercise, training status information, or recommended guidelines related to training. Claim 18 In claim 11, the time-series information-based anomaly detection model as the training evaluation model analyzes current training results or analyzes the trend of results following repeated training by analyzing previous training results and current training results to perform future training prediction, an artificial intelligence-based robot-assisted orthopedic exercise provision method. Claim 19 In claim 11, the reporting unit analyzes previous training results and current training results to generate report content in the form of text, images, and videos, an artificial intelligence-based robot-assisted orthopedic exercise provision method.
Citation Information
Patent Citations
Learning device, walking training system, method, program, and learned model
JP2021003490A
Learning device, rehabilitation support system, method, program, and learned model
JP2021003541A
Method for estimating gait index of user, and wearable device and electronic device performing the same
KR1020240009528A
Method for real-time adjustment of gait training parameters
KR1020240013925A
