Device and method for real-time mobile gait analysis using gyro sensor attached socks
The mobile gait analysis device using gyro sensors in socks addresses the limitations of conventional methods by enabling real-time, comprehensive gait analysis and surgical outcome evaluation in a daily living environment.
Patent Information
- Application Number
- KR1020240141605
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2024-04-03
- Filing Date
- 2024-10-16
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2044-10-16
AI Technical Summary
Conventional gait analysis devices using pressure sensors in insoles are inadequate for comprehensive analysis of gait indicators at anatomically important joints, requiring large spaces and complex attachments, limiting their use to laboratories and restricting accessibility for daily gait pattern analysis.
A real-time mobile gait analysis device using gyro sensors embedded in socks, capable of measuring angular velocity at specific body parts, with a communication module, memory, and processor for evaluating surgical outcomes based on pre- and post-surgery movement data.
Enhances accessibility and compliance by allowing gait analysis in a daily living environment, providing accurate surgical outcome evaluation through gyro sensors attached to socks.
Smart Images

Figure 112024112630115-PAT00009_ABST
Abstract
Description
Technology Field
[0001] The present disclosure relates to a real-time mobile gait analysis device and method utilizing socks equipped with a gyro sensor. Background Technology
[0002] Conventional mobile gait analysis devices primarily adopted a method for measuring plantar pressure, performing this by embedding pressure sensors in insoles placed inside shoes to recognize changes in pressure distribution across different parts of the sole during walking and quantifying designated indicators. However, the method of recognizing changes during walking solely through pressure sensors placed in the insoles had technical limitations in comprehensively analyzing gait indicators occurring within the ankle and various joints of the foot.
[0003] Specifically, when planning surgical treatment for patients seeking to correct gait abnormalities or analyzing a patient's gait after surgery to identify patterns of change, it is inevitably difficult to conduct an accurate analysis based solely on changes in pressure distribution on the soles of the feet.
[0004] To accurately analyze a patient's gait after surgery, it is necessary to be able to detect indicators that change during standing and walking in anatomically important parts of the patient's major joints or small joints below the ankle.
[0005] While existing gait analysis equipment does exist, it has the disadvantage of requiring a space of a certain size for 3D imaging and necessitating devices that combine complex external attachment methods and protective functions, making them uncomfortable to wear on a daily basis and thus limiting accessibility for testing and patient compliance. Consequently, these devices are used restrictively only within laboratories or specialized clinics, which means they cannot obtain data on gait patterns in the patient's natural daily living environment.
[0006] Accordingly, there is a need for devices and methods capable of analyzing the gait of subjects seeking to resolve pain or discomfort in their daily lives. Prior art literature
[0007] Korean Patent Publication No. 10-1975585 The problem to be solved
[0008] The present disclosure aims to provide a gait analysis device and method capable of analyzing a patient's gait in real time in their daily living environment.
[0009] The problems that this disclosure aims to solve are not limited to those mentioned above, and other unmentioned problems will be clearly understood by a person skilled in the art from the description below. means of solving the problem
[0010] A real-time mobile gait analysis device according to the present disclosure for achieving the aforementioned technical problem may be provided, comprising a sock having a fixing part capable of fixing the gyro sensors, wherein a plurality of gyro sensors configured to measure angular velocity are worn on the patient's foot, a communication module configured to receive data measured by the plurality of gyro sensors, a memory storing at least one process for gait analysis, and a processor that performs the gait analysis according to the process, wherein the processor receives movement data of a patient before surgery measured through the plurality of gyro sensors, receives movement data of a patient after surgery measured through the plurality of gyro sensors, and generates evaluation data for evaluating the surgical result based on the movement data of the patient before and after surgery.
[0011] In one embodiment, each of the plurality of gyro sensors may be attached to the fixing part so as to be fixed on a specific body part of the patient while the patient is wearing the socks.
[0012] In one embodiment, the body part of the patient to which the plurality of gyro sensors are fixed may be at least one of the ankle, the area below the ankle, the instep, the heel, and the big toe.
[0013] In one embodiment, the fixing part is made of a magnet with a larger surface area than the plurality of gyro sensors, and each of the plurality of gyro sensors can be made to be attachable to the magnet.
[0014] In one embodiment, the processor may output either a good surgical result or a need for additional treatment as evaluation data for evaluating the surgical result.
[0015] In one embodiment, the processor may determine that the surgical result is satisfactory if the amount of change in movement data corresponding to the ankle and big toe among the movement data of the patient before and after surgery exceeds a predetermined reference value.
[0016] In one embodiment, the processor may determine that the surgical result is good if the amount of change in movement data corresponding to the heel, instep, and underfoot among the patient's movement data before and after surgery is less than a predetermined reference value.
[0017] Additionally, the present disclosure provides a method for a real-time mobile gait analysis device comprising a plurality of gyroscope sensors and a sock that can be worn on a patient's foot and can secure the gyroscope sensors, wherein the gait analysis method may include the steps of a processor receiving pre-operative patient movement data measured through the plurality of gyroscope sensors, the processor receiving post-operative patient movement data measured through the plurality of gyroscope sensors, and the processor generating evaluation data to evaluate the surgical results based on the pre-operative and post-operative patient movement data.
[0018] In addition to this, a computer program stored on a computer-readable recording medium for implementing the present disclosure may be further provided.
[0019] In addition to this, a computer-readable recording medium for recording a computer program for implementing the present disclosure may be further provided. Effects of the invention
[0020] The gait analysis device and method according to the present disclosure can improve the accessibility and compliance of the examination by analyzing the patient's gait using a gyroscope sensor attached to a sock worn by the patient in daily life.
[0021] The effects of the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by a person skilled in the art from the description below. Brief explanation of the drawing
[0022] FIG. 1 is an overall system diagram of the present disclosure. FIG. 2 is a block diagram of a server included in the gait analysis device of the present disclosure. FIG. 3 is a block diagram of a terminal included in the gait analysis device of the present disclosure. FIG. 4 is an exemplary diagram showing a gyro sensor attached to a sock according to the present disclosure. Figure 5 is a drawing illustrating a plurality of fixing parts included in a sock. Figure 6 is a drawing illustrating an example in which a gyro sensor is attached to the fixed part of Figure 5. FIGS. 7 and FIGS. 8 are example diagrams showing in detail each part of FIGS. 5 and FIGS. 6 to which a plurality of gyro sensors are attached. FIG. 9 is a flowchart illustrating a gait analysis method according to the present disclosure. Specific details for implementing the invention
[0023] Throughout this disclosure, the same reference numerals denote the same components. This disclosure does not describe all elements of the embodiments, and general content in the art to which this disclosure pertains or content that overlaps between embodiments is omitted. The terms “part, module, component, block” as used in the specification may be implemented in software or hardware, and depending on the embodiments, a plurality of “parts, modules, components, blocks” may be implemented as a single component, or a single “part, module, component, block” may include a plurality of components. Throughout the specification, when a part is described as being “connected” to another part, this includes not only direct connection but also indirect connection, and indirect connection includes connection via a wireless communication network.
[0024] Furthermore, when it is stated that a part "includes" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.
[0025] Throughout the specification, when it is stated that a component is located "on" another component, this includes not only cases where a component is in contact with another component, but also cases where another component exists between the two components.
[0026] The terms first, second, etc. are used to distinguish one component from another, and the components are not limited by the aforementioned terms.
[0027] Singular expressions include plural expressions unless there is an obvious exception in the context.
[0028] In each step, identification codes are used for convenience of explanation and do not describe the order of the steps; the steps may be performed differently from the specified order unless a specific order is clearly indicated in the context.
[0029] The operating principles and embodiments of the present disclosure will be described below with reference to the attached drawings.
[0030] In this specification, the term "device according to the present disclosure" includes all various devices capable of performing computational processing and providing results to a user. For example, the device according to the present disclosure may include all of a computer, a server device, and a portable terminal, or may be in the form of any one of these.
[0031] Here, the computer may include, for example, a notebook, desktop, laptop, tablet PC, slate PC, etc. equipped with a web browser.
[0032] The above server device is a server that processes information by communicating with an external device, and may include an application server, a computing server, a database server, a file server, a game server, a mail server, a proxy server, and a web server.
[0033] The above portable terminal may include, for example, all types of handheld-based wireless communication devices such as PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), WiBro (Wireless Broadband Internet) terminals, smartphones, etc., as well as wearable devices such as watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted devices (HMDs).
[0034] The gait analysis device according to the present disclosure may be implemented by at least one of a server and a terminal. Specifically, the device according to the present disclosure may be implemented by either a server or a terminal, or may be implemented as a system through data transmission and reception between a server and a terminal.
[0035] Hereinafter, a gait analysis device according to the present disclosure will be described.
[0036] Referring to FIG. 1, the device according to the present disclosure may include a server (10), a terminal (20), and a sensor (30).
[0037] At least one of the terminal (20) and the server (30) and the sensor (30) are connected via a network, and the server (10) or the terminal can generate an analysis result after receiving data necessary for analysis from the sensor (30). When the server (30) generates an analysis result, the server (30) can receive data measured by the sensor (30) from the terminal (20), generate an analysis result based on this, and transmit it to the terminal (20).
[0038] Meanwhile, it is obvious to a person skilled in the art that the above-described terminal (20) is not limited to the portable terminal described above and may include a laptop, desktop, laptop, tablet PC, slate PC, etc. equipped with a processor.
[0039] As described above, the gait analysis device according to the present disclosure can be implemented through data transmission and reception between a server (10), a terminal (20), and a server (30).
[0040] Hereinafter, each of the server (10), terminal (20), and sensor (30) for implementing the gait analysis device according to the present disclosure will be described.
[0041] FIG. 2 is a block diagram of a server included in the gait analysis device of the present disclosure.
[0042] A server (100) according to the present disclosure may include at least one of a communication module (110), a memory (120), and a processor (130).
[0043] The communication module (110) can communicate with at least one of a terminal, an external storage (e.g., a database (140)), an external server, and a cloud server.
[0044] Meanwhile, an external server or cloud server may be configured to perform at least a part of the role of the processor (130). That is, the performance of data processing or data computation, etc., can be performed on an external server or cloud server, and the present invention does not impose any special restrictions on such a method.
[0045] Meanwhile, the communication module (110) can support various communication methods depending on the communication standards of the target to be communicated (e.g., electronic device, external server, device, etc.).
[0046] For example, the communication module (110) may be configured to communicate with a communication target using at least one of the following technologies: WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), 5G (5th Generation Mobile Telecommunication), Bluetooth (Bluetooth™), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra-Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus).
[0047] Next, the memory (120) may be configured to store various information related to the present invention. In the present invention, the memory (120) may be provided in the device itself according to the present invention. Alternatively, at least a portion of the memory (120) may refer to at least one of a database (DB, 140) or a cloud storage (or cloud server). That is, the memory (120) is sufficient as a space where information necessary for the device and method according to the present invention is stored, and it can be understood that there are no restrictions on the physical space. Accordingly, below, the memory (120), database (140), external storage, and cloud storage (or cloud server) will not be distinguished separately and will all be referred to as memory (120).
[0048] Next, the processor (130) may be configured to control the overall operation of the device related to the present invention. The processor (130) may process signals, data, information, etc. that are input or output through the components described above, or provide or process appropriate information or functions to the user.
[0049] The processor (130) includes at least one CPU (Central Processing Unit) and can perform the functions according to the present invention.
[0050] At least one component may be added or removed in response to the performance of the components illustrated in FIG. 2. Additionally, it will be readily understood by those skilled in the art that the relative positions of the components may be changed in response to the performance or structure of the device.
[0051] Hereinafter, a terminal included in the device of the present disclosure will be described in detail.
[0052] FIG. 3 is a block diagram of a terminal included in the device of the present disclosure.
[0053] Referring to FIG. 3, a terminal (200) according to the present disclosure may include a communication module (210), an input unit (220), a display (230), and a processor (240), etc. Since the components illustrated in FIG. 3 are not essential for implementing the device according to the present disclosure, the terminal described herein may have more or fewer components than those listed above.
[0054] Among the above components, the communication module (210) may include one or more components that enable communication with an external device, and may include, for example, at least one of a broadcast receiving module, a wired communication module, a wireless communication module, a short-range communication module, and a location information module.
[0055] The wired communication module may include various wired communication modules such as a Local Area Network (LAN) module, a Wide Area Network (WAN) module, or a Value Added Network (VAN) module, as well as various cable communication modules such as USB (Universal Serial Bus), HDMI (High Definition Multimedia Interface), DVI (Digital Visual Interface), RS-1302 (recommended standard 1302), power line communication, or POTS (plain old telephone service).
[0056] In addition to Wi-Fi modules and WiBro (Wireless broadband) modules, the wireless communication module may include wireless communication modules that support various wireless communication methods such as GSM (global System for Mobile Communication), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), UMTS (universal mobile telecommunications system), TDMA (Time Division Multiple Access), LTE (Long Term Evolution), 4G, 5G, and 6G.
[0057] The input module (220) is for inputting video information (or signal), audio information (or signal), data, or information input from a user, and may include at least one of at least one camera, at least one microphone, and a user input unit. Voice data or image data collected from the input unit may be analyzed and processed into a user control command.
[0058] The output module (230) is intended to generate outputs related to sight, hearing, or touch, and may include at least one of a display, an audio output unit, a haptic module, and an optical output unit. The display may form a layered structure with the touch sensor or be formed integrally to implement a touch screen. Such a touch screen functions as a user input unit that provides an input interface between the device and the user, and at the same time can provide an output interface between the device and the user.
[0059] The display displays (outputs) information processed by the device. For example, the display unit may display execution screen information of an application program (e.g., an application) running on the device, or UI (User Interface) and GUI (Graphic User Interface) information based on such execution screen information.
[0060] In addition to the components described above, the terminal described above may further include an interface unit and memory.
[0061] The interface section serves as a passage for various types of external devices connected to the present device. This interface section may include at least one of a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with a SIM card, an audio I / O (Input / Output) port, a video I / O (Input / Output) port, and an earphone port. The present device can perform appropriate control related to the external device connected to the interface section.
[0062] The memory can store data supporting various functions of the device and programs for the operation of the processor, and can store input / output data (e.g., music files, still images, videos, etc.), and can store multiple application programs (or applications) running on the device, data for the operation of the device, and instructions. At least some of these application programs may be downloaded from an external server via wireless communication.
[0063] Such memory may include at least one type of storage medium among flash memory type, hard disk type, SSD type (Solid State Disk type), SSD type (Silicon Disk Drive type), multimedia card micro type, card type memory (e.g., SD or XD memory, etc.), RAM (random access memory; RAM), SRAM (static random access memory), ROM (read-only memory; ROM), EEPROM (electrically erasable programmable read-only memory), PROM (programmable read-only memory), magnetic memory, magnetic disk, and optical disk. Additionally, the memory may be a database that is separate from the device but connected via wired or wireless connection.
[0064] Meanwhile, the above-described terminal includes a processor (240). The processor may be implemented as a memory that stores data for an algorithm or a program that reproduces the algorithm for controlling the operation of components within the device, and at least one processor (not shown) that performs the above-described operation using the data stored in the memory. In this case, the memory and the processor may each be implemented as separate chips. Alternatively, the memory and the processor may be implemented as a single chip.
[0065] Meanwhile, a processor included in at least one of the server and the terminal may include an artificial intelligence module for implementing the gait analysis device to be described later. The artificial intelligence model learning method described later is described as being implemented by the operation of the said module, but the execution of the operation of each step described later does not necessarily have to be performed by the said module.
[0066] In addition, the processor may control one or a combination of the components described above in order to implement various embodiments according to the present disclosure described in the drawings below on the device.
[0067] Hereinafter, a terminal included in the device of the present disclosure will be described in detail.
[0068] FIG. 4 is an exemplary diagram showing a gyro sensor attached to a sock according to the present disclosure.
[0069] The device of the present disclosure includes a plurality of gyro sensors configured to measure angular velocity.
[0070] The angular velocity measured by a gyroscope sensor can define the movement of an object to which the gyroscope sensor is attached.
[0071] For example, with a gyroscope sensor attached to a patient's ankle, the data measured by the gyroscope sensor can generate movement data corresponding to the patient's ankle.
[0072] In this specification, data generated by a gyroscope sensor is referred to as motion data. Motion data may be data defining the angular velocity or movement of an object to which the gyroscope sensor is attached.
[0073] A gyroscope sensor can be fixed to a specific part of a patient's body to generate movement data corresponding to that specific body part.
[0074] Multiple gyroscope sensors are attached to each of the patient's different body parts to generate movement data for each of the multiple body parts.
[0075] For example, referring to FIG. 4, a plurality of gyro sensors may include a sensor (30a) fixed to the patient's heel, a sensor (30b) fixed below the ankle, a sensor (30c) fixed to the ankle, a sensor (30d) fixed to the instep, and a sensor (30e) fixed to the big toe. In this case, each of the plurality of gyro sensors can generate movement data for the patient's heel, below the ankle, ankle, instep, and big toe, respectively.
[0076] Meanwhile, the gait analysis device according to the present disclosure is configured to be worn on a patient's foot and includes a sock having a fixing part capable of fixing the gyro sensor.
[0077] A plurality of gyro sensors may be fixed to the above socks. The plurality of gyro sensors may be fixed to the socks so that when the patient wears the socks, the gyro sensors are positioned on a specific part of the patient's body.
[0078] For example, referring to Fig. 4, five gyro sensors can be fixed to the sock, and when the patient wears the sock, the fixed positions of the gyro sensors can be set so that the gyro sensors are located at the patient's heel, under the ankle, ankle, instep, and big toe, respectively.
[0079] The sock may include a fixing part for securing a gyro sensor. The fixing part allows the gyro sensor to be secured to a specific part of the patient's body while the patient is wearing the sock.
[0080] In one embodiment, the fixing part may be made of a magnet and may be formed with an area larger than that of the gyro sensor. Meanwhile, each of the plurality of gyro sensors may be configured to be attachable to the magnet. In this case, the gyro sensor is not fixed only at a specific fixed position, but its position may vary within the area range of the fixing part. Through this, even if a patient of a different body size wears the socks according to the present disclosure, the gyro sensor can be fixed to the accurate measurement target area.
[0081] Figure 5 is a drawing illustrating a plurality of fixing parts included in a sock.
[0082] Figure 6 is a drawing illustrating an example in which a gyro sensor is attached to the fixed part of Figure 5.
[0083] FIGS. 7 and FIGS. 8 are example diagrams showing in detail each part of FIGS. 5 and FIGS. 6 to which a plurality of gyro sensors are attached.
[0084] Each position will be described with reference to Figures 5 (a) and (b).
[0085] The fixation part (501) is formed to correspond to the LM (lateral malleolus) position, where LM means the lateral malleolus.
[0086] The fixation part (502) is formed to correspond to the MM (medial malleolus) position, where MM means the medial malleolus.
[0087] The fixed portion (503) is formed to correspond to the position of the TH (talar head), where TH refers to the talar head. The talar head is the head portion of the talus, which is one of the ankle bones, and is connected to the tibia and fibula to form the ankle joint.
[0088] The fixed portion (504) is formed to correspond to the CB (cuboid) position, where CB means the cuboid bone. The cuboid bone is one of the bones that make up the outer arch of the foot and connects the calcaneus and the fifth medial arch.
[0089] The fixed portion (505) is formed to correspond to the 5MTH (fifth metatarsal head) position, where 5MTH means the fifth metatarsal head.
[0090] The fixed portion (506) is formed to correspond to the position 23T (between the heads of second and third metatarsals and the hallux), where 23T is between the heads of the second and third metatarsals and the thumb.
[0091] The fixed part (507) is attached to the Hallux (big toe) position.
[0092] The fixed portion (508) is formed to correspond to the 1MTH (first metatarsal head) position, where 1MTH means the first metatarsal head.
[0093] The fixation part (509) is formed to correspond to the NV (navicular bone) position, where NV means navicular bone.
[0094] The fixed portion (510) is formed to correspond to the TC (top calcaneus) position, where TC is the upper part of the calcaneus, meaning the uppermost part of the heel bone.
[0095] The fixed portion (511) is formed to correspond to the position of the BC (bottom calcaneus), where BC is the lower part of the calcaneus, meaning the lowest part of the heel bone.
[0096] Referring to FIG. 6 (a) and (b), it is illustrated that gyroscope sensors (601, 602, 603, 604, 605, 606, 607, 608, 609, 610, 611) are each attached to fixed parts (501, 502, 503, 504, 505, 506, 507, 508, 509, 510, 511).
[0097] The gait analysis device according to the present disclosure collects movement data of each body part of a patient while wearing the aforementioned socks, and analyzes the patient's gait based on this data.
[0098] Meanwhile, at least one component may be added or removed in response to the performance of the components illustrated in FIGS. 1 to 8. In addition, it will be readily understood by those skilled in the art that the relative positions of the components may be changed in response to the performance or structure of the device.
[0099] Below, the artificial intelligence described in the present invention will be explained in detail.
[0100] The artificial intelligence-related functions according to the present disclosure are operated through the processor and memory installed in the aforementioned server and terminal. The processor may be composed of one or more processors. In this case, the one or more processors may be general-purpose processors such as CPUs, APs, and DSPs (Digital Signal Processors), graphics-dedicated processors such as GPUs and VPUs (Vision Processing Units), or artificial intelligence-dedicated processors such as NPUs. The one or more processors control the processing of input data according to predefined operation rules or artificial intelligence models stored in memory. Alternatively, if the one or more processors are artificial intelligence-dedicated processors, the artificial intelligence-dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.
[0101] The predefined rules of operation or artificial intelligence models are characterized by being created through learning. Here, being created through learning means that a basic artificial intelligence model is trained using a number of training data by a learning algorithm, thereby creating predefined rules of operation or artificial intelligence models configured to perform desired characteristics (or objectives). Such learning may be performed on the device itself where the artificial intelligence according to the present disclosure is executed, or it may be performed through a separate server and / or system. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.
[0102] An artificial intelligence model may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values and performs neural network operations through operations between the results of previous layers and the multiple weights. The multiple weights possessed by the multiple neural network layers can be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights may be updated so that the loss value or cost value obtained from the artificial intelligence model during the learning process is reduced or minimized. Artificial neural networks may include deep neural networks (DNNs), such as Convolutional Neural Networks (CNNs), Deep Neural Networks (DNNs), Recurrent Neural Networks (RNNs), Restricted Boltzmann Machines (RBMs), Deep Belief Networks (DBNs), Bidirectional Recurrent Deep Neural Networks (BRDNNs), or Deep Q-Networks, but are not limited to the examples mentioned above.
[0103] According to an exemplary embodiment of the present disclosure, a processor can implement artificial intelligence. Artificial intelligence refers to a machine learning method based on an artificial neural network that enables a machine to learn by mimicking human biological neurons. Methodologies of artificial intelligence can be classified according to the learning method into supervised learning, where input data and output data are provided together as learning data and the solution (output data) to the problem (input data) is predetermined; unsupervised learning, where only input data is provided without output data and the solution (output data) to the problem (input data) is not predetermined; and reinforcement learning, where a reward is given from an external environment whenever an action is taken from the current state, and learning proceeds in a direction that maximizes such reward. In addition, artificial intelligence methodologies can be classified according to the architecture, which is the structure of the learning model. The architectures of widely used deep learning technologies can be classified into Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), Transformers, and Generative Adversarial Networks (GAN).
[0104] The device and system may include an artificial intelligence model. The artificial intelligence model may be a single model or may be implemented as multiple models. The artificial intelligence model may be composed of a neural network (or artificial neural network) and may include statistical learning algorithms that mimic biological neurons in machine learning and cognitive science. A neural network may refer to a model that possesses problem-solving capabilities by having artificial neurons (nodes) that form a network through synaptic connections and change the strength of synaptic connections through learning. The neurons of a neural network may include combinations of weights or biases. A neural network may include one or more layers composed of one or more neurons or nodes. For example, the device may include an input layer, a hidden layer, and an output layer. The neural network constituting the device can infer a result (output) to be predicted from an arbitrary input by changing the weights of the neurons through learning.
[0105] The processor can create a neural network, train or learn a neural network, perform operations based on received input data, generate an information signal based on the results of the operation, or retrain the neural network. The neural network models may include, but are not limited to, various types of models such as Convolutional Neural Networks (CNN), Region with Convolutional Neural Networks (R-CNN), Region Proposal Networks (RPN), Recurrent Neural Networks (RNN), Stacking-based Deep Neural Networks (S-DNN), State-Space Dynamic Neural Networks (S-SDNN), Deconvolution Networks, Deep Belief Networks (DBN), Restructured Boltzmann Machines (RBM), Fully Convolutional Networks, Long Short-Term Memory Networks (LSTM), and Classification Networks, such as GoogleNet, AlexNet, and VGG Network. The processor may include one or more processors for performing operations according to the neural network models. For example, neural networks can include deep neural networks.
[0106] Neural networks include CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), perceptron, multilayer perceptron, FF (Feed Forward), RBF (Radial Basis Network), DFF (Deep Feed Forward), LSTM (Long Short Term Memory), GRU (Gated Recurrent Unit), AE (Auto Encoder), VAE (Variational Auto) Encoder), DAE (Denoising Auto Encoder), SAE (Sparse Auto Encoder), MC (Markov Chain), HN (Hopfield Network), BM (Boltzmann Machine), RBM (Restricted Boltzmann Machine), DBN (Depp Belief Network), DCN (Deep Convolutional Network), DN (Deconvolutional Network), DCIGN (Deep Convolutional Inverse Graphics Network), GAN (Generative Adversarial Network), LSM (Liquid State Machine), ELM (Extreme Learning Machine), ESN (Echo It will be understood by a person skilled in the art that any neural network may be included, but is not limited to, State Network, Deep Residual Network, Differential Neural Computer, Neural Turning Machine, Capsule Network, Kohonen Network, and Attention Network.
[0107] According to an exemplary embodiment of the present disclosure, the processor comprises a Convolutional Neural Network (CNN) such as GoogleNet, AlexNet, VGG Network, Region with Convolutional Neural Network (R-CNN), Region Proposal Network (RPN), Recurrent Neural Network (RNN), Stacking-based Deep Neural Network (S-DNN), State-Space Dynamic Neural Network (S-SDNN), Deconvolution Network, Deep Belief Network (DBN), Restructured Boltzmann Machine (RBM), Fully Convolutional Network, Long Short-Term Memory (LSTM) Network, Classification Network, Generative Modeling, eXplainable AI, Continual AI, Representation Learning, AI for Material Design, BERT, SP-BERT, MRC / QA, Text Analysis, Dialog System, GPT-3, GPT-4 for Natural Language Processing, Visual Analytics, Visual Understanding, Video Synthesis for Vision Processing, Anomaly Detection, Prediction, Time-Series Forecasting, Optimization for ResNet Data Intelligence, Various artificial intelligence structures and algorithms, such as recommendation and data creation, may be used, but are not limited thereto. Hereinafter, embodiments of the present disclosure will be described in detail with reference to the attached drawings.
[0108] Hereinafter, a gait analysis method utilizing the aforementioned components is described in detail. The gait analysis method described below is implemented through data transmission and reception between the aforementioned server, terminal, and sensor, and some steps of the method may be performed on at least one of the server, terminal, and sensor. However, it is obvious to a person skilled in the art that the method described below may be performed independently on either the server or the terminal, without being limited thereto.
[0109] Hereinafter, a gait analysis method utilizing the components described in FIGS. 1 to 4 will be described.
[0110] FIG. 9 is a flowchart illustrating a gait analysis method according to the present disclosure.
[0111] Referring to FIG. 9, a step of sensing the patient's movement through a sensor attached to the patient before surgery or the patient with gait abnormalities is performed (S110).
[0112] Although this specification describes an embodiment in which the device according to the present disclosure is worn by a patient prior to surgery, it is obvious to a person skilled in the art that the device according to the present disclosure can also be applied to patients with gait abnormalities.
[0113] As described in Fig. 4, after having the patient wear socks with a gyroscope sensor attached before surgery, movement data from daily life can be collected.
[0114] In one embodiment, the movement data collected from the patient before surgery may be movement data for at least one of the ankle, below the ankle, instep, heel, and big toe.
[0115] In one embodiment, movement data collected from a patient before surgery may be collected within a predetermined time period based on the time of surgery. For example, the movement data collected from a patient before surgery may be data collected within the past week based on the time of surgery, and may be data collected during daily walking for three days.
[0116] Next, the step of sensing the patient's movement through a sensor attached to the patient after surgery is performed (S120).
[0117] After surgery, the patient can wear socks equipped with fixed gyroscope sensors to collect movement data during daily life.
[0118] In one embodiment, the movement data collected from the patient after surgery may be movement data for at least one of the ankle, below the ankle, instep, heel, and big toe.
[0119] In one embodiment, movement data collected from a patient after surgery may be collected for a predetermined period within a predetermined time based on the time of surgery. For example, the movement data collected from a patient after surgery may be data collected within one week from the time when self-walking became possible after surgery, and may be data collected during daily walking for three days.
[0120] Finally, a step of determining the surgical result based on the patient's movement sensed through the sensors before and after the surgery is performed (S130).
[0121] The processor can generate evaluation data to assess surgical outcomes based on the patient's movement data.
[0122] The processor can output either a good surgical result or the need for additional treatment as evaluation data for evaluating the above surgical result.
[0123] In one embodiment, the processor can generate evaluation data by comprehensively considering movement data for at least one of the ankle, the area below the ankle, the instep, the heel, and the big toe.
[0124] In one embodiment, the processor can generate evaluation data using only movement data of body parts (ankle and big toe) where increased movement after surgery is judged to result in a good surgical outcome. Specifically, the processor can determine that the surgical outcome is good if the amount of change in movement data corresponding to the ankle and big toe among the patient's movement data before and after surgery exceeds a predetermined threshold value.
[0125] In one embodiment, the processor can generate evaluation data using only movement data of body parts (heel, instep, and lower ankle) where the surgical outcome can be judged to be good if the amount of change in movement before and after surgery is reduced. Specifically, the processor can determine that the surgical outcome is good if the amount of change in movement data corresponding to the heel, instep, and lower ankle among the patient's movement data before and after surgery is less than a predetermined reference value.
[0126] In one embodiment, the processor may assign weights to each body part of the patient and generate evaluation data based on the assigned weights and movement data of each body part.
[0127] For example, a positive weight may be assigned to body parts (ankle and big toe) where increased movement after surgery indicates a good surgical outcome, and a negative weight may be assigned to body parts (heel, instep, and below the ankle) where a small change in movement before and after surgery indicates a good surgical outcome. The processor may generate evaluation data indicating that the surgical outcome is satisfactory if a result value exceeding a predetermined threshold is produced by applying the above weights to the movement data of each body part, and that additional treatment is required if a result value below the predetermined threshold is produced.
[0128] Meanwhile, the processor may include an artificial intelligence model trained to receive movement data of the patient before and after surgery and generate evaluation data to evaluate the surgical outcome. The artificial intelligence model may be trained based on training data in which correct answer data is labeled on the patient's movement data before and after surgery.
[0129] Here, the correct answer data may be the patient's medical data after a predetermined period has elapsed from the time of the patient's surgery. For example, if the patient's surgical prognosis is good three months after the time of the patient's surgery, the correct answer data may define that the surgical outcome is good, and if the patient is not cured three months after the time of the patient's surgery, the correct answer data may define that additional treatment is necessary.
[0130] As described above, the gait analysis device and method according to the present disclosure can improve the accessibility and compliance of the examination by analyzing gait using a gyro sensor attached to a sock that a patient wears daily.
[0131] Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium that stores instructions executable by a computer. The instructions may be stored in the form of program code and, when executed by a processor, may generate a program module to perform the operation of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.
[0132] Computer-readable recording media include all types of recording media that store instructions that can be decoded by a computer. Examples include ROM (Read Only Memory), RAM (Random Access Memory), magnetic tape, magnetic disk, flash memory, optical data storage devices, etc.
[0133] As described above, the disclosed embodiments have been explained with reference to the attached drawings. Those skilled in the art will understand that the present disclosure may be practiced in forms different from the disclosed embodiments without changing the technical spirit or essential features of the present disclosure. The disclosed embodiments are illustrative and should not be interpreted restrictively.
Claims
Claim 1 A real-time mobile gait analysis device comprises: a plurality of gyroscope sensors configured to measure angular velocity; a sock configured to be worn on a patient's foot and including a fixing part capable of fixing the gyroscope sensors; a communication module configured to receive data measured by the plurality of gyroscope sensors; and a memory storing at least one process for gait analysis. A real-time mobile gait analysis device comprising a processor that performs the gait analysis according to the above process, wherein the processor receives movement data of a patient before surgery measured through the plurality of gyro sensors and receives movement data of a patient after surgery measured through the plurality of gyro sensors, assigns weights to each body part of the patient to which the plurality of gyro sensors are fixed, and generates evaluation data that evaluates the surgical result based on the assigned weights and the movement data of each body part, wherein the weights are assigned as positive (+) weights to the ankle and big toe of the patient, where the surgical result can be judged as good if the amount of change in movement data among the movement data of the patient before and after surgery exceeds a predetermined standard value, and are assigned as negative (-) weights to the heel, instep, and lower ankle of the patient, where the surgical result can be judged as good if the amount of change in movement data among the movement data of the patient before and after surgery is less than the predetermined standard value, and the surgical result is judged as good if the result of applying the weights to the movement data of each body part is greater than or equal to a predetermined value. Claim 2 A real-time mobile gait analysis device according to claim 1, wherein each of the plurality of gyro sensors is attached to a fixing part so as to be fixed on a specific body part of the patient while the patient is wearing the socks. Claim 3 A real-time mobile gait analysis device according to paragraph 2, wherein the body part of the patient to which the plurality of gyro sensors are fixed is at least one of the ankle, the lower ankle, the instep, the heel, and the big toe. Claim 4 A real-time mobile walking analysis device characterized in that, in paragraph 3, the fixed part is made of a magnet with a larger surface area than the plurality of gyro sensors, and each of the plurality of gyro sensors is made to be attachable to the magnet. Claim 5 A real-time mobile gait analysis device according to claim 4, wherein the processor outputs either "satisfactory surgical result" or "needs additional treatment" as evaluation data for evaluating the surgical result. Claim 6 delete Claim 7 delete Claim 8 A method for real-time mobile gait analysis of a device comprising a plurality of gyroscope sensors and a sock that can be worn on a patient's foot and includes a fixing part capable of fixing the gyroscope sensors, wherein the method comprises: a step in which a processor receives movement data of a patient before surgery measured through the plurality of gyroscope sensors; a step in which the processor receives movement data of a patient after surgery measured through the plurality of gyroscope sensors; a step in which the processor generates evaluation data that evaluates the surgical result based on the assigned weights and the movement data of each body part of the patient to which the plurality of gyroscope sensors are fixed, wherein the weights are assigned as positive (+) weights to the ankle and big toe of the patient, where the surgical result can be judged as good if the amount of change in movement data among the movement data of the patient before and after surgery exceeds a predetermined reference value, and assigned as negative (-) weights to the heel, instep, and underfoot of the patient, where the surgical result can be judged as good if the amount of change in movement data among the movement data of the patient before and after surgery is less than the predetermined reference value. A real-time mobile gait analysis method characterized by including a step of determining that the surgical result is satisfactory when the result of applying the weights to the movement data of each of the body parts by the processor is greater than or equal to a predetermined value. Claim 9 A real-time mobile gait analysis method according to claim 8, wherein each of the plurality of gyro sensors is attached to a fixing part so as to be fixed on a specific body part of the patient while the patient is wearing the socks. Claim 10 A real-time mobile gait analysis method according to claim 9, wherein the body part of the patient to which the plurality of gyro sensors are fixed is at least one of the ankle, the lower ankle, the instep, the heel, and the big toe. Claim 11 A real-time mobile walking analysis method according to claim 10, wherein the fixed part is made of a magnet with a larger surface area than the plurality of gyro sensors, and each of the plurality of gyro sensors is made to be attachable to the magnet. Claim 12 A real-time mobile gait analysis method according to claim 8, wherein the processor outputs either "satisfactory surgical result" or "needs additional treatment" as evaluation data for evaluating the surgical result. Claim 13 delete Claim 14 delete
Citation Information
Patent Citations
Walking coaching system and coaching method using the flexible sensor
KR101975585B1
A Portable Height Measurement Tool and Height Management System using thereof
KR1020180079112A
Systems and related methods for detecting a user's gait impairment
KR1020200140879A
Walking ability evaluation system for rehabilitation patient with cerebrovascular accident
KR1020220115314A
