Action state estimation device, action state estimation method, action state learning device, and action state learning method
By using a sampling unit, a statistics calculation unit, and an inference calculation unit to generate and calculate untransformed measurement data without converting it to frequency components, the problem of handling increased load in the prior art is solved, and high-precision muscle load state inference and system miniaturization are achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- MURATA MFG CO LTD
- Filing Date
- 2021-07-21
- Publication Date
- 2026-05-12
AI Technical Summary
Existing technologies require converting sensor signals into frequency components when inferring muscle load, which increases processing load and affects inference accuracy.
Displacement measurement data is generated by the first sampling unit, statistics are calculated by the first statistics calculation unit, and load state is inferred without being transformed into frequency components using the action state model storage unit and the inference calculation unit. Inference is made using untransformed measurement data.
It achieves high-precision estimation of muscle load status while reducing processing load, can estimate the load status of muscles not exposed on the body surface, and the system is miniaturized.
Smart Images

Figure CN116322508B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a technique for inferring action states including muscle load states based on tremor detection results, and a technique for generating action state models for the inference technique (action state learning technique). Background Technology
[0002] Patent Document 1 describes an action state estimation device, etc. The action state estimation device described in Patent Document 1 converts the measurement signal from a displacement detection sensor into frequency components. The action state estimation device described in Patent Document 1 estimates the action state based on the components of a predetermined frequency band.
[0003] Patent Document 1: Japanese Patent Application Publication No. 2011-182824
[0004] However, in the existing apparatus and method shown in Patent Document 1, it is necessary to convert the sensor's measurement signal into frequency components. Therefore, the processing load for generating the inference signal increases. Summary of the Invention
[0005] Therefore, the object of the present invention is to provide an action state prediction technique that achieves the desired prediction accuracy and suppresses processing load.
[0006] The motion state estimation device of the present invention includes a first sampling unit, a first statistic calculation unit, a motion state model storage unit, and an estimation calculation unit. The first sampling unit samples the displacement measurement signal of a subject within a predetermined time period to generate displacement measurement data. The first statistic calculation unit calculates a first statistic from the displacement measurement data. The motion state model storage unit stores a motion state model obtained by establishing a correlation between the first statistic and the desired muscle load state. The estimation calculation unit uses the first statistic as an input vector and the motion state model to estimate the load state.
[0007] In this structure, measurement data that has not been converted into frequency components is used to infer the load condition.
[0008] According to the present invention, the desired prediction accuracy can be achieved, and the processing load can be suppressed. Attached Figure Description
[0009] Figure 1 This is a functional block diagram of the action state prediction device according to the first embodiment of the present invention.
[0010] Figure 2 This is a table that sets an example of the importance of the first implementation.
[0011] Figure 3 This is a flowchart illustrating the main processing steps of the action state prediction method according to the first embodiment of the present invention.
[0012] Figure 4 This is a functional block diagram of the action state learning device according to the first embodiment of the present invention.
[0013] Figure 5 This is a flowchart illustrating the main processing steps of the action state learning method according to the first embodiment of the present invention.
[0014] Figure 6 (A) represents the time variation of signal strength. Figure 6 (B) represents the signal strength distribution. Figure 6 (C) represents the intensity block data.
[0015] Figure 7 This is a table that sets an example of the importance of the second implementation.
[0016] Figure 8 (A) is a graph representing an example of the time-varying signal strength. Figure 8 (B) is a graph representing the intensity block data (average). Figure 8 (C) is a graph representing the intensity block data (cumulative value).
[0017] Figure 9 This is a functional block diagram of the action state prediction device according to the third embodiment of the present invention.
[0018] Figure 10 (A) Figure 10 (B) is a table representing a setting example of the importance of the third embodiment.
[0019] Figure 11 This is a flowchart illustrating the main processing steps of the action state prediction method according to the third embodiment of the present invention.
[0020] Figure 12 This is a functional block diagram of the action state learning device according to the third embodiment of the present invention.
[0021] Figure 13 This is a flowchart illustrating the main processing steps of the action state learning method according to the third embodiment of the present invention.
[0022] Figure 14 (A) Figure 14 (B) is a table representing a setting example of the importance of the fourth embodiment.
[0023] Figure 15 This is a flowchart illustrating the main processing steps of the action state learning method according to the fifth embodiment of the present invention.
[0024] Figure 16 This is a diagram representing the concept of synchronization. Detailed Implementation
[0025] (First Implementation)
[0026] The action state prediction technique and action state model generation technique of the first embodiment of the present invention will be described with reference to the accompanying drawings.
[0027] (Structure and processing of the action status prediction device)
[0028] Figure 1 This is a functional block diagram of the action state prediction device according to the first embodiment of the present invention. Figure 1 As shown, the action state prediction device 10 includes a time series sampling unit 11, a statistical calculation unit 12, a prediction calculation unit 14, and an action state model storage unit 13. Each functional unit constituting the action state prediction device 10 can be implemented by electronic circuits, ICs, a storage medium storing a program that executes the functions of each functional unit, and an arithmetic processing device (CPU, etc.) that executes the program.
[0029] A displacement measurement signal is input to the sampling unit 11 from the displacement detection sensor 101. The sampling unit 11 samples the displacement measurement signal at a predetermined sampling frequency (e.g., 100Hz), thereby generating displacement measurement data. That is, the sampling unit 11 generates displacement measurement data without converting the displacement measurement signal into frequency components. The sampling unit 11 outputs the displacement measurement data to the statistical calculation unit 12.
[0030] Furthermore, the displacement detection sensor 101 is implemented using a piezoelectric sensor, an accelerometer, or the like. The displacement detection sensor 101 does not need to be positioned at the location of the muscle under the inferred load state; it only needs to be positioned at a location capable of measuring the tremors produced by the muscles of the inferred object. Additionally, the displacement detection sensor 101 can be a single sensor positioned at one location, or multiple sensors positioned at multiple locations. The displacement detection sensor 101 generates and outputs a displacement measurement signal. The displacement measurement signal is a signal that converts the displacement of the skin surface caused by tremors and deformation into a voltage signal.
[0031] The tremor described herein refers, for example, to involuntary movements indicating regular muscle activity. That is, the tremor of this invention is a subtle and rapid postural tremor that can be observed by a normal person, referred to as a physiological tremor, for example, with a frequency of 8 Hz to 12 Hz. Furthermore, movements that can be observed in patients such as those with Parkinson's disease are pathological tremors, for example, with a frequency of 4 Hz to 7 Hz, and are not the subject of this invention. Using tremor provides various advantages over electromyography (EMG) in the following ways: For example, tremor can be detected (measured) even without direct attachment to the surface of the tested object (skin, etc.). Muscle contraction can be detected through tremor detection. Changes accompanying muscle fatigue can be detected through tremor detection.
[0032] The statistics calculation unit 12 calculates statistics based on displacement measurement data. The statistics calculation unit 12 calculates statistics based on multiple displacement measurement data within a specified period (e.g., 1 second).
[0033] As types of statistics, examples include the average, maximum, minimum, median, 1% value, 5% value, 25% value, 75% value, 95% value, 99% value, variance, skewness, kurtosis, and cumulative value. Furthermore, the types of statistics are not limited to these; any content obtainable from time-series displacement measurement data can be used, and other types are also possible. The statistics calculation unit 12 calculates various statistics from these. Additionally, the x% value refers to the value among multiple displacement measurement data within the period, counted in ascending order from the minimum value and located at x%.
[0034] The statistical calculation unit 12 outputs the calculated statistical quantities to the prediction calculation unit 14.
[0035] An action state model is stored in the action state model storage unit 13. The action state model sets the relationship between various statistics of displacement measurement data and the load state of the muscles of the predicted object. The action state model is, for example, pre-generated by the action state learning device 20 described later and stored in the action state model storage unit 13.
[0036] The prediction calculation unit 14 uses the action state model stored in the action state model storage unit 13, and takes multiple statistics as input vectors to predict the load state of the muscles of the prediction object. At this time, the prediction calculation unit 14 sets the importance of the statistics used for prediction based on the muscles of the prediction object. This importance is, for example, set in the action state model.
[0037] Figure 2 This is a table showing examples of settings indicating the importance of the first embodiment. Muscle M1, Muscle M2, Muscle M3, and Muscle M4 represent the types of muscles whose load state can be inferred from the measured displacement. For example, when the displacement detection sensor 101 is disposed at the location where tendons are concentrated in the ankle, or more specifically at the front and back of the ankle, Muscle M1, Muscle M2, Muscle M3, and Muscle M4 can be set to the soleus, gastrocnemius, tibialis anterior, quadriceps, hamstring, etc. In addition, the statistics A1 to A15 are respectively set to any of the above-mentioned statistics (mean, maximum, minimum, median, 1% value, 5% value, 25% value, 75% value, 95% value, 99% value, variance, skewness, kurtosis, cumulative value, etc.).
[0038] For example, in Figure 2In the case of muscle M1, the importance of the inference is set according to the following order: statistics A1, A2, A8, A12, and A7, in the order of 1st, 2nd, 3rd, 4th, and 5th place. Similarly, for muscle M2, the importance of the inference is set according to the following order: statistics A3, A5, A2, A14, and A15, in the order of 1st, 2nd, 3rd, 4th, and 5th place. The same applies to muscles M3 and M4. Figure 2 As shown, importance is set for the statistics.
[0039] If the estimation calculation unit 14 sets the muscle to be estimated, it uses an importance set according to the muscle to estimate the muscle's load status (e.g., electromyographic value) based on multiple statistical quantities. Furthermore, the muscle's load status is not limited to electromyographic value; any quantity that can be expressed as a value can also be used.
[0040] More specifically, for example, the prediction calculation unit 14 calculates the prediction results of the load state of each statistic based on the statistics with importance ranking from 1st to 5th and the action state model. Then, the prediction calculation unit 14 weights each prediction result according to its importance, such as by performing an additive average, thereby calculating the final prediction result of the load state. Furthermore, the number of statistics used by the prediction calculation unit 14 in the prediction is not limited to this. For example, the prediction calculation can also be performed based on statistics with importance ranking from 1st to 10th.
[0041] Furthermore, if there is only one type of muscle to be predicted, the prediction calculation unit 14 uses the statistics and importance corresponding to that muscle to predict the load state. On the other hand, if there are multiple types of muscles to be predicted, the prediction calculation unit 14 sets statistics and importance for each muscle and predicts the load state for each muscle.
[0042] By using this structure, the action state estimation device 10 can estimate the muscle load state without performing processing that converts the measurement data into frequency components. Thus, the action state estimation device 10 can achieve the desired estimation accuracy and suppress processing load.
[0043] Furthermore, by using this structure, the action state estimation device 10 individually sets the types and importance of the statistics used for estimation for each muscle in the estimation object. As a result, the action state estimation device 10 can estimate the muscle load state with higher accuracy.
[0044] Furthermore, by using this structure, even if the position of the displacement detection sensor 101 is not the position of the muscle being predicted, the action state prediction device 10 can still predict the load state of that muscle. Thus, the action state prediction device 10 can predict the load state even for muscles not exposed on the body surface or muscles whose myoelectric potentials cannot be directly measured (for example, muscles far from the placement position of the displacement detection sensor 101). By placing the displacement detection sensor 101 on the ankle, the action state prediction device 10 can predict the load state of the quadriceps, hamstrings (biceps femoris, semimembranosus, semitendinosus, and rotatores major), tibialis anterior, gastrocnemius, soleus, gluteus maximus, etc. In addition, the action state prediction device 10 can predict the coordinated state of multiple muscles.
[0045] Furthermore, the effects of errors in the placement of the displacement detection sensor 101 can be suppressed. Therefore, the placement of the displacement detection sensor 101 becomes easier, and the operation for estimating the load condition becomes easier.
[0046] Furthermore, in this structure, the displacement measurement signal of the displacement detection sensor 101 can be used to infer the load state of multiple muscles, thus enabling the miniaturization of the motion state inference system that includes the sensor and the motion state inference device.
[0047] Furthermore, in this structure, the statistics and importance used are set individually for each muscle being predicted. Therefore, the action state prediction device 10 can use the displacement measurement signal of the displacement detection sensor 101 to predict the load state of multiple muscles with high accuracy.
[0048] Furthermore, in this structure, the load status can be inferred as a value rather than a classification. This allows the load status to be inferred from the value, enabling the action status inference device 10 to provide more accurate load status indications and management, and to provide more appropriate notifications to the subject.
[0049] (Method for predicting action status)
[0050] Figure 3 This is a flowchart illustrating the main processes of the action state prediction method according to the first embodiment of the present invention. Furthermore, the specific details of each process are described in the above structural explanation, and therefore will be given a brief description below.
[0051] The motion state estimation device 10 receives a displacement measurement signal (S11). The motion state estimation device 10 samples the displacement measurement signal and generates displacement measurement data (S12). The motion state estimation device 10 calculates statistics based on the displacement measurement data (S13).
[0052] Action state prediction device 10 acquires action state model (S14). Action state prediction device 10 uses statistics as input vector and action state model to predict load state (S15).
[0053] In addition, the above-mentioned processing can also be programmed, stored in a storage medium, and executed by a computing device such as a CPU.
[0054] (Structure and processing method of the action state learning device)
[0055] The above-mentioned action state model is generated, for example, as follows. Figure 4 This is a functional block diagram of the action state learning device according to the first embodiment of the present invention.
[0056] like Figure 4 As shown, the action state learning device 20 includes a sampling unit 11, a statistics calculation unit 12, an action state model storage unit 13, a sampling unit 21, a modeling baseline value calculation unit 22, and a learning calculation unit 24. The sampling unit 11, the statistics calculation unit 12, and the action state model storage unit 13 are described above and will not be further explained.
[0057] A muscle activity measurement signal (e.g., myoelectric potential signal) is input from the muscle activity detection sensor 102 to the sampling unit 21. The sampling unit 21 generates muscle activity measurement data by sampling the muscle activity measurement signal at a predetermined sampling frequency (e.g., 100 Hz). The sampling unit 21 outputs the muscle activity measurement data to the modeling reference value calculation unit 22.
[0058] Furthermore, the muscle activity detection sensor 102 is a sensor capable of measuring muscle activity, such as an electromyography (EMG) sensor. The muscle activity detection sensor 102 is positioned near the muscle where the load state is inferred. More specifically, the muscle activity detection sensor 102 is positioned at the location of the muscle that forms the basis for the muscle activity that generates the tremor measured by the muscle activity detection sensor 102. The muscle activity detection sensor 102 detects muscle activity, generates, and outputs a muscle activity measurement signal. The muscle activity detection sensor 102 can be a single sensor configured for one type of muscle, or multiple sensors configured for each type of muscle.
[0059] The modeling baseline calculation unit 22 calculates the modeling baseline value based on muscle activity measurement data. For example, the modeling baseline calculation unit 22 calculates the absolute average value of muscle activity measurement data within a specified period as the modeling baseline value. The absolute average value refers to the average of the absolute values of the measurement data.
[0060] Furthermore, the modeling baseline is not limited to the absolute mean; it can also use values that can be regressed, such as the mean, maximum, minimum, median, 1% value, 5% value, 25% value, 75% value, 95% value, 99% value, variance, skewness, kurtosis, etc. Moreover, the modeling baseline can also be a value that can classify muscle activity measurement data into categories such as large, medium, and small loads.
[0061] The modeling baseline calculation unit 22 outputs the modeling baseline value to the learning calculation unit 24.
[0062] The learning computation unit 24 uses statistics and modeled baseline values to learn and generate an action state model. More specifically, for example, the learning computation unit 24 uses statistics as explanatory variables and modeled baseline values as target variables, and uses a gradient boosting method utilizing decision tree algorithms to learn. The learning computation unit 24 repeatedly performs this learning, and if a predetermined inference accuracy is obtained, the result is used to generate an action state model. Furthermore, the learning method is not limited to gradient boosting; boosting methods such as AdaBoost can also be used. In addition, other learning methods can include SVM, GMM, HMM, neural networks, learning Bayesian networks, etc. Moreover, multiple learners can be used in the learning computation unit 24, employing a weighted average method that uses majority voting after weighting the results of multiple learners.
[0063] By using this structure and processing, the action state learning device 20 is able to properly set the action state model.
[0064] (Method for generating action state models)
[0065] Figure 5 This is a flowchart illustrating the main processes of the action state learning method according to the first embodiment of the present invention. Furthermore, the specific details of each process are described in the above structural explanation, and therefore will be given a brief description below.
[0066] The action state learning device 20 receives a displacement measurement signal (S21). The action state learning device 20 samples the displacement measurement signal and generates displacement measurement data (S22). The action state learning device 20 calculates statistics based on the displacement measurement data (S23).
[0067] The action state learning device 20 receives a muscle activity measurement signal (S31). The action state learning device 20 samples the muscle activity measurement signal and generates muscle activity measurement data (S32). The action state learning device 20 calculates a modeled baseline value based on the muscle activity measurement data (S33).
[0068] Action state learning device 20 performs learning using statistics and modeled baseline values to generate an action state model (S41).
[0069] In addition, the above-mentioned processing can also be pre-stored in a storage medium or the like and executed by a processing device such as a CPU.
[0070] Furthermore, based on the structure of the action state estimation device 10 and the action state learning device 20 of this embodiment, it can be seen that by using the structure of this embodiment, although a relatively large electromyography (EMG) measurement unit such as an EMG meter is required during learning, a high-precision action state model can be generated. In actual use (when the action state estimation device 10 is used), it is not necessary to use a relatively large EMG measurement unit such as an EMG meter. That is, in actual use, the load state can be estimated (measured) with a simple structure, reducing the burden on the subject.
[0071] (Second Implementation)
[0072] The action state prediction technique and action state model generation technique of the second embodiment of the present invention will be described with reference to the accompanying drawings. The action state prediction technique of the second embodiment differs from the action state prediction technique shown in the first embodiment in the method of calculating the statistical quantities. Figure 6 (A) represents the time variation of signal strength. Figure 6 (B) represents the signal strength distribution. Figure 6 (C) represents the intensity block data.
[0073] The statistical calculation unit 12 calculates the signal strength distribution based on displacement measurement data within a specified period. The signal strength distribution is obtained by arranging the displacement measurement data within the specified period in descending order of signal strength. For example, if the statistical calculation unit 12 calculates the signal strength distribution as follows: Figure 6 As shown in (A), the signal strength from time t1 to time t100 is obtained according to the specified sampling period (sampling frequency), then... Figure 6 As shown in (B), the signal strength is arranged from large to small, from sequential R1 to sequential R100.
[0074] The statistical calculation unit 12 generates intensity block data based on the signal strength distribution and outputs it as a statistical measure. More specifically, the statistical calculation unit 12 rearranges the signal strength distribution in descending order of signal strength and sets up intensity blocks (signal strength blocks) according to a predetermined number of blocks. The statistical calculation unit 12 generates intensity block data by calculating a cumulative value for each intensity block. For example, in Figure 6In case (C), the statistical calculation unit 12 divides the measurement data into 10 blocks. As an example, the statistical calculation unit 12 sets the signal strength from sequence R1 to sequence R10 as intensity block B1, and calculates the cumulative value of the signal strength from sequence R1 to sequence R10. The statistical calculation unit 12 performs this processing from intensity block B1 to intensity block B10 and outputs the statistical result.
[0075] The prediction calculation unit 14 uses statistics obtained based on the signal strength distribution to predict the action state. At this time, the prediction calculation unit 14 uses importance to predict the action state.
[0076] Figure 7 This is a table showing examples of how important the second implementation method is. For example... Figure 7 As shown, in the second embodiment, for the intensity blocks of the signal intensity distribution, importance is set for each muscle.
[0077] For example, in Figure 7 In the case of muscle M1, the importance of the predicted intensity is set according to the order of intensity blocks B10, B9, B6, B3, and B5, in the order of 1st, 2nd, 3rd, 4th, and 5th. Similarly, for muscle M2, the importance of the predicted intensity is set according to the order of intensity blocks B10, B8, B9, B7, and B1, in the order of 1st, 2nd, 3rd, 4th, and 5th. The same applies to muscles M3 and M4. Figure 7 As shown, set the importance for the statistics (intensity blocks).
[0078] If the estimation calculation unit 14 sets the muscle to be estimated, it uses the importance set according to the muscle to estimate the muscle load state based on multiple statistics (values of intensity blocks).
[0079] With this structure, similar to the action state estimation device 10 of the first embodiment, the action state estimation device of the second embodiment can estimate the muscle load state without performing processing to convert the measurement data into frequency components. Therefore, the action state estimation device of the second embodiment can achieve the necessary estimation accuracy and suppress processing load.
[0080] Furthermore, in the above explanation (refer to...) Figure 6 (A) Figure 6 (B) Figure 6 In (C), multiple measurement data are arranged in order of intensity, multiple intensity blocks are set, and a cumulative value is calculated for each intensity block, which is then used as a statistic. However, in this case, the cumulative value can also be replaced by the average value.
[0081] Furthermore, referring to... Figure 8 (A) Figure 8 (B) Figure 8 In the method described in (C), multiple blocks (time blocks) are set for multiple measurement data within a time range, and the average value and cumulative value are calculated for each time block in the multiple time blocks and used as statistics.
[0082] When using the average value, the statistics calculation unit 12 divides multiple measurement data within the time period for statistics calculation into time series blocks (time blocks), and calculates the average value for each time block. When using the cumulative value, the statistics calculation unit 12 divides multiple measurement data within the time period for statistics calculation into time series blocks (time blocks), and calculates the cumulative value for each time block. The statistics calculation unit 12 uses the average value and the cumulative value as the value (statistic) of the time block.
[0083] Figure 8 (A) is a graph representing an example of the time-varying signal strength. Figure 8 (B) is a graph representing time block data (average). Figure 8 (C) is a graph representing time block data (cumulative values).
[0084] For example, in obtaining Figure 8 When measuring the data in (A), time blocks B1t-B10t are set up in the time series for the signal strength from time t1 to time t100. Time block B1t corresponds to times t1-t10, and time block B2t corresponds to times t11-t20. Similarly, time blocks B3t-B9t and time block B10t are set up to correspond to times t91-t100.
[0085] When using average values, the statistics calculation unit 12 calculates the average signal strength from time t1 to time t10 for time block B1t, as the statistics for time block B1t. Similarly, the statistics calculation unit 12 calculates average values for time blocks B2t-B9t, as their respective statistical values. Furthermore, the statistics calculation unit 12 calculates the average signal strength from time t91 to time t100 for time block B10t, as the statistics for time block B10t.
[0086] When using cumulative values, the statistics calculation unit 12 calculates the cumulative signal strength from time t1 to time t10 for time block B1t, and uses this as the statistics for time block B1t. Similarly, the statistics calculation unit 12 calculates cumulative values for time blocks B2t-B9t, and uses these as their respective statistics. Furthermore, the statistics calculation unit 12 calculates the cumulative signal strength from time t91 to time t100 for time block B10t, and uses this as the statistics for time block B10t.
[0087] (Third Implementation)
[0088] The action state prediction technique and action state model generation technique of the third embodiment of the present invention will be described with reference to the accompanying drawings.
[0089] (Structure and processing of the action status prediction device)
[0090] Figure 9 This is a functional block diagram of the action state prediction device according to the third embodiment of the present invention. Figure 9 As shown, the action state estimation device 10A differs from the action state estimation device 10 of the first embodiment in that it includes a sampling unit 31 and a statistical calculation unit 32, and in that it has an action state model storage unit 13A and an estimation calculation unit 14A. The other structures of the action state estimation device 10A are the same as those of the action state estimation device 10, and the description of the same parts is omitted.
[0091] The action state prediction device 10A includes a sampling unit 11, a statistical calculation unit 12, a prediction calculation unit 14A, an action state model storage unit 13A, a sampling unit 31, and a statistical calculation unit 32. Each functional unit constituting the action state prediction device 10A can be implemented by electronic circuits, ICs, a storage medium storing a program that executes the functions of each functional unit, and an arithmetic processing device (CPU, etc.) that executes the program.
[0092] The statistics calculation unit 12 calculates the statistics shown in the first embodiment as displacement statistics and outputs them to the prediction calculation unit 14A.
[0093] A motion measurement signal is input from the motion detection sensor 300 to the sampling unit 31. The sampling unit 31 generates motion measurement data by sampling the motion measurement signal at a predetermined sampling frequency (e.g., 100Hz). That is, the sampling unit 31 generates motion measurement data without converting the motion measurement signal into frequency components. The sampling unit 31 outputs the motion measurement data to the statistics calculation unit 32.
[0094] Furthermore, the motion detection sensor 300 is implemented using an accelerometer, angular velocity sensor, etc. The motion detection sensor 300 does not need to be positioned at the location of the muscle under the inferred load state; it only needs to be positioned at a location capable of measuring the movements produced by the muscles of the inferred target on the subject. Additionally, the motion detection sensor 300 can be a single sensor positioned at one location, or multiple sensors positioned at multiple locations. The motion detection sensor 300 detects the subject's movements, generates, and outputs a measurement signal of the movement.
[0095] The statistics calculation unit 32 calculates motion statistics based on motion measurement data. The statistics calculation unit 32 calculates motion statistics based on multiple motion measurement data within a specified period (e.g., 1 second).
[0096] Types of motion statistics include, for example, the average, maximum, minimum, median, 1% value, 5% value, 25% value, 75% value, 95% value, 99% value, variance, skewness, kurtosis, and cumulative value. Furthermore, the types of motion statistics are not limited to these; any type that can be obtained from time-series measurement data can be used. The statistics calculation unit 32 calculates various motion statistics from these. Additionally, the x% value refers to the value at which the maximum value among multiple motion measurement data within a period is set to 100%, equivalent to x% of its highest value.
[0097] The statistical calculation unit 32 outputs the calculated various action statistics to the prediction calculation unit 14A.
[0098] An action state model is stored in the action state model storage unit 13A. The action state model sets the relationship between various displacement statistics and various motion statistics and the muscle load state of the predicted object. The action state model is, for example, pre-generated by the action state learning device 20A described later, and stored in the action state model storage unit 13A.
[0099] The prediction calculation unit 14A uses the action state model stored in the action state model storage unit 13A, and takes displacement statistics and motion statistics as input vectors to predict the load state of the muscles of the prediction object. At this time, the prediction calculation unit 14A sets the importance of the displacement statistics and motion statistics used for prediction based on the muscles of the prediction object. These importance values are, for example, set in the action state model.
[0100] Figure 10 (A) Figure 10 (B) is a table representing a setting example of the importance of the third embodiment. Figure 10 (A) indicates the importance of the displacement statistic. Figure 10 (B) indicates the importance of the action statistic. Additionally, in Figure 10 (A) Figure 10In (B), muscle M1, muscle M2, muscle M3, and muscle M4 represent the types of muscles whose load state can be inferred from the measured displacement. For example, when the displacement detection sensor 101 is disposed at the tendon concentration area of the ankle, more specifically at the front and back of the ankle, muscle M1, muscle M2, muscle M3, and muscle M4 can be set to the soleus, gastrocnemius, tibialis anterior, quadriceps, hamstrings, etc. Displacement statistics Ar1 to Ar15 are each set to any one of the above displacement statistics, and motion statistics Aa1 to Aa15 are each set to any one of the above motion statistics.
[0101] For example, in Figure 10 In case (A), for muscle M1, the importance of the inference is set according to the displacement statistics Ar1, Ar2, Ar8, Ar12, and Ar7, in the order of 1st, 2nd, 3rd, 4th, and 5th position. Similarly, for muscle M2, the importance of the inference is set according to the displacement statistics Ar3, Ar5, Ar2, Ar14, and Ar15, in the order of 1st, 2nd, 3rd, 4th, and 5th position. The same applies to muscles M3 and M4. Figure 10 As shown in (A), importance is set for displacement statistics.
[0102] And, for example, in Figure 10 In case (B), for muscle M1, the importance of the inference is set according to the order of motion statistics Aa1, Aa2, Aa8, Aa12, and Aa7, in the order of 1st, 2nd, 3rd, 4th, and 5th. Similarly, for muscle M2, the importance of the inference is set according to the order of motion statistics Aa3, Aa5, Aa2, Aa14, and Aa15, in the order of 1st, 2nd, 3rd, 4th, and 5th. The same applies to muscles M3 and M4. Figure 10 As shown in (B), importance is set for motion statistics.
[0103] Furthermore, the importance of displacement statistics and motion statistics for a single muscle can be set using a shared importance system or set individually. For example, in Figure 10 (A) Figure 10 When the suffix (number) of the displacement statistic shown in (B) and the suffix (number) of the motion statistic represent the same type of statistic, Figure 10 (A) Figure 10The importance of the displacement statistics and motion statistics shown in (B) can be set by using a shared importance setting.
[0104] On the other hand, if Figure 10 The suffix (number) of the displacement statistics shown in (A) is set according to the type of displacement statistics. Figure 10 The suffix (number) of the motion statistics shown in (B) is set according to the type of motion statistics, and the importance of displacement statistics and the importance of motion statistics are set separately.
[0105] On the one hand, by using a shared importance scale to set the importance of displacement statistics and motion statistics, the setting of importance can be simplified, as can the prediction of action states. On the other hand, by setting the importance of displacement statistics and motion statistics separately, the prediction conditions for action states can be set in a more diverse manner, and the prediction of action states can be made with higher accuracy.
[0106] If the estimation calculation unit 14A sets the muscle to be estimated, it uses an importance set according to the muscle to estimate the muscle's load state (e.g., myoelectric point value) based on multiple displacement statistics and motion statistics. Furthermore, the muscle's load state is not limited to myoelectric point value; any parameter that can be expressed as a value can also be used.
[0107] More specifically, for example, the prediction calculation unit 14A calculates the predicted load state based on groups of displacement statistics and motion statistics with the same importance and the action state model. The prediction calculation unit 14A calculates the predicted load state for each group with the same importance. Furthermore, the prediction calculation unit 14A weights each predicted result according to its importance, for example, by performing an additive average, thereby calculating the final predicted load state.
[0108] Furthermore, the prediction calculation unit 14A can also independently calculate the prediction results of the load state based on displacement statistics and the motion state model, as well as the prediction results of the load state based on motion statistics and the motion state model, and calculate the final prediction result of the load state based on these prediction results. The number of posture statistics and motion statistics used by the prediction calculation unit 14 in the prediction is not limited to this, and can be appropriately set. For example, the prediction calculation can also be performed based on statistics with importance from the 1st to the 10th place.
[0109] Furthermore, if there is only one type of muscle to be predicted, the prediction calculation unit 14A uses the displacement statistics and motion statistics corresponding to that muscle, as well as their importance, to predict the load state. On the other hand, if there are multiple types of muscles to be predicted, the prediction calculation unit 14A sets the displacement statistics and motion statistics, as well as their importance, for each muscle each time, and predicts the load state for each muscle.
[0110] By using this structure, the action state estimation device 10A can infer muscle load status not only using displacement including tremors, but also using motion detection results such as acceleration and angular velocity. The sampled motion detection results such as acceleration and angular velocity are strongly influenced by the subject's movements and have a high correlation with the subject's muscle activity. Moreover, the action state estimation device 10A infers action state based on microscopic tremor measurement data and macroscopic motion measurement data, thus enabling high-precision estimation of muscle load status.
[0111] Furthermore, in this structure, displacement measurement data is also the sampled measurement data. Therefore, the action state estimation device 10A can suppress the loss of information related to tremors accompanied by frequency changes, and can estimate the muscle load state with higher accuracy.
[0112] Furthermore, by using this structure, the motion state estimation device 10A can individually set the types and importance of displacement and motion statistics used for estimation for each muscle being estimated. As a result, the motion state estimation device 10A can estimate the muscle load state with higher accuracy.
[0113] Furthermore, by using this structure, even if the positions of the displacement detection sensor 101 and the motion detection sensor 300 are not the positions of the muscles being predicted, the action state prediction device 10A can still predict the load state of those muscles. Thus, the action state prediction device 10A can predict the load state even for muscles not exposed on the body surface or muscles where myoelectric potentials cannot be directly measured (for example, muscles far from the placement positions of the displacement detection sensor 101 or the motion detection sensor 300). By placing the displacement detection sensor 101 and the motion detection sensor 300 on the ankle, the action state prediction device 10A can predict the load state of the quadriceps, hamstrings (biceps femoris, semimembranosus, semitendinosus, and rotatores major), tibialis anterior, gastrocnemius, soleus, gluteus maximus, etc. Additionally, the action state prediction device 10A can predict the coordinated state of multiple muscles.
[0114] Furthermore, the effects caused by errors in the placement of the displacement detection sensor 101 can be suppressed. Therefore, the placement of the displacement detection sensor 101 and the motion detection sensor 300 becomes easier, and the operation for estimating load conditions becomes easier.
[0115] Furthermore, in this structure, the displacement measurement signal of the displacement detection sensor 101 and the motion measurement signal of the motion detection sensor 300 can be used interchangeably to infer the load state of multiple muscles, thus enabling the miniaturization of the motion state estimation system that includes sensors and motion state estimation devices.
[0116] Furthermore, in this structure, the displacement statistics, motion statistics, and importance are individually set for each muscle being estimated. Therefore, the motion state estimation device 10A can use the measurement signals from the displacement detection sensor 101 and the motion detection sensor 300 together to estimate the load state of multiple muscles with high accuracy.
[0117] Furthermore, in this structure, the load status can be inferred as a value rather than a classification. This allows the load status to be inferred from the value, enabling the action status inference device 10A to provide more accurate load status indications and management, and to deliver more appropriate notifications to the subject.
[0118] (Method for predicting action status)
[0119] Figure 11 This is a flowchart illustrating the main processes of the action state prediction method according to the third embodiment of the present invention. Furthermore, the specific details of each process are described above in the structural explanation, and therefore will be given a brief overview below.
[0120] The motion state estimation device 10A receives a displacement measurement signal (S11A). The motion state estimation device 10A samples the displacement measurement signal and generates displacement measurement data (S12A). The motion state estimation device 10 calculates displacement statistics based on the displacement measurement data (S13A).
[0121] The motion state estimation device 10A receives a motion measurement signal (S21A). The motion state estimation device 10A samples the motion measurement signal and generates motion measurement data (S22A). The motion state estimation device 10A calculates motion statistics based on the motion measurement data (S23A).
[0122] Action state prediction device 10A acquires action state model (S14A). Action state prediction device 10A uses displacement statistics and motion statistics as input vectors and uses the action state model to predict load state (S15A).
[0123] In addition, the above-mentioned processing can also be pre-stored in a storage medium or the like and executed by a processing device such as a CPU.
[0124] (Structure and processing of the action state learning device)
[0125] The above-mentioned action state model is generated, for example, as follows. Figure 12 This is a functional block diagram of the action state learning device according to the third embodiment of the present invention.
[0126] like Figure 12 As shown, the action state learning device 20A includes a sampling unit 11, a statistics calculation unit 12, an action state model storage unit 13A, a sampling unit 21, a modeling baseline value calculation unit 22, a learning calculation unit 24A, a sampling unit 31, and a statistics calculation unit 32. The sampling unit 11, statistics calculation unit 12, action state model storage unit 13A, sampling unit 31, and statistics calculation unit 32 are described above and will not be further explained.
[0127] A muscle activity measurement signal (e.g., myoelectric potential signal) is input from the muscle activity detection sensor 102 to the sampling unit 21. The sampling unit 21 generates muscle activity measurement data by sampling the muscle activity measurement signal at a predetermined sampling frequency (e.g., 100 Hz). The sampling unit 21 outputs the muscle activity measurement data to the modeling reference value calculation unit 22.
[0128] Furthermore, the muscle activity detection sensor 102 is a sensor capable of measuring muscle activity, such as an electromyography (EMG) sensor. The muscle activity detection sensor 102 is positioned at the location of the muscle to infer its load state. More specifically, the muscle activity detection sensor 102 is positioned at the location of the muscle that forms the basis of muscle activity, producing tremors that are measured by the muscle activity detection sensor 102. The muscle activity detection sensor 102 detects muscle activity, generates, and outputs a measurement signal of the muscle activity. The muscle activity detection sensor 102 can also be a single sensor configured for one type of muscle, or multiple sensors configured for each type of muscle.
[0129] The modeling baseline calculation unit 22 calculates the modeling baseline value based on muscle activity measurement data. For example, the modeling baseline calculation unit 22 calculates the absolute average value of muscle activity measurement data within a specified period as the modeling baseline value. The absolute average value refers to the average of the absolute values of the measurement data.
[0130] Furthermore, the modeling baseline is not limited to the absolute mean; it can also use values that can be regressed, such as the mean, maximum, minimum, median, 1% value, 5% value, 25% value, 75% value, 95% value, 99% value, variance, skewness, kurtosis, etc. Moreover, the modeling baseline can also be a value that can classify muscle activity measurement data into categories such as large, medium, and small loads.
[0131] The modeling baseline calculation unit 22 outputs the modeling baseline value to the learning calculation unit 24A.
[0132] The learning and calculation unit 24A uses displacement statistics, motion statistics, and modeled baseline values to learn and generate an action state model. More specifically, for example, the learning and calculation unit 24A uses displacement statistics and motion statistics as explanatory variables, and the modeled baseline values as target variables, and uses a gradient boosting method utilizing a decision tree algorithm to learn. The learning and calculation unit 24A repeatedly performs this learning, and if a predetermined inference accuracy is obtained, the result is used to generate an action state model.
[0133] Furthermore, the learning method is not limited to gradient boosting; methods such as AdaBoost can also be used. In addition, other learning methods include SVM, GMM, HMM, neural networks, and learning-based Bayesian networks. Moreover, multiple learners can be used in the learning computation unit 24A, employing a general method that weights the results from multiple learners and then uses majority voting.
[0134] By using this structure and processing, the action state learning device 20A is able to properly set the action state model.
[0135] (Action-based learning method)
[0136] Figure 13 This is a flowchart illustrating the main processing steps of the action state learning method according to the third embodiment of the present invention.
[0137] The motion state learning device 20A receives displacement measurement signals and motion measurement signals as input (S41A). The motion state learning device 20A samples the displacement measurement signals to generate displacement measurement data and samples the motion measurement signals to generate motion measurement data (S42A). The motion state learning device 20A calculates displacement statistics based on the displacement measurement data and calculates motion statistics based on the motion measurement data (S43A).
[0138] The action state learning device 20A inputs a muscle activity measurement signal (S51A). The action state learning device 20A samples the muscle activity measurement signal and generates muscle activity measurement data (S52A). The action state learning device 20A calculates a modeled baseline value based on the muscle activity measurement data (S53A).
[0139] The action state learning device 20A performs learning using displacement statistics, motion statistics, and modeling baseline values to generate an action state model (S61A).
[0140] In addition, the above-mentioned processing can also be pre-stored in a storage medium or the like and executed by a processing device such as a CPU.
[0141] (Fourth Implementation)
[0142] The action state prediction technique and action state model generation technique of the fourth embodiment of the present invention will be described. The action state prediction technique of the fourth embodiment differs from the action state prediction technique shown in the third embodiment in the use of intensity block data of displacement statistics and motion statistics. The method for generating intensity block data of motion statistics is the same as the method for generating intensity block data of displacement statistics in the third embodiment, and specific examples are omitted.
[0143] The statistical calculation unit 12 generates intensity block data (displacement intensity block data) of the displacement measurement data based on the signal intensity distribution of the displacement measurement data, and outputs it as displacement statistics. More specifically, the statistical calculation unit 12 sets intensity blocks (signal intensity blocks) according to the signal intensity distribution in descending order of signal intensity, and sets a predetermined number of such blocks. The statistical calculation unit 12 generates displacement intensity block data by calculating the cumulative value for each intensity block.
[0144] The statistics calculation unit 32 has the same structure as the statistics calculation unit 12, and performs the same processing on the motion measurement data as the statistics calculation unit 12. As a result, the statistics calculation unit 32 calculates and outputs motion statistics composed of intensity block data (motion intensity block data) of the motion measurement data.
[0145] The prediction calculation unit 14A uses displacement statistics and motion statistics obtained based on the signal intensity distribution to predict the action state. At this time, the prediction calculation unit 14A uses importance to predict the action state.
[0146] Figure 14 (A) Figure 14 (B) is a table representing a setting example of the importance of the fourth embodiment. Figure 14 (A) indicates the importance of the displacement statistic. Figure 14 (B) indicates the importance of the action statistic. For example... Figure 14 (A) Figure 14 As shown in (B), in the fourth embodiment, for the intensity blocks of the signal intensity distribution, importance is set for each muscle.
[0147] about Figure 14 The importance setting shown in (A), besides the fact that the displacement statistic is the value of the strength block, is related to... Figure 10 The importance setting shown in (A) is the same. Regarding Figure 14 The importance setting shown in (B), besides the fact that the motion statistics are the values of the intensity blocks, is related to... Figure 10 The importance setting shown in (B) is the same. Therefore, detailed explanation is omitted.
[0148] If the estimation calculation unit 14A sets the muscle to be estimated, it uses the importance set according to the muscle to estimate the muscle load state based on multiple displacement statistics (intensity block values) and motion statistics (intensity block values).
[0149] With this structure, similar to the action state estimation device 10A of the third embodiment, the action state estimation device of the fourth embodiment can estimate the muscle load state with high accuracy.
[0150] (Fifth Implementation)
[0151] The action state estimation technique and action state model generation technique of the fifth embodiment of the present invention will be described. Compared with the action state estimation technique shown in the first embodiment, the action state estimation technique of the fifth embodiment differs in that it synchronizes the displacement measurement signal and the muscle activity measurement signal during learning. Other methods of the action state estimation technique of the fifth embodiment are the same as those of the action state estimation technique of the first embodiment, and the description of the same parts is omitted.
[0152] Figure 15 This is a flowchart illustrating the main processes of the action state learning method according to the fifth embodiment of the present invention. For example... Figure 15 As shown, the fifth embodiment of the action state learning method differs from the first embodiment in that it adds synchronization processing. Other processing in the fifth embodiment is the same as in the first embodiment, and descriptions of identical parts are omitted.
[0153] If the action state learning device 20 calculates the statistics and the modeled baseline, it synchronizes the statistics with the modeled baseline. Figure 16 This is a diagram representing the concept of synchronization. For example... Figure 16 As shown, based on the response difference between the displacement detection sensor 101 and the muscle activity detection sensor 102, a time difference Δt is generated between the reference time t0t of the displacement measurement signal and the reference time t0m of the muscle activity measurement signal.
[0154] Therefore, the learning and calculation unit 24 detects the reference time t0t of the displacement measurement signal and the reference time t0m of the muscle activity measurement signal, and detects the time difference Δt by calculating their difference. The learning and calculation unit 24 uses this time difference Δt to synchronize the statistic with the modeled reference value.
[0155] The learning and calculation unit 24 performs learning using synchronized statistics and modeled baseline values to generate an action state model (S41).
[0156] By performing such processing, the action state estimation device 10 is able to estimate the muscle load state with higher accuracy.
[0157] Furthermore, when using displacement measurement signals, motion measurement signals, and muscle activity measurement signals for learning, it is sufficient to synchronize the displacement measurement signals and motion measurement signals with the muscle activity measurement signals during learning.
[0158] Furthermore, the structures and processes of the various embodiments described above can be combined. Moreover, by using these combinations, the action state estimation device and the action state estimation method can achieve higher estimation accuracy. For example, both the statistics obtained through sampling and the statistics obtained by calculating the signal strength distribution can be used (using both statistics).
[0159] Furthermore, the above description illustrates the use of an electromyography (EMG) sensor as the muscle activity detection sensor 102. However, the muscle activity detection sensor 102 can also be other sensors capable of measuring muscle activity, such as MRI.
[0160] Furthermore, the above description indicates the use of inertial sensors such as accelerometers and angular velocity sensors as the motion detection sensor 300. However, the motion detection sensor 300 can also be, for example, a motion sensor or an image sensor.
[0161] Furthermore, the above explanation describes sampling the displacement measurement signal. However, when sampling the motion measurement signal, frequency sampling of the displacement measurement signal is also possible. By sampling the displacement measurement signal as described above, the motion state estimation device can estimate the muscle load state with higher accuracy.
[0162] With this in mind, a piezoelectric sensor is preferred for displacement detection sensor 101. That is, while other sensors such as accelerometers improve accuracy by extracting frequency components, a piezoelectric sensor can make high-precision predictions even without such frequency component extraction.
[0163] Furthermore, the above structure and processing demonstrate how to infer the muscle's load state as a behavioral state. However, it is also possible to infer other behavioral states of the subject that are related to the muscle's load state.
[0164] Furthermore, the above structure and processing describe a method of inferring the action state by directly using displacement and motion statistics obtained through sampling, or by using displacement and motion statistics obtained by calculating the signal strength distribution. However, in the action state inference device and method, the difference (change) and rate of change of each statistic can also be used. Specifically, in the action state inference device and method, the difference (change) and rate of change of adjacent statistics in the time series among multiple statistics arranged in a time series are calculated, and this calculated value is used. Thus, changes in the action state can also be inferred in the action state in the action state inference device and method.
[0165] Furthermore, in the estimation of muscle load status using the aforementioned action state model, the following biological information-related items can be added as input vectors. For example, at least one of the following can be added: the subject's BMI, height, weight, body fat percentage, muscle mass, grip strength (left and right, first time, second time), minimum calf circumference, age group (20, 30, 40, 50, 60 years old), and gender (female, male). This allows for more accurate estimation of muscle load status.
[0166] Explanation of reference numerals in the attached figures
[0167] 10, 10A...Movement state prediction device; 11...Sampling unit; 12...Statistical calculation unit; 13, 13A...Movement state model storage unit; 14, 14A...Prediction calculation unit; 20, 20A...Movement state learning device; 21...Sampling unit; 22...Modeling baseline value calculation unit; 24, 24A...Learning calculation unit; 31...Sampling unit; 32...Statistical calculation unit; 101...Displacement detection sensor; 102...Muscle activity detection sensor; 300...Motion detection sensor.
Claims
1. An action state estimation device, comprising: The first sampling unit samples the displacement signal obtained by converting the displacement caused by the physiological tremors and deformations of the muscles on the surface of the subject into voltage within a specified time, thereby generating displacement measurement data. The first statistic calculation unit calculates a first statistic of the displacement measurement data; The action state model storage unit stores the action state model obtained by establishing a correlation between the first statistic and the muscle load state. as well as The inference calculation unit takes the first statistic as an input vector and uses the action state model to infer the load state. The action state model assigns a significance level to the statistic for each muscle that is the object of the inference of the load state. The importance is used to determine the weighted importance when calculating the final inference result based on multiple load states.
2. The action state prediction device according to claim 1, wherein, The statistical calculation unit calculates the first statistic based on the signal strength distribution, which is obtained by arranging the displacement measurement data in descending order of signal strength.
3. The action state prediction device according to claim 2, wherein, The statistical calculation unit divides the signal intensity distribution into multiple signal intensity blocks and uses the statistical quantity calculated for each signal intensity block as the first statistical quantity.
4. The action state prediction device according to claim 1, wherein, The statistical calculation unit divides the displacement measurement data into blocks according to a predetermined time sequence, and uses the statistical quantity calculated for each block as the first statistical quantity.
5. The action state prediction device according to claim 1, wherein, The action status prediction device also has the following features: The second sampling unit samples the motion measurement signal generated and output by the motion detection sensor detecting the subject's motion within a specified time, and generates motion measurement data. as well as The second statistic calculation unit calculates a second statistic for the motion measurement data. The action state model storage unit stores an action state model obtained by establishing a correlation between the first statistic, the second statistic, and the muscle load state. The inference calculation unit uses the first statistic and the second statistic as input vectors and the action state model to infer the load state.
6. The action state prediction device according to claim 5, wherein, The second statistical calculation unit divides the motion measurement data into multiple blocks and uses the statistical measure calculated for each block as the second statistical measure.
7. The action state prediction device according to claim 5 or 6, wherein, The action state model assigns the importance of the first statistic and the importance of the second statistic to each muscle that is the object of the inference of the load state.
8. The action state prediction device according to claim 7, wherein, The importance of the first statistic and the importance of the second statistic are set using a shared importance value.
9. The action state prediction device according to claim 7, wherein, The importance of the first statistic and the importance of the second statistic are set separately.
10. The action state estimation device according to claim 5 or 6, wherein, The motion measurement signal is a measurement signal of at least one of acceleration and angular velocity.
11. The action state prediction device according to claim 1, wherein, The displacement measurement signal is a signal obtained by voltage transformation of the displacement amount, which includes the effects caused by physiological tremors.
12. The action state prediction device according to claim 1, wherein, The input vector also includes biological information.
13. A method for inferring action state, comprising: The first sampling process involves sampling the displacement signal obtained by converting the displacement of the subject's skin surface caused by physiological tremors and deformations produced by muscles into voltage within a specified time, thereby generating displacement measurement data. First statistic calculation processing: Calculate the first statistic of the displacement measurement data; as well as The inference process uses a behavioral state model derived by establishing a correlation between a first statistic and the muscle load state. The first statistic is used as an input vector to infer the load state. The action state model assigns a significance level to the statistic for each muscle that is the object of the inference of the load state. The importance is used to determine the weighted importance when calculating the final inference result based on multiple load states.
14. The action state prediction method according to claim 13, wherein, This method for inferring the state of action also has the following characteristics: The second sampling process involves sampling the motion measurement signal generated and output by the motion detection sensor detecting the subject's movements within a specified time period to generate motion measurement data. as well as The second statistic calculation process calculates a second statistic for the action measurement data. In the inference operation, an action state model is used to establish a correlation between the first statistic, the second statistic, and the muscle load state. The first statistic and the second statistic are used as input vectors to infer the load state.
15. An action state learning device, comprising: The first sampling unit samples the displacement signal obtained by converting the displacement caused by the physiological tremors and deformations of the muscles on the surface of the subject into voltage within a specified time, thereby generating displacement measurement data. The first statistic calculation unit calculates a first statistic of the displacement measurement data; The third sampling unit samples the muscle activity measurement signal, which is composed of muscle potentials obtained by detecting the muscle activity of the subject, within a specified time, and generates muscle activity measurement data. The modeling baseline calculation unit calculates the modeling baseline value of the action state model based on the muscle activity measurement data. as well as The learning computation unit performs learning using the first statistic and the modeled baseline value to generate the action state model. The action state model assigns a significance level to the statistic for each muscle that is considered as the object of the load state prediction. The importance is used to determine the weighted importance when calculating the final inference result based on multiple load states.
16. The action state learning device according to claim 15, wherein, The learning and computing unit synchronizes the first statistic and the modeling benchmark value to generate the action state model.
17. The action state learning device according to claim 15 or 16, wherein, The action state learning device also features: The second sampling unit samples the motion measurement signal generated and output by the motion detection sensor detecting the subject's motion within a specified time, and generates motion measurement data. as well as The second statistic calculation unit calculates a second statistic for the motion measurement data. The learning and computing unit uses the first statistic, the second statistic, and the modeling baseline value to generate the action state model.
18. The action state learning device according to claim 17, wherein, The learning and computing unit synchronizes the first statistic, the second statistic, and the modeling baseline value to generate the action state model.
19. An action state learning method, having: The first sampling process involves sampling the displacement signal obtained by converting the displacement of the subject's skin surface caused by physiological tremors and deformations produced by muscles into voltage within a specified time, thereby generating displacement measurement data. First statistic calculation processing: Calculate the first statistic of the displacement measurement data; The third sampling process involves sampling the muscle activity measurement signal, which is composed of muscle potentials obtained from detecting the muscle activity of the subject, within a specified time period, and generating muscle activity measurement data. Modeling baseline value calculation processing: Calculate the modeling baseline value of the action state model based on the muscle activity measurement data; as well as The learning computation is performed, using the first statistic and the modeled baseline value, to generate the action state model. The action state model assigns a significance level to the statistic for each muscle that is considered as the object of load state prediction. The importance is used to determine the weighted importance when calculating the final inference result based on multiple load states.
20. The action state learning method according to claim 19, wherein, This action state learning method also has the following characteristics: The second sampling process involves sampling the motion measurement signal generated and output by the motion detection sensor detecting the subject's movements within a specified time period to generate motion measurement data. as well as The second statistic calculation process calculates a second statistic for the action measurement data. The action state model is generated using the first statistic, the second statistic, and the modeling benchmark value in the learning operation process.