Motion analysis method, motion analysis system and service

Abstract

To provide an operation analysis method, an operation analysis system and service, capable of automatically and accurately providing advice toward proficiency of sport, dance or the like.SOLUTION: A motion sensor is attached on a user and a motion of a user is analyzed based on a result of the motion sensor. Information showing the analysis result is displayed and advice toward proficiency of sport, dance or the like is provided automatically and accurately.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a motion analysis method, a motion analysis system, and a service that can automatically and accurately present advice for improving skills such as sports and dancing. [Background technology]

[0002] Conventionally, various motion capture techniques have been proposed for recording the motion of a moving subject (see, for example, Patent Document 1). Furthermore, a technique using a motion sensor has been proposed as an analysis method for improving golf swings (see, for example, Patent Document 2).

[0003] However, conventional methods have had the problem of requiring large-scale equipment, and optical methods cannot measure blind spots that are hidden by the body. Furthermore, with regard to technology using motion sensors, there have not been many methods or systems proposed to date that can automatically and accurately provide advice on how to improve in sports, dance, etc. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2019-88469 [Patent Document 2] Japanese Patent Application Laid-Open No. 2016-140693 Summary of the Invention [Problem to be solved by the invention]

[0005] The present invention has been made in consideration of the above background, and its purpose is to provide a motion analysis method, a motion analysis system, and a service that can automatically and accurately present advice for improving skills in sports, dance, etc. [Means for solving the problem]

[0006] As a result of intensive research into achieving the above-mentioned objectives, the inventors discovered that the desired method and system could be obtained by devising the placement of the motion sensor when attaching it to the user, and after further intensive research they were able to complete the present invention.

[0007] Thus, according to the present invention, there is provided a "motion analysis method comprising attaching a motion sensor to a user or to clothing worn by the user, analyzing the user's movements based on the output of the motion sensor, and displaying information showing the analysis results." In this case, the motion sensors are preferably attached to the user's back, the user's waist, and the user's wrists.

[0008] Furthermore, according to the present invention, there is provided a "motion analysis system characterized by comprising a motion sensor attached to a user or to clothing worn by the user, an analysis means for analyzing the user's movements based on the output of the motion sensor, and a display means for displaying information showing the analysis results by the analysis means."

[0009] In this case, it is preferable that the motion sensors are multiple motion sensors including a motion sensor attached to the user's back, a motion sensor attached to the user's waist, and a motion sensor attached to the user's wrist. It is also preferable that the user's motion stage is determined based on the output of the motion sensor attached to the wrist, and when the user's motion stage is a specific motion stage, the user's posture is determined based on the output of the other motion sensors (the motion sensor attached to the user's back and / or the motion sensor attached to the user's waist). It is also preferable that the display means displays the user's motion stages in a divided manner. It is also preferable that a part of the wristband on which the motion sensor attached to the user's wrist is attached contains a fabric containing ultrafine fibers with a single fiber diameter of 50 to 3000 nm.

[0010] Furthermore, the present invention provides a "service characterized by detecting and analyzing a user's movements using wearable means via clothing, and automatically presenting the user with advice to help them improve." In this case, it is preferable to use the above-mentioned motion analysis method or the above-mentioned motion analysis system. [Effects of the Invention]

[0011] According to the present invention, a motion analysis method, a motion analysis system, and a service are provided that can automatically and accurately present advice for improving skills in sports, dancing, and the like. [Brief explanation of the drawings]

[0012] [Figure 1] 1A and 1B are diagrams illustrating an example in which motion sensors are attached to the back, waist, and wrist of a user in accordance with the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0013] The present invention relates to a method for analyzing the movements of a user (wearer of clothing), a motion analysis system, and a motion analysis service, and uses a motion sensor (hereinafter also referred to as "sensor") to detect the movements. Examples of the motion sensor include, but are not limited to, inertial sensors (including quantum inertial sensors) such as acceleration sensors, gyro sensors, and geomagnetic sensors, optical sensors, mechanical sensors, magnetic sensors, and image sensors. Among these, inertial sensors are preferred. For example, a sensor capable of detecting acceleration in three axes, angular velocity around three axes, and orientation in three axes, such as that described in JP 2019-88469 A, is preferred, but is not limited thereto.

[0014] The motion sensor is attached to at least one selected from the user or clothing worn by the user. Specific examples of attaching the motion sensor include attaching it directly to the user's body and attaching it to clothing worn by the user. When using multiple motion sensors in the present invention, these methods may be combined.

[0015] The wearable device includes clothing as well as body-worn items such as wristbands. In the present invention, when multiple motion sensors are used, they are preferably attached to the wearable device (clothing) worn on the upper body and the wristband (wrist). In this case, as shown in Fig. 1, it is preferable that the wearable device is a vest (vest-type clothing) and that motion sensors are provided at least on the back and waist of the vest (positions corresponding to the user's back and waist) as a form of feedback of the movement of the main axis of the body.

[0016] By combining this configuration with a motion sensor attached to the wristband to analyze the user's movements, it is possible to analyze the movement status of each part of the user's body to which the motion sensor is attached in conjunction with one another, and to accurately determine the user's posture in each movement state.

[0017] The wear may have, for example, an outside-air-side fabric and a skin-side fabric, with a sensor disposed between the outside-air-side fabric and the skin-side fabric. The skin-side fabric may be made of power net. A power net made of nylon fiber and polyurethane fiber with a total fineness of 300 to 800 dtex and 5 to 40 filaments is particularly preferred. A power net having a warp-knit structure is also preferred. The skin-side fabric may have a pocket on the outside-air-side fabric side, with a motion sensor disposed in the pocket. The sensor disposed in the pocket may be fixed within the pocket by a hook-and-loop fastener. The skin-side fabric may have a belt with a buckle. Ultrafine fibers may be used as a non-slip material to more accurately measure body movements.

[0018] It is also preferable that the motion sensor be fixed to the wrist without slipping by a wristband. In particular, it is preferable that a part of the wristband that holds the motion sensor attached to the user's wrist contains a fabric containing ultrafine fibers with a single fiber diameter of 50 to 3000 nm.

[0019] Here, if the wristband includes a hook-and-loop fastener composed of fabric a containing filament yarn A with a single fiber diameter of 1000 nm or less and raised fabric b, as described in JP 2009-285144 A, this not only prevents the sensor from shifting but also prevents it from shifting due to sweat or rain, which is very easy and preferable.

[0020] The user's movements are analyzed based on the output of the motion sensor, and information showing the analysis results is displayed on a display screen. Hereinafter, a golf swing will be used as an example to explain one embodiment of the movement analysis method of the present invention, but the present invention is not limited to the golf swing.

[0021] For example, it is preferable to automatically classify the physical movements of the wearer (user) during a golf swing into swing phases using a motion sensor fixed to the wrist, analyze posture information calculated from multiple motion sensors attached to the wear (preferably motion sensors attached to positions corresponding to the user's back and waist), and automatically present (display) appropriate advice and practice methods for each phase.

[0022] More specifically, it is preferable that the output of a motion sensor attached to a wristband (wrist) is used to automatically divide the swing motion into the phases of setup, backswing, downswing, impact, and follow-through, and that the upper body posture in each phase is quantified based on the output from a motion sensor attached to clothing that is time-synchronized with the wrist sensor, an index for evaluating the golf swing is calculated, and then advice for improving the swing is automatically presented for each phase of the swing.

[0023] Here, it is preferable that a motion sensor worn on the wrist is used for the purpose of automatically dividing the swing motion into each of the above phases. Furthermore, it is preferable to calculate the left and right tilt based on the rotation angle in the X-axis direction, the trunk angle indicating the forward and backward tilt angle based on the rotation direction of the Y-axis, and the rotation based on the rotation angle in the Z-axis direction, using the output from the motion sensor attached to the lower back and the motion sensor attached to the upper back.

[0024] The motion analysis system of the present invention comprises a motion sensor attached to a user or to clothing worn by the user, an analysis means for analyzing the user's motion based on the output of the motion sensor, and a display means for displaying information showing the analysis results by the analysis means.

[0025] In this case, it is preferable that the motion sensors are a plurality of motion sensors including a motion sensor attached to the user's back, a motion sensor attached to the user's waist, and a motion sensor attached to the user's wrist.

[0026] Furthermore, it is further preferable that the motion stage of the user is determined based on the output of the motion sensor attached to the wrist, and when the motion stage of the user is a specific motion stage, the posture of the user is determined based on the output of the other motion sensor. Furthermore, it is preferable that the motion stage of the user is divided into a plurality of motion stages and displayed on the display means.

[0027] In addition to the various features described in the above-mentioned motion analysis method, the motion sensor includes, as a sensor terminal, a detection unit for detecting the rate of change of position or angle, acceleration, etc., and a transmission unit for the data, and may also include a power supply unit, a memory unit, a processing unit, etc. Furthermore, the data output from the sensor terminal is transmitted to an analysis device (processing unit) by a communication means described later, and information indicating the results of the analysis processing is displayed on a display unit.

[0028] The motion analysis system will be further explained below using a golf swing as an example. This motion analysis system includes a motion sensor terminal (including a detector for detecting the rate of change and acceleration of position and angle, and a transmitter for the data, and may also include a power supply, memory, processor, etc.) worn on the user's wrist and creating first time-series data, multiple motion sensor terminals (including detectors for detecting the rate of change and acceleration of position and angle, a processor for creating Nth time-series data (N≧2) of measurement locations, and a transmitter for the data, and may also include a power supply, memory, etc.) fixed to clothing (preferably at positions corresponding to the user's back and waist), and an analysis device connected to the sensor terminal worn on the user's wrist and the multiple motion sensor terminals fixed to the clothing so as to be able to communicate (wirelessly or via wire) with them.

[0029] Here, the analysis device preferably includes a communication unit capable of communicating with the sensor terminal worn on the user's wrist and multiple motion sensor terminals fixed to the clothing, a processing unit that processes automatic classification of the golf swing from the first time series data, classifies the multiple time series data measured by the clothing for each classification, and calculates posture information calculated for each motion sensor and indicators for analyzing the golf swing, a memory unit that stores each indicator calculated by the above processing unit for each motion sensor, a memory unit that stores conditions for automatically classifying the swing phase from the first time series data, a memory unit that stores conditions and text (messages) for displaying advice based on each indicator calculated by the processing unit, a memory unit that stores motion data (model data) to be compared when judging the golf swing, and a display unit (such as a display).

[0030] Furthermore, such an analysis device is preferably a portable electronic device such as a tablet computer, a smartphone, or a mobile terminal. Furthermore, the present invention provides a service that uses wearable means via clothing to detect and analyze a user's movements and automatically provide the user with advice for improvement. In this case, the motion analysis method or system described above makes it possible to automatically and accurately provide advice for improvement in sports, dance, etc. Furthermore, since there is no need to carry multiple cameras or large measuring devices, it is also anticipated that the service will be used on golf courses.

[0031] The services mentioned above include not only motion analysis, but also display of advice for improving sports, dance, etc., audio advice, and even communication of these. It can also be used in a wide range of applications, including choreography and judging in tennis, batting, dance, gymnastics, etc. Of course, it is not limited to sports, but can also be applied to a wide range of applications, such as skilled labor, standardized movements, mastering movements in traditional skills (dance, performance, Noh), rehabilitation, and everyday movements. [Example]

[0032] The present invention will be explained in more detail below by way of examples, but is not limited to these.

[0033] [Example 1] First, a vest body fabric was obtained using a composite yarn made of polyurethane fiber covered with polyester fiber containing an ultraviolet absorber. The vest body fabric was designed to open at the front and had a zipper attached.

[0034] On the other hand, a back panel (skin side fabric) made of nylon fiber power net was obtained. A pocket was attached to the outside air side fabric of this back panel, and a motion sensor (a DSP wireless 9-axis motion sensor manufactured by Teijin Frontier Sensing Co., Ltd.) was placed in the pocket (i.e., the back portion). The sensor was fixed inside the pocket with a hook-and-loop fastener (Fasteno (registered trademark) manufactured by Teijin Frontier Co., Ltd.). In addition, a motion sensor (a DSP wireless 9-axis motion sensor manufactured by Teijin Frontier Sensing Co., Ltd.) was attached to the waist portion of the main fabric of the vest to create a golf vest.

[0035] Meanwhile, a wristband was attached to the left wrist, and a motion sensor (a DSP wireless 9-axis motion sensor manufactured by Teijin Frontier Sensing Co., Ltd.) was fixed using a hook-and-loop fastener.

[0036] Next, using acceleration and angular velocity detected by a motion sensor attached to the left wrist, golf swing phases were divided into five chronological phases (address, take-back, downswing, impact, and follow-through). The subjects performed a golf swing with the motion sensor attached to their wrist, and multiple acceleration and angular velocity data were collected. These data were then combined to determine the conditions and thresholds for classifying swing phases. The swing phases were then automatically classified using the swing rotation direction from the angular velocity of the wrist-mounted motion sensor and the swing velocity component from the acceleration.

[0037] Twenty measurements were performed, and the system successfully classified the swing phase 20 out of 20 times without any false recognition of a swing phase transition. The automatic classification was determined based on the filmed swing video, determining whether there was a deviation of 0.1 seconds or more in the swing phase transition. Furthermore, the body movements were measured using motion sensors fixed to the back and waist of the vest, and the body movements were displayed for each swing phase. The body movements for each swing phase were analyzed, and a judgment was made by comparing them with appropriate posture information (teaching data), and feedback was provided on whether the results were good or bad and on areas for improvement. Feedback was provided via a communication device, with advice displayed for each classification.

[0038] [Comparative Example 1] Using a product that attaches a motion sensor to a golf club, the experiment was carried out in the same manner as in Example 1. As a result, it was not possible to measure the body posture from the movement of the golf club, and it was not possible to accurately present the body movement, which is considered important in the swing.

[0039] Comparative Example 2 A product that performs motion analysis using a camera was used, and the same experiment was carried out as in Example 1. As a result, accurate measurements could not be made due to obstructions during shooting and the shooting angle, and the body movements that are considered important in swinging could not be accurately presented. [Industrial Applicability]

[0040] According to the present invention, a motion analysis method, a motion analysis system and a service are provided that can automatically and accurately present advice for improving skills in sports, dance, etc., and have great industrial value.

Claims

[Claim 1] A motion analysis system comprising a motion sensor attached to a user or to clothing worn by the user, analysis means for analyzing the user's motion based on the output of the motion sensor, and display means for displaying information showing the analysis results by the analysis means, wherein the motion sensors are a plurality of motion sensors including a motion sensor attached to the user's back, a motion sensor attached to the user's waist, and a motion sensor attached to the user's wrist, and the motion sensors are inertial sensors, and a method of using the motion analysis system to detect and analyze the user's motion using wearable means via the clothing and automatically provide the user with advice to improve their game, and determining a motion stage of the user based on an output of the motion sensor attached to the wrist, and when the user's motion stage is a specific motion stage, determining the user's posture based on the output of the other motion sensors, and displaying the posture divided into a plurality of user motion stages on the display means, the motion analysis system includes a wristband for attaching a motion sensor attached to a user's wrist, the wristband including a fabric containing ultrafine fibers having a single fiber diameter of 50 to 3000 nm; the user's motion is a golf swing, A method of using a motion analysis system in which a motion sensor attached to the user's back and a motion sensor attached to the user's wrist are secured by hook-and-loop fasteners.

Images