Motion analysis system, motion analysis method and program

Abstract

A new motion analysis system, a motion analysis method, and a program are provided that are simple in configuration and can easily analyze user motion. [Solution] The motion analysis system disclosed herein includes a control unit that executes a motion analysis process that estimates at least one of the number of times and the intensity of a specific motion of a user based on sensor data acquired by a sensor device attached between the user's shoulder blades.

Description

[Technical Field]

[0001] The present disclosure relates to a motion analysis system, a motion analysis method, and a program. [Background technology]

[0002] BACKGROUND ART Conventionally, a device that is attached to a bat to measure swing speed in order to analyze a baseball swing motion is known (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Registered Utility Model No. 3160720 Summary of the Invention [Problem to be solved by the invention]

[0004] The device in Patent Document 1 can measure the speed and number of practice swings of a bat. However, there are issues with attaching the device to the bat, such as the time and effort required, and the feeling of a swing being different from that of a normal swing.

[0005] Therefore, the present disclosure has been made in consideration of the above-mentioned problems, and its purpose is to provide a new motion analysis system, motion analysis method, and program that can easily analyze user motion with a simple configuration. [Means for solving the problem]

[0006] According to the present disclosure, there is provided a motion analysis system including a control unit that executes a motion analysis process that estimates at least one of the number of times and intensity of a specific motion of a user based on sensor data acquired by a sensor device attached between the user's shoulder blades.

[0007] Furthermore, according to the present disclosure, a motion analysis method is provided in which a control unit of a motion analysis apparatus executes a motion analysis process to estimate at least one of the number of times and the intensity of a specific motion of the user based on sensor data acquired by a sensor device attached between the user's shoulder blades.

[0008] According to the present disclosure, the control unit of the motion analysis device includes: A program is provided that executes a motion analysis process to estimate at least one of the number of times and the intensity of a specific motion of a user based on sensor data acquired by a sensor device attached between the shoulder blades of the user. [Effects of the Invention]

[0009] According to the present disclosure, it is possible to provide a new motion analysis system, a motion analysis method, and a program that are capable of analyzing a user's motion with a simple configuration. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating a configuration example of a motion analysis system according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating a configuration example of a sensor device according to the embodiment. [Figure 3] FIG. 10 is a diagram illustrating a configuration example of a user terminal according to the embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of the configuration of an information processing device according to the embodiment. [Figure 5] FIG. 10 is a flowchart illustrating an example of processing in the motion analysis system according to the embodiment. [Figure 6] FIG. 10 is a flowchart illustrating an example of a motion analysis process according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0012] 1 shows an example configuration of a motion analysis system 1 (hereinafter also referred to as "system") according to an embodiment of the present disclosure. The system 1 of this embodiment includes a sensor device 10, a user terminal 20, and an information processing device 30, but is not limited to these.

[0013] The system 1 of this embodiment includes a control unit that executes a motion analysis process to estimate at least one of the number of times and the intensity of a specific motion of a user based on sensor data acquired by a sensor device 10 attached between the shoulder blades of the user. The control unit may include at least one of the sensor device 10, the user terminal 20, and the information processing device 30 (server device).

[0014] 1, the sensor device 10 is placed on the user's back, particularly between the left and right shoulder blades. In this example, the sensor device 10 is placed between the shoulder blades by the user wearing an upper garment A that holds the sensor device 10 in place.

[0015] As shown in FIG. 2, the sensor device 10 may include, for example, a control unit 11, a storage unit 12, an input unit 13, an output unit 14, a communication unit 15, and a detection unit 16.

[0016] The control unit 11 transfers data between each unit and controls the entire device, and is realized, for example, by a CPU (Central Processing Unit), MPU (Micro Processing Unit), or GPU (Graphics Processing Unit) executing a program stored in a specified memory.

[0017] The memory unit 12 stores various data and programs, and may be a non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), etc., as well as a magnetic disk, flexible disk, optical disk, compact disk, mini disk, DVD (Digital Versatile Disc), etc.

[0018] The input unit 13 is used by users and system administrators to input various data, and is realized by, for example, a touch panel, buttons, a keyboard, a mouse, a microphone, and the like.

[0019] The output unit 14 outputs various information generated by the control unit, etc. The output unit is, for example, a liquid crystal display (LCD), a touch panel, a speaker, etc.

[0020] The communication unit 15 is for communicating with other information processing devices, and functions as a receiving unit that receives various data and signals transmitted from other information processing devices, etc., and as a transmitting unit that transmits various data and signals to other information processing devices, etc., in response to commands from the control unit. The communication unit is realized, for example, by a Network Interface Card (NIC), an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, a Universal Serial Bus (USB) connector or an RS232C connector for serial communication, etc. The communication unit 15 can utilize wireless technologies such as radio, including Bluetooth (registered trademark), Wi-Fi (registered trademark), and ZigBee, as well as wireless technologies such as microwaves, coaxial cables, optical fiber cables, twisted pairs, digital subscriber lines (DSL), infrared rays, etc.

[0021] The detector 16 is not particularly limited as long as it can detect the user's motion, and may include an IMU (Inertial Measurement Unit) that can detect the linear movement (translational movement) of an object, gravitational acceleration, and rotational movement (angular velocity) of an object. The detector 16 can detect, for example, three-axis orientation, three-axis velocity, three-axis acceleration, three-axis angular velocity, rotation velocity, and three-axis position.

[0022] The detection unit 16 may include a GNSS (GPS / GLO / GAL / QZSS / SBAS) that detects location information, or a geomagnetic sensor that can detect direction information. Using data from multiple sensors can improve detection accuracy.

[0023] The sensor device 10 can detect the movement and position of the upper body (trunk) of the user and acquire the detected movement and position as sensor data.

[0024] The sensor device 10 can store the sensor data in the storage unit 12 of the sensor device 10 and transmit the sensor data to the user terminal 20 or the information processing device 30 via the communication unit 15 .

[0025] The sensor device 10 can also perform filtering processing (such as noise removal) on the acquired sensor data, evaluate the sensor data, and edit the data for transmission to an external device.

[0026] The user terminal 20 and the information processing device 30 can receive and display the information transmitted from the sensor device 10.

[0027] The user terminal 20 and the information processing device 30 can store the information transmitted from the sensor device 10 in a memory unit, filter the sensor data (such as noise removal), evaluate the sensor data, and edit it for transmission to an external device.

[0028] 3, the user terminal 20 includes a control unit 21, a storage unit 22, an input unit 23, an output unit 24, and a communication unit 25. The user terminal 20 is a computer operated by a user for inputting and outputting various information, and is configured, for example, as a smartphone, a tablet computer, or a personal computer. The user can access the information processing device 30, for example, by an application or a web browser executed on each terminal.

[0029] 4, the information processing device 30 includes a control unit 31, a storage unit 32, an input unit 33, an output unit 34, and a communication unit 35. The information processing device 30 is a computer (server) used by a user or an administrator to input and output various types of information, and is configured, for example, by a personal computer.

[0030] When the user terminal 20 or the information processing device 30 receives various commands (requests) via an input unit or a communication unit, the control unit executes processing according to a program, and the processing results of the program (e.g., images, sounds, etc.) are sent to an output unit or another information processing device, etc. Alternatively, the user terminal 20 or the information processing device 30 receives various commands (requests) from another information processing device, etc. via a communication unit, and the processing results of the program executed by the control unit are sent to the other information processing device, etc. Note that part of the program may be sent to the other information processing device and executed on the other information processing device. In this case, the other information processing device may be, for example, a smartphone, a mobile phone terminal, a tablet terminal, a personal computer, etc., and is connected to the user terminal 20 or the information processing device 30 wirelessly or via a wire via a network such as the Internet.

[0031] User data, measurement data, analysis data, condition data, etc. are stored in the storage unit of the user terminal 20 or the information processing device 30. The user data may include identification information such as a user ID, name, age, sex, physical information (height, weight, etc.), type of sport (baseball, soccer, rugby, etc.), position (pitcher, catcher, etc.), etc.

[0032] The measurement data and analysis data are stored in association with each user. The measurement data is data acquired by the sensor device 10, and the analysis data may include data generated based on the sensor data. The data generated based on the sensor data may include data after filtering processing, data evaluated (determined) based on a threshold (number of times, intensity, time series records, etc.), output data, etc.

[0033] The condition data is data indicating conditions for the motion analysis, such as filtering conditions and evaluation conditions (determination conditions).

[0034] 5 shows an example of the flow of information processing in this embodiment. In this system 1, the control unit executes a process (S1) of acquiring sensor data from the sensor device 10, a process (S2) of analyzing the user's behavior based on the sensor data, and a process (S3) of outputting data of the analysis results.

[0035] As shown in FIG. 1, the user performs a start operation (turns on the switch) before wearing (or while wearing) the sensor device 10, and performs a predetermined action while wearing it. The sensor device 10 may continue to acquire data continuously (continuously) until a stop operation is performed. The user's action may be, for example, a baseball batting motion (swinging motion) or pitching motion, or other action involving rotation or movement of the upper body (trunk). The other action may include, for example, golf (swinging), volleyball (spiking / serving), rugby (tackling / kicking), and soccer (shooting motion).

[0036] When the detection unit provided in the sensor device 10 detects a user's motion, the control unit 11 acquires the sensor data (S1). The sensor data is information that numerically indicates, for example, position, orientation, three-axis velocity, three-axis acceleration, three-axis angular velocity, etc. In the motion analysis process (S2), the control unit may determine that a predetermined motion has occurred when, for example, the change in the value of each sensor data from the start of measurement exceeds a predetermined value (threshold), or when the change in each value per predetermined period exceeds a predetermined value (threshold). Furthermore, the determination process may be performed using two or more types of sensor data. Specifically, the predetermined motion may be determined to have occurred when the change in orientation per predetermined period is equal to or greater than a specific value and the change in angular acceleration is equal to or greater than a specific value, or three or more types of values ​​may be used. In this way, the control unit can estimate the number of predetermined motions. Furthermore, the intensity of the motion can be estimated based on the magnitude (absolute value) of the numerical value at the time of the predetermined motion. The intensity may be expressed as the highest value of the sensor data (the highest value within the range of sensor data representing one specified action), or as a value (score) calculated by applying a predetermined mathematical formula to the highest value, or as a stepped value or letter obtained by comparing the highest value with a threshold value of 1 or more.

[0037] In this example, for example, it may be determined that a baseball batting motion (swinging motion) has been performed when the difference in direction from the initial state is equal to or greater than a predetermined value (or when the time during which the difference is equal to or greater than the predetermined value is equal to or greater than a specific period of time). If this continues for a certain period of time, it is possible to measure how many times the user has performed a baseball swing motion. It is also possible to determine the intensity of the motion using angular velocity information. For example, an angular velocity less than a first threshold value may be determined as "weak," one that is equal to or greater than the first threshold value but less than a second threshold value as "medium," and one that is equal to or greater than the second threshold value as "strong." The number of stages is not limited to three, and may be two or four or more. Information on such determination conditions is stored in a storage unit in advance, with information on the type of sensor data and threshold value associated with information on the type of motion and intensity.

[0038] The motion analysis process may be executed by a control unit of at least one of the sensor device 10, the user terminal 20, and the information processing device 30, but may also be executed by more than one. For example, a simple motion analysis such as detection of the number of times or intensity may be executed by the sensor device 10 or the user terminal 20, and a detailed analysis over a long period of time may be executed by the information processing device 30. The results of the motion analysis process (S2) may be transmitted to at least one of the sensor device 10, the user terminal 20, and the information processing device 30, and may be displayed on a monitor or touch panel of one of them, or output as audio from a speaker (S3).

[0039] The sensor device 10 transmits the sensor data to the user terminal 20 or the information processing device 30 either directly or after filtering or determining the intensity based on a threshold value.

[0040] In this embodiment, the motion analysis process may include a sensor data filtering process (S21), a level determination process (S22), and a storage process in a storage unit (S23), as shown in Fig. 5. The order of these processes can be changed as appropriate.

[0041] The filtering process of the sensor data (S21) may include, for example, noise removal using a low-pass filter. This allows, for example, noise removal using a low-pass filter to be performed, thereby improving the accuracy of motion detection.

[0042] The level determination process (S22) may be performed in two stages (such as "weak" and "strong") depending on whether the values ​​of the direction, acceleration, angular velocity, etc. are less than or equal to a threshold value.

[0043] In the storage process (S23), the sensor data before processing, the data after processing, etc. may be stored in a storage unit of the user terminal 20 or the information processing device 30.

[0044] In this embodiment, the user may specify the type of motion before performing the motion. For example, the control unit 21 of the user terminal 20 may display options for types of motion (batting motion, pitching motion, etc.) on the touch panel of the user terminal 20, accept the user's selection operation, and store it in the storage unit. Then, depending on the type of motion selected by the user, the control unit may refer to the judgment condition information (including threshold information) in the storage unit and determine the number of times and intensity of the motion based on the sensor data corresponding to the user's motion.

[0045] As described above, this embodiment includes a control unit that executes a motion analysis process to estimate at least one of the number of times and the intensity of a specific motion of a user based on sensor data acquired by a sensor device attached between the user's shoulder blades. This makes it possible to analyze the user's motion with a simple configuration.

[0046] In this embodiment, the motion analysis process may include noise removal processing using a low-pass filter, which can improve the accuracy of motion detection.

[0047] In this embodiment, the motion analysis process may include a process of evaluating the intensity of the specific motion in stages by comparing the sensor data with a predetermined threshold value. This allows the output of evaluated information in addition to the sensor data itself, thereby improving user convenience.

[0048] In this embodiment, an output process may be further executed to transmit analysis data estimated by the motion analysis process to a user terminal and display the analysis data. The analysis data may be information such as the type, number, and intensity of the above motions. This can improve the convenience of the user who uses the user terminal.

[0049] In this embodiment, the process from acquiring sensor data by the sensor device to the motion analysis process may be performed substantially in real time, allowing the motion analysis results to be checked immediately.

[0050] In this embodiment, the specific motion may include a batting motion in baseball. The batting motion includes a pivoting (rotating) motion of the upper body, and the sensor device 10 placed between the shoulder blades also pivots in accordance with the movement of the upper body.

[0051] In this embodiment, the specific motion may include a pitching motion in baseball. A pitching motion involves a rotation (turning) motion of the upper body, and the change in direction is greater than in a batting motion. The sensor device 10, which is placed between the shoulder blades, also rotates in accordance with the movement of the upper body.

[0052] In this embodiment, the sensor data may include rotation speed, may include angular velocity, and may include data such as orientation and acceleration.

[0053] In this embodiment, a storage process may be performed in which at least one of the analysis data estimated by the motion analysis process and the sensor data is stored as accumulated information in a storage unit, and time-series analysis information may be output based on the accumulated information stored in the storage unit over a predetermined period. For example, by performing a predetermined motion every day and accumulating sensor data over a long period, such as one month, a record of the motion over one month may be displayed as time-series numerical data, a table, a time-series graph (such as a wave line graph or a bar graph), or the like. This allows for long-term records and changes over time to be confirmed.

[0054] In this embodiment, the motion analysis process may be, for example, as follows.

[0055] First, as sensor data, three-axis data (acceleration (X, Y, Z), angular velocity (X, Y, Z)) is acquired at a sampling rate of 100 times per second (100Hz).

[0056] Then, the vector data is converted into scalar data. For example, the value of each axis is converted into the magnitude (norm) of the vector. This allows it to be treated as strength data that is independent of direction.

[0057] A low-pass filter is then applied to remove high-frequency noise and smooth the signal, preventing false positives and capturing only meaningful changes.

[0058] Then, downsampling (100Hz → 10Hz) may be performed to obtain data, for example, once every 0.1 seconds, which can reduce the calculation load.

[0059] Thereafter, an event is determined to have been detected if the angular velocity starts below a predetermined threshold, exceeds a first specific value within 0.X seconds (predetermined time), and then reaches a peak and then suddenly drops to a second specific value within 0.X seconds. In this way, an event is counted only when multiple conditions (three in this example) are met. If the conditions are not met along the way, it is not counted as an event. If an event is detected, the maximum angular velocity and maximum acceleration are recorded. These maximum angular velocity and maximum acceleration can be treated as intensity data.

[0060] Although the preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical idea described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0061] The devices described in this specification may be realized as a single device, or may be realized by multiple devices (e.g., cloud servers) some or all of which are connected via a network. For example, the control unit and storage of a server may be realized by different servers connected to each other via a network.

[0062] The series of processes performed by the device described herein may be implemented using software, hardware, or a combination of software and hardware. A computer program for implementing each function of the server according to this embodiment may be created and installed on a PC or the like. A computer-readable recording medium storing such a computer program may also be provided. Examples of the recording medium include a magnetic disk, an optical disk, a magneto-optical disk, and a flash memory. The computer program may also be distributed, for example, via a network, without using a recording medium.

[0063] Furthermore, the processes described herein using flowchart diagrams do not necessarily have to be performed in the order shown. Some process steps may be performed in parallel. Additional process steps may be employed, and some process steps may be omitted.

[0064] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that will be apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects.

[0065] The following configurations also fall within the technical scope of the present disclosure. (Item 1) A motion analysis system comprising a control unit that executes a motion analysis process that estimates at least one of the number of times and the intensity of a specific motion of a user based on sensor data acquired by a sensor device attached between the user's shoulder blades. (Item 2) 2. The motion analysis system according to item 1, wherein the motion analysis process includes noise removal processing using a low-pass filter. (Item 3) 2. The motion analysis system according to item 1, wherein the motion analysis process includes a process of evaluating the strength of the specific motion in stages by comparing a predetermined threshold value with the sensor data. (Item 4) The motion analysis system according to item 1 further executes an output process for transmitting analysis data estimated by the motion analysis process to a user terminal and displaying the analysis data. (Item 5) 2. The motion analysis system according to item 1, wherein operations from acquisition of sensor data by the sensor device to the motion analysis processing are performed substantially in real time. (Item 6) Item 2. The motion analysis system according to item 1, wherein the specific motion includes a baseball batting motion. (Item 7) Item 2. The motion analysis system according to item 1, wherein the specific motion includes a baseball pitching motion. (Item 8) 2. The motion analysis system according to item 1, wherein the sensor data includes rotational velocity. (Item 9) Item 2. The motion analysis system of item 1, wherein the sensor data includes angular velocity. (Item 10) a storage process of storing at least one of the analysis data estimated by the motion analysis process and the sensor data in a storage unit as accumulated information; 2. The motion analysis system according to item 1, which outputs time-series analysis information based on the accumulated information accumulated in the storage unit over a predetermined period of time. (Item 11) A motion analysis method in which a control unit of a motion analysis device executes a motion analysis process to estimate at least one of the number of times and the intensity of a specific motion of the user based on sensor data acquired by a sensor device attached between the user's shoulder blades. (Item 12) The control unit of the motion analysis device A program that executes a motion analysis process that estimates at least one of the number of times and the intensity of a specific motion of a user based on sensor data acquired by a sensor device attached between the user's shoulder blades. [Explanation of symbols]

[0066] 1. Motion analysis system 10 Sensor Devices 20 User terminal 30 Information processing equipment

Claims

1. a control unit that executes a motion analysis process to estimate the number and intensity of specific motions of the user based on sensor data acquired by a sensor device attached between the shoulder blades of the user; the motion analysis process includes a process of determining that the specific motion has been performed when angular velocity data as the sensor data satisfies a predetermined condition, and a process of counting the number of times the specific motion has been performed; A motion analysis system, wherein the specific motion includes a baseball batting motion or a pitching motion.

2. The motion analysis system according to claim 1 , wherein the motion analysis process includes a noise removal process using a low-pass filter.

3. The motion analysis system according to claim 1 , wherein the motion analysis process includes a process of evaluating the strength of the specific motion in stages by comparing the sensor data with a predetermined threshold value.

4. The motion analysis system according to claim 1 , further comprising an output process for transmitting analysis data estimated by the motion analysis process to a user terminal and displaying the analysis data on the user terminal.

5. The motion analysis system according to claim 1 , wherein processes from acquisition of sensor data by the sensor device to the motion analysis process are performed substantially in real time.

6. A motion analysis system as described in Claim 2, wherein the noise removal process is performed by the control unit within the sensor device.

7. A motion analysis system as described in Claim 3, wherein the evaluation process is performed by the control unit within the sensor device.

8. The motion analysis system of claim 1 , wherein the sensor data includes rotational velocity.

9. the sensor data includes orientation information; The motion analysis system according to claim 1 , wherein the motion analysis process further determines whether the specific motion has been performed based on information about the direction.

10. a storage process of storing at least one of the analysis data estimated by the motion analysis process and the sensor data in a storage unit as accumulated information; The motion analysis system according to claim 1 , wherein the system outputs time-series analysis information based on the accumulated information accumulated in the storage unit over a predetermined period of time.

11. a control unit of the motion analysis device executes a motion analysis process to estimate the number and intensity of a specific motion of the user based on sensor data acquired by a sensor device attached between the shoulder blades of the user; the motion analysis process includes a process of determining that the specific motion has been performed when angular velocity data as the sensor data satisfies a predetermined condition, and a process of counting the number of times the specific motion has been performed; A motion analysis method, wherein the specific motion includes a baseball batting motion or a pitching motion.

12. The control unit of the motion analysis device executes a motion analysis process for estimating the number and intensity of specific motions of the user based on sensor data acquired by a sensor device attached between the shoulder blades of the user; the motion analysis process includes a process of determining that the specific motion has been performed when angular velocity data as the sensor data satisfies a predetermined condition, and a process of counting the number of times the specific motion has been performed; The specific motion includes a baseball batting motion or a baseball pitching motion.

Images