Warm-up exercises evaluation device, warm-up exercises evaluation method, and warm-up exercises evaluation program

The warm-up exercise evaluation device objectively assesses individual movements against a model, using machine learning to generate comparison standard data, improving the evaluation of warm-up exercises and health management.

JP7596245B2Active Publication Date: 2024-12-09TOBISHIMA CONSTRUCT
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021164574
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-10-06
Publication Date
2024-12-09
Estimated Expiration
2041-10-06

AI Technical Summary

Technical Problem

Existing methods for evaluating warm-up exercises rely on human judgment, which is subjective and inefficient, and fail to detect abnormalities in individual movements compared to a model.

Method used

A warm-up exercise evaluation device and method that uses a storage unit, model video playback, body motion acquisition, and scoring to objectively assess the degree of coincidence between an individual's movements and a model, utilizing machine learning to generate comparison standard data for physical condition evaluation.

Benefits of technology

Enables objective evaluation of warm-up exercises, confirming the quality of movements and physical condition, facilitating health management by linking personal authentication and exercise data to collect insights on physical and mental health.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007596245000001
    Figure 0007596245000001
  • Figure 0007596245000002
    Figure 0007596245000002
  • Figure 0007596245000003
    Figure 0007596245000003
Patent Text Reader

Abstract

To provide a warming-up exercise evaluation device, a warming-up exercise evaluation method and a warming-up exercise evaluation program which support body condition management of an evaluation object person who performs a warming-up exercise.SOLUTION: A warming-up exercise evaluation device reproduces and displays moving image data of a warming-up exercise, acquires a body motion image of an evaluation object person who performs the warming-up exercise according to an example moving image, recognizes a position of each portion of the body of the evaluation object person in time series, compares comparison reference data previously set for a plurality of reproduction positions in the example moving image data with position data of each portion of the body of the evaluation object person recognized in time series corresponding to the plurality of reproduction positions to calculate the matching degree, and grades the body motion of the evaluation object person by totalizing the matching degrees to display a score as an exercise evaluation point. The comparison reference data are the position data of each portion of the body of a model performer at a specific reproduction position of the example moving image data. A body motion grading part stores the exercise evaluation point of the evaluation object person as learning data for setting the comparison reference data for body condition evaluation of the individual evaluation object person.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a warm-up exercises evaluation device, a warm-up exercises evaluation method, and a warm-up exercises evaluation program, and in particular to a warm-up exercises evaluation device, a warm-up exercises evaluation method, and a warm-up exercises evaluation program that support the physical condition management of a person to be evaluated based on images of the person's exercise movements. [Background technology]

[0002] At construction and transportation sites, workers do warm-up exercises before starting work to loosen up their bodies and prevent accidents and injuries, as well as to manage their physical condition. Supervisors and managers at the workplace can see whether their subordinates are feeling unwell or are under psychological stress by observing their warm-up exercises, and if they are concerned, they can speak up to prevent trouble from occurring.

[0003] However, the judgment by a human being as to whether there is anything of concern in the movements of the warm-up exercises performed by the workers is based on intuition, and does not necessarily detect abnormalities. It is also not realistic for a supervisor to simultaneously observe the movements of all the workers performing the exercises and discover abnormalities. Therefore, an evaluation method that does not depend on a human being is required.

[0004] As a method for evaluating a person's body movements by comparing them with model movements, for example, Patent Document 1 proposes a technology for detecting a user's golf swing with a motion sensor such as an angular velocity sensor mounted in the housing of a mobile terminal device. Also, Patent Document 2 proposes a technology that enables a practitioner to judge for himself or herself whether or not he or she is able to properly imitate the movements of a model skilled person.

[0005] These technologies only measure the difference from a model movement, and have the problem that they are not capable of detecting abnormalities in the normal movements of an individual who is exercising while referring to a model. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2010-68947 A [Patent Document 2] JP 2014-57800 A Summary of the Invention [Problem to be solved by the invention]

[0007] The present invention has been made in consideration of the above-mentioned problems in the conventional art, and an object of the present invention is to provide a warm-up exercises evaluation device, a warm-up exercises evaluation method, and a warm-up exercises evaluation program that support the physical condition management of an individual to be evaluated who performs warm-up exercises according to a model video. [Means for solving the problem]

[0008] In order to achieve the above object, one aspect of the present invention provides a warm-up exercises evaluation device that supports physical condition management of an evaluation subject who performs warm-up exercises in accordance with a model video, and includes a storage unit that stores video data of the warm-up exercises performed by a model performer as model video data, a model video playback unit that plays back the model video data and displays it on a predetermined display means, a body movement acquisition unit that acquires, via a predetermined imaging means, body movement images of the evaluation subject who performs the warm-up exercises in accordance with the displayed model video and recognizes the positions of each part of the body of the evaluation subject in time series from the acquired body movement images, comparison reference data that is set in advance for a plurality of playback positions in the model video data, and the time-series recognized body movement images of the evaluation subject corresponding to the plurality of playback positions. the physical movement judging unit compares the exercise evaluation score of the subject with the position data of each body part to calculate the degree of agreement; a physical movement scoring unit tallying up the calculated degrees of agreement, scoring the physical movements of the subject to be evaluated, and displaying the scoring result on the specified display means as an exercise evaluation score; and a control unit which operates the model video playback unit, the physical movement acquisition unit, the physical movement judging unit, and the physical movement scoring unit, and controls the warm-up exercises evaluation device as a whole, wherein the comparison reference data is position data of each body part of the model performer at a specific playback position of the model video data, and the physical movement scoring unit stores the exercise evaluation score of the subject to be evaluated in the memory unit as learning data for setting comparison reference data for evaluating the subject's personal physical condition.

[0009] The physical movement scoring unit may store in the memory unit the position data of each part of the subject's body at the multiple playback positions used in the scoring, together with the subject's exercise evaluation score, as learning data for setting comparison standard data for evaluating the subject's individual physical condition. The warm-up exercises evaluation device further includes an evaluation standard data generation unit that generates comparison standard data for evaluating the physical condition of the individual person to be evaluated, wherein the evaluation standard data generation unit uses the learning data and exercise evaluation scores stored in the memory unit to calculate standard positions of each part of the person to be evaluated at each of the multiple playback positions through machine learning and generates comparison standard data for evaluating the physical condition of the individual person to be evaluated based on the calculated standard positions of each part of the body, the physical movement determination unit compares the position data of each part of the person to be evaluated recognized by the physical movement acquisition unit with the comparison standard data for evaluating the physical condition of the individual person to be evaluated to calculate a degree of agreement, and the physical movement scoring unit causes the scoring result using the comparison standard data for evaluating the physical condition of the individual person to be evaluated to be displayed on the specified display means as a physical condition evaluation score.

[0010] A method for evaluating warm-up exercises according to one aspect of the present invention that has been made to achieve the above-mentioned object is a method for evaluating warm-up exercises that supports physical condition management of an evaluation subject who performs warm-up exercises in accordance with a model video, the method including: a storage unit that stores video data of the warm-up exercises performed by a model performer as model video data; a model video playback unit that plays back the model video data and displays it on a predetermined display means; and a body movement acquisition unit that acquires body movement images of the evaluation subject who performs the warm-up exercises in accordance with the displayed model video and recognizes the positions of each part of the body of the evaluation subject in chronological order from the acquired body movement images. a body movement judging section which compares comparison reference data previously set for a plurality of playback positions in the model video data with position data of each part of the body of the person to be evaluated which is recognized in the time series corresponding to the plurality of playback positions, and calculates a degree of agreement; a body movement scoring section which tallies up the calculated degrees of agreement, scores the body movements of the person to be evaluated, and causes the scoring result to be displayed on the predetermined display means as an exercises evaluation score; and a control section which controls the above sections and the device as a whole, and a step of playing back model video data and displaying it on the predetermined display means; a step of having the body movement acquisition unit acquire body movement images of the person to be evaluated performing the warm-up exercises in accordance with the displayed model video and recognize the positions of each part of the body of the person to be evaluated in time series from the acquired body movement images; and a step of having the body movement determination unit compare comparison reference data previously set for a plurality of playback positions in the model video data with the position data of each part of the body of the person to be evaluated recognized in time series corresponding to the plurality of playback positions, respectively, to calculate a degree of agreement. the step of causing the physical movement scoring unit to calculate the degree of agreement and score the physical movement of the person to be evaluated, and the step of causing the physical movement scoring unit to add up the calculated degrees of agreement and score the physical movement of the person to be evaluated, and displaying the scoring result on the display means as an exercises evaluation score, wherein the comparison reference data is position data of each part of the body of the model performer at a specific playback position of the model video data, and the control unit further includes a step of causing the physical movement scoring unit to store the exercises evaluation score of the person to be evaluated in the memory unit as learning data for setting comparison reference data for evaluating the physical condition of the person to be evaluated.

[0011] The present invention provides a warm-up exercises evaluation program that has been devised to achieve the above object, comprising: a storage unit that stores video data of the warm-up exercises performed by a model performer as model video data; a model video playback unit that plays back the model video data and displays it on a predetermined display means; a body movement acquisition unit that acquires, via a predetermined imaging means, body movement images of a subject performing the warm-up exercises in accordance with the displayed model video and recognizes the position of each part of the subject's body in time series from the acquired body movement images; a body movement judging section for comparing the comparison reference data set for the warm-up exercises with the position data of each part of the body of the person to be evaluated that is recognized in the time series corresponding to the plurality of playback positions, and calculating a degree of agreement; a body movement scoring section for tallying up the calculated degrees of agreement, scoring the body movements of the person to be evaluated, and displaying the scoring result on the predetermined display means as an exercise evaluation score; and a control section for controlling the above sections and the entire device. a step of causing the physical movement acquisition unit to acquire physical movement images of the person to be evaluated performing the warm-up exercises in accordance with the displayed model video and to recognize the positions of each part of the body of the person to be evaluated in time with the acquired physical movement images; a step of causing the physical movement judging unit to compare comparison reference data that is set in advance for a plurality of playback positions in the model video data with the position data of each part of the body of the person to be evaluated that corresponds to the playback positions and recognizes the degree of agreement; a step of causing the physical movement scoring unit to tally up the calculated degrees of agreement and score the physical movements of the person to be evaluated and display the scoring result on the display means as an exercises evaluation score; and a step of causing the physical movement scoring unit to store the exercises evaluation score of the person to be evaluated in the memory unit as learning data for setting comparison reference data for evaluating the physical condition of the person to be evaluated. Effect of the Invention

[0012] According to the present invention, the physical condition of the person to be evaluated can be confirmed based on the change in the evaluation score given by the warm-up exercises evaluation device. The supervisor can use the evaluation score to confirm that the warm-up exercises are being performed and that the exercises being performed are the same as the usual ones. This can also be used for warm-up exercises performed remotely. In addition, by collecting personal authentication in association with evaluation data on warm-up exercises, it is possible to obtain health management data such as the fact that people who receive high evaluations for their warm-up exercises are healthy both physically and mentally, less likely to get injured, and less likely to develop injuries. [Brief description of the drawings]

[0013] [Figure 1] 1 is a block diagram showing a configuration of a warm-up exercises evaluation device according to one embodiment of the present invention. [Diagram 2] FIG. 11 is a diagram showing an example of position data of a body part recognized by modeling the body part according to the present embodiment. [Diagram 3] 4 is a flowchart showing the operation of the warm-up exercises evaluation device according to one embodiment of the present invention. [Figure 4] 1A to 1C are diagrams showing example images corresponding to a series of actions included in the model video data. [Diagram 5] FIG. 13 shows a data sequence of modeled body movements of an evaluation subject synchronized with an example video. [Figure 6] 10 is a flowchart showing the operation of performing a physical condition evaluation for each evaluation subject by the warm-up exercises evaluation device according to one embodiment of the present invention. [Figure 7] FIG. 13 is a diagram showing an example of learning data used to generate comparison reference data for evaluating a physical condition. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, specific examples of the embodiments of the present invention will be described in detail with reference to the drawings.

[0015] FIG. 1 is a block diagram showing the configuration of a warm-up exercises evaluation device according to an embodiment of the present invention. As shown in FIG. 1, the warm-up exercises evaluation device 10 according to an embodiment of the present invention includes a control unit 11 having a central processing unit (CPU), ROM, RAM, etc. (not shown) and executing a predetermined program to perform various data processing and control the system, a storage unit 12 storing various programs and data, a display unit 13 consisting of a liquid crystal display or an organic EL display, etc., an input unit 14 receiving user commands and input data from the outside, an imaging unit 15 consisting of a camera, an output unit 16 serving as an interface for outputting data to the outside, and a communication unit 17. The warm-up exercises evaluation device 10 may be composed of a computer, a smartphone, a tablet terminal, or other mobile information terminal equipped with the above-mentioned components.

[0016] The warm-up exercises evaluation device 10 includes a model video playback unit 111, a body movement acquisition unit 113, a body movement judgment unit 115, a body movement scoring unit 117, and an evaluation criteria data generation unit 119 that function when the control unit 11 reads and executes an OS (Operating System), a warm-up exercises evaluation program, and various data stored in a ROM, RAM, or memory unit 12.

[0017] The model video reproducing unit 111 reproduces model video data of a model performer performing choreography to the music of Radio Calisthenics (registered trademark) as a warm-up exercise, for example, and displays it on the display unit 13. The model video data is data that defines body movements to the music, and is stored in advance in the storage unit 12 in a predetermined video file format in which the music and the model image are combined. Examples of video file formats include, but are not limited to, AVI, MPEG2, MP4, etc.

[0018] The body motion acquisition unit 113 recognizes the position of each part of the body in time series from the image of the evaluation subject captured by the imaging unit 15, and recognizes the relative positions of other parts based on the center of gravity of the body. This makes it possible to perform scoring that is less affected by the shooting position, the height difference of the evaluation subject, and the difference in physique. At this time, the body motion acquisition unit 113 may recognize the body parts by modeling them. As a body model, a model in which the positions of the main joints are estimated and the body parts are classified may be used. For this reason, for example, motion capture can be easily performed by using "YOLO v3" as an algorithm for detecting people in an image and applying "PoseNet" that can measure the positions of each part of a person's face and body in real time. By using such a technology, the movement of the body model (skeletal model) corresponding to the gymnastics movement of the evaluation subject can be obtained in real time. Note that this embodiment does not require the use of YOLO and PoseNet, and other motion capture technologies may be used.

[0019] 2 is a diagram showing an example of position data of body parts recognized by modeling body parts according to this embodiment. In this embodiment, the body part acquisition unit 113 classifies and recognizes body parts into 17 parts.<Table.1> As shown in FIG. 1, in this embodiment, the position data of the modeled body parts is composed of the body part and its position information on the X, Y, and Z coordinates (the center of gravity of the body is the origin) for each row number (ID).

[0020] The body movement determination unit 115 chronologically compares the positions of each body part acquired by the body movement acquisition unit 113 with "data specifying model reference movements (hereinafter referred to as comparison reference data)" previously stored in the storage unit 12, and determines the degree of agreement between them. The comparison reference data is data that specifies the positional relationship between the body's center of gravity and a part (predetermined part) that has a model pose for a model performer's pose (called a model pose) at a specific playback position (called a judgment point) selected from a series of movements included in the model video data, and is set by selecting multiple points in time (playback positions) from the entire model video data. The body movement determination section 115 determines the degree of match by comparing the comparison reference data with the positions of the body parts recognized by the body movement acquisition section 113. Details of the method of determining the degree of match will be described later with reference to Fig. 4. Note that the determination of the degree of match is not limited to the method based on the comparison of positional relationships, and a method of calculation based on the tendency (feature amount) of the position data of each body part using machine learning or deep learning may also be applied.

[0021] The body movement scoring unit 117 receives the judgment result of the degree of coincidence at each judgment point from the body movement judging unit 115, counts up the degrees of coincidence at each judgment point, and scores the body movement (gymnastics movement) of the person to be evaluated that corresponds to the model video. For example, the scoring is performed by accumulating the degrees of coincidence at each judgment point or calculating the average value. The body movement scoring unit 117 displays the scoring results as an exercise evaluation score on the display unit 13, and stores in the memory unit 12 the position data of each part of the body of the person being evaluated at each judgment point in association with an identifier (e.g., a user registration number) assigned to the person being evaluated.

[0022] The evaluation reference data generating unit 119 uses the position data of each part of the body of the person to be evaluated at each judgment point set in the model video of the warm-up exercises, which is stored in the memory unit 12 by the body movement scoring unit 117, as learning data to generate comparison reference data for physical condition evaluation for each person to be evaluated by machine learning or deep learning. A method for generating comparison reference data for physical condition evaluation will be described in detail later.

[0023] Hereinafter, the operation of the warm-up exercises evaluation device according to one embodiment of the present invention will be described with reference to Figs.

[0024] FIG. 3 is a flowchart showing the operation of the warm-up exercises evaluation device according to one embodiment of the present invention.

[0025] In step S201 of Fig. 3, the model video playback unit 111 plays a model video of warm-up exercises to be viewed by the person to be evaluated. The person to be evaluated performs corresponding body movements in accordance with the model movements (choreography) while referring to the model video. The model video is composed of images in which the body movements to be performed by the person to be evaluated move in sync with music.

[0026] In synchronization with the start of playback of the model video, the body movement acquisition unit 113 acquires image data of the body movement of the person to be evaluated from the imaging unit 15 (step S203). The acquired image data of the body movement is acquired by the body movement acquisition unit 113 as, for example, motion capture data of a skeletal model. The acquired data is hereinafter referred to as body movement data. The above-mentioned "YOLO" and "PoseNet" can be used as a technique for acquiring motion capture data. Note that the means for acquiring the body movement data in this embodiment is not limited to this.

[0027] In step S205, body movement determination unit 115 compares the model animation data with the acquired body movement data. In this comparison, the acquired body movement data is compared with comparison reference data of a model pose at a determination point set in advance in the model animation data to determine the degree of agreement.

[0028] In step S207, the body motion scoring unit 117 counts the degree of coincidence at each judgment point and scores the body motion of the person to be evaluated. The body motion scoring unit 117 can score at any time even during the video playback, and can display the scoring result on the display unit 13.

[0029] In step S209, the body movement scoring unit 117 stores the position data of each part of the body of the person to be evaluated at each judgment point in the storage unit 12 in association with the identifier given to the person to be evaluated. When storing the data, an index or a serial number may be further added to distinguish between data of warm-up exercises performed in the past and data of the warm-up exercises performed this time.

[0030] Next, a description will be given of the model poses set by the warm-up exercises evaluation device according to one embodiment of the present invention.

[0031] FIG. 4 is a diagram showing an example of images corresponding to a series of movements of warm-up exercises included in the model video data.

[0032] The playback position counter axis 310 shown in FIG. 4 is a time axis for identifying the playback position during video playback, and the numbers displayed above the playback position counter axis 310 indicate frame numbers 320 from the beginning (start) of the video being played.

[0033] The model poses (330a, 330b) are poses corresponding to specific movements of interest, selected from a series of movements included in the model video, and are set in advance for a plurality of playback positions (judgment points). FIG. 4 shows an example of model poses corresponding to the set playback positions (judgment points). For example, a skeletal model made up of a combination of joints is used for the model poses. The playback positions corresponding to each model pose (330a, 330b) in the model video are specified by frame number 320.

[0034] FIG. 5 shows a data sequence of modeled body movements of an evaluation subject synchronized with a model video.

[0035] The body movement data 400 of the subject to be evaluated is acquired by the body movement acquisition unit 113 at a predetermined time interval (in milliseconds). Image data of the body movements of the subject to be evaluated captured by the imaging unit 15 is recognized in the form of, for example, a skeletal model. Then, to perform a comparison within a time period before and after a judgment point (playback position) corresponding to each model pose (330a, 330b), a plurality of body movement data acquired during a time interval Δt before and after the judgment point is selected as comparison candidates.

[0036] For example, for the model pose 330b in Fig. 5, the body movement data (442, 443, 444) acquired during the interval Δt between the video playback positions for comparison are selected. Then, the body movement determination unit 115 calculates the degree of agreement between the comparison reference data corresponding to the model pose 330b and the body movement data 442 among the multiple acquired body movement data.

[0037] In this embodiment, the body movement determination unit 115 calculates the degree of agreement between skeletal models. For example, the distance between corresponding joints and the difference in the angle of the bones at the joints are calculated, and the degree of agreement is calculated by summing up the absolute values ​​of the differences. As an example, if the reciprocal of the summed absolute values ​​is defined as the degree of agreement, the greater the value of the degree of agreement, the higher the degree of agreement. As another example, a method may be used in which points are assigned to each body part according to the magnitude of the difference (small is "-1", the same is "0", and large is "+1"), and the sum of these points is determined as the degree of agreement.

[0038] Similarly, the body movement determination unit 115 calculates the degree of agreement between the remaining body movement data (443, 444) and the comparison reference data corresponding to the model pose 330b. Then, the body movement determination unit 115 adopts the highest degree of agreement among the degrees of agreement corresponding to each of the body movement data (442, 443, 444) as the degree of agreement with the model pose 330b. In addition, the adopted body movement data and the video playback position of the adopted body movement data are stored in the storage unit 12 in association with an identifier (user registration number) previously assigned to the person to be evaluated.

[0039] In this manner, the degree of agreement is calculated for each of the multiple model poses. Note that the method for calculating the degree of agreement is not limited to the above method, and a method for calculating the degree of agreement from the tendency of the body movement data using machine learning or deep learning may be applied.

[0040] After starting playback of the model video, the body movement scoring unit 117 may sequentially add up the degrees of agreement corresponding to the model poses or calculate an average value, and display the results as an intermediate evaluation score on the display unit 13. Then, when playback of the video ends, the final evaluation score (gymnastics evaluation score) is calculated.

[0041] As described above, the warm-up exercises evaluation device according to one embodiment of the present invention has a function of evaluating the degree of correspondence between model poses at multiple playback positions (judgment points) preset in a model video of the warm-up exercises and the physical movements of the person to be evaluated, and furthermore, it uses data on the physical movements of the person to be evaluated during warm-up exercises that he or she has previously performed in accordance with the model video to generate comparison reference data for evaluating the personal physical condition of the person to be evaluated, and compares and scores the generated comparison reference data for evaluating physical condition in chronological order with the data on the physical movements of the warm-up exercises currently being performed, thereby making it possible to check the physical condition of the person to be evaluated.

[0042] FIG. 6 is a flowchart showing a method for evaluating the physical condition of an evaluation subject using the warm-up exercises evaluation device according to one embodiment of the present invention.

[0043] 6, when a user registration number is input via the input unit 14, the control unit 11 of the warm-up exercises evaluation device 10 reads out comparison reference data for evaluating the physical condition of the person to be evaluated that is stored in association with the user registration number from the storage unit 12 (step S502). Note that the comparison reference data for evaluating the physical condition that is read out at the first use consists of position data of each part of the body at each judgment point of the person to be evaluated that was stored when the person to be evaluated performed user registration, but as will be described later, learning is carried out with each use, and the data becomes more reflective of the person to be evaluated's own normal condition.

[0044] Thereafter, when an instruction to start playing the model video is given via the input unit 14, the model video playback unit 111 plays the model video of the warm-up exercises to be viewed by the person to be evaluated (step S503). The person to be evaluated performs the corresponding body movements in accordance with the model while referring to the model video.

[0045] In synchronization with the start of playback of the model video, the body motion acquisition unit 113 acquires image data of the body motion of the person to be evaluated from the imaging unit 15 (step S504). The acquired image data of the body motion is acquired by the body motion acquisition unit 113 as, for example, motion capture data of a skeletal model, and is transmitted to the body motion determination unit 115 as body motion data.

[0046] In step S505, body movement determination section 115 compares the acquired body movement data with comparison reference data of a model pose at a determination point set in advance in the model moving image data, and determines the degree of agreement with the model pose. At the same time, the body movement determining section 115 compares the acquired body movement data with the comparison reference data for evaluating the physical condition of the individual to be evaluated, and determines the degree of agreement with the comparison reference data for evaluating the physical condition.

[0047] In step S506, physical movement scoring section 117 tallies the degree of agreement with the model pose at each judgment point, and scores the physical movement that matches the warm-up exercises currently being performed by the person to be evaluated. At the same time, the body action scoring section 117 tallyes up the degree of agreement with the comparison standard data for evaluating the physical condition of the individual to be evaluated at each judgment point, and assigns an evaluation score representing the physical condition of the individual to be evaluated.

[0048] At this time, the physical action scoring unit 117 can score the currently executed physical action against the model pose at any time even during the video playback, and can display the scoring result on the display unit 13. Meanwhile, the physical action scoring unit 117 scores the currently executed physical action against the comparison reference data for physical condition evaluation at any time during the video playback, but displays the scoring result on the display unit 13 after the video playback has ended. This can eliminate errors and cheating that may occur when the person being evaluated intentionally corrects his or her physical action after seeing the score during the warm-up exercises.

[0049] In step S507, the body action scoring unit 117 stores the position data of the body parts of the person to be evaluated at each judgment point in the storage unit 12 in association with the identifier of each judgment point (e.g., frame number) and the identifier (user registration number) given to the person to be evaluated. When storing the data, it is preferable to further add an index or serial number for distinguishing between data of the currently performed warm-up exercises and data of warm-up exercises performed in the past.

[0050] The above-mentioned steps S504 to S506 are sequentially performed for a plurality of preset playback positions (judgment points), and step S507 may be performed one by one as the grading is performed at each judgment point, or may be performed collectively after the grading at the final judgment point is completed. However, after the grading at the final judgment point is completed, the position data of each part of the body of the person to be evaluated at each of the plurality of playback positions (judgment points) used for grading is stored in the storage unit 12 as data in a format associated with the above-mentioned identifiers (user registration number and serial number of the execution time) together with the exercise evaluation score of the person to be evaluated. The stored data is used as learning data for setting comparison reference data for evaluating the physical condition of the person to be evaluated.

[0051] As described above, the warm-up exercises evaluation device and warm-up exercises evaluation method according to one embodiment of the present invention not only grades the performance of the warm-up exercises currently being performed by the person to be evaluated (whether or not the body movements are faithful to the model), but also compares the warm-up exercises with the person's usual body movements during previous warm-up exercises and quantifies the deviation (calculates the degree of agreement), thereby providing data that can be used to judge the physical condition of the person.

[0052] A method for generating comparison reference data for evaluating physical condition used in the warm-up exercises evaluation device and warm-up exercises evaluation method according to one embodiment of the present invention will be described.

[0053] Comparison reference data for evaluating physical condition is generated by using a collection of data on the physical movements of multiple warm-up exercises previously performed by the person to be evaluated as learning data at multiple playback positions (judgment points) that are preset in the model video of the warm-up exercises.

[0054] FIG. 7 is a diagram showing an example of learning data used for generating comparison reference data for evaluating physical condition.

[0055] The warm-up exercises evaluation device may be programmed in advance to execute a step of generating or updating comparison reference data for evaluating physical condition after a series of steps related to warm-up exercises evaluation corresponding to the video playback shown in Fig. 6 is completed. At this time, the display unit 13 may be caused to display that learning is currently being performed, although this is not shown.

[0056] When the process of generating or updating comparison standard data for evaluating physical condition begins, the warm-up exercises evaluation device causes the evaluation standard data generation unit 119 to execute a step of calculating, by machine learning or deep learning, the standard positions of each part of the body of the person to be evaluated for each of a plurality of playback positions (judgment points) using the learning data and exercise evaluation scores stored in the memory unit 12, and a step of generating comparison standard data for evaluating the physical condition of the individual person to be evaluated based on the calculated data on the standard positions of each part of the body.

[0057] Specifically, each time the person to be evaluated performs a new warm-up exercise, the evaluation reference data generating unit 119 reads out the learning data for that person to be evaluated stored in the storage unit 12, calculates the standard positions of each part of the person to be evaluated for each of a plurality of judgment points combining the present and past (for example, the body movement data 443, 443', 443'' shown in FIG. 7) by machine learning or deep learning, and generates comparison reference data for evaluating the physical condition of the individual person to be evaluated based on the calculated standard positions of each part of the body. At this time, the exercise evaluation score for each execution may be used for weighting. A predetermined weighting coefficient may be added to the positions of each part of the body at each judgment point in the execution of the execution with a high exercise evaluation score. Therefore, the comparison standard data for evaluating the physical condition at each judgment point is the data of the physical movements when the warm-up exercises were performed well (in physical condition) from the current to the past, and this data is reflected in the comparison standard data for evaluating the physical condition of the person being evaluated.

[0058] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the present invention is not limited to the above-described embodiments and can be modified in various ways without departing from the technical scope of the present invention. [Explanation of symbols]

[0059] 10. Warm-up exercise evaluation device 11 Control section 12 Storage section 13 Display section 14 Input section 15 Imaging unit 16 Output section 17 Communications Department 111 Example Video Playback Section 113 Body motion acquisition section 115 Body motion determination section 117 Physical Movement Scoring Section 119 Evaluation Criteria Data Generation Unit

Claims

1. A warm-up exercises evaluation device that supports physical condition management of an evaluation subject who performs warm-up exercises in accordance with a model video, A storage unit that stores video data of the warm-up exercises performed by a model performer as model video data; a model video playback unit for playing back the model video data and displaying it on a predetermined display means; a body motion acquisition unit that acquires, via a predetermined imaging means, body motion images of the person to be evaluated performing the warm-up exercises in accordance with the displayed example video, and recognizes the positions of each part of the body of the person to be evaluated in chronological order from the acquired body motion images; a body movement determination unit that calculates a degree of agreement between comparison reference data that has been set in advance for a plurality of playback positions in the example video data and position data of each part of the body of the subject that corresponds to the plurality of playback positions and that is recognized in the time series; a body movement scoring unit that aggregates the calculated degrees of agreement, scores the body movement of the person to be evaluated, and displays the scoring result on the predetermined display means as an exercise evaluation score for the model video; an evaluation standard data generating unit that generates comparison standard data for evaluating the physical condition of the individual subject; a control unit that causes the model video playback unit, the body movement acquisition unit, the body movement judging unit, the body movement scoring unit, and the evaluation reference data generation unit to function, and also controls the warm-up exercises evaluation device as a whole, the comparison reference data is position data of each part of the body of the model performer at a specific playback position of the model video data; the body movement scoring unit stores in the storage unit position data of each part of the body of the subject at the plurality of playback positions used in scoring the exercise evaluation score of the subject as learning data for setting comparison standard data for evaluating the physical condition of the subject; the evaluation reference data generation unit reads out the learning data of the person to be evaluated stored in the storage unit each time the person to be evaluated newly performs the warm-up exercises, and executes machine learning using position data of each part of the body of the person to be evaluated at the multiple playback positions in each of the warm-up exercises previously performed by the person to be evaluated and the newly performed warm-up exercises, which are included in the learning data, as input, to calculate a tendency (feature amount) indicated by the positions of each part of the body of the person to be evaluated at each of the multiple playback positions, and generates comparison reference data for evaluating the personal physical condition of the person to be evaluated, which specifies a standard position of each part of the body of the person to be evaluated at each of the multiple playback positions, based on the tendency (feature amount) calculated by the machine learning; the physical movement determination unit further compares the position data of each part of the body of the subject recognized by the physical movement acquisition unit with comparison reference data for evaluating the physical condition of the subject, and calculates a degree of agreement; the physical action scoring unit causes the predetermined display means to display a score of the physical condition of the evaluation subject on the predetermined display means, the score being calculated based on the degree of agreement with the comparison standard data for evaluating the physical condition of the evaluation subject; A warm-up exercises evaluation device, characterized in that the tendency (feature amount) is composed of body parts and positions that reflect movements unique to the individual person to be evaluated.

2. A warm-up exercise evaluation method for supporting a physical condition management of an evaluation subject who performs warm-up exercises in accordance with a model video, comprising: a physical movement acquisition unit that acquires physical movement images of a person to be evaluated performing the warm-up exercises in accordance with the displayed model video and recognizes the positions of each part of the person to be evaluated in time series from the acquired physical movement images; a physical movement determination unit that calculates a degree of agreement between comparison reference data previously set for a plurality of playback positions in the model video data and the position data of each part of the person to be evaluated that corresponds to the plurality of playback positions and that is recognized in time series; a physical movement scoring unit that calculates the degree of agreement to score the physical movements of the person to be evaluated and displays the scoring result on the predetermined display means as an exercises evaluation score for the model video; an evaluation reference data generation unit that generates comparison reference data for evaluating the physical condition of each person to be evaluated; and a control unit that controls the above units and the device as a whole. The control unit: causing the model video playback unit to play back the model video data and display it on the predetermined display means; a step of causing the body motion acquisition unit to acquire body motion images of the person to be evaluated performing the warm-up exercises in accordance with the displayed model video, and recognizing the positions of each part of the body of the person to be evaluated in chronological order from the acquired body motion images; a step of causing the body movement determination unit to compare comparison reference data previously set for a plurality of playback positions in the model video data with position data of each part of the body of the subject recognized in the time series corresponding to the plurality of playback positions, and to calculate a degree of agreement; and causing the body movement scoring unit to collect the calculated degrees of agreement, score the body movement of the person to be evaluated, and display the scoring result on the display means as an exercise evaluation score for the model video. Here, the comparison reference data is position data of each part of the body of the model performer at a specific playback position of the model video data, The control unit: causing the body action scoring unit to store in the storage unit position data of each part of the body of the subject at the plurality of playback positions, which was used in scoring the exercise evaluation score of the subject, as learning data for setting comparison standard data for evaluating the physical condition of the subject; a step of causing the evaluation reference data generation unit to read out the learning data of the person to be evaluated stored in the storage unit each time the person to be evaluated newly performs the warm-up exercises, and to execute machine learning using position data of each part of the body of the person to be evaluated at the multiple playback positions in each of the warm-up exercises previously performed by the person to be evaluated and the newly performed warm-up exercises, which are included in the learning data, to calculate a tendency (feature amount) indicated by the position of each part of the body of the person to be evaluated at each of the multiple playback positions, and to generate comparison reference data for evaluating the physical condition of the person to be evaluated, which specifies a standard position of each part of the body of the person to be evaluated at each of the multiple playback positions, based on the tendency (feature amount) calculated by the machine learning; a step of causing the body movement determination unit to compare position data of each part of the body of the subject recognized by the body movement acquisition unit with comparison reference data for evaluating the physical condition of the subject, and calculate a degree of agreement; and causing the body action scoring unit to display, on the predetermined display means, a score of the physical condition of the subject, the degree of agreement with the comparison standard data for evaluating the physical condition of the subject, and A method for evaluating warm-up exercises, characterized in that the tendency (feature amount) is composed of body parts and positions that reflect movements unique to the individual subject to be evaluated.

3. a storage section for storing video data of a model performer's warm-up exercises as model video data; a model video playback section for playing back the model video data and displaying it on a predetermined display means; a body motion acquisition section for acquiring, via a predetermined imaging means, body motion images of a subject performing the warm-up exercises in accordance with the displayed model video and recognizing the positions of each part of the subject's body in time series from the acquired body motion images; comparison reference data previously set for a plurality of playback positions in the model video data and the positions of each part of the subject's body recognized in time series corresponding to the plurality of playback positions a body movement judging section which compares the body movement data of the person to be evaluated with the position data of the person to be evaluated to calculate a degree of agreement, a body movement scoring section which counts up the calculated degrees of agreement, scores the body movement of the person to be evaluated, and displays the scoring result on the predetermined display means as an exercises evaluation score corresponding to the model video, an evaluation standard data generating section which generates comparison standard data for evaluating the physical condition of each of the people to be evaluated, and a control section which controls the above sections and the device in general, said warm-up exercises evaluation program causing a warm-up exercises evaluation device to execute a process of calculating and scoring the degree of agreement of the body movements of the person to be evaluated who are performing warm-up exercises in accordance with the model video, The control unit of the warm-up exercises evaluation device causing the model video playback unit to play back the model video data and display it on the predetermined display means; a step of causing the body motion acquisition unit to acquire body motion images of the person to be evaluated performing the warm-up exercises in accordance with the displayed model video, and recognizing the positions of each part of the body of the person to be evaluated in chronological order from the acquired body motion images; a step of causing the body movement determination unit to compare comparison reference data previously set for a plurality of playback positions in the model video data with position data of each part of the body of the subject recognized in the time series corresponding to the playback positions, and to calculate a degree of agreement; and causing the physical action scoring unit to collect the calculated degrees of agreement, score the physical action of the person to be evaluated, and display the scoring result on the display means as an exercise evaluation score for the model video. causing the body action scoring unit to store in the storage unit position data of each part of the body of the subject at the plurality of playback positions, which was used in scoring the exercise evaluation score of the subject, as learning data for setting comparison standard data for evaluating the physical condition of the subject; a step of causing the evaluation reference data generation unit to read out the learning data of the person to be evaluated stored in the storage unit each time the person to be evaluated newly performs the warm-up exercises, and to execute machine learning using position data of each part of the body of the person to be evaluated at the multiple playback positions in each of the warm-up exercises previously performed by the person to be evaluated and the newly performed warm-up exercises, which are included in the learning data, to calculate a tendency (feature amount) indicated by the position of each part of the body of the person to be evaluated at each of the multiple playback positions, and to generate comparison reference data for evaluating the physical condition of the person to be evaluated, which specifies a standard position of each part of the body of the person to be evaluated at each of the multiple playback positions, based on the tendency (feature amount) calculated by the machine learning; a step of causing the body movement determination unit to compare position data of each part of the body of the subject recognized by the body movement acquisition unit with comparison reference data for evaluating the physical condition of the subject, and calculate a degree of agreement; and causing the physical action scoring unit to display, on the predetermined display means, a score of the physical condition of the subject, the score of the degree of agreement with the comparison reference data for evaluating the physical condition of the subject, and A warm-up exercises evaluation program, characterized in that the tendency (feature amount) is composed of body parts and positions that reflect movements unique to the individual person to be evaluated.

Citation Information

Patent Citations

  • Exercise support system, user terminal therefor and exercise support program

    JP2006302122A

  • System and method for analyzing user movement

    JP2009504298A

  • Personal digital assistance, method and program of measuring swing

    JP2010068947A

  • Motion evaluation support device and motion evaluation support method

    JP2014057800A

  • Rehabilitation support device

    JP2021015593A