Exercise support program, exercise support system and exercise support method

Abstract

To provide an exercise support program for creating an exercise menu based on a posture of a user, and changing the exercise menu based on a muscle activity amount of the user.SOLUTION: An exercise support program causes a computer to execute the steps of: acquiring a first posture analysis result representing a balance of skeletal muscles of a user; creating exercise menu information based on the first posture analysis result; and changing the exercise menu information based on at least one of the exercise menu information, skeletal muscle activity information estimated based on video images of the user exercising according to exercise menu information, and an amount of change between the first posture analysis result and a second posture analysis result representing the balance of the skeletal muscles of the user exercising according to the exercise menu information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an exercise support program, an exercise support system, and an exercise support method. [Background technology]

[0002] Conventionally, as a technology for providing an exercise menu such as muscle training, for example, an exercise menu providing system described in the following Patent Document 1 is known. This exercise menu providing system provides an exercise menu according to the user's posture. The exercise menu providing system photographs the user's posture, extracts specific part images showing multiple specific parts from the user image, analyzes the posture of the specific part corresponding to each specific part image based on the extracted multiple specific part images, and provides an exercise menu according to the analyzed posture of each specific part. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-047105 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, although the exercise menu providing system described in Patent Document 1 provides an exercise menu according to the user's posture, the user needs to continue to perform the exercises in order to correct the user's posture. Furthermore, if the exercise menu is not suitable for the user, the user is often unable to continue performing the exercise menu. Therefore, it is desirable to change the exercise menu to one more suitable for the user depending on how the user actually performs the exercise.

[0005] The present disclosure has been made in consideration of the above circumstances, and aims to provide an exercise support program, an exercise support system, and an exercise support method that can create an exercise menu based on the user's posture and change the exercise menu based on the user's muscle activity level. [Means for solving the problem]

[0006] The present disclosure has been made to solve the above-mentioned problems, and one aspect of the present disclosure is an exercise support program that causes a computer to execute the steps of acquiring a first posture analysis result representing a user's skeletal muscle balance, creating exercise menu information based on the first posture analysis result, and changing the exercise menu information based on at least one of skeletal muscle activity information estimated based on the exercise menu information and a video of the user exercising in accordance with the exercise menu information and an amount of change between the first posture analysis result and a second posture analysis result representing the skeletal muscle balance of the user who has exercised in accordance with the exercise menu information.

[0007] Another aspect of the present disclosure is an exercise support system including an information acquisition unit that acquires a first posture analysis result representing a balance of a user's skeletal muscles, an exercise menu creation unit that creates exercise menu information based on the first posture analysis result acquired by the information acquisition unit, and a muscle activity estimation unit that estimates skeletal muscle activity information based on a video of the user exercising according to the exercise menu information and the exercise menu information created by the exercise menu creation unit, wherein the exercise menu creation unit changes the exercise menu information based on at least one of the skeletal muscle activity information estimated by the muscle activity estimation unit and an amount of change between the first posture analysis result acquired by the information acquisition unit and a second posture analysis result representing the balance of the skeletal muscles of the user who exercised according to the exercise menu information.

[0008] Another aspect of the present disclosure is an exercise support method including the steps of: an information acquisition unit acquiring a first posture analysis result representing a balance of skeletal muscles of a user; an exercise menu creation unit creating exercise menu information based on the first posture analysis result; and the exercise menu creation unit changing the exercise menu information based on at least one of skeletal muscle activity information estimated based on the exercise menu information and a video image of the user exercising in accordance with the exercise menu information and an amount of change between the first posture analysis result and the second posture analysis result representing the balance of skeletal muscles of the user who has exercised in accordance with the exercise menu information. Effect of the Invention

[0009] According to one aspect of the present invention, an exercise menu can be created based on the user's posture, and the exercise menu can be changed based on the user's muscle activity amount. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing an example of an exercise support system according to a first embodiment. [Diagram 2] FIG. 3 is a diagram showing an example of user basic data and user past data in the first embodiment. [Diagram 3] 4 is a flowchart showing an example of an operation procedure of the exercise support system according to the first embodiment. [Figure 4] 4 is an example of posture information and posture analysis results according to an embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of an exercise menu in the embodiment. [Figure 6] FIG. 11 is a block diagram showing an example of an exercise support system according to a second embodiment. [Figure 7] 13 is a flowchart showing an example of an operation procedure of the exercise support system according to the second embodiment. [Figure 8] FIG. 13 is a block diagram showing an example of an exercise support system according to a third embodiment. [Figure 9]FIG. 13 is a block diagram showing an example of an exercise support system according to a fourth embodiment. [Figure 10] 13 is a flowchart showing an example of an operation procedure of the exercise support system according to the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] An exercise support program, an exercise support system, and an exercise support method to which the present invention is applied will be described below with reference to the drawings.

[0012] FIG. 1 is a block diagram showing an example of an exercise support system 1 according to the first embodiment. The exercise support system 1 includes, for example, a server device 100 and a user terminal device 200. The server device 100 and the user terminal device 200 each have a communication interface (not shown) such as a network interface card (NIC) or a wireless communication module for connecting to a communication network such as the Internet. The network may include, for example, a general-purpose network such as the Internet, and a private network such as local 5G or WiFi (registered trademark).

[0013] The server device 100 is an information processing device called, for example, a web server or an application server. The server device 100 provides content for supporting a user's exercise in response to a request from the user terminal device 200. The server device 100 includes, for example, a request receiving unit 110, an information acquiring unit 120, a posture analyzing unit 130, a muscle activity amount estimating unit 135, an exercise menu creating unit 140, a presentation information creating unit 150, an information providing unit 160, and a storage unit 170. These units 110 to 160 are integrated into one device, but are not limited to this, and may be distributed and arranged in a plurality of devices connected by a communication network. The functional units such as the request receiving unit 110, the information acquiring unit 120, the posture analyzing unit 130, the muscle activity amount estimating unit 135, the exercise menu creating unit 140, the presentation information creating unit 150, and the information providing unit 160 are realized by a hardware processor such as a CPU (Central Processing Unit) executing an exercise support program (software). The server device 100 may include a plurality of processors for implementing each of the functional units. In addition, some or all of these functional units may be implemented by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be implemented by a combination of software and hardware.

[0014] The request receiving unit 110 receives various requests from the user terminal device 200. The information acquiring unit 120 acquires the first posture information of the user, a moving image of the user exercising according to the exercise menu information, and the second posture information of the user. The first posture information and the second posture information are the results of skeleton extraction based on a still image of the user, and are information indicating points indicating joints and lines connecting the joints. The first posture information is the posture acquired before exercising according to the exercise menu information, and the second posture information is the posture of the user exercising according to the exercise menu information. The second posture analysis result may be a posture analysis result of a user whose muscle mass has increased by repeatedly exercising for a certain period of time.

[0015] The posture analysis unit 130 analyzes the user's posture based on the first posture information to create a first posture analysis result. The posture analysis unit 130 analyzes the user's posture based on the second posture information to create a second posture analysis result. The first posture analysis result and the second posture analysis result are information that represents the muscle strength balance of each skeletal muscle, such as skeletal distortion and muscle attachment. The posture analysis unit 130 may analyze the image using basic information, a front standing full-body image, and a sideways standing full-body image, using an AI technique for extracting skeletons, such as OpenPose. In the following description, the first posture information and the second posture information are collectively referred to simply as "posture information", and the first posture analysis result and the second posture analysis result are collectively referred to simply as "posture analysis result".

[0016] When an exercise menu for the user has not been created, the exercise menu creation unit 140 creates exercise menu information based on the first posture analysis result. The muscle activity amount estimation unit 135 estimates skeletal muscle activity amount information based on the exercise menu information and a video image of the user exercising according to the exercise menu information. The muscle activity amount estimation unit 135 may estimate the load on each skeletal muscle of the user from the exercise video image by inverse dynamics. The exercise menu creation unit 140 changes the exercise menu information based on at least one of the estimated skeletal muscle activity amount information and the change amount between the first posture analysis result and the second posture analysis result. The presentation information creation unit 150 creates presentation information for the user. The presentation information is, for example, information about the exercise menu. The information about the exercise menu is, for example, video image data representing skeletal muscle activity amount information, and can be displayed by the user terminal device 200 corresponding to the user. The information provision unit 160 transmits content including the presentation information to the user terminal device 200.

[0017] When the exercise menu creation unit 140 changes the exercise menu information based on the skeletal muscle activity amount information and the first posture analysis result, the process of acquiring the amount of change from the second posture analysis result by the posture analysis unit 130 may be omitted. When the exercise menu creation unit 140 changes the exercise menu information based on the amount of change in the second posture analysis result, the process of acquiring a moving image of the user by the information acquisition unit 120 or the process of estimating skeletal muscle activity amount information by the muscle activity estimation unit 135 may be omitted.

[0018] The storage unit 170 is realized by, for example, a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a flash memory, a solid state drive (SSD), or a hybrid storage device that combines a plurality of these. The storage unit 170 may be realized by a single device, or a part or the whole of the storage unit 170 may be an external device accessible to the server device 100, such as a NAS or an external storage server.

[0019] 2 is a diagram showing an example of the user basic data 172 and the user past data 174 in the first embodiment. For example, the user basic data 172 and the user past data 174 are stored in the storage unit 170. The user basic data 172 includes a user ID and basic information. The basic information is unique information such as the user's height, weight, age, sex, etc., but is not limited thereto, and may include information indicating the user's exercise habits, user goal information, and sport type information. The user past data 174 includes information that changes depending on exercise, such as posture information, posture analysis results, exercise menu information, and muscle activity amount information.

[0020] The user terminal device 200 is an information processing device operated by a user who is exercising. The user terminal device 200 is, for example, a mobile phone such as a smartphone, a tablet terminal, or a computer device such as a PDA (Personal Digital Assistant). The user terminal device 200 operates by a UA (User Agent) such as a browser or an application program for exercise support. The user terminal device 200 transmits various requests to the server device 100 based on the user's operation, and displays various contents by receiving data transmitted in response to the requests.

[0021] 1, the user terminal device 200 includes a communication unit 210, an information input unit 220, an imaging unit 230, and a display unit 240. The communication unit 210 is a communication circuit for communicating with the server device 100 via a communication network. The information input unit 220 is an interface for inputting various information in response to receiving a user's operation. The imaging unit 230 generates still image data and moving image data. The display unit 240 is a display device and displays various contents and the like.

[0022] FIG. 3 is a flowchart showing an example of an operation procedure of exercise support system 1 in the first embodiment. First, the information input unit 220 accepts a user operation and transmits a request S10 including basic information to the server device 100. When the request accepting unit 110 accepts the request S10, the storage unit 170 stores the basic information in the storage unit 170 in association with the user ID (step ST10).

[0023] The server device 100 transmits posture information request information S12 to the user terminal device 200. The imaging unit 230 captures a still image of the user (step ST12) and transmits first posture information S14 to the server device 100. Fig. 4 shows an example of the first posture information S14 and the first posture analysis result S16 in the embodiment. The first posture information S14 includes, for example, a plurality of points (circles in the figure) and lines connecting the points based on a standing full-body image facing forward (Fig. 4(A)) and a standing full-body image from the side (Fig. 4(B)).

[0024] The information acquisition unit 120 acquires the first posture information S14, the posture analysis unit 130 analyzes the first posture information S14 (step ST14), and the presentation information creation unit 150 and the information provision unit 160 transmit the first posture analysis result S16 to the user terminal device 200. The first posture analysis result S16 is, for example, skeletal information of the user acquired from a standing whole-body image as shown in FIG. 4. The first posture analysis result S16 may be angle information indicating the left and right inclination of the whole body, upper body, lower body, head, etc., as a numerical value such as "1.0 degree to the right" or "1.1 degrees to the left", or may be positional deviation information indicating the left and right positional deviation of the shoulders, waist, etc., as a numerical value such as "the right side is 1.0 cm higher" or "the left side is 1.1 cm higher". Furthermore, the first posture analysis result S16 may be text information that informs the user of the center of gravity, habits, etc. based on the user's posture, such as angle information or positional deviation information.

[0025] Next, exercise menu creation unit 140 creates an exercise menu based on the first posture analysis result (step ST16), and presentation information creation unit 150 and information provision unit 160 transmit exercise menu information S18 to user terminal device 200. This allows display unit 240 to display the first posture analysis result and the exercise menu based on the first posture analysis result S16 and exercise menu information S18. Figure 5 is a diagram showing an example of an exercise menu in the embodiment.

[0026] The imaging unit 230 captures an image of the user exercising according to the exercise menu (step ST18), and the communication unit 210 transmits the exercise video S20 to the server device 100. In response to the information input unit 220 accepting input of load information for the exercise menu, the communication unit 210 may transmit the load information to the server device 100 in addition to the exercise video S20. The load information is weight information indicating the weight of the exercise equipment, but is not limited thereto, and may be any information regarding the load of the exercise.

[0027] The muscle activity estimation unit 135 estimates the amount of skeletal muscle activity based on the motion video S20 (step ST20). Specifically, the muscle activity estimation unit 135 uses an AI technique for extracting skeletons such as OpenPose to extract time-series skeleton information from the motion video of the user during exercise, and estimates the amount of skeletal muscle activity by analyzing the joint movement based on inverse dynamics from the extracted time-series skeleton information. Software such as AnyBody (registered trademark) may be used to estimate the amount of skeletal muscle activity based on inverse dynamics. The posture analysis unit 130 estimates the amount of change in posture from the estimated amount of skeletal muscle activity (step ST22). It is desirable to improve the accuracy of posture estimation by the posture analysis unit 130 by comparing the estimation result based on the motion video with the actual posture based on a still image.

[0028] The exercise menu creation unit 140 updates (changes) the exercise menu information based on the skeletal muscle activity amount information and the amount of change between the first posture analysis result analyzed in step ST14 and the second posture analysis result analyzed in step ST22 (step ST24). The exercise menu is, for example, a muscle strength training menu. The muscle strength training menu includes muscle strength training that balances muscle strength in the whole body while correcting the posture before the muscle strength training. The exercise menu creation unit 140 may update the exercise menu information to include muscle strength training that balances the amount of skeletal muscle activity in the whole body based on the skeletal muscle activity amount information. The exercise menu creation unit 140 may update the exercise menu information to correct the posture before the muscle strength training based on the amount of change between the first posture analysis result and the second posture analysis result. In addition, the exercise menu creation unit 140 may select from a plurality of exercise menus prepared in advance according to the posture analysis result and basic information such as the user's age. Furthermore, the exercise menu creating unit 140 may periodically add or change the exercise menu so that the user does not get bored.

[0029] For example, if the amount of skeletal muscle activity does not reach an expected value even though the user's form during exercise is correct, or if the amount of change between the first posture analysis result and the second posture analysis result does not reach an expected value, the exercise menu creation unit 140 may determine that the current exercise menu includes a muscle training that the user is not good at, and may change to another muscle training that provides the same effect as the muscle training included in the current exercise menu. Also, if the amount of skeletal muscle activity exceeds an expected value, or if the amount of change between the first posture analysis result and the second posture analysis result exceeds an expected value, the exercise menu creation unit 140 may determine that the current exercise menu is a burden to the user, and may reduce the weight of the exercise equipment used in the muscle training, the number of repetitions of the muscle training, etc.

[0030] The presentation information creation unit 150 and the information provision unit 160 transmit the updated exercise menu information S22 to the user terminal device 200. The user terminal device 200 displays the updated exercise menu information S22. The steps of capturing a moving image of the user exercising according to such an exercise menu (step ST18), estimating the amount of muscle activity (step ST20), analyzing posture (step ST22), and updating the exercise menu (step ST24) are repeated.

[0031] The exercise menu information may include advice information such as differences between the user's form and a reference form. The presentation information creation unit 150 may create content including information recommending meal recipes or dishes from nearby restaurants based on the user's basic information and muscle activity level in addition to the exercise menu information.

[0032] Information acquisition section 120 transmits posture information request information S24 to user terminal device 200. Information acquisition section 120 may transmit posture information request information S24 to user terminal device 200 when an amount of exercise based on an exercise video image acquired from user terminal device 200 exceeds a standard, and may transmit posture information request information S24 to user terminal device 200 when it is determined that posture has been improved based on a second posture analysis result by posture analysis (step ST22).

[0033] The posture information request information S24 is displayed by the display unit 240. The imaging unit 230 captures a still image of the user (step ST26) and transmits the second posture information S26 to the server device 100. The information acquisition unit 120 acquires the second posture information S26, and the posture analysis unit 130 analyzes the second posture information S26 (step ST28). The presentation information creation unit 150 creates a posture comparison result between the first posture analysis result in step ST14 and the second posture analysis result in step ST28 (step ST30), and transmits the posture comparison result S28 to the user terminal device 200. This enables the user terminal device 200 to present the posture comparison result to the user.

[0034] It is preferable that the exercise menu creation unit 140 creates a new exercise menu, and the presentation information creation unit 150 and the information providing unit 160 transmit content including the new exercise menu to the user terminal device 200.

[0035] As described above, according to the exercise support system 1 of the first embodiment, an exercise support program can be realized that causes the computer of the server device 100 to execute the steps of acquiring a first posture analysis result representing the balance of the skeletal muscles of the user, creating exercise menu information based on the first posture analysis result, and changing the exercise menu information based on at least one of the exercise menu information and the skeletal muscle activity amount information estimated based on the motion image of the user exercising according to the exercise menu information and the amount of change between the first posture analysis result and the second posture analysis result representing the balance of the skeletal muscles of the user who exercised according to the exercise menu information. According to this exercise support system 1, an exercise menu can be created based on the user's posture, and the exercise menu can be changed based on the user's muscle activity amount. According to the exercise support system 1, for example, a smartphone application can be realized that allows the user to quantitatively realize the effect of posture correction by having the user exercise according to an exercise menu based on the user's posture, such as personal training. In addition, according to the exercise support system 1, the exercise menu is updated according to the muscle activity amount and posture when the user actually exercises, so that an exercise menu that is easy for the user to continue can be provided.

[0036] In addition, according to the exercise support system 1, video images of a user exercising according to exercise menu information are obtained, skeletal muscle activity information is estimated based on the exercise menu information and the video images, and video data representing the skeletal muscle activity information is created and displayed by the user terminal device 200. Therefore, by having the user exercise according to the exercise menu, the user can quantitatively experience the amount of skeletal muscle activity.

[0037] (Second embodiment) 6 is a block diagram showing an example of an exercise support system 1A in the second embodiment. The exercise support system 1A in the second embodiment differs from the first embodiment in that a user terminal device 200A includes a form determination section 250. The form determination section 250 determines the form based on the difference between the user's motion in the video and a reference motion included in the exercise menu.

[0038] FIG. 7 is a flowchart showing an example of an operation procedure of the exercise support system 1A in the second embodiment. The imaging unit 230 captures an image of the user exercising according to the exercise menu (step ST18), and the form determination unit 250 determines the form based on the difference between the user's movement in the captured video and the reference movement included in the exercise menu (step ST40). The communication unit 210 transmits the form determination result and the exercise video S30 to the server device 100A. The muscle activity estimation unit 135 estimates the muscle activity of the skeletal muscle based on the form determination result and the exercise video S30 (step ST42), the posture analysis unit 130 analyzes the posture (step ST44), and the exercise menu creation unit 140 updates (changes) the exercise menu information based on the skeletal muscle activity information and the amount of change between the first posture analysis result analyzed in step ST14 and the second posture analysis result analyzed in step ST22 (step ST46). The presentation information creation unit 150 and the information provision unit 160 transmit the updated exercise menu information S32 to the user terminal device 200A. The user terminal device 200A displays the updated exercise menu information S32. The steps of capturing a moving image of the user exercising according to the exercise menu (step ST18), determining the user's form (step ST40), estimating the amount of muscle activity (step ST42), analyzing the user's posture (step ST44), and updating the exercise menu (step ST46) are repeated.

[0039] In step ST46, the exercise menu creation unit 140 changes the exercise menu information based on the difference between the user's movement and the reference movement, the skeletal muscle activity amount information, and the amount of change between the first posture analysis result and the second posture analysis result. The exercise menu creation unit 140 may change the exercise menu information based on at least one of the difference between the user's movement in the moving image and the reference movement, the skeletal muscle activity amount information, and the amount of change between the first posture analysis result and the second posture analysis result. In addition, the form determination unit 250 may create proposal information for correcting the user's movement based on the difference between the user's movement in the moving image and the reference movement and the skeletal muscle activity amount information. The proposal information is transmitted to the user terminal device 200A together with the exercise menu information S22, and is displayed by the display unit 240 of the user terminal device 200A.

[0040] It is desirable that the display unit 240 and the form determination unit 250 visually and quantitatively display the load applied to the skeletal muscles by the user's exercise and the accuracy of the exercise form. Furthermore, the display unit 240 may display warning information when there is a large difference between the user's movement and the reference movement included in the exercise menu.

[0041] The exercise menu creation unit 140 may classify and create an exercise menu suitable for the user (exercise menu with good form determination results) and an exercise menu suitable for the user (exercise menu with poor form determination results) for each posture tendency based on the posture analysis results, using the posture analysis results and form determination results of many users stored in the storage unit 170 in addition to or instead of the difference between the user's movement and the reference movement, the skeletal muscle activity amount information, and the amount of change between the first posture analysis result and the second posture analysis result. For example, the exercise menu creation unit 140 may cause a machine learning model to learn the form determination results for the posture analysis results as learning data, and output a suitable exercise menu from the machine learning model in response to inputting the posture analysis results into the machine learning model.

[0042] As described above, according to the exercise support system 1A of the second embodiment, a moving image of a user exercising according to exercise menu information is acquired, skeletal muscle activity information is estimated based on the exercise menu information and the moving image, and proposal information for correcting the user's movement can be created based on the difference between the user's movement in the moving image and the reference movement and the skeletal muscle activity information. Also, according to the exercise support system 1A, the exercise menu information can be changed based on at least one of the difference between the user's movement and the reference movement, the skeletal muscle activity information, and the change amount between the first posture analysis result and the second posture analysis result. As a result, according to the exercise support system 1A, an exercise support program can be provided that allows the user to quantitatively feel the skeletal muscle activity based on the form judgment and the form.

[0043] (Third embodiment) 8 is a block diagram showing an example of an exercise support system 1B in the third embodiment. The exercise support system 1B in the third embodiment differs from the above-mentioned embodiment in that the user terminal device 200B includes a form determination unit 250, a posture analysis unit 260, a muscle activity amount estimation unit 262, an exercise menu creation unit 264, and a presentation information creation unit 266. The form determination unit 250, the posture analysis unit 260, the muscle activity amount estimation unit 262, the exercise menu creation unit 264, and the presentation information creation unit 266 are functional units realized by, for example, the computer of the user terminal device 200 executing an exercise support program. The posture analysis unit 260 corresponds to the posture analysis unit 130, the muscle activity amount estimation unit 262 corresponds to the muscle activity amount estimation unit 135, the exercise menu creation unit 264 corresponds to the exercise menu creation unit 140, and the presentation information creation unit 266 corresponds to the presentation information creation unit 150.

[0044] The user terminal device 200B transmits a request including the user basic data accepted by the information input unit 220 to the server device 100B. The server device 100B accepts a request to use an exercise assistance program by the request accepting unit 110, for example, and stores the user basic data 172 and the user past data 174 in the storage unit 170.

[0045] In the user terminal device 200B, the imaging unit 230 captures a standing whole-body image of the user, and the posture analysis unit 260 acquires a first posture analysis result representing the balance of the user's skeletal muscles. If an exercise menu for the user has not been created, the exercise menu creation unit 264 creates exercise menu information based on the first posture analysis result, and the display unit 240 displays the exercise menu information. The imaging unit 230 acquires a moving image of the user exercising according to the exercise menu information. The form determination unit 250 determines the form of the user exercising according to the exercise menu information, and the muscle activity estimation unit 262 estimates skeletal muscle activity information based on the exercise menu information and the moving image. Thereafter, the imaging unit 230 captures a standing whole-body image of the user, and the posture analysis unit 260 acquires a second posture information representing the balance of the user's skeletal muscles. The exercise menu creation section 264 changes the exercise menu information based on the skeletal muscle activity amount information and the amount of change between the first posture analysis result and the second posture analysis result, and the display section 240 displays the changed exercise menu information.

[0046] The user terminal device 200B may transmit to the server device 100B a request to store the user past data 174 including the user basic data 172, the posture analysis result, the exercise menu information, the moving image, the form determination result, and the skeletal muscle activity amount information. When updating the exercise menu based on the past posture analysis result, the user terminal device 200B can acquire the user past data 174 by transmitting a request to acquire the user past data 174 to the server device 100B.

[0047] As described above, according to the third embodiment, by simply installing an exercise support program for realizing functional units such as the form determination unit 250, the posture analysis unit 260, the muscle activity estimation unit 262, the exercise menu creation unit 264, and the presentation information creation unit 266 in a terminal device, exercise can be easily supported using a smartphone or the like.

[0048] (Fourth embodiment) FIG. 9 is a block diagram showing an example of an exercise support system 1C according to the fourth embodiment. The information acquisition unit 120 in the server device 100C may acquire basic information for each user, acquire exercise menu information corresponding to a second user having basic information similar to the acquired basic information of the first user, and the presentation information creation unit 150 and the information provision unit 160 may present the exercise menu created based on the exercise menu information corresponding to the second user to the first user. The storage unit 170 stores, for example, other user data 176 in addition to the user basic data 172 and user past data 174 for each user. The other user data 176 is information in which, for example, basic information such as age, height, weight, and sex are associated with a user ID, exercise menu information, posture analysis results, and muscle activity amount information.

[0049] FIG. 10 is a flowchart showing an example of an operation procedure of the exercise support system 1C in the fourth embodiment. The information input unit 220 accepts the operation of the first user and transmits a request S10 including basic information to the server device 100C. When the request receiving unit 110 accepts the request S10, the storage unit 170 stores the basic information in the storage unit 170 in association with the user ID (step ST10). The server device 100C transmits a request information S12 for posture information to the user terminal device 200C corresponding to the first user. The imaging unit 230 captures a still image of the first user (step ST12) and transmits the first posture information S14 to the server device 100C. The information acquisition unit 120 acquires the first posture information S14, the posture analysis unit 130 analyzes the first posture information S14 (step ST14), and the presentation information creation unit 150 and the information provision unit 160 transmit the first posture analysis result S16 to the user terminal device 200C.

[0050] Next, the exercise menu creation unit 140 searches for a second user having basic information similar to the basic information of the first user from the other user data 176 stored in the storage unit 170 (step ST50). The exercise menu creation unit 140 acquires an exercise menu of the searched second user from the user past data 174, and creates an exercise menu of the first user based on the acquired exercise menu (step ST16). The presentation information creation unit 150 and the information providing unit 160 transmit the created exercise menu information S18 to the user terminal device 200C. This allows the display unit 240 to display the posture analysis result and the exercise menu based on the first posture analysis result S16 and the exercise menu information S18.

[0051] The user terminal device 200C displays the posture comparison result of the user in response to acquiring the posture comparison result S28 from the server device 100C. The information input unit 220 accepts an operation by the user to share information such as basic information about the user, an exercise menu, a video image, and a posture comparison result. The communication unit 210 transmits a sharing request S40 including the information permitted to be shared to the server device 100C. The server device 100C accepts the sharing request S40 and stores the information to be shared in the storage unit 170. The presentation information creation unit 150 creates content including the information permitted to be shared based on the sharing request S40 for the user, and the information providing unit 160 can transmit the created content to other users.

[0052] In the fourth embodiment, the information acquisition unit 120 in the server device 100C may acquire goal information for each user, acquire exercise menu information corresponding to a second user having goal information similar to the acquired goal information of the first user, and the presentation information creation unit 150 and the information provision unit 160 may present the exercise menu information created based on the exercise menu information corresponding to the second user to the first user. The goal information may be, for example, a body shape that the user is aiming for, a sport that the user is engaged in, etc.

[0053] As shown in FIG. 10, the information input unit 220 accepts an operation of the first user and transmits a request S10 including goal information in addition to or instead of the basic information to the server device 100. When the request receiving unit 110 accepts the request S10, the storage unit 170 stores the goal information in the storage unit 170 in association with the user ID (step ST10). The server device 100C transmits a request information S12 for posture information to the user terminal device 200C corresponding to the first user. The imaging unit 230 captures a still image of the first user (step ST12) and transmits the first posture information S14 to the server device 100C. The information acquisition unit 120 acquires the first posture information S14, the posture analysis unit 130 analyzes the first posture information S14 (step ST14), and the presentation information creation unit 150 and the information provision unit 160 transmit the first posture analysis result S16 to the user terminal device 200C.

[0054] Next, the exercise menu creation unit 140 searches for a second user having goal information similar to the goal information of the first user from the user basic data 172 stored in the storage unit 170 (step ST50). The exercise menu creation unit 140 acquires an exercise menu of the searched second user from the user past data 174, and creates an exercise menu of the first user based on the acquired exercise menu (step ST16). The presentation information creation unit 150 and the information providing unit 160 transmit the created exercise menu information S18 to the user terminal device 200C. This allows the display unit 240 to display the posture analysis result and the exercise menu based on the first posture analysis result S16 and the exercise menu information S18.

[0055] As described above, according to the exercise supporting system 1C in the fourth embodiment, an exercise menu can be created using the other user data 176, so that an effective exercise menu can be recommended to the user.

[0056] Although each embodiment and each variant have been described, these are merely examples and are not intended to be limiting. For example, any of the embodiments or variants, or a part of each embodiment or a part of each variant, may be combined with one or more other embodiments or one or more other variants to realize one aspect of the present invention. [Explanation of symbols]

[0057] 1, 1A, 1B, 1C...exercise support system, 100, 100A, 100B, 100C...server device, 110...request reception unit, 120...information acquisition unit, 130...posture analysis unit, 135...muscle activity estimation unit, 140...exercise menu creation unit, 150...presentation information creation unit, 160...information provision unit, 170...storage unit, 172...user basic data, 174...user past data, 176...other user data, 200, 200A, 200B, 200C...user terminal device, 210...communication unit, 220...information input unit, 230...imaging unit, 240...display unit, 250...form determination unit, 260...posture analysis unit, 262...muscle activity estimation unit, 264...exercise menu creation unit, 266...presentation information creation unit

Claims

1. On the computer, obtaining a first posture analysis indicative of a muscular balance of the user; creating exercise menu information based on the first posture analysis result; changing the exercise menu information based on at least one of the exercise menu information and skeletal muscle activity information estimated based on a video image of the user exercising according to the exercise menu information and an amount of change between the first posture analysis result and a second posture analysis result representing a balance of the skeletal muscles of the user exercising according to the exercise menu information; An exercise support program that helps people achieve their goals.

2. On the computer, acquiring the moving image of the user exercising according to the exercise menu information; estimating skeletal muscle activity information based on the exercise menu information and the video image; creating video data representing the activity amount information of the skeletal muscle, and displaying the video data on a terminal device corresponding to the user; The exercise support program according to claim 1 , further comprising:

3. On the computer, acquiring the moving image of the user exercising according to the exercise menu information; estimating skeletal muscle activity information based on the exercise menu information and the video image; creating proposal information for correcting the user's motion based on a difference between the user's motion in the moving image and a reference motion and on the skeletal muscle activity amount information, and displaying the proposal information on a terminal device corresponding to the user; The exercise support program according to claim 1 , further comprising:

4. On the computer, acquiring the moving image of the user exercising according to the exercise menu information; and estimating the skeletal muscle activity information based on the exercise menu information and the moving image.

2. The exercise support program according to claim 1, wherein the exercise menu information is changed based on at least one of a difference between the user's movement in the moving image and a reference movement, skeletal muscle activity information, and an amount of change between the first posture analysis result and the second posture analysis result.

5. On the computer, acquiring basic information for each user; Obtaining exercise menu information corresponding to a second user having basic information similar to the basic information of the first user; presenting exercise menu information created based on exercise menu information corresponding to the second user to the first user; The exercise support program according to claim 1 , further comprising:

6. On the computer, acquiring goal information for each user; Obtaining exercise menu information corresponding to a second user having goal information similar to the goal information of the first user; presenting exercise menu information created based on exercise menu information corresponding to the second user to the first user; The exercise support program according to claim 1 , further comprising:

7. an information acquisition unit that acquires a first posture analysis result representing a balance of a skeletal muscle of a user; an exercise menu creation unit that creates exercise menu information based on the first posture analysis result acquired by the information acquisition unit; a muscle activity estimation unit that estimates skeletal muscle activity information based on a video image of the user exercising according to the exercise menu information and the exercise menu information created by the exercise menu creation unit; the exercise menu creation unit changes the exercise menu information based on at least one of the skeletal muscle activity amount information estimated by the muscle activity amount estimation unit and an amount of change between the first posture analysis result acquired by the information acquisition unit and a second posture analysis result representing a balance of the skeletal muscles of the user who exercised according to the exercise menu information. Exercise support system.

8. An information acquisition unit acquires a first posture analysis result representing a balance of a skeletal muscle of a user; an exercise menu creation unit creating exercise menu information based on the first posture analysis result; changing the exercise menu information based on at least one of the exercise menu information and skeletal muscle activity information estimated based on a video image of the user exercising according to the exercise menu information and the amount of change between the first posture analysis result and a second posture analysis result representing a balance of the skeletal muscles of the user exercising according to the exercise menu information; An exercise support method comprising:

Images