Information processing program, information processing device, and information processing method

Abstract

An information processing program, an information processing device, and an information processing method are provided that can assist a user in exercising so as to stabilize the user's exercise load. [Solution] The information processing program causes a processor to execute the following: acquiring a user video of a user 70 performing an exercise type, inputting the user video to an evaluation model that outputs an evaluation result regarding the exercise captured in the input video, and acquiring a user exercise evaluation regarding the exercise load of the user 70 captured in the user video from the evaluation model. The user exercise evaluation includes an evaluation that the fluctuation of the estimated load, which is an estimated value of the exercise load of the user 70 captured in the user video, is within a set fluctuation range.

Description

[Technical field]

[0001] The present disclosure relates to an information processing program, an information processing device, and an information processing method. [Background technology]

[0002] As described in Patent Document 1, a cardiac rehabilitation support device is known that adjusts the exercise load of a pedaling motion of a subject based on the subject's biosignals. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-120910 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the exercise therapy, the effectiveness of the exercise therapy decreases when the exercise load of the user is insufficient. Also, the safety of the exercise therapy decreases when the exercise load of the user is excessive. Therefore, it is required to support the user to stabilize the exercise load of the user.

[0005] The present disclosure has been made in consideration of the above-mentioned points, and aims to provide an information processing program, an information processing device, and an information processing method that can assist a user in exercising so as to stabilize the exercise load of the user. [Means for solving the problem]

[0006] According to an embodiment of the present disclosure, an information processing program (1) causes a processor to acquire a user video of a user performing an exercise, input the user video to an evaluation model that outputs an evaluation result regarding the exercise captured in the input video, and acquire a user exercise evaluation regarding an exercise load of the user captured in the user video from the evaluation model as the evaluation result. The user exercise evaluation includes an evaluation that a fluctuation in an estimated load, which is an estimated value of the exercise load of the user captured in the user video, is within a set fluctuation range.

[0007] (2) In the information processing program described in (1) above, the exercise type may be defined so that an exercise load is constant when the exercise is performed according to the exercise type.

[0008] (3) In the information processing program described in (1) or (2) above, the user exercise evaluation may include an evaluation that the difference between a standard load, which is a standard exercise load when the user performs the exercise type, and the estimated load is within a load setting range.

[0009] (4) In the information processing program according to any one of (1) to (3) above, the exercise type may include a plurality of unit exercises. The exercise type may be defined such that a unit standard load, which is a standard exercise load when the user performs each of the plurality of unit exercises, is equal to each other.

[0010] (5) In the information processing program described in (4) above, the user exercise evaluation may include an evaluation that a fluctuation in a unit estimated load, which is an estimated value of the exercise load of the user for each of the plurality of unit exercises, is within a unit fluctuation setting range.

[0011] (6) In the information processing program described in (5) above, the information processing program may include the number of unit exercises in which the difference between the standard unit load and the estimated unit load is within a unit load setting range.

[0012] (7) In the information processing program according to any one of (1) to (6) above, the user exercise evaluation may include a score that is calculated to be a higher value as the variation in the estimated load is closer to zero.

[0013] (8) In the information processing program described in any one of (4) to (6) above, the user exercise evaluation may include a unit exercise score that is calculated to be a higher value the closer the fluctuation of a unit estimated load, which is an estimate of the exercise load of the user for each of the multiple unit exercises, is to 0.

[0014] (9) In the information processing program according to any one of (1) to (8) above, the standard load for the type of exercise performed by the user may be an exercise load equivalent to the anaerobic metabolic threshold of the user.

[0015] (10) In the information processing program described in any one of (1) to (9) above, the evaluation model may be configured to further input the state of the user during at least a portion of a period or at least a portion of a time point of the entire period of the user video, and may be configured to output as the evaluation result that the level of the user's exercise load is constant at an estimated level based on the state of the user during the entire period of the user video.

[0016] (11) In the information processing program described in (10) above, the evaluation model may be configured to output, as the evaluation result, that the level of the user's exercise load is constant at the reference level when the estimated level is a reference level.

[0017] (12) In the information processing program according to any one of (1) to (11) above, the exercise type may be defined so that the user can perform the exercise in a standing position.

[0018] An information processing device according to an embodiment of the present disclosure (13) includes a processor. The processor acquires a user video of a user performing an exercise, inputs the user video into an evaluation model that outputs an evaluation result regarding the exercise captured in the input video, and acquires, from the evaluation model, a user exercise evaluation regarding an exercise load of the user captured in the user video as the evaluation result, the user exercise evaluation including an evaluation that a fluctuation in an estimated load, which is an estimated value of the exercise load of the user captured in the user video, is within a set fluctuation range.

[0019] An information processing method according to an embodiment of the present disclosure (14) includes a processor acquiring a user video of a user performing an exercise type, inputting the user video to an evaluation model that outputs an evaluation result regarding the exercise captured in the input video, and acquiring a user exercise evaluation regarding an exercise load of the user captured in the user video from the evaluation model as the evaluation result. The user exercise evaluation includes an evaluation that a fluctuation in an estimated load, which is an estimated value of the exercise load of the user captured in the user video, is within a set fluctuation range. Effect of the Invention

[0020] According to the information processing program, information processing device, and information processing method disclosed herein, exercise is supported so that the exercise load of the user is stabilized. [Brief description of the drawings]

[0021] [Figure 1] 1 is a block diagram showing a configuration example of an information processing system according to the present disclosure. [Diagram 2] FIG. 1 is a schematic diagram illustrating an example of how an information processing system is used to support a user's exercise. [Diagram 3] FIG. 13 is a diagram showing an example of a screen of an information processing device that supports a user's exercise. [Figure 4] 13 is a flowchart showing an example of a procedure for outputting an evaluation result of a user's exercise. [Diagram 5]13 is a flowchart showing an example of a procedure for evaluating a user's exercise with a score. [Figure 6] 13 is a flowchart showing an example of a procedure for dividing a user's exercise into unit exercises and evaluating the unit exercises. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] Exercise therapy that utilizes exercise for the treatment or prevention of diseases and the like is known. It is preferable that a target user of exercise therapy exercise with an appropriate amount of exercise load. Here, the amount of exercise load is an index that represents the burden placed on the target user's body when the target user exercises. The amount of exercise load may be defined based on the amount of oxygen intake or energy consumption when the target user is exercising. The amount of exercise load may be defined based on the amount of physical work done when the target user is exercising. The amount of exercise load is not limited to these examples and may be defined based on various information.

[0023] In exercise therapy, the higher the exercise load of the target user of the exercise therapy, the higher the effectiveness of the exercise therapy. On the other hand, if the exercise load is too high, the target user's body is overburdened and safety is reduced. Therefore, an exercise load that can increase both the effectiveness and safety of the exercise therapy is determined as an appropriate exercise load for the exercise therapy.

[0024] In addition, when the exercise load during exercise varies from the appropriate load, the load becomes too high or too low. When the load becomes too high or too low, the effectiveness or safety of the exercise therapy decreases. Therefore, in the exercise therapy, it is required to exercise with a stable load.

[0025] It is believed that the amount of exercise load stabilizes by repeating the same exercise. In fact, it has been confirmed that the amount of exercise load reaches a plateau, that is, the amount of oxygen intake and heart rate can be adjusted to a certain range, by continuously performing the exercise with a defined range of motion and pace.

[0026] An appropriate exercise stress amount in exercise therapy is, for example, an exercise stress amount equivalent to the anaerobic threshold (AT) of a target user of the exercise therapy. When the exercise stress amount of the target user is an exercise stress amount equivalent to around the AT, the effect of the exercise therapy is likely to be observed. Therefore, it is preferable to define the exercise so that the exercise stress amount of the target user can be adjusted to an exercise stress amount equivalent to around the AT.

[0027] However, even if a target user of exercise therapy imitates exercises defined to make the effects of exercise therapy more likely to appear, the target user's movements may differ from the defined exercises, resulting in insufficient or excessive load, rather than the intended amount of exercise load. Insufficient load reduces the effectiveness of exercise therapy. Overload reduces the safety of exercise therapy. Therefore, it is necessary to confirm whether the target user is performing exercises with a stable amount of exercise load.

[0028] In order to stabilize the exercise load of a target user of the exercise therapy, it is possible to use equipment capable of adjusting the exercise load, such as an ergometer. However, the target user needs to travel to a facility where the equipment, such as an ergometer, is installed in order to use the equipment. In addition, it is not easy to install the equipment in the target user's home. In other words, the convenience of the target user when performing the exercise therapy is reduced. Due to the low convenience of the target user when performing the exercise therapy, the user may not be able to easily perform the exercise therapy and may not be able to continue performing the exercise therapy.

[0029] In order to carry out exercise so that the exercise load reaches a plateau without using equipment such as an ergometer, it is possible to carry out exercise that matches a sample exercise defined so that the exercise load reaches a plateau, for example.

[0030] As a method for confirming that the exercise is being performed so that the exercise stress reaches a plateau, it is possible to confirm that the movement of the target user of the exercise therapy matches the sample exercise. However, even if the movement of the target user does not match the sample movement of the defined exercise, the exercise stress may reach a plateau. Therefore, the fact that the exercise stress reaches a plateau may be overlooked.

[0031] In addition, as a method for confirming that a target user of an exercise therapy is able to perform exercise so that the exercise load reaches a plateau, it is possible to actually measure the exercise load of the target user and confirm that the plateau has been reached. It is not easy to measure the oxygen intake of the target user while exercising as information defining the exercise load of the target user, because it is necessary to analyze the exhaled gas of the target user. In addition, it is not easy to measure the energy consumption of the target user while exercising as information defining the exercise load of the target user.

[0032] As described above, it is difficult to confirm that a target user of an exercise therapy is able to perform exercise so that the exercise stress amount reaches a plateau. It is required to easily confirm that a target user is able to perform exercise so that the exercise stress amount reaches a plateau.

[0033] Hereinafter, it will be described that the information processing system 1 (see FIG. 1) according to the present disclosure can easily confirm that the target user of the exercise therapy is able to perform the exercise so that the exercise stress reaches a plateau, i.e., at a stable exercise stress. By being able to easily confirm that the target user is able to perform the exercise at a stable exercise stress, the target user can easily adjust and perform the exercise so that the exercise stress is stable. In other words, the information processing system 1 according to the present disclosure can support the target user of the exercise therapy to perform the exercise at a stable exercise stress.

[0034] (Example of configuration of information processing system 1) As shown in FIG. 1, an information processing system 1 according to the present disclosure includes an information processing device 10. The information processing system 1 further includes a server 20, although this is not essential. The information processing device 10 and the server 20 are communicatively connected via a wired or wireless network 40. The information processing device 10 and the server 20 may be communicatively connected directly without the network 40. The information processing system 1 further includes a wearable device 30, although this is not essential. The information processing device 10 and the wearable device 30 are communicatively connected via the network 40 or without the network 40.

[0035] <Information processing device 10> The information processing device 10 includes a processor 11, a storage unit 12, a communication unit 13, an input unit 14, an output unit 15, and a camera 16.

[0036] The processor 11 controls the operation of the information processing device 10 and realizes the functions of the information processing device 10. The processor 11 may be configured to include one or more general-purpose processors or dedicated circuits. The general-purpose processor may include a central processing unit (CPU) or a graphics processing unit (GPU), etc. The dedicated circuit may include a field-programmable gate array (FPGA) or an application specific integrated circuit (ASIC), etc.

[0037] The storage unit 12 stores any data, information, or program used for the operation of the information processing device 10. The storage unit 12 may store, for example, a system program such as an OS (Operating System) or an application program. The application program may include, for example, a web browser, a therapeutic application, a rehabilitation application, or a fitness application program. Diseases targeted by therapeutic applications or rehabilitation applications may include, for example, lifestyle-related diseases such as heart disease, hypertension, diabetes, dyslipidemia, or hyperlipidemia, or diseases such as obesity whose symptoms may be improved by exercise. The data may include, for example, a database referred to in the information processing, or data obtained by executing the information processing, that is, the execution result of the information processing.

[0038] The storage unit 12 may include, for example, a semiconductor memory, a magnetic memory, an optical memory, or the like, but is not limited to these. The storage unit 12 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 12 may include an electromagnetic storage medium such as a magnetic disk. The storage unit 12 may include a non-transitory computer-readable medium. The storage unit 12 may be included in the processor 11.

[0039] The communication unit 13 may include a communication module configured to be able to communicate with other devices such as the server 20. The communication module may be compatible with mobile communication standards such as 4G (4th Generation) or 5G (5th Generation). The communication module may be compatible with communication standards such as LAN (Local Area Network). The communication module may be compatible with wired or wireless communication standards. The communication module is not limited to these standards and may be compatible with various communication standards.

[0040] The input unit 14 may be configured to include an input device that accepts input of information or data from a user of the information processing system 1. The input device may be configured to include, for example, a touch panel or a touch sensor, or a pointing device such as a mouse. The input device may be configured to include physical keys. The input device may be configured to include a voice input device such as a microphone. The input unit 14 may include an input interface configured to be connectable to an external input device. The input unit 14 may be configured to be able to acquire information or data input to the external input device via the input interface.

[0041] The output unit 15 may be configured to include an output device that outputs information or data to a user of the information processing system 1. The output device may include, for example, a display device that outputs visual information such as an image, character, or figure. The display device may include, for example, an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence) display or an inorganic EL display, or a PDP (Plasma Display Panel). The display device is not limited to these displays and may include displays of various other types. The display device may include a light-emitting device such as an LED (Light Emitting Diode) or an LD (Laser Diode). The display device may include various other devices. The output device may include, for example, an audio output device such as a speaker that outputs auditory information such as sound. The output device is not limited to these examples and may include various other devices. The output unit 15 may include an output interface configured to be connectable to an external output device. The output unit 15 may be configured to be able to output information or data to an external output device via the output interface.

[0042] The camera 16 captures an image of a subject and outputs a still image or a video of the subject. In the present disclosure, the camera 16 captures an image of a subject of exercise therapy performing exercise as the subject and outputs the captured video.

[0043] The camera 16 may include a stereo camera capable of measuring distance data to a target object. The camera 16 may be configured to acquire point cloud data of the target object. The information processing device 10 may include a distance sensor or a point cloud data generating device separate from the camera 16.

[0044] The camera 16 may be configured as an external camera separate from the information processing device 10. When the camera 16 is configured as an external camera, the information processing device 10 may acquire a user video from the external camera via an input interface of the input unit 14, for example.

[0045] The information processing device 10 may be configured to include a mobile terminal such as a smartphone or a tablet, or a PC such as a notebook PC (Personal Computer) or a tablet PC. The information processing device 10 is not limited to these examples and may be configured to include various devices.

[0046] <Server 20> The server 20 may include a server control unit. The server control unit controls the operation of the server 20 and realizes the functions of the server 20. The server control unit may be configured to include one or more general-purpose processors or dedicated circuits. The general-purpose processor may include a CPU, a GPU, or the like. The dedicated circuit may include an FPGA, an ASIC, or the like. The server control unit may be configured in the same manner as the processor 11 of the information processing device 10.

[0047] The server 20 may include a server storage unit. The server storage unit stores any data, information, or programs used in the operation of the server 20. The server storage unit may be configured in the same manner as the storage unit 12 of the information processing device 10.

[0048] The server 20 may include a server communication unit. The server communication unit may include a communication module configured to be able to communicate with other devices such as the information processing device 10. The server communication unit may be configured similarly to the communication unit 13 of the information processing device 10.

[0049] The server 20 may include a server input unit. The server input unit may be configured similarly to the input unit 14 of the information processing device 10. The server 20 may include a server output unit. The server output unit may be configured similarly to the output unit 15 of the information processing device 10.

[0050] The server 20 may be configured to include one or more server devices that can communicate with each other. The server 20 may be realized as a cloud server.

[0051] <Wearable Devices 30> The wearable device 30 is configured to be wearable on the body of a user who is a target of exercise therapy. The wearable device 30 may include a sensor.

[0052] The sensor may include, for example, a heart rate sensor. The heart rate sensor measures the heart rate of the target user when the wearable device 30 is worn on the body of the target user of the exercise therapy, and outputs a measurement result of the heart rate of the target user. The measurement result of the heart rate may include a heart rate. The measurement result of the heart rate may include a heart rate waveform. The heart rate sensor may be configured to measure the heart rate by an optical measurement technique.

[0053] The sensor may include, for example, an acceleration sensor configured to detect the acceleration of a part of the target user wearing the wearable device 30.

[0054] The wearable device 30 may include a device control unit. The device control unit controls the operation of the wearable device 30 and realizes the functions of the wearable device 30. The device control unit may be configured in the same manner as the processor 11 of the information processing device 10.

[0055] The wearable device 30 may include a device storage unit. The device storage unit stores any data, information, or program used in the operation of the wearable device 30. The device storage unit may be configured in the same manner as the storage unit 12 of the information processing device 10.

[0056] The wearable device 30 may include a device communication unit. The device communication unit may include a communication module configured to be able to communicate with other devices such as the information processing device 10. The device communication unit may be configured similarly to the communication unit 13 of the information processing device 10.

[0057] The wearable device 30 may include a device input unit. The device input unit may be configured similarly to the input unit 14 of the information processing device 10. The wearable device 30 may include a device output unit. The device output unit may be configured similarly to the output unit 15 of the information processing device 10.

[0058] (Example of operation of information processing system 1) As illustrated in FIG. 2, the information processing system 1 captures an image of a user performing exercise, i.e., an exercise user 70, with the camera 16 of the information processing device 10 installed on a tripod. The camera 16 may be installed so as to capture an image of the entire body of the exercise user 70 performing exercise from the front or diagonally forward. The camera 16 may be installed, for example, about 2 m away from the exercise user 70. The camera 16 may be installed at an appropriate height for the exercise user 70 by using a height adjustment means such as a tripod. A video of the exercise user 70 captured by the camera 16 is also referred to as a user video. The user video may include distance data or point cloud data of the exercise user 70.

[0059] In this operation example, the exercise user 70 is assumed to be a user who is a target of exercise therapy. The exercise therapy may include cardiac rehabilitation or exercise instruction. The exercise user 70 may be a user who performs exercise regardless of exercise therapy. The exercise user 70 may perform exercise defined to have an exercise load based on the plan or instruction of the exercise therapy. The exercise user 70 may perform exercise while watching a video showing a sample of the exercise, as described below. The exercise user 70 may perform exercise based on oral or written explanations of the exercise.

[0060] The processor 11 of the information processing device 10 acquires a user video from the camera 16. The processor 11 may store the user video in the storage unit 12. The processor 11 evaluates whether the exercise user 70 can exercise at an exercise load that has reached a plateau, that is, a constant exercise load, based on the user video. The processor 11 may output an evaluation of pass / fail when the exercise user 70 can exercise at a constant exercise load.

[0061] The amount of exercise stress may vary depending on the timing when the person performing the exercise moves at least a part of the body. Therefore, when the change in the amount of exercise stress is captured at a short time interval, the change in the amount of exercise stress may become large and the amount of exercise stress may not be constant. However, the stability of the amount of exercise stress required in exercise therapy is sufficient if the amount of exercise stress is constant when the change in the amount of exercise stress is captured at a long span. Therefore, the processor 11 may, for example, calculate a moving average of the amount of exercise stress over a period corresponding to the period in which at least a part of the body is repeatedly moved during exercise, and output an evaluation of pass when the amount of exercise stress after the moving average is constant. The period for calculating the moving average is not limited to the above example and may be set appropriately depending on the content of the exercise.

[0062] The processor 11 may evaluate whether the exercise user 70 is able to perform exercise defined to have an exercise load based on the exercise therapy plan or instruction.

[0063] A specific operation example of the information processing system 1 will be described below.

[0064] <user profile> If the exercise user 70 is a target user of exercise therapy, the exercise user 70 may perform exercise defined to have an exercise load suitable for the exercise user 70 based on the plan or instruction of the exercise therapy. The processor 11 of the information processing device 10 may manage a user profile of the exercise user 70 in order to suggest exercise defined to have an exercise load suitable for the exercise user 70. The user profile may include information that associates an ID or user name that identifies the exercise user 70 with a target load of the exercise user 70, as shown in Table 1 below. In Table 1, the target load of the exercise user 70 with the user name XYZ is 3.5 METs.

[0065] [Table 1]

[0066] The target load is information on a target value of the exercise load when the exercise user 70 performs exercise. The exercise load may be defined by, for example, oxygen intake, energy consumption, or heart rate, or a combination of these items.

[0067] As an example, the target load may be set by a person in charge, such as a doctor, who plans or instructs the exercise therapy, based on the results of measuring the exercise tolerance of the exercise user 70 by a cardiopulmonary exercise stress test, i.e., a CPX test, or the results of measuring the heart rate by a heart rate sensor when using an ergometer. The CPX test can determine the anaerobic metabolic threshold (AT) of the person being tested based on the measurement results of oxygen intake, carbon dioxide output, tidal volume, respiratory rate, or minute ventilation, or a combination thereof, etc., by exhaled gas analysis. The CPX test can also determine a maximum oxygen intake equivalent to an exercise intensity near the maximum exercise tolerance, without being limited to the AT. The person in charge of planning or instructing the exercise therapy may set the target load based on the oxygen intake or heart rate when the exercise user 70 exercises at an exercise load equivalent to the AT.

[0068] The target load may be set by a doctor's judgment, not based on the measurement result. As another example, the target load may be determined by an algorithm based on the result of measuring the exercise tolerance of the exercise user 70 by, for example, a CPX test.

[0069] In order to safely and effectively perform aerobic exercise, the exercise user 70 preferably performs exercise at an exercise load equivalent to near the AT of the exercise user 70. Therefore, an exercise load equivalent to the AT of the exercise user 70 may be set as the target load of the exercise user 70. An exercise load calculated based on another standard may also be set as the target load of the exercise user 70.

[0070] The amount of exercise load suitable for the exercise therapy of the exercise user 70, or the type of exercise corresponding to the amount of exercise load, may be determined by a person in charge of planning or instructing the exercise therapy of the exercise user 70. The person in charge of planning or instructing the exercise therapy may include, for example, a medical professional, a nutritionist, or a trainer. The medical professional may include a doctor, a nurse, a pharmacist, a physical therapist, an occupational therapist, a clinical laboratory technician, or the like. The amount of exercise load suitable for the exercise therapy of the exercise user 70, or the type of exercise corresponding to the amount of exercise load, may be associated with an ID or the like that identifies the exercise user 70 in a user profile.

[0071] As an example of an exercise prescription, the doctor may set an upper limit of the exercise load of the exercise user 70. The upper limit of the exercise load of the exercise user 70 may be associated with an ID or the like that identifies the exercise user 70 in the user profile. When an upper limit of the exercise load is set, the exercise user 70 is not permitted to select an exercise type that exceeds the set upper limit of the exercise load.

[0072] A UI (User Interface) screen for exercise prescription may be displayed on the display of a terminal used by a doctor for exercise prescription. The UI screen may include, for example, a display of CPX data of the exercise user 70, or a display of sample videos of a plurality of exercise types selectable by the exercise user 70. The sample videos of each exercise type may be displayed in order based on the exercise load amount corresponding to the exercise type. For example, when 3.6 METs is recommended as the upper limit of the exercise load amount of the subject of the exercise prescription based on the measurement result of the CPX test, sample videos of exercise types corresponding to 3.4 METs, 3.6 METs, and 3.8 METs may be displayed on the UI screen. When a doctor selects a sample video of one of the exercise types, the exercise load amount associated with the exercise type corresponding to the selected sample video is set as the upper limit of the exercise user 70.

[0073] The upper limit of the exercise load specified by the doctor's exercise prescription may be changed by a medical professional under the supervision of a doctor during regular medical guidance, for example, every two weeks, or during a doctor's rounds.

[0074] The user profile may include information that associates physical information of the exercise user 70 with an ID or user name that identifies the exercise user 70. The physical information is information about the body or physical functions of the exercise user 70. As an example, the physical information may include information such as the age, sex, weight, or height of the exercise user 70, or information about a disease or the like of the exercise user 70.

[0075] The user profile may include information identifying an individual planning or supervising the exercise regimen of the exercise user 70, or information identifying the exercise user's 70 physician.

[0076] The user profile may be stored in the storage unit 12 of the information processing device 10, the server storage unit of the server 20, or another storage device such as a database.

[0077] <Sports> When the exercise user 70 is a target user of the exercise therapy, he / she performs a target exercise type of the exercise therapy. The target exercise type of the exercise therapy is an exercise type defined so that the exercise load amount is based on the plan or instruction of the exercise therapy. In the present disclosure, the target exercise type is defined so that the exercise load amount is constant when the exercise is performed exactly as defined. The standard load amount of the target exercise type may be an exercise load amount equivalent to the anaerobic metabolic threshold of the target user.

[0078] The exercise type may be defined so that the exercise can be performed without using special equipment such as an ergometer. The exercise type may be defined so that the user who is the target of the exercise therapy can perform the exercise in a standing position. In this way, obstacles to the implementation of the exercise therapy are reduced.

[0079] Information regarding the target exercise type of the exercise therapy may be stored in the memory unit 12 of the information processing device 10, the server memory unit of the server 20, or a storage device such as another database. Information regarding the target exercise type of the exercise therapy may include an explanation necessary for the exercise user 70 to perform the target exercise type of the exercise therapy. The explanation of the target exercise type may be provided as a sample video. The sample video is a video in which a trainer or the like demonstrates a sample of the movements of the exercise type. The explanation of the target exercise type may be provided as audio data that provides an oral explanation, or text data that provides a written explanation, or the like. In this operation example, the explanation of the target exercise type is provided as a sample video.

[0080] Information on the target exercise type of the exercise therapy may be associated with an ID or name that identifies the exercise type and a standard load, as shown in the following Table 2. In Table 2, the standard load of the exercise type called "leg lift" is 4.5 METs, and the standard load of the exercise type called "exercise A" is 2.5 METs.

[0081] [Table 2]

[0082] The standard load for an exercise type is, for example, information on the exercise load when a person with standard physical function performs the target exercise type. In other words, the exercise type is defined so that the standard exercise load when the exercise is performed exactly as defined is the standard load. The standard load for an exercise type may be derived, for example, by measuring the average oxygen intake of each person by exhaled gas analysis when the target exercise type is performed by multiple people, and performing statistical processing such as averaging on the measurement results of the average oxygen intake. The measurement item for deriving the standard load is not limited to the average oxygen intake, and may be other items such as energy consumption. The standard load may be obtained as the exercise load set by a third-party institution.

[0083] The standard load may be associated with an exercise that is more subdivided than a generally recognized exercise type. As an example, an exercise type may include a plurality of variations in which at least one element, such as form, pace, number of reps, or time or number of rest periods, is changed. The standard load may be associated with each of the exercises obtained by subdividing a generally recognized exercise type by variation. In other words, an exercise generally recognized as a single type may be defined as a plurality of exercise types with slightly different exercise load amounts by specifying form, pace, number of reps, or details of rest periods. For example, leg raises are an exercise generally recognized as a single type. For an exercise subdivided by a variation in which at least one element included in leg raises is changed, a plurality of leg raises may be defined as exercise types with exercise load amounts that differ by 0.2 METs.

[0084] The exercise user 70 can perform aerobic exercise by selecting and playing a sample video of an exercise type whose standard load is equal to or less than the exercise load corresponding to the AT of the exercise user 70, and performing the exercise by imitating the sample video. When the exercise therapy is cardiac rehabilitation, a person in charge of planning or instructing the exercise therapy may determine an exercise type whose standard load is equal to or less than the exercise load corresponding to the AT of the exercise user 70 as an exercise type whose exercise load is suitable for the cardiac rehabilitation of the exercise user 70.

[0085] The exercise user 70 may select and play a sample video of an exercise type whose standard load is greater than the exercise load corresponding to the AT of the exercise user 70, and perform anaerobic exercise by imitating the sample video.

[0086] The exercise user 70 may select and play a sample video of an exercise type in which the standard load is around the exercise load corresponding to the AT of the exercise user 70, and perform aerobic exercise or anaerobic exercise by imitating the sample video. The exercise load around the exercise load corresponding to the AT of the exercise user 70 may be within the AT setting range. The lower limit of the AT setting range is an exercise load that is lower than the exercise load corresponding to the AT of the exercise user 70 by a first predetermined value. The upper limit of the AT setting range is an exercise load that is higher than the exercise load corresponding to the AT of the exercise user 70 by a second predetermined value. The first predetermined value and the second predetermined value may be set appropriately. The first predetermined value and the second predetermined value may be the same value or different values.

[0087] The exercise type may be associated with an index reference value. The index reference value is information on an index value of an exercise stress amount when a person with standard physical function performs the exercise type corresponding to the index reference value.

[0088] As an example, an exercise type may be divided into a plurality of unit movements. A unit movement is a component of an exercise type, and when an exercise type includes a plurality of patterns of movement, each pattern of movement may correspond to a unit movement. For example, when an exercise type is a dance, each of the individual choreographies included in the dance may correspond to a unit movement. Also, when an exercise type is a squat, each of a person's transition from a standing state to a squatting state and a person's transition from a squatting state to a standing state may correspond to a unit movement.

[0089] The unit movement may be further divided into smaller movements than the above-mentioned examples. For example, in a leg-raising exercise, the unit movement may be divided into a leg-raising movement and a leg-lowering movement.

[0090] A unit exercise may be a movement with a set pattern. For example, in a thigh-raising exercise, a unit exercise may be a movement that combines the movements of raising and lowering the left and right thighs multiple times. Also, in radio calisthenics, for example, a unit exercise may be a series of movements performed while counting from 1 to 8.

[0091] The index reference value may be derived by measuring the exercise load of each person for each unit exercise included in the exercise type when a plurality of people perform the exercise type corresponding to the index reference value, applying the measurement result of the exercise load of each unit exercise for each person to a predetermined calculation formula to calculate the individual index of each person, and averaging the individual index of each person. The index reference value may be used as an alternative index to the standard load described above.

[0092] As described above, the exercise load can be measured for each unit exercise. Therefore, a standard load can be associated with each unit exercise. The standard load associated with a unit exercise is also called a unit standard load to distinguish it from the standard load for the entire exercise. Information on the target exercise type of the exercise therapy may include information that associates a unit standard load with each unit exercise obtained by subdividing the target exercise type. The target exercise type may be defined so that the unit standard load of each unit exercise is equal.

[0093] <Exercise performed by exercise user 70> The exercise user 70 may perform an exercise type selected from target exercise types defined to have an exercise load suitable for the exercise therapy of the exercise user 70. The exercise user 70 may perform an exercise type prescribed by a doctor. In this operation example, the exercise user 70 performs exercise while watching a sample video of the exercise type to be performed. A specific manner in which the exercise user 70 selects and plays the sample video and performs exercise while watching the sample video will be described below.

[0094] The processor 11 of the information processing device 10 accepts an input by the exercise user 70 to select a sample video through the input unit 14. The processor 11 may present all sample videos prepared in advance to the exercise user 70 and allow the exercise user 70 to select a sample video. When an upper limit of the exercise load of the exercise user 70 is set, the processor 11 may not present to the exercise user 70 a sample video of an exercise type defined to have an exercise load exceeding the set upper limit, but may present to the exercise user 70 only a sample video of an exercise type defined to have an exercise load equal to or less than the set upper limit. When an exercise type to be performed by the exercise user 70 is determined by a person who plans or instructs the exercise therapy of the exercise user 70, the processor 11 may present to the exercise user 70 only a sample video of the determined exercise type.

[0095] 3, the processor 11 plays the sample video selected by the exercise user 70 and displays it in a sample video frame 72 of the display device, which is the output unit 15 of the information processing device 10. The processor 11 may play back a video that has been recorded in advance and stored in the server 20 or the storage unit 12 of the information processing device 10 as the sample video and display it on the display device. The processor 11 may also display a sample video distributed in real time from an external device such as the server 20 on the display device.

[0096] The exercise user 70 performs exercise while watching the sample video displayed in the sample video frame 72.

[0097] When playing the sample video, the processor 11 may display a video remaining time display frame 73 on the display device. The processor 11 may display operation buttons 74 on the display device for inputting operations such as playing, pausing, stopping, fast forwarding, or rewinding the sample video. The processor 11 may accept operation inputs related to control of the playback of the sample video as vocal instructions from the exercise user 70 through the input unit 14.

[0098] The processor 11 may display the user video in a user video frame 71 located next to a sample video frame 72 displaying the sample video. By performing exercise while comparing the sample video with the user video, the exercise user 70 can easily recognize the difference between the movements shown in the sample video and the exercise user's own movements.

[0099] As illustrated in Fig. 2, an athletic user 70 may wear the wearable device 30. In the example of Fig. 2, the wearable device 30 is worn on the wrist of the athletic user 70, but may be worn on various other parts of the body.

[0100] In this operation example, the wearable device 30 measures the heart rate of the exercise user 70 and outputs the heart rate to the information processing device 10. The processor 11 of the information processing device 10 acquires the measurement result of the heart rate of the exercise user 70 from the wearable device 30 via the communication unit 13 or the input unit 14. The processor 11 may display the measurement result of the heart rate of the exercise user 70 as a heart rate display frame 75 on a display device that is the output unit 15 of the information processing device 10. The processor 11 may display the current heart rate of the exercise user 70 in the heart rate display frame 75, or may display a graph of the time change of the past heart rate.

[0101] <Evaluation of exercise performed by exercise user 70> The processor 11 of the information processing device 10 evaluates the exercise performed by the exercise user 70 based on the user video. The processor 11 may evaluate whether an estimated load, which is an estimated value of the exercise load when the exercise user 70 performs the exercise, is constant. The processor 11 may evaluate a difference between the estimated load and a standard load for the exercise type corresponding to the sample video. A specific manner of evaluating the exercise performed by the exercise user 70 will be described below.

[0102] The processor 11 may obtain a user video from the camera 16 after the exercise user 70 performs exercise, and evaluate whether an estimated load, which is an estimated value of an exercise load when the exercise user 70 performs exercise, was constant based on the user video. The processor 11 may also evaluate a difference between the estimated load and a standard load for the exercise type corresponding to the sample video based on the user video.

[0103] The processor 11 may use the evaluation model to evaluate the exercise performed by the exercise user 70. The evaluation model includes a video input unit to which a video is input, an evaluation unit that evaluates the exercise performed by a person appearing in the video, and an evaluation result output unit that outputs the evaluation result.

[0104] The evaluation unit may evaluate the exercise load of the exercise user 70 appearing in the user video. The evaluation result regarding the exercise load of the exercise user 70 is also referred to as a user exercise evaluation. The evaluation unit may evaluate whether an estimated load, which is an estimated value of the exercise load of the exercise user 70 appearing in the user video, was constant. If the evaluation unit evaluates that the estimated load was constant, the evaluation result output unit outputs an evaluation result that the estimated load was constant. If the processor 11 obtains an evaluation result that the estimated load was constant from the evaluation model, the processor 11 may determine that the exercise performed by the exercise user 70 appearing in the user video is acceptable.

[0105] The evaluation unit may evaluate that the estimated load was constant when the fluctuation of the estimated load during the period in which the user video is captured is within a fluctuation setting range. The fluctuation setting range is a range that is appropriately set. The fluctuation of the estimated load may be calculated as a difference between the maximum value and the minimum value of the estimated load during the period in which the user video is captured. When the fluctuation of the estimated load is a difference between the maximum value and the minimum value of the estimated load, the fluctuation setting range may be specified as a range equal to or less than a value that is appropriately set as an upper limit of the difference between the maximum value and the minimum value of the estimated load. The upper limit of the difference between the maximum value and the minimum value of the estimated load may be set to a maximum value allowed as the fluctuation of the estimated load. The fluctuation setting range may be incorporated into the evaluation model. The evaluation model may be configured so that the fluctuation setting range is input to the video input unit together with the user video. The evaluation unit may calculate a moving average of an instantaneous estimated value of the exercise load as the estimated load.

[0106] The evaluation unit may evaluate the difference between an estimated load, which is an estimated value of the exercise load of the exercise user 70 appearing in the user video, and a standard load of the exercise type corresponding to the sample video imitated by the exercise user 70 appearing in the user video. The standard load of the exercise type corresponding to the sample video may be incorporated into the evaluation model. When the standard load is incorporated into the evaluation model, the evaluation model may be prepared for each sample video. The evaluation model may be configured such that the standard load of the exercise type corresponding to the sample video is input to the video input unit together with the user video.

[0107] The evaluation unit may evaluate whether the difference between the estimated load and the standard load is within the load variation setting range. In this case, the evaluation result output unit outputs an evaluation result indicating that the difference between the estimated load and the standard load is within the load setting range. When the processor 11 obtains an evaluation result indicating that the difference between the estimated load and the standard load is within the load setting range, the processor 11 may determine that the exercise performed by the exercise user 70 shown in the user video is acceptable. The load setting range is a range that is set appropriately. The load setting range may be incorporated into the evaluation model. The evaluation model may be configured such that the load setting range is input to the video input unit together with the user video.

[0108] The evaluation unit may calculate a difference between the estimated load and the standard load. In this case, the evaluation result output unit outputs the difference between the estimated load and the standard load as the evaluation result. When the difference between the estimated load and the standard load is within a load setting range, the processor 11 may determine that the exercise performed by the exercise user 70 shown in the user video is acceptable.

[0109] The evaluation unit may calculate a score as an evaluation result of the exercise performed by the exercise user 70 appearing in the user video. In this case, the evaluation result output unit outputs the score as the evaluation result. The evaluation unit may calculate a higher score value as the variation in the estimated load is closer to 0. The evaluation unit may calculate a higher score value as the difference between the estimated load and the standard load is closer to 0. When the score is equal to or greater than a score threshold, the processor 11 may determine that the exercise performed by the exercise user 70 appearing in the user video is acceptable.

[0110] The evaluation model may be a trained model generated by performing learning using teacher data that associates a user video with an evaluation result of the exercise performed by the exercise user 70 shown in the user video. The evaluation result associated with the user video in the teacher data may be generated by evaluating the exercise based on the result of actually measuring the exercise load of the exercise user 70 performing the exercise during the execution of the exercise shown in the user video. The measurement of the exercise load may include, for example, a CPX test. The measurement of the exercise load may include, for example, measurement of the heart rate. The measurement of the exercise load is not limited to these examples and may be performed by various other means.

[0111] The evaluation model is not limited to a trained model, but may be a model of various other types, such as a rule-based model.

[0112] <<Example of exercise evaluation procedure>> The processor 11 may execute an information processing method including the steps of the flowchart illustrated in Fig. 4 in order to evaluate the exercise performed by the exercise user 70 appearing in the user video based on the user video. The information processing method may be realized as an information processing program executed by the processor 11. The information processing program may be stored in a non-transitory computer-readable medium.

[0113] Processor 11 acquires a user video captured by camera 16 of exercise user 70 performing exercise (step S1). Processor 11 inputs the user video into an evaluation model (step S2). The evaluation model outputs an evaluation result for the exercise performed by exercise user 70 who appears in the input user video. Processor 11 acquires and outputs the evaluation result for the exercise performed by exercise user 70 from the evaluation model (step S3). Processor 11 may output a pass / fail judgment for the exercise performed by exercise user 70 based on the evaluation result. Processor 11 may also output the evaluation result acquired from the evaluation model itself. After executing the procedure of step S3, processor 11 ends execution of the procedure of the flowchart in FIG. 4.

[0114] When the evaluation model outputs a score as an evaluation result, the processor 11 may execute an information processing method including the steps of the flowchart illustrated in FIG.

[0115] The processor 11 acquires a score from the evaluation model (step S11). The processor 11 determines whether the score is equal to or greater than a score threshold (step S12).

[0116] If the score is equal to or greater than the score threshold (step S12: YES), the processor 11 outputs a pass judgment indicating that the exercise performed by the exercise user 70 appearing in the user video input to the evaluation model is pass (step S13). After executing the procedure of step S13, the processor 11 ends the execution of the procedure of the flowchart in FIG.

[0117] If the score is not equal to or greater than the score threshold (step S12: NO), that is, if the score is less than the score threshold, the processor 11 does not output a pass judgment and ends the execution of the procedure of the flowchart in Fig. 5. If the score is less than the score threshold, the processor 11 may output a fail judgment indicating that the exercise performed by the exercise user 70 appearing in the user video input to the evaluation model is unsuccessful.

[0118] <<Summary of exercise evaluation>> As described above, the information processing device 10 according to the present disclosure can easily evaluate the exercise performed by the exercise user 70 based on a user video of the exercise user 70 performing the exercise. The exercise user 70 can improve his / her own exercise according to the evaluation result. As a result, the exercise of the exercise user 70 is appropriately supported. In addition, when the exercise user 70 performs exercise therapy, the effectiveness and safety of the exercise therapy are improved.

[0119] <Evaluation of unit movement> As described above, an exercise type may be divided into unit exercises. The processor 11 of the information processing device 10 may not only evaluate whether the exercise load is constant throughout the entire exercise captured in the user video, but also evaluate the exercise load for each unit exercise included in the exercise captured in the user video. The processor 11 may evaluate the exercise load for each unit exercise for all unit exercises. The processor 11 may evaluate the exercise load for each unit exercise for at least some of the unit exercises. Conversely, the processor 11 may not need to evaluate the exercise load for some unit exercises.

[0120] The evaluation model may be configured to output the results of dividing the exercise into unit exercises and evaluating the exercise load for each unit exercise. For example, the evaluation model may include a dividing unit that divides the exercise shown in the user video input to the input unit 14 into unit exercises and outputs the unit exercises to the evaluation unit. The evaluation unit of the evaluation model may be configured to include a function of dividing the exercise into unit exercises.

[0121] The evaluation unit evaluates the exercise load for each of the subdivided unit exercises. The evaluation unit may evaluate for each unit exercise whether the unit estimated load, which is an estimated value of the exercise load for the unit exercise included in the exercise performed by the exercise user 70 shown in the user video, was constant. Specifically, the evaluation unit may evaluate that the unit estimated load was constant when the fluctuation of the unit estimated load was within a unit fluctuation setting range. The unit fluctuation setting range may be set to the same range as the fluctuation setting range, or a narrower or wider range than the fluctuation setting range. The evaluation unit may calculate a moving average of the instantaneous estimated value of the exercise load for the unit exercise as the unit estimated load. When the length of the unit exercise is not long enough to calculate the moving average, the evaluation unit may calculate an average of the instantaneous estimated value of the exercise load for the unit exercise as the unit estimated load.

[0122] When there is a unit exercise that has been evaluated by the evaluation unit as having a constant unit estimated load, the evaluation result output unit may output information identifying the unit exercise that has been evaluated as having a constant unit estimated load as the evaluation result. The processor 11 may determine that the unit exercise identified in the evaluation result is a pass. Furthermore, when the number of unit exercises that have been determined to be a pass is equal to or greater than a predetermined number, the processor 11 may determine that the exercise performed by the exercise user 70 appearing in the user video is a pass. The predetermined number may be set appropriately according to the number of unit exercises included in the exercise appearing in the user video. The predetermined number may be set to a value obtained by multiplying the number of unit exercises included in the exercise appearing in the user video by a predetermined ratio, for example. The predetermined ratio may be set appropriately.

[0123] The evaluation unit may evaluate whether the difference between the unit standard load and the unit estimated load for each unit exercise is within a unit load setting range. The unit load setting range may be set to the same range as the load setting range, or a range narrower or wider than the load setting range. The evaluation unit may calculate a moving average of instantaneous estimated values ​​of the exercise load of the unit exercise as the unit estimated load, and calculate the difference between the unit standard load and the unit estimated load. When the length of the unit exercise is shorter than the period for calculating the moving average, the evaluation unit may calculate the average value of the estimated values ​​of the exercise load of the unit exercise as the unit estimated load.

[0124] When there is a unit exercise for which the evaluation unit has evaluated that the difference between the unit standard load and the unit estimated load is within the unit load setting range, the evaluation result output unit may output information identifying the unit exercise for which the difference between the unit standard load and the unit estimated load is within the unit load setting range as the evaluation result. The processor 11 may determine that the unit exercise identified in the evaluation result is passed. Furthermore, when the number of unit exercises determined to be passed is equal to or greater than a predetermined number, the processor 11 may determine that the entire exercise including the unit exercise for which the exercise load has been evaluated is passed.

[0125] The evaluation unit may calculate a unit movement score for each unit movement as an evaluation result of the exercise load of the unit movement. In this case, the evaluation result output unit outputs the unit movement score for each unit movement as the evaluation result. The evaluation unit may calculate a higher unit movement score as the variation of the unit estimated load is closer to 0. The evaluation unit may calculate a higher unit movement score as the difference between the unit estimated load and the unit standard load is closer to 0.

[0126] The processor 11 may determine that the unit exercise corresponding to the unit exercise score is passed when the unit exercise score is equal to or greater than the unit exercise score threshold. The processor 11 may also determine that the entire exercise including the unit exercise for which the exercise load was evaluated is passed when the number of unit exercises whose unit exercise scores are equal to or greater than the unit exercise score threshold is a predetermined number or more.

[0127] Processor 11 may calculate the average value of the unit movement score for each unit movement, and if the average value is equal to or greater than the unit movement score threshold, determine that the entire exercise, including the unit movement for which the exercise load was evaluated, is a pass.

[0128] Processor 11 may determine that the entire exercise, including the unit exercise for which the exercise load was evaluated, is a pass if the number of unit movements whose unit movement scores are equal to or greater than the unit movement score threshold is a predetermined number or more and the average value of the unit movement scores of each unit movement is equal to or greater than the unit movement score threshold.

[0129] When the evaluation model is configured to evaluate the exercise load of a unit movement, the evaluation model may be a trained model generated by performing learning using training data including data that associates a user video with information that subdivides the movement shown in the user video into unit movements. The training data may include data that associates the user video with an evaluation result of the exercise performed by the athletic user 70 shown in the user video, similar to the training data used to generate an evaluation model that does not consider unit movements.

[0130] Even when the evaluation model is configured to evaluate the exercise load amount of a unit exercise, it is not limited to a trained model, and may be a model of various other aspects, such as a rule-based model.

[0131] Each of the divided unit movements may be the same movement. For example, squatting is an exercise in which a person repeats the movement from a standing position to squatting and from the squatting position to standing up. When one movement is repeated, the repeated one movement may be considered as a unit movement. For example, an exercise in which one movement is repeated 20 times may be divided into 20 unit movements.

[0132] The divided unit movements may include at least one different movement. That is, at least one unit movement of the divided unit movements may be different movements. For example, dance is a type of movement that includes movements of different choreographies. Therefore, movements of different choreographies may be considered as different unit movements from each other.

[0133] Among the multiple subdivided unit movements, different unit movements may be movements defined to be performed for the same length of time, or may be movements defined to be performed for different lengths of time.

[0134] <<Example of procedure for evaluating unit movement>> The processor 11 may execute an information processing method including the steps of the flowchart illustrated in FIG. 6 when the evaluation model outputs a unit exercise score to break down and evaluate the exercise performed by the exercise user 70 appearing in the user video into unit exercises based on the user video.

[0135] The processor 11 acquires a user video of the exercise user 70 performing an exercise type, inputs the user video into an evaluation model, and acquires a unit exercise score from the evaluation model as an evaluation result of the exercise load amount of the unit exercise included in the user video (step S21). The processor 11 calculates an average value of the unit exercise scores corresponding to each of the multiple unit exercises, and determines whether the average value of the unit exercise score is equal to or greater than a score threshold (step S22). If the average value of the unit exercise score is equal to or greater than the score threshold (step S22: YES), the processor 11 proceeds to the procedure of step S24.

[0136] If the average value of the unit movement scores is not equal to or greater than the score threshold (step S22: NO), i.e., if the average value of the unit movement scores is less than the score threshold, processor 11 judges whether each unit movement is pass or not. Specifically, processor 11 compares the unit movement score with the score threshold for each unit movement, and judges a unit movement whose unit movement score is equal to or greater than the score threshold as pass. Then, processor 11 judges whether the number of unit movements judged as pass is a predetermined number or more (step S23). If the number of unit movements judged as pass is not equal to or greater than the predetermined number (step S23: NO), processor 11 ends the execution of the procedure of the flowchart in FIG. 6.

[0137] If the average value of the unit exercise score is equal to or greater than the score threshold (step S22: YES), or if the number of unit exercises determined to be passed is equal to or greater than a predetermined number (step S23: YES), the processor 11 outputs a pass judgment indicating that the exercise performed by the exercise user 70 appearing in the user video is passed (step S24). After executing step S24, the processor 11 ends the execution of the procedure of the flowchart in FIG. 6. If the condition for outputting a pass judgment is not met, the processor 11 may output a fail judgment indicating that the exercise performed by the exercise user 70 appearing in the user video input to the evaluation model is unsuccessful. The processor 11 may execute only one of the procedures of steps S22 or S23 in the procedure of the flowchart in FIG. 6 without executing both the procedures of steps S22 and S23.

[0138] <<Summary of evaluation of unit movement>> As described above, the information processing device 10 according to the present disclosure can easily and in detail evaluate the exercise load for each unit exercise by dividing the exercise performed by the exercise user 70 into unit exercises based on a user video of the exercise user 70 performing the exercise. The exercise user 70 can finely improve his / her own exercise according to the evaluation result. As a result, the exercise of the exercise user 70 is appropriately supported. In addition, when the exercise user 70 performs exercise therapy, the effectiveness and safety of the exercise therapy are improved.

[0139] The processor 11 may evaluate the exercise stress amount in a manner that does not consider the unit exercise in addition to evaluating the exercise stress amount for each unit exercise. For example, the evaluation model may be configured to output the result of evaluating the exercise stress amount for each unit exercise and to output the result of evaluating the exercise stress amount for the entire exercise.

[0140] <Evaluation of exercise load levels for exercise users 70> The processor 11 of the information processing device 10 may regard the exercise load of the exercise user 70 as a level, and may evaluate at what level the exercise load of the exercise user 70 is constant throughout the entire period of the user video. The level of the exercise load of the exercise user 70 may be set as a reference level when the exercise load of the exercise user 70 is within the AT setting range. In addition, the level of the exercise load of the exercise user 70 may be set as at least one excess level, which is divided by a range of the same width as the reference level, when the exercise load of the exercise user 70 is greater than the upper limit of the AT setting range. The excess level may be expressed to include the degree of the excess of the exercise load from the reference level, such as level +1 or level +2. Level +1 and level +2 represent levels one step higher and two steps higher than the reference level, respectively. In addition, the level of the exercise load of the exercise user 70 may be set as at least one deficiency level, which is divided by a range of the same width as the reference level, when the exercise load of the exercise user 70 is smaller than the lower limit of the AT setting range. The deficiency level may be expressed to include the degree of deficiency of the exercise load relative to the reference level, such as level-1 or level-2. Level-1 and level-2 represent levels one level lower and two levels lower than the reference level, respectively.

[0141] If the processor 11 evaluates that the level of exercise stress of the exercise user 70 is constant throughout the entire period of the user video, the processor 11 can evaluate at what level the exercise stress of the exercise user 70 is constant throughout the entire period of the user video by estimating the level of exercise stress of the exercise user 70 within at least a portion of the period or time of the user video.

[0142] The processor 11 may estimate the level of the exercise load of the exercise user 70 based on the state of the exercise user 70 during exercise. The processor 11 may estimate the level of the exercise load of the exercise user 70 during at least a part of the period or time of the entire period of the user video based on the state of the exercise user 70 during at least a part of the period or time during which the exercise shown in the user video is being performed. The state of the exercise user 70 during exercise may or may not include an index such as oxygen intake that defines the exercise load.

[0143] The state of the exercise user 70 during exercise may be measured as a subjective intensity of exercise. The subjective intensity of exercise is an index that numerically represents the subjective burden when exercising. For example, the Borg index is known as a representative index of the subjective intensity of exercise. The Borg index represents the subjective burden using integers from 6 to 20. When the Borg index felt by the exercise user 70 when exercising is 13, it is considered that the level of the exercise load of the exercise user 70 is the level of the exercise load corresponding to the AT of the exercise user 70, that is, the reference level. The processor 11 may acquire the measurement result of the subjective intensity of exercise of the exercise user 70 as the state of the exercise user 70 during exercise by, for example, accepting an input of the Borg index from the exercise user 70 through the input unit 14 after the exercise user 70 has performed the exercise.

[0144] The state of the exercise user 70 during exercise may be measured by a talk test. The talk test is performed by a specialist such as a doctor or a physical therapist. The talk test determines whether the exercise load of the exercise user 70 is around or outside the exercise load equivalent to the AT of the exercise user 70. In other words, the talk test determines whether the exercise load of the exercise user 70 is within or outside the AT setting range. The talk test may be performed using a trained model that imitates the talk test. The processor 11 may acquire, for example, the determination result of the talk test after the exercise user 70 has performed exercise as the state of the exercise user 70 during exercise.

[0145] The state of the exercise user 70 during exercise may be measured based on an analysis result of the sweat of the exercise user 70 or the lactate contained in the blood of the exercise user 70, or an analysis result of the exhaled gas of the exercise user 70. The processor 11 may acquire, as the state of the exercise user 70 during exercise, for example, an analysis result of the sweat of the exercise user 70 or the lactate contained in the blood of the exercise user 70, or an analysis result of the exhaled gas of the exercise user 70 while the exercise user 70 is exercising or after the exercise user 70 is exercising.

[0146] The state of the exercise user 70 during exercise may be obtained as an average state of the exercise user 70 during the entire period of the user video. The state of the exercise user 70 during exercise may be obtained as an average state of the exercise user 70 during one period of the entire period of the user video. The state of the exercise user 70 during exercise may be measured as a state obtained by further averaging the average state of the exercise user 70 during each of a plurality of periods of the entire period of the user video. The state of the exercise user 70 during exercise may be measured as an instantaneous state of the exercise user 70 at one time point during the entire period of the user video. The state of the exercise user 70 during exercise may be measured as an average state of the exercise user 70 at each of a plurality of time points during the entire period of the user video.

[0147] The input unit of the evaluation model may be configured to be able to input the state of the exercise user 70 during at least a part of a period or time point during which the exercise shown in the user video is being performed. The evaluation unit of the evaluation model may estimate the level of the exercise load of the exercise user 70 during a period or time point corresponding to the state based on the state of the exercise user 70 input to the input unit. The estimated result of the level of the exercise load of the exercise user 70 is also referred to as an estimated level.

[0148] The evaluation unit may evaluate that the level of the exercise stress of the exercise user 70 is constant throughout the entire period of the user video based on the user video, and may evaluate that the level of the exercise stress of the exercise user 70 is constant at the estimated level when the level of the exercise stress of the exercise user 70 can be estimated. Furthermore, when the estimated level of the exercise stress of the exercise user 70 is a reference level for the exercise user 70, the evaluation unit may evaluate that the level of the exercise stress of the exercise user 70 is constant at the reference level throughout the entire period of the user video.

[0149] In the above-described example, the width of each level used in determining the level of the exercise stress of the exercise user 70 was set to the width of the AT setting range. In this case, the width of the variation setting range may be set to be the same as or less than the width of the AT setting range. By setting the width of the variation setting range based on the width of the AT setting range, if the level of the exercise stress of the exercise user 70 during at least a part of the period or time of the user video is at a reference level, even if the exercise stress of the exercise user 70 fluctuates within the variation setting range, the level of the exercise stress of the exercise user 70 is at least within the level ±1 during the entire period of the user video. In other words, if the level of the exercise stress of the exercise user 70 during at least a part of the period or time of the user video is at a reference level, the evaluation unit can evaluate that the level of the exercise stress of the exercise user 70 is constant within the reference level or within the range of the level ±1.

[0150] The width of the reference level may be set to be less than the width of the AT setting range. In this way, even if the exercise stress amount of the exercise user 70 fluctuates within the fluctuation setting range, the level of the exercise stress amount of the exercise user 70 is likely to be within the reference level throughout the entire period of the user video.

[0151] Furthermore, the width of the reference level and the width of the variation setting range may be set to less than 1 / 3 of the width of the AT setting range. In this way, if the level of the exercise stress of the exercise user 70 during at least a part of the period or time of the user video is the reference level, even if the exercise stress of the exercise user 70 varies within the variation setting range, the level of the exercise stress of the exercise user 70 will be within the reference level throughout the entire period of the user video. In other words, if the level of the exercise stress of the exercise user 70 during at least a part of the period or time of the user video is the reference level, the evaluation unit can evaluate that the level of the exercise stress of the exercise user 70 is constant within the reference level or within a range of the level ±1.

[0152] The processor 11 inputs the state of the exercise user 70 during at least a part of the period or time during which the exercise user 70 is performing the exercise shown in the user video to the evaluation model together with the user video, thereby obtaining an evaluation result that the exercise load of the exercise user 70 is constant throughout the entire period of the user video, as well as an evaluation result that the level of the exercise load of the exercise user 70 is constant within an estimated level, a reference level, or a range of the level ±1 throughout the entire period of the user video. In this case, the processor 11 does not need to measure values ​​such as oxygen intake that define the exercise load of the exercise user 70. As a result, the exercise is evaluated simply and easily.

[0153] If it is evaluated that the level of the exercise stress of the exercise user 70 is constant within a range of the reference level or level ±1 throughout the entire period of the user video, it is understood that the exercise user 70 can safely exercise at an exercise stress level equivalent to the AT. As a result, the exercise of the exercise user 70 is appropriately supported. Furthermore, when the exercise user 70 performs exercise therapy, the effectiveness and safety of the exercise therapy are improved.

[0154] <Real-time assessment of exercise> The processor 11 may evaluate in real time whether the exercise load of the exercise user 70 is constant based on the user video while the exercise user 70 is exercising. The processor 11 may also evaluate in real time the difference between the exercise load of the exercise user 70 and the standard load of the exercise type corresponding to the sample video based on the user video while the exercise user 70 is exercising. The processor 11 may also acquire the state of the exercise user 70 during at least a part of a period or time point during exercise, and evaluate in real time whether the level of the exercise load of the exercise user 70 is constant within an estimated level, a reference level, or a level ±1 based on the user video and the state of the exercise user 70.

[0155] In the present disclosure, evaluating in real time means outputting an evaluation of the content of the exercise to be evaluated that has been performed up to an intermediate evaluation point in time with a delay of a predetermined time from the evaluation point in time. By evaluating the exercise of the exercise user 70 in real time, the exercise user 70 can improve the movement during the exercise. As a result, the exercise of the exercise user 70 is appropriately supported. In addition, both the effectiveness and safety of the exercise therapy are enhanced during the exercise.

[0156] Although the embodiments of the present disclosure have been described based on the drawings and examples, it should be noted that those skilled in the art can make various modifications or alterations based on the present disclosure. Therefore, it should be noted that these modifications or alterations are included in the scope of the present disclosure. For example, the functions included in each component can be rearranged so as not to cause logical inconsistencies, and multiple components can be combined into one or divided. [Explanation of symbols]

[0157] 1. Information Processing Systems 10 Information processing device (11: processor, 12: memory unit, 13: communication unit, 14: input unit, 15: output unit, 16: camera) 20 Servers 30 Wearable Devices 40 Network 70 Exercise Users 71 User Video Slots 72 Sample Video Slot 73 Remaining time display frame 74 Operation Buttons 75 Heart rate display

Claims

1. Obtaining a user video of a user performing an exercise; inputting the user video into an evaluation model that outputs an evaluation result regarding the exercise depicted in the input video; acquiring, from the evaluation model, a user exercise evaluation regarding an exercise load of the user captured in the user video as the evaluation result; to a processor, The exercise type is defined so that the exercise load is constant when the exercise is performed according to the exercise type, The user exercise evaluation includes an evaluation that a fluctuation in an estimated load, which is an estimated value of an exercise load of the user captured in the user video, is within a set fluctuation range. Information processing program.

2. An information processing program as described in Claim 1, wherein the user's exercise load is defined based on the amount of oxygen intake when the user is exercising.

3. The information processing program according to claim 1 or 2, wherein the user exercise evaluation includes an evaluation that the difference between a standard load, which is a standard exercise load when the user performs the exercise type, and the estimated load is within a load setting range.

4. The information processing program according to claim 1 , wherein the exercise type includes a plurality of unit exercises, and the unit standard load, which is a standard exercise load when the user performs each of the plurality of unit exercises, is defined so that the unit standard load is equal.

5. The information processing program according to claim 4 , wherein the user exercise evaluation includes an evaluation that a fluctuation in a unit estimated load, which is an estimated value of the exercise load of the user for each of the plurality of unit exercises, is within a unit fluctuation setting range.

6. The information processing program according to claim 5 , wherein the user's exercise evaluation includes the number of unit exercises in which a difference between the standard unit load and the estimated unit load falls within a unit load setting range.

7. The information processing program according to claim 1 , wherein the user's exercise evaluation includes a score that is calculated to be a higher value as the variation in the estimated load is closer to zero.

8. The information processing program according to claim 4 , wherein the user exercise evaluation includes a unit exercise score that is calculated to be a higher value the closer the variation in a unit estimated load, which is an estimated value of the exercise load of the user for each of the plurality of unit exercises, is to zero.

9. The information processing program according to claim 1 , wherein the standard load of the type of exercise performed by the user is an exercise load that corresponds to the anaerobic metabolic threshold of the user.

10. The evaluation model is The state of the user during a part of a period or a part of a time point of the entire period of the user video can be further input, The method is configured to output, as the evaluation result, a level of the exercise stress of the user that is constant throughout the entire period of the user video at an estimated level based on a state of the user during the partial period or at the partial time point. The information processing program according to claim 1 .

11. The information processing program according to claim 10 , wherein the evaluation model is configured to output, as the evaluation result, a fact that a level of the exercise stress of the user is constant at the reference level when the estimated level is a reference level.

12. The information processing program according to claim 1 , wherein the exercise type is defined so that the user can perform the exercise in a standing position.

13. An information processing device including a processor, The processor, Obtain a user video of the user performing an exercise event; inputting the user's video into an evaluation model that outputs an evaluation result regarding the exercise depicted in the input video; obtaining, from the evaluation model, a user exercise evaluation regarding an exercise load of the user captured in the user video as the evaluation result; The exercise type is defined so that the exercise load is constant when the exercise is performed according to the exercise type, The user exercise evaluation includes an evaluation that a fluctuation in an estimated load, which is an estimated value of an exercise load of the user captured in the user video, is within a set fluctuation range. Information processing device.

14. A processor acquires a user video of a user performing an exercise event; The processor inputs the user video into an evaluation model that outputs an evaluation result regarding the exercise depicted in the input video; the processor acquires, from the evaluation model, a user exercise evaluation regarding an exercise load of the user captured in the user video as the evaluation result; Including, The exercise type is defined so that the exercise load is constant when the exercise is performed according to the exercise type, The user exercise evaluation includes an evaluation that a fluctuation in an estimated load, which is an estimated value of an exercise load of the user captured in the user video, is within a set fluctuation range. Information processing methods.

Images