Information processing device, method, program, and system

Abstract

To fulfill utilizable exercise types without sacrificing effectiveness and safety of exercise therapy.SOLUTION: A program allows a computer to function as means for determining desired exercise intensity, means for referencing a database for relating predetermined exercise intensity to an exercise type and selecting an exercise type corresponding to desired exercise intensity for each exercise type composed of exercise in which each repeats the same operation at least at a specific pace or in a specific operation region, and means for presenting information showing a selected exercise type to a user.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, a method, a program, and a system. [Background technology]

[0002] The importance of exercise therapy, which utilizes exercise for the treatment and prevention of disorders and diseases, is increasing. For example, cardiac rehabilitation aims to help heart disease patients regain their physical strength and confidence, return to a comfortable home and social life, and prevent recurrence of heart disease or re-hospitalization through a comprehensive activity program that includes exercise therapy. The core of exercise therapy is aerobic exercise, such as walking, jogging, cycling, and aerobics. To perform aerobic exercise more safely and effectively, it is preferable for the subject to exercise at an intensity near their anaerobic threshold (AT).

[0003] The anaerobic metabolic threshold is an example of an evaluation index of exercise tolerance and corresponds to a change point in cardiopulmonary function, i.e., an exercise intensity near the boundary between aerobic exercise and anaerobic exercise. The anaerobic metabolic threshold is generally determined by a cardiopulmonary exercise test (CPX test), in which a test subject is subjected to a gradually increasing exercise load while exhaled gas is collected and analyzed (see Non-Patent Document 1). In a CPX test, the anaerobic metabolic threshold is determined based on the results measured by exhaled gas analysis (e.g., oxygen intake, carbon dioxide output, tidal volume, respiratory rate, minute ventilation, or a combination thereof). In addition to the anaerobic metabolic threshold, a CPX test can also determine the maximum oxygen intake, which corresponds to an exercise intensity near the maximum exercise tolerance.

[0004] In particular, for high-risk patients with heart disease and other conditions, it is important to appropriately manage the exercise intensity of the subjects in order to ensure the effectiveness and safety of exercise therapy.

[0005] Patent Document 1 describes that whether or not the ventilatory threshold (VT) has been reached is determined based on the subject's pulse information, and the exercise load of the exercise providing device is adjusted according to the determination result. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2022-059494 [Non-patent literature]

[0007] [Non-Patent Document 1] Muneyasu Saito, Cardiac Rehabilitation, Physical Therapy, 1997, Vol. 24, No. 8, pp. 414-418 Summary of the Invention [Problem to be solved by the invention]

[0008] The technical concept described in Patent Document 1, in general, performs feedback control to bring exercise intensity closer to the ventilatory threshold (VT). However, the amount of load imposed on the exerciser depends not only on the type of exercise but also on the individual's physical function and daily physical condition. Furthermore, the definition of some exercise types is ambiguous, and the load imposed on the exerciser may vary depending on the exerciser's approach. Therefore, even if this technical concept is applied to exercise therapy, it is not possible to determine the exercise intensity that a specified exercise type will impose on the subject, or to determine what type of exercise should be recommended to the subject to achieve the specified exercise intensity. Furthermore, the technical concept described in Patent Document 1 cannot be simply applied, for example, to cases where a subject is required to exercise at an intensity lower than the ventilatory threshold (VT).

[0009] The purpose of the present disclosure is to expand the range of exercises available without sacrificing the effectiveness and safety of exercise therapy. [Means for solving the problem]

[0010] A program according to one aspect of the present disclosure causes a computer to function as: a means for determining a desired exercise intensity; a means for referencing a database that associates predetermined exercise intensities with each type of exercise, each of which consists of repeating the same movement at a specific pace or within a specific range of motion, and selecting the type of exercise corresponding to the desired exercise intensity; and a means for presenting information indicating the selected type of exercise to the user. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a configuration of an information processing system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a block diagram showing the configuration of a client device according to the present embodiment. [Figure 3] FIG. 2 is a block diagram showing the configuration of a server according to the present embodiment. [Figure 4] FIG. 1 is a block diagram showing the configuration of a wearable device according to an embodiment of the present invention. [Figure 5] FIG. 1 is an explanatory diagram of one aspect of the present embodiment. [Figure 6] FIG. 2 is a diagram showing the data structure of an exercise event database according to the present embodiment. [Figure 7] FIG. 2 is a diagram showing the data structure of a user profile database according to the present embodiment. [Figure 8] 10 is a flowchart of an exercise event recommendation process according to the present embodiment. [Figure 9] 10A and 10B are diagrams illustrating an example of a screen displayed in the exercise event recommendation process of the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In the drawings for explaining the embodiment, the same components are generally designated by the same reference numerals, and repeated description thereof will be omitted.

[0013] (1) Information processing system configuration The configuration of the information processing system will now be described with reference to Fig. 1, which is a block diagram showing the configuration of the information processing system according to this embodiment.

[0014] As shown in FIG. 1, the information processing system 1 includes a client device 10, a server 30, and a wearable device 50.

[0015] Here, the number of client devices 10 and wearable devices 50 varies depending on, for example, the number of users. Therefore, the number of client devices 10 and wearable devices 50 may each be two or more. Furthermore, a terminal of a person who plans or instructs exercise therapy may also be included in the information processing system 1. The person who plans or instructs exercise therapy may include, for example, a medical professional (e.g., a doctor, nurse, pharmacist, physical therapist, occupational therapist, or clinical laboratory technician), a nutritionist, or a trainer.

[0016] The client device 10 and the server 30 are connected via a network (for example, the Internet or an intranet) NW. The client device 10 and the wearable device 50 are connected via a wireless channel using, for example, Bluetooth (registered trademark) technology.

[0017] The client device 10 is an example of an information processing device that transmits a request to the server 30. The client device 10 is, for example, a smartphone, a tablet terminal, or a personal computer.

[0018] The server 30 is an example of an information processing device that provides the client device 10 with a response in response to a request transmitted from the client device 10. The server 30 is, for example, a server computer.

[0019] The wearable device 50 is an example of an information processing device that can be worn on the user's body (for example, on the arm, hand, or head).

[0020] (1-1) Client device configuration The configuration of the client device will now be described with reference to Fig. 2, which is a block diagram showing the configuration of the client device of this embodiment.

[0021] 2, the client device 10 includes a storage device 11, a processor 12, an input / output interface 13, and a communication interface 14. The client device 10 is connected to a display 15, a camera 16, a depth sensor 17, a microphone 18, and an acceleration sensor 19.

[0022] The storage device 11 is configured to store programs and data, and is, for example, a combination of a read-only memory (ROM), a random access memory (RAM), and a storage (for example, a flash memory or a hard disk).

[0023] The programs include, for example, the following programs: OS (Operating System) programs · Programs for applications that process information (e.g., web browsers, therapy apps, rehabilitation apps, or fitness apps) Here, the diseases that are the target of therapeutic or rehabilitation apps are, for example, heart disease, lifestyle-related diseases (hypertension, diabetes, dyslipidemia, hyperlipidemia), obesity, and other diseases in which exercise may contribute to improving symptoms.

[0024] The data includes, for example, the following data: Databases referenced in information processing Data obtained by performing information processing (i.e., the results of performing information processing)

[0025] The processor 12 is a computer that implements the functions of the client device 10 by running a program stored in the storage device 11. The processor 12 is, for example, at least one of the following: ·CPU(Central Processing Unit) ·GPU(Graphic Processing Unit) ·ASIC(Application Specific Integrated Circuit) ·FPGA(Field Programmable Gate Array)

[0026] The input / output interface 13 is configured to acquire information (e.g., user instructions, images, sounds) from an input device connected to the client device 10, and to output information (e.g., images, commands) to an output device connected to the client device 10.

[0027] The input device is, for example, a camera 16, a depth sensor 17, a microphone 18, an acceleration sensor 19, a keyboard, a pointing device, a touch panel, a sensor, or a combination thereof. The output device is, for example, a display 15, a speaker, or a combination thereof.

[0028] The communication interface 14 is configured to control communication between the client device 10 and external devices (eg, another client device 10, a server 30, and a wearable device 50). Specifically, the communication interface 14 may include a module (e.g., a WiFi module, a mobile communication module, or a combination thereof) for communication with the server 30. The communication interface 14 may include a module (e.g., a Bluetooth module) for communication with the wearable device 50.

[0029] The display 15 is configured to display an image (a still image or a moving image). The display 15 is, for example, a liquid crystal display or an organic EL display.

[0030] The camera 16 is configured to take pictures and generate image signals.

[0031] The depth sensor 17 is, for example, a light detection and ranging (LIDAR) sensor. The depth sensor 17 is configured to measure the distance (depth) from the depth sensor 17 to a surrounding object (for example, a user).

[0032] The microphone 18 is configured to receive sound waves and generate sound signals, and is preferably placed near the user's body (particularly the respiratory tract) as an earphone microphone, for example.

[0033] The acceleration sensor 19 is configured to detect acceleration.

[0034] (1-2) Server configuration The configuration of the server will now be described with reference to Fig. 3, which is a block diagram showing the configuration of the server according to this embodiment.

[0035] As shown in FIG. 3, the server 30 includes a storage device 31, a processor 32, an input / output interface 33, and a communication interface .

[0036] The storage device 31 is configured to store programs and data, and is, for example, a combination of ROM, RAM, and storage.

[0037] The programs include, for example, the following programs: OS programs Application programs that perform information processing

[0038] The data includes, for example, the following data: Databases referenced in information processing - Results of information processing

[0039] The processor 32 is a computer that implements the functions of the server 30 by running a program stored in the storage device 31. The processor 32 is, for example, at least one of the following: ·CPU GPU ASIC FPGA

[0040] The input / output interface 33 is configured to obtain information (for example, a user's instruction) from an input device connected to the server 30 and to output information to an output device connected to the server 30. The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display.

[0041] The communication interface 34 is configured to control communications between the server 30 and an external device (eg, the client device 10).

[0042] (1-3) Wearable device configuration The configuration of the wearable device will now be described with reference to Figure 4. Figure 4 is a block diagram showing the configuration of the wearable device of this embodiment.

[0043] 4, the wearable device 50 includes a storage device 51, a processor 52, an input / output interface 53, and a communication interface 54. The wearable device 50 is connected to a display 55, a heart rate sensor 56, and an acceleration sensor 57.

[0044] The storage device 51 is configured to store programs and data, and is, for example, a combination of ROM, RAM, and storage.

[0045] The programs include, for example, the following programs: OS programs · Programs for applications that process information (e.g., therapeutic, rehabilitation, or fitness apps)

[0046] The data includes, for example, the following data: Databases referenced in information processing - Results of information processing

[0047] The processor 52 is a computer that executes the programs stored in the storage device 51 to realize the functions of the wearable device 50. The processor 52 is, for example, at least one of the following: ·CPU GPU ASIC FPGA

[0048] The input / output interface 53 is configured to acquire information (e.g., user instructions, sensing results) from an input device connected to the wearable device 50, and to output information (e.g., images, commands) to an output device connected to the wearable device 50.

[0049] The input device is, for example, a heart rate sensor 56, an acceleration sensor 57, a microphone, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display 55, a speaker, or a combination thereof.

[0050] The communication interface 54 is configured to control communication between the wearable device 50 and an external device (eg, the client device 10). Specifically, the communication interface 54 may include a module for communication with the client device 10 (eg, a Bluetooth module).

[0051] The display 55 is configured to display an image (still image or moving image). The display 55 is, for example, a liquid crystal display or an organic EL display.

[0052] The heart rate sensor 56 is configured to measure the heart rate and generate a sensing signal. As an example, the heart rate sensor 56 measures the heart rate using an optical measurement technique.

[0053] The acceleration sensor 57 is configured to detect acceleration.

[0054] (2) One aspect of the embodiment An example of this embodiment will now be described with reference to Fig. 5, which is an explanatory diagram of this example.

[0055] As shown in Fig. 5, target exercise intensity information for each user is stored in the storage device 31 of the server 30. The target exercise intensity information is information that indicates the target exercise intensity for the user. For example, the target exercise intensity information for user US1 may be determined based on instructions from a doctor DC2 who is in charge of the user US1. The instructions from the doctor DC2 are accepted by the instructor terminal 70 and transmitted to the server 30.

[0056] The user US1 is typically a person undergoing exercise therapy, such as a participant in a (cardiac) rehabilitation program or an exercise instruction program. In the example of FIG. 5, the exercise type is gymnastics, but the exercise type may include any exercise (aerobic exercise or anaerobic exercise).

[0057] The client device 10 of the user US1 determines a desired exercise intensity. As an example, the client device 10 may determine the desired exercise intensity based on target exercise intensity information of the user US1. The storage device 11 of the client device 10 stores exercise intensity information for each of a plurality of selectable exercise types. The exercise intensity information is information indicating the standard exercise intensity that the subject will be required to perform when performing the corresponding exercise type. Specifically, the storage device 11 stores an exercise type database, which will be described later. The exercise type database associates, for each exercise type, a predetermined (standard) exercise intensity for that exercise type.

[0058] Here, each exercise type stored in the exercise type database consists of repeating the same movement at a specific pace or within a specific range of motion. For example, when a user performs an exercise type with a wide variety of variations, such as squats, there is room for interpretation of small details such as how far to lower the hips, how wide the stance, and how many seconds it takes to complete one rep, which can lead to significant variations in exercise intensity. Therefore, for example, by focusing on the range of motion, the variation in exercise intensity can be reduced by categorizing squats as different exercise types, such as half squats and full squats. By defining each exercise type in this way, the specifications of the exercise type are clarified, reducing the room for interpretation by the user and suppressing variations in exercise intensity when performing the exercise type.

[0059] The client device 10 refers to the exercise type database (exercise intensity information for each exercise type) and selects an exercise type corresponding to the desired exercise intensity. The client device 10 presents information indicating the selected exercise type to the user US1.

[0060] In this way, the information processing system 1 can suggest exercise types appropriate for a given exercise intensity. Each suggested exercise type consists of repeating the same movement at a specific pace or within a specific range of motion, so there is little variation in exercise intensity when performing that exercise type. Therefore, this embodiment can expand the range of available exercise types without sacrificing the effectiveness and safety of exercise therapy.

[0061] (3) Database The databases of this embodiment will be described below. The following databases are stored in the storage device 11 or the storage device 31.

[0062] (3-1) Sports event database The exercise event database of this embodiment will be described below with reference to Fig. 6, which is a diagram showing the data structure of the exercise event database of this embodiment.

[0063] The exercise type database stores exercise type information. The exercise type information is information about exercise types available to the user. In this embodiment, the exercise types include exercise types that can be performed without using devices with adjustable exercise loads, such as gymnastics, bodyweight training, dancing, walking, running, and treadmills. These exercise types are rich in variety because they include types performed in a standing position. Furthermore, the exercise types available in this embodiment may also include types consisting of repeated exercises within a specific range of motion without using a machine (especially a machine with a function to fix the range of motion). Furthermore, in this embodiment, even an exercise type that is generally considered to be a single type, such as squats, is subdivided and defined as multiple exercise types with different exercise intensities by varying the form (e.g., the positional relationship between body parts, the angle of the body parts, the range of motion of the body parts moved during exercise, etc.), pace, number of repetitions, or the duration or number of rest periods. However, the exercise types of this embodiment may further include exercise types performed using equipment capable of adjusting the exercise load, such as an ergometer or strength training using training equipment.

[0064] In this embodiment, the exercise types available consist of repeating the same movement at a specific pace or within a specific range of motion. However, even among these exercise types, excluding exercise types that have any of the following characteristics can be used to provide exercise therapy that takes into consideration both effectiveness and safety: - The exercise intensity (e.g., perceived exertion) fluctuates beyond the acceptable range during the exercise event (hereinafter referred to as "characteristic 1"). - The inter-individual variability of exercise intensity (e.g., oxygen intake, energy expenditure, or heart rate) exceeds the acceptable range (hereinafter referred to as the "second characteristic"). An exercise type having the first characteristic is difficult to continue at a stable exercise intensity for a long period of time, and therefore is not suitable from the viewpoint of controlling the exercise intensity of the user at a specific level for a long period of time. Typically, an exercise type that involves repeated movements that overwork small muscles such as the arms may have the first characteristic. Exercise types with the second characteristic are not suitable from the perspective of controlling the exercise intensity of a wide range of users to a specific level, because the actual exercise intensity of the user is uncertain (difficult to predict). For example, suppose that measurements of exercise types for multiple people consistently show that the exercise intensity of exercise type A is higher than that of exercise type B. On the other hand, if the exercise intensity of exercise type C for each person varies among three patterns: "higher than that of exercise type A," "between the exercise intensities of exercise types A and B," and "lower than that of exercise type B," then exercise type C is considered to have the second characteristic.

[0065] 6, the exercise event database includes an "ID" field, a "name" field, an "exercise intensity" field, and an "exercise definition" field. Each field is associated with the others.

[0066] The "ID" field stores an exercise type ID. The exercise type ID is information that identifies the exercise type corresponding to the record.

[0067] The "Name" field stores information about the name of the exercise type. The exercise type name information is information about the name of the exercise type corresponding to the record.

[0068] The "exercise intensity" field stores exercise intensity information. The exercise intensity information is information related to the standard exercise intensity of the exercise type corresponding to the record. Standard exercise intensity may refer to the exercise intensity when a person with standard physical function performs the corresponding exercise type as defined. As an example, such exercise intensity may be derived by actually measuring the exercise intensity (e.g., average oxygen consumption) when one or more people perform the corresponding exercise type as defined (i.e., according to a specific pace or a specific range of motion) using, for example, exhaled gas analysis (or estimating it by analyzing a video of the user exercising), and then statistically processing the results (e.g., averaging). Here, whether a person is performing the exercise type as defined may be determined by an algorithm based on the person's sensing results, or may be determined by a human.

[0069] Note that exercise intensity may be derived by, for example, measuring (or estimating) the exercise intensity of one or more people performing a corresponding exercise type as defined for each section of the exercise type, applying the measurement results for each section to a predetermined calculation formula for each person, and then statistically processing (e.g., averaging) the values obtained by this calculation formula across people. Here, a section is a component unit of an exercise type, and if an exercise type consists of multiple movement patterns, each movement pattern may correspond to a section. For example, if the exercise type is dance, each choreography may correspond to a section. Also, if the exercise type is squats, the transition from a standing position to a crouching position and the transition from a crouching position to a standing position may each correspond to a section.

[0070] The "exercise definition" field stores exercise definition information. The exercise definition information is information about the definition of the exercise event corresponding to the record. The exercise definition information can include information about at least one of the following elements: - The pace of exercise (for example, the time required for one cycle of movement, or the speed or acceleration of the moving part) - Tolerance of positional relationships between parts (e.g., foot width) - The allowable range of angles (for example, the direction of the knee, the angle between the upper arm and the forearm) of the part (which may be one or more) The range of motion (for example, the range of movement of each part during one cycle of movement) of the part (which may be one or more) that moves during exercise Number of reps Break time Exercise load (for example, the magnitude of the external load set when exercising using an ergometer or other device that allows for adjustable exercise load)

[0071] Even for an exercise that is generally recognized as a single event (such as squats), multiple events with slightly different exercise intensities can be defined by specifying details of the pace, form (particularly the range of motion), number of repetitions, rest time, and exercise load. For example, for an exercise that is generally recognized as a single event, multiple events with exercise intensities that differ by 0.2 METs can be defined.

[0072] (3-2) User profile database The user profile database of this embodiment will now be described with reference to Fig. 7, which shows the data structure of the user profile database of this embodiment.

[0073] The user profile database stores user profile information, which is information relating to the profile of a user of the information processing system 1 (i.e., a person who exercises).

[0074] 7, the user profile database includes an "ID" field, a "name" field, a "target strength" field, and a "body" field. Each field is associated with the others.

[0075] The "ID" field stores a user ID. The user ID is information that identifies the user corresponding to the corresponding record.

[0076] The "Name" field stores user name information. The user name information is information about the name of the user corresponding to the record (for example, name, account name, etc.).

[0077] The "target intensity" field stores target intensity information. The target intensity information is information about the target value of exercise intensity (e.g., oxygen consumption, energy consumption, heart rate, or a combination thereof) set for the user corresponding to the record. As an example, the target intensity information is specified by a person (e.g., a doctor) who plans or instructs exercise therapy based on the results of measuring the user's exercise tolerance, for example, by CPX while using an ergometer (e.g., oxygen consumption and heart rate at the anaerobic threshold (AT)). However, CPX is not required, and the target value may be specified at the doctor's discretion. As another example, the target intensity information is determined by an algorithm based on the results of measuring the user's exercise tolerance, for example, by CPX. In order to perform aerobic exercise more safely and effectively, it is preferable to exercise at an intensity near the anaerobic threshold. Therefore, the target value of exercise intensity is, for example, but not limited to, an exercise intensity corresponding to the anaerobic threshold. While an ergometer is typically used as the exercise type for CPX measurement, the oxygen consumption at the anaerobic threshold when using a treadmill, for example, is approximately 1.2 to 1.3 times that when using an ergometer. This is thought to be because the total muscle mass used on the treadmill exceeds the total muscle mass used on the ergometer. Therefore, as a first example, the target intensity information may be a value obtained by correcting the target value based on the results measured by CPX when using an ergometer to approximately 1.2 to 1.3 times the original value, or by further subtracting a predetermined value (e.g., 1 MET). As a second example, the target intensity information may be a value obtained by correcting the target value based on the results measured by CPX when using an ergometer without correction. This prevents the target value from becoming excessively high when selecting an exercise type that uses a relatively small amount of muscle mass, such as an ergometer. As a third example, the target value for each exercise type may be corrected, for example, using a coefficient corresponding to the total muscle mass used.

[0078] The doctor may also set an upper limit on the exercise intensity for the user (an example of exercise prescription). In this case, the user is not permitted to select an exercise type that exceeds the prescribed upper limit of exercise intensity. For exercise prescription, a UI (User Interface) screen for exercise prescription may be displayed on the display of the terminal used by the doctor. Such a UI screen may include, for example, the following information: User CPX data -Display area for sample videos of multiple exercises that can be selected Here, the display areas of the sample videos for each exercise type may be arranged according to the exercise intensity information corresponding to the exercise type. For example, if 3.6 METs is recommended as the upper limit based on the CPX data, a group of display areas of sample videos for exercise types corresponding to 3.4 METs, a group of display areas of sample videos for exercise types corresponding to 3.6 METs, and a group of display areas of sample videos for exercise types corresponding to 3.8 METs may be arranged on the UI screen. Note that the information on exercise types (e.g., sample videos) may be arranged in units smaller than or larger than 0.2 METs. When the doctor selects one of the display areas, the exercise intensity associated with the corresponding exercise type is set as the upper limit.

[0079] In addition, the upper limit specified by a doctor through exercise prescription may be raised or lowered by a medical professional under the supervision of a doctor during regular (for example, every two weeks) medical guidance or doctor rounds.

[0080] The "Physical" field stores physical information. The physical information is information about the body (functions) of the user corresponding to the record. As an example, the physical information may include information about the user's age, sex, weight, height, illnesses, etc.

[0081] Additionally, the user profile database may store the following information: Information indicating the person who planned or instructed the user's exercise regimen Information indicating the user's doctor

[0082] (4) Information processing The information processing of this embodiment will be described.

[0083] (4-1) Exercise recommendation processing The exercise type recommendation process of this embodiment will be described below. Fig. 8 is a flowchart of the exercise type recommendation process of this embodiment. Fig. 9 is a diagram showing an example of a screen displayed in the exercise type recommendation process of this embodiment.

[0084] The exercise type recommendation process starts when, for example, any of the following start conditions is met. The exercise recommendation process was called by another process. The user or the person who plans or instructs the user's exercise therapy performs an operation to call the exercise type recommendation process. The client device 10 enters a predetermined state (for example, a predetermined application is started). The appointed date and time has arrived. A certain amount of time has passed since a certain event.

[0085] As shown in FIG. 8, the client device 10 executes information acquisition (S110). Specifically, the client device 10 acquires information regarding the criteria for determining the desired exercise intensity used to select a recommended exercise type.

[0086] As a first example of information acquisition (S110), the client device 10 acquires target strength information of the user. For example, the client device 10 may read the target strength information of the user stored in the storage device 11. Alternatively, the client device 10 may request the server 30 to transmit the target strength information of the user and receive the transmitted information.

[0087] As a second example of information acquisition (S110), the client device 10 acquires information related to the exercise tolerance of the user. For example, the client device 10 may acquire information on the results of measuring the exercise tolerance of the user by CPX while using an ergometer (for example, the oxygen consumption and heart rate at the anaerobic threshold (AT)).

[0088] As a third example of information acquisition (S110), the client device 10 acquires instructions from the user's instructor (e.g., a person who plans or instructs exercise therapy, such as a doctor). For example, the client device 10 may acquire the instructor's instructions via the server 30 or from the instructor terminal 70.

[0089] As a fourth example of information acquisition (S110), the client device 10 acquires information about the exercise intensity set by the user. The exercise intensity set by the user may be, for example, the exercise intensity desired by the user. Alternatively, the exercise intensity set by the user may be the perceived intensity of exertion (for example, the Borg index) evaluated by the user for an exercise type performed by the user in the past.

[0090] As a fifth example of information acquisition (S110), the client device 10 acquires exercise intensity information of an exercise type previously performed by the user and the results of sensing the user while performing the exercise type.

[0091] Here, various sensing operations may be performed on the user. For example, the client device 10 may acquire user video data, which is a video of the user exercising, from the camera 16. The client device 10 may also acquire user depth data, which is a measurement of the distance to each part of the user's body while exercising, from the depth sensor 17. The client device 10 may acquire user data, which is a collection of sound (e.g., sound generated by the user's breathing or vocalization) from the microphone 18. The client device 10 may also acquire user heart rate data, which is a measurement of the heart rate using the heart rate sensor 56, from the wearable device 50. The client device 10 may also acquire user acceleration data, which is a measurement of the user's acceleration, from the acceleration sensor 19 or the wearable device 50. The client device 10 may also acquire user oxygen intake data, which is a measurement of the user's oxygen intake (an example of "exercise intensity"), from a device that performs a test related to exhaled gas (e.g., a CPX test).

[0092] Furthermore, the client device 10 may acquire data related to the user's bone structure, facial expression, skin color, or breathing, for example, by analyzing user video data. Furthermore, the client device 10 may estimate exercise intensity by applying a trained model (hereinafter referred to as an "estimation model") to the analysis results. The exercise intensity may be calculated as, for example, energy consumption (e.g., METs), oxygen consumption, exercise intensity based on heart rate (e.g., exercise intensity calculated using the Karvonen method), or a combination thereof. The client device 10 may request the server 30 or another external device to analyze the sensing data or apply the estimation model.

[0093] As a sixth example of information acquisition (S110), the client device 10 acquires exercise intensity information for an exercise type previously performed by the user and the results of a talk test administered to the user while performing the exercise type. The talk test may be administered to the user by having a conversation with a specialist (talk test examiner), such as a physical therapist, using a voice communication function provided in the client device 10. The client device 10 may acquire the results of the talk test via the server 30 or from the terminal of the talk test examiner.

[0094] After step S110, the client device 10 determines the desired exercise intensity (S111). Specifically, the client device 10 determines the desired exercise intensity based on the information acquired in step S110.

[0095] As a first example of determining the desired exercise intensity (S111), the client device 10 determines the target intensity indicated by the user's target intensity information or the target intensity corrected by a first parameter as the desired exercise intensity. The first parameter may be, for example, a coefficient set in consideration of the characteristics of the user's exercise tolerance.

[0096] As a second example of determining the desired exercise intensity (S111), the client device 10 determines the desired exercise intensity based on information related to the user's exercise tolerance. For example, the client device 10 determines the exercise intensity when the user is in a specific state (e.g., near the anaerobic threshold (AT) or maximum exercise tolerance) or the exercise intensity corrected by a first parameter as the desired exercise intensity.

[0097] As a second example of determining the desired exercise intensity (S111), the client device 10 determines the desired exercise intensity based on instructions from the user's instructor. For example, if the instructor instructs the user to perform a specific exercise type and another exercise type with an equivalent exercise intensity, the client device 10 determines the exercise intensity indicated by the exercise intensity information of the instructed exercise type as the desired exercise intensity.

[0098] As a third example of the determination of the desired exercise intensity (S111), the client device 10 determines the desired exercise intensity as the exercise intensity associated with the type of exercise previously performed by the user, corrected as necessary using a second parameter. The second parameter may be a value determined based on at least one of the following: the perceived exercise intensity evaluated by the user for the type of exercise previously performed by the user; the results of sensing the user while performing the type of exercise (e.g., heart rate) or information based thereon (e.g., respiratory rate); or the results of a talk test administered to the user while performing the type of exercise. For example, if the perceived exercise intensity, heart rate, respiratory rate, or talk test results satisfy a predetermined increase condition, the client device 10 may determine the desired exercise intensity as a value obtained by adding a predetermined value to the exercise intensity associated with the type of exercise previously performed by the user. However, if a doctor has set an upper limit on exercise intensity for the user, the client device 10 may determine the desired exercise intensity so as not to exceed the upper limit. On the other hand, if the perceived exertion, heart rate, respiration rate, or talk test result satisfies a predetermined decrease condition, the client device 10 may determine the desired exercise intensity as a value obtained by subtracting a predetermined value from the exercise intensity associated with the type of exercise the user previously performed. The increase condition may be, for example, that the perceived exertion, heart rate, or respiration rate falls below a lower limit (e.g., the perceived exertion is less than 10, or the average heart rate is 5 or more lower than the target heart rate), or that the talk test result indicates that the exercise intensity has not reached the anaerobic metabolic threshold. The decrease condition may be, for example, that the perceived exertion, heart rate, or respiration rate exceeds an upper limit (e.g., the perceived exertion is 14 or 16 or higher, or the average heart rate is 5 or more higher than the target heart rate), or that the talk test result indicates that the exercise intensity has exceeded the anaerobic metabolic threshold. The increase and decrease conditions may be defined in multiple stages.

[0099] After step S111, the client device 10 selects an exercise event (S112). Specifically, the client device 10 refers to the exercise type database (FIG. 6) and selects an exercise type (hereinafter referred to as a "recommended exercise type") that corresponds to the desired exercise intensity determined in step S111. The client device 10 may select one recommended exercise type or multiple recommended exercise types.

[0100] As an example, the client device 10 selects a recommended type of exercise from among exercise types for which the exercise intensity indicated by the corresponding exercise intensity information (hereinafter referred to as "standard intensity") does not exceed the desired exercise intensity. For example, the client device 10 may include, in the recommended type of exercise, an exercise type for which the standard intensity is the highest within a range equal to or less than the desired exercise intensity. Note that, when selecting a recommended type of exercise, the client device 10 may use, instead of the desired exercise intensity, a value obtained by adding or subtracting a margin to the desired exercise intensity, or a value obtained by multiplying the desired exercise intensity by a positive coefficient different from 1. Alternatively, when selecting a recommended type of exercise, the client device 10 may use, instead of the standard intensity, a value obtained by adding or subtracting a margin to the standard intensity, or a value obtained by multiplying the standard intensity by a positive coefficient different from 1.

[0101] After step S112, the client device 10 executes the presentation of information (S113). Specifically, the client device 10 presents information about the recommended exercise selected in step S112 (hereinafter referred to as "recommended exercise information") to the user. For example, the client device 10 may display a screen based on the recommended exercise information on the display 15 or output audio based on the recommended exercise information from a speaker.

[0102] For example, the client device 10 displays the screen of Fig. 9 on the display 15. The screen of Fig. 9 includes objects J20 to J23.

[0103] The object J20 displays a recommended exercise. The object J20 also accepts a user instruction to start the recommended exercise or to play a model video of the recommended exercise. When the object J20 is selected, the client device 10 may have the user perform the exercise corresponding to the object J20, and then re-execute the exercise recommendation process of this embodiment. Here, the client device 10 may sense the user while performing the exercise and select additional recommended exercises based on the results of the sensing. Alternatively, when the object J20 is selected, the client device 10 may play a model video of the exercise corresponding to the object J20. The model video may include information indicating the pace or range of motion that defines the corresponding exercise (e.g., text or audio that conveys information such as the start and end of movement of a specific body part, or the number of seconds required to perform one cycle (rep) of movement).

[0104] The object J21 accepts a user instruction to select an exercise type other than the recommended exercise types. When the object J21 is selected, the client device 10 may, for example, display a list of exercise types other than the recommended exercise types and accept a user instruction to select an exercise type. In response to the user's instruction, the client device 10 may have the user perform the selected exercise type, and then re-execute the exercise type recommendation process of this embodiment. Here, the client device 10 may perform sensing of the user while performing the exercise type and select additional recommended exercise types based on the sensing results. Alternatively, when an exercise type is selected, the client device 10 may play a model video of the selected exercise type. The model video may include information indicating the pace or range of motion that defines the corresponding exercise type (e.g., text or audio that conveys information such as the start and end of movement of a specific body part, or the number of seconds required to perform one cycle (rep) of movement).

[0105] The object J22 receives a user instruction to end the exercise. When the object J22 is selected, the client device 10 ends the exercise type recommendation process of this embodiment.

[0106] After step S113, the client device 10 may end the exercise event recommendation process (FIG. 8).

[0107] (5) Summary As described above, the client device 10 of this embodiment determines a desired exercise intensity, and for each exercise type consisting of repeating the same movement at a specific pace or within a specific range of motion, references an exercise type database that associates predetermined exercise intensities with the exercise type and selects an exercise type corresponding to the desired exercise intensity. The client device 10 then presents information indicating the selected exercise type to the user. This allows the client device 10 to suggest an exercise type appropriate for a given exercise intensity. Furthermore, because each suggested exercise type consists of repeating the same movement at a specific pace or within a specific range of motion, there is little variation in exercise intensity when performing the exercise type. Therefore, this embodiment allows the user to expand the range of available exercise types without sacrificing the effectiveness and safety of exercise therapy.

[0108] The client device 10 may determine the desired exercise intensity based on the user's exercise tolerance. This allows the user to choose an exercise type that can be performed at an intensity close to the exercise intensity that matches the user's exercise tolerance. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0109] The client device 10 may determine the desired exercise intensity based on instructions from the user's instructor. This allows the user to choose exercises that can be performed at intensities close to those intended by the instructor. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0110] The client device 10 may determine the desired exercise intensity based on the exercise intensity associated with the type of exercise the user has previously performed and the information set by the user for that type of exercise. This allows the client device 10 to suggest to the user an exercise type that can be performed at an intensity close to the standard intensity of the type of exercise the user actually performed, corrected based on the information set by the user for that type of exercise. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0111] The client device 10 may determine the desired exercise intensity based on the exercise intensity associated with the type of exercise the user has previously performed and the results of sensing the user while performing that type of exercise. This makes it possible to suggest to the user an exercise type that can be performed at an intensity close to the standard intensity of the type of exercise the user actually performed, corrected based on the results of sensing the user while performing that type of exercise. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0112] The results of sensing the user may include the user's exercise intensity. This makes it possible to suggest to the user exercises that can be performed at an intensity close to the standard intensity of the exercise type actually performed by the user, corrected based on the exercise intensity experienced by the user while performing the exercise type. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0113] The client device 10 may determine the desired exercise intensity based on the exercise intensity associated with the type of exercise the user has previously performed and the results of a talk test administered to the user while performing that type of exercise. This allows the client device 10 to suggest to the user an exercise type that can be performed at an intensity close to the standard intensity of the type of exercise the user actually performed, corrected based on the results of a talk test administered to the user while performing that type of exercise. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0114] The client device 10 may also present information indicating a specific pace or range of motion corresponding to the selected exercise type, thereby encouraging the user to exercise as defined and preventing the user from exercising too hard or too little.

[0115] The exercise type database may associate a first exercise type, which is composed of repeated exercises within a specific range of motion without using at least a machine, with a predetermined exercise intensity for the first exercise type. This allows exercises that do not use machines to be defined as one or more exercise types by limiting the range of motion, thereby reducing the variation in exercise intensity when performing the exercise type. In other words, the number of available exercise types can be expanded without sacrificing the effectiveness and safety of exercise therapy.

[0116] The exercise intensity associated with an exercise type may be determined based on the exercise intensity measured when one or more people perform the exercise type at a specific pace or in accordance with a specific range of motion corresponding to the exercise type, thereby reducing the difference between the exercise intensity when various users perform each exercise type and the standard intensity for the exercise type.

[0117] The exercise database does not need to store information about exercises whose exercise intensity fluctuates beyond an acceptable range during execution, making it easier to control the user's exercise intensity at a specific level over a long period of time.

[0118] The exercise type database does not need to include information on exercise types for which inter-individual variation in exercise intensity exceeds an acceptable range, making it easier to control the exercise intensity of a wide range of users to a specific level.

[0119] (6) Other variations The storage device 11 may be connected to the client device 10 via a network NW. Each input device or output device may be integrated with the client device 10. The storage device 31 may be connected to the server 30 via the network NW. Each input device or output device may be integrated with the wearable device 50.

[0120] Each step of the above information processing can be executed by either the client device 10 or the server 30. As an example, the server 30 may select a recommended exercise type. One or more steps of the above information processing may be performed using a trained model.

[0121] The client device 10 may further perform the following processing, for example, while the user is exercising. Specifically, the client device 10 estimates the user's movements during exercise (e.g., movements of the skeleton or other feature points over multiple points of time, or the state of the skeleton or other feature points at a single point of time) based on the sensing data. Then, if the results of the estimation of the movements do not match at least one of the form or pace defined for the type of exercise the user is performing (e.g., the range of motion of a body part is too narrow or too wide, the angle of a body part deviates from the standard, or the pace is too fast or too slow), the client device 10 provides feedback to the user. The feedback may include at least one of the following: Light, sound or audio output (e.g., audio that tells the user what they did wrong) Displaying images (e.g., images that tell the user what they did wrong) Vibration on wearable devices This makes it possible to prevent the user's exercise intensity from deviating significantly from the standard intensity of the recommended exercise type. Alternatively, the client device 10 may recommend that the user perform a different type of exercise if the number or frequency at which the results of the movement estimation do not conform to at least one of the form or pace defined for the type of exercise the user is performing exceeds a threshold.

[0122] In the above description, an example has been given in which a user video is captured using the camera 16 of the client device 10. However, the user video may be captured using a camera other than the camera 16. In the above description, an example has been given in which the user depth is measured using the depth sensor 17 of the client device 10. However, the user depth may be measured using a depth sensor other than the depth sensor 17.

[0123] In the above description, an example has been given in which the wearable device 50 measures the user's heart rate. However, the heart rate can also be obtained by analyzing video data or its analysis results (e.g., skin color data) (e.g., rPPG (Remote Photoplethysmography) analysis). The heart rate analysis may be performed using a trained model constructed using machine learning technology. Alternatively, the user may exercise while wearing electrodes for an electrocardiogram monitor, allowing the electrocardiogram monitor to measure the user's heart rate. In these modified examples, the user does not need to wear the wearable device 50 to measure the heart rate.

[0124] Instead of the heart rate sensor 56 and the acceleration sensor 57, or in addition to the heart rate sensor 56 and the acceleration sensor 57, the wearable device 50 can be provided with a sensor for measuring at least one of the following items: Blood sugar levels Oxygen saturation The measurement results from each sensor may be used as appropriate to estimate exercise intensity or ventilation index, present information based on the estimation results, or in other situations. For example, blood glucose level measurements may be referenced to evaluate exercise intensity converted into energy consumption or oxygen consumption. For another example, acceleration measurements may be used to determine a user's exercise (e.g., gymnastics) score.

[0125] The acceleration data may be used as part of the input data for the estimation model. Alternatively, the user's skeletal structure may be analyzed with reference to the acceleration data. The acceleration data may be acquired by the acceleration sensor 19 or the acceleration sensor 57, for example, when the user's video is captured.

[0126] Oxygen saturation data can also be used as part of the input data for the estimation model. The oxygen saturation data can be obtained, for example, by having the user wear a wearable device equipped with a sensor (e.g., an optical sensor) capable of measuring blood oxygen levels or a pulse oximeter while recording the user's video. The oxygen saturation data can be estimated, for example, by performing rPPG analysis on the user's video data.

[0127] In addition to or instead of microphone 18, a microphone of wearable device 50 (a microphone provided in wearable device 50 or connected to wearable device 50) may receive sound waves emitted by the user when capturing the user video and generate sound data. The sound data may constitute input data for the estimation model described above. The sound emitted by the user may be, for example, at least one of the following: Sound waves emitted by the rotation of the user's legs (e.g., sounds coming from the pedals or the drive mechanism connected to the pedals) - Sounds that occur when the user breathes or speaks

[0128] In the above description, a CPX test is exemplified as a test related to exhaled gas. In a CPX test, a gradually increasing exercise load is applied to the test subject. However, it is not necessary to gradually increase the exercise load applied to the user when recording the user video. Specifically, real-time exercise intensity can be estimated even when the user is given a constant or constantly changeable exercise load. For example, the exercise performed by the user may be bodyweight exercise, calisthenics, or strength training.

[0129] Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited to the above-described embodiments. Furthermore, the above-described embodiments can be improved or modified in various ways without departing from the spirit of the present invention. Furthermore, the above-described embodiments and modifications can be combined. [Explanation of symbols]

[0130] 1: Information processing system 10: Client device 11:Storage device 12: Processor 13: Input / output interface 14: Communication interface 15: Display 16: Camera 17: Depth sensor 18: Microphone 19: Acceleration sensor 30: Server 31: Storage device 32: Processor 33: Input / output interface 34: Communication interface 50: Wearable devices 51 :Storage device 52: Processor 53: Input / output interface 54: Communication interface 55: Display 56: Heart rate sensor 57: Acceleration sensor 70: Instructor terminal

Claims

1. Computer, means for determining a desired exercise intensity; a means for selecting an exercise type corresponding to a desired exercise intensity by referring to a database that associates predetermined exercise intensities with each exercise type, for each exercise type consisting of repeating the same movement at a specific pace or within a specific range of motion; means for presenting information indicating the selected exercise type to the user; A program that functions as a

2. the determining means determines the desired exercise intensity based on the exercise tolerance of the user. The program according to claim 1.

3. the determining means determines the desired exercise intensity based on instructions from an instructor of the user. The program according to claim 1.

4. the determining means determines the desired exercise intensity based on exercise intensities associated with exercise types previously performed by the user and information set by the user for the exercise types; The program according to claim 1.

5. The determining means determines the desired exercise intensity based on an exercise intensity associated with an exercise type previously performed by the user and a result of sensing the user while performing the exercise type. The program according to claim 1.

6. The result of sensing the user includes the exercise intensity of the user. The program according to claim 5.

7. The determining means determines the desired exercise intensity based on an exercise intensity associated with an exercise type previously performed by the user and a result of a talk test administered to the user while performing the exercise type. The program according to claim 1.

8. the presenting means presents information indicating a specific pace or a specific range of motion corresponding to the selected exercise event; The program according to claim 1.

9. The database associates a first exercise type, which is composed of repeated exercises within a specific range of motion without using at least a machine, with a predetermined exercise intensity for the first exercise type. The program according to claim 1.

10. The exercise intensity associated with the exercise type is determined based on the exercise intensity measured when one or more persons perform the exercise type at a specific pace or in accordance with a specific range of motion corresponding to the exercise type. The program according to claim 1.

11. The database does not contain information about exercise events whose exercise intensity fluctuates beyond an acceptable range during execution. The program according to claim 1.

12. The database does not contain information on exercise events for which inter-individual variation in exercise intensity exceeds an acceptable range. The program according to claim 1.

13. a means for determining a desired exercise intensity; a means for selecting an exercise type corresponding to a desired exercise intensity by referring to a database that associates predetermined exercise intensities with each exercise type, for each exercise type consisting of repeating the same movement at a specific pace or within a specific range of motion; means for presenting information indicating the selected exercise type to the user; An information processing device comprising:

14. The computer determining a desired exercise intensity; a step of referring to a database that associates predetermined exercise intensities with each type of exercise, for each type of exercise consisting of repeating the same movement at a specific pace or within a specific range of motion, and selecting an exercise type corresponding to the desired exercise intensity; presenting information indicating the selected exercise type to the user; How to perform.

15. A system including a plurality of information processing devices, a means for determining a desired exercise intensity; a means for selecting an exercise type corresponding to a desired exercise intensity by referring to a database that associates predetermined exercise intensities with each exercise type, for each exercise type consisting of repeating the same movement at a specific pace or within a specific range of motion; means for presenting information indicating the selected exercise type to the user; A system comprising:

Images