Information processing device, method, program, and system

Abstract

A program according to one aspect of the present disclosure causes a computer to function as: a means for determining a desired exercise intensity; a means for, for each exercise item constituted from exercise in which the same motion is repeated at a specific pace and / or in a specific range of motion, referring to a database that associates a predetermined exercise intensity with the exercise item, and selecting an exercise item corresponding to a desired exercise intensity; and a means for presenting information indicating the selected exercise item to a user.

Description

Information processing device, method, program, and system

[0001] The present disclosure relates to an information processing device, a method, a program, and a system.

[0002] The importance of exercise therapy, which utilizes exercise for the treatment and prevention of disorders and diseases, is increasing. For example, cardiac rehabilitation aims to help heart disease patients regain their physical strength and confidence, return to a comfortable home and social life, and prevent recurrence of heart disease or re-hospitalization through a comprehensive activity program including exercise therapy. The focus of exercise therapy is aerobic exercise, such as walking, jogging, cycling, and aerobics. To perform aerobic exercise more safely and effectively, it is preferable for the subject to exercise at an intensity near their anaerobic threshold (AT).

[0003] The anaerobic threshold is an example of an evaluation index of exercise tolerance and corresponds to a change point in cardiopulmonary function, i.e., an exercise intensity near the boundary between aerobic exercise and anaerobic exercise. The anaerobic threshold is generally determined by a cardiopulmonary exercise test (CPX), in which a test subject is subjected to a gradually increasing exercise load while exhaled gas is collected and analyzed (see Non-Patent Document 1). In a CPX test, the anaerobic threshold is determined based on the results measured by exhaled gas analysis (e.g., oxygen intake, carbon dioxide output, tidal volume, respiratory rate, minute ventilation, or a combination thereof). In addition to the anaerobic threshold, a CPX test can also determine the maximum oxygen intake corresponding to an exercise intensity near maximum exercise tolerance.

[0004] In particular, for high-risk patients with heart disease and other conditions, it is important to appropriately manage the exercise intensity of the subjects in order to ensure the effectiveness and safety of exercise therapy.

[0005] Patent document 1 describes a method of determining whether or not a subject has reached the ventilatory threshold (VT) based on the subject's pulse information, and adjusting the exercise load of an exercise providing device according to the determination result.

[0006] Japanese Patent Publication No. 2022-059494

[0007] Saito, Muneyasu, Cardiac Rehabilitation, Physical Therapy, 1997, Vol. 24, No. 8, pp. 414-418

[0008] The technical concept described in Patent Document 1, in general, involves feedback control to bring exercise intensity closer to the ventilatory threshold (VT). However, the amount of load imposed on the exerciser depends not only on the type of exercise but also on the individual's physical function and daily physical condition. Furthermore, the definition of some exercise types is vague, and the load imposed on the exerciser may vary depending on the exerciser's approach. Therefore, even if this technical concept is applied to exercise therapy, it is not possible to determine the exercise intensity that a specified exercise type will impose on the subject, or what type of exercise should be recommended to the subject to achieve the specified exercise intensity. Furthermore, the technical concept described in Patent Document 1 cannot be simply applied, for example, to cases where a subject is required to exercise at an exercise intensity lower than the ventilatory threshold (VT).

[0009] The purpose of the present disclosure is to expand the range of exercises available without sacrificing the effectiveness and safety of exercise therapy.

[0010] A program according to one aspect of the present disclosure causes a computer to function as: a means for determining a desired exercise intensity; a means for referencing a database that associates predetermined exercise intensities with each type of exercise, each of which consists of repeating the same movement at a specific pace or within a specific range of motion, and selecting the type of exercise corresponding to the desired exercise intensity; and a means for presenting information indicating the selected type of exercise to the user.

[0011] 1 is a block diagram showing the configuration of an information processing system according to this embodiment; FIG. 2 is a block diagram showing the configuration of a client device according to this embodiment; FIG. 3 is a block diagram showing the configuration of a server according to this embodiment; FIG. 4 is a block diagram showing the configuration of a wearable device according to this embodiment; FIG. 5 is an explanatory diagram of one aspect of this embodiment; FIG. 6 is a diagram showing the data structure of an exercise type database according to this embodiment; FIG. 7 is a diagram showing the data structure of a user profile database according to this embodiment; FIG. 8 is a flowchart of exercise type recommendation processing according to this embodiment; and FIG. 9 is a diagram showing an example of a screen displayed in the exercise type recommendation processing according to this embodiment.

[0012] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In the drawings for explaining the embodiment, the same components are generally designated by the same reference numerals, and repeated description thereof will be omitted.

[0013] (1) Configuration of Information Processing System The configuration of the information processing system will be described below. Fig. 1 is a block diagram showing the configuration of the information processing system according to this embodiment.

[0014] As shown in FIG. 1 , the information processing system 1 includes a client device 10 , a server 30 , and a wearable device 50 .

[0015] Here, the number of client devices 10 and wearable devices 50 varies depending on, for example, the number of users. Therefore, the number of client devices 10 and wearable devices 50 may each be two or more. Furthermore, a terminal of a person who plans or instructs the exercise therapy may also be included in the information processing system 1. The person who plans or instructs the exercise therapy may include, for example, a medical professional (e.g., a doctor, nurse, pharmacist, physical therapist, occupational therapist, or clinical laboratory technician), a nutritionist, or a trainer.

[0016] The client device 10 and the server 30 are connected via a network (e.g., the Internet or an intranet) NW. The client device 10 and the wearable device 50 are connected via a wireless channel using, for example, Bluetooth (registered trademark) technology.

[0017] The client device 10 is an example of an information processing device that transmits a request to the server 30. The client device 10 is, for example, a smartphone, a tablet terminal, or a personal computer.

[0018] The server 30 is an example of an information processing device that provides the client device 10 with a response in response to a request transmitted from the client device 10. The server 30 is, for example, a server computer.

[0019] The wearable device 50 is an example of an information processing device that can be worn on the user's body (for example, on the arm, hand, or head).

[0020] (1-1) Configuration of the Client Device The configuration of the client device will be described below with reference to Fig. 2, which is a block diagram showing the configuration of the client device of this embodiment.

[0021] 2 , the client device 10 includes a storage device 11, a processor 12, an input / output interface 13, and a communication interface 14. The client device 10 is connected to a display 15, a camera 16, a depth sensor 17, a microphone 18, and an acceleration sensor 19.

[0022] The storage device 11 is configured to store programs and data, and is, for example, a combination of a read-only memory (ROM), a random access memory (RAM), and a storage (for example, a flash memory or a hard disk).

[0023] The programs include, for example, the following: - An operating system (OS) program - An application program that executes information processing (for example, a web browser, a therapeutic app, a rehabilitation app, or a fitness app) Here, diseases that are the target of therapeutic apps or rehabilitation apps are diseases in which exercise may contribute to improving symptoms, such as heart disease, lifestyle-related diseases (hypertension, diabetes, dyslipidemia, hyperlipidemia), and obesity.

[0024] The data includes, for example, the following data: Databases referenced in information processing Data obtained by executing information processing (i.e., execution results of information processing)

[0025] The processor 12 is a computer that executes the programs stored in the storage device 11 to realize the functions of the client device 10. The processor 12 is, for example, at least one of the following: - CPU (Central Processing Unit) - GPU (Graphic Processing Unit) - ASIC (Application Specific Integrated Circuit) - FPGA (Field Programmable Gate Array)

[0026] The input / output interface 13 is configured to acquire information (e.g., user instructions, images, sounds) from an input device connected to the client device 10, and to output information (e.g., images, commands) to an output device connected to the client device 10.

[0027] The input device is, for example, a camera 16, a depth sensor 17, a microphone 18, an acceleration sensor 19, a keyboard, a pointing device, a touch panel, a sensor, or a combination thereof. The output device is, for example, a display 15, a speaker, or a combination thereof.

[0028] The communication interface 14 is configured to control communication between the client device 10 and external devices (e.g., another client device 10, the server 30, and the wearable device 50). Specifically, the communication interface 14 may include a module for communication with the server 30 (e.g., a WiFi module, a mobile communication module, or a combination thereof). The communication interface 14 may include a module for communication with the wearable device 50 (e.g., a Bluetooth module).

[0029] The display 15 is configured to display an image (still image or moving image) and is, for example, a liquid crystal display or an organic EL display.

[0030] The camera 16 is configured to take pictures and generate image signals.

[0031] The depth sensor 17 is, for example, a light detection and ranging (LIDAR) sensor. The depth sensor 17 is configured to measure the distance (depth) from the depth sensor 17 to a surrounding object (for example, a user).

[0032] The microphone 18 is configured to receive sound waves and generate sound signals, and is preferably placed near the user's body (particularly the respiratory tract) as an earphone microphone.

[0033] The acceleration sensor 19 is configured to detect acceleration.

[0034] (1-2) Server Configuration The server configuration will be described below with reference to Fig. 3, which is a block diagram showing the configuration of the server according to this embodiment.

[0035] As shown in FIG. 3, the server 30 includes a storage device 31, a processor 32, an input / output interface 33, and a communication interface .

[0036] The storage device 31 is configured to store programs and data, and is, for example, a combination of ROM, RAM, and storage.

[0037] The programs include, for example, the following programs: OS programs; application programs for executing information processing.

[0038] The data includes, for example, the following data: Databases referenced in information processing Execution results of information processing

[0039] The processor 32 is a computer that executes the programs stored in the storage device 31 to realize the functions of the server 30. The processor 32 is, for example, at least one of the following: CPU, GPU, ASIC, FPGA

[0040] The input / output interface 33 is configured to acquire information (e.g., user instructions) from an input device connected to the server 30, and to output information to an output device connected to the server 30. The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display.

[0041] The communication interface 34 is configured to control communications between the server 30 and an external device (eg, the client device 10).

[0042] (1-3) Configuration of the Wearable Device The configuration of the wearable device will be described below. Fig. 4 is a block diagram showing the configuration of the wearable device of this embodiment.

[0043] 4 , the wearable device 50 includes a storage device 51, a processor 52, an input / output interface 53, and a communication interface 54. The wearable device 50 is connected to a display 55, a heart rate sensor 56, and an acceleration sensor 57.

[0044] The storage device 51 is configured to store programs and data, and is, for example, a combination of ROM, RAM, and storage.

[0045] The programs include, for example, the following: - OS programs - Programs for applications that execute information processing (for example, medical applications, rehabilitation applications, or fitness applications)

[0046] The data includes, for example, the following data: Databases referenced in information processing Execution results of information processing

[0047] The processor 52 is a computer that executes the programs stored in the storage device 51 to realize the functions of the wearable device 50. The processor 52 is, for example, at least one of the following: a CPU, a GPU, an ASIC, or an FPGA.

[0048] The input / output interface 53 is configured to acquire information (e.g., user instructions, sensing results) from an input device connected to the wearable device 50, and to output information (e.g., images, commands) to an output device connected to the wearable device 50.

[0049] The input device is, for example, a heart rate sensor 56, an acceleration sensor 57, a microphone, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display 55, a speaker, or a combination thereof.

[0050] The communication interface 54 is configured to control communication between the wearable device 50 and an external device (e.g., the client device 10). Specifically, the communication interface 54 may include a module (e.g., a Bluetooth module) for communication with the client device 10.

[0051] The display 55 is configured to display an image (still image or moving image) and is, for example, a liquid crystal display or an organic EL display.

[0052] The heart rate sensor 56 is configured to measure the heart rate and generate a sensing signal. As an example, the heart rate sensor 56 measures the heart rate using an optical measurement technique.

[0053] The acceleration sensor 57 is configured to detect acceleration.

[0054] (2) One aspect of the embodiment One aspect of the present embodiment will be described below. Fig. 5 is an explanatory diagram of one aspect of the present embodiment.

[0055] As shown in Fig. 5, the storage device 31 of the server 30 stores target exercise intensity information for each user. The target exercise intensity information indicates the user's target exercise intensity. For example, the target exercise intensity information for user US1 may be determined based on instructions from a doctor DC2 in charge of user US1. The instructions from doctor DC2 are accepted by the instructor terminal 70 and transmitted to the server 30.

[0056] The user US1 is typically a person undergoing exercise therapy, such as a (cardiac) rehabilitation program or a participant in an exercise instruction program. In the example of Fig. 5, the exercise type is gymnastics, but the exercise type may include any exercise (aerobic exercise or anaerobic exercise).

[0057] The client device 10 of the user US1 determines a desired exercise intensity. As an example, the client device 10 may determine the desired exercise intensity based on target exercise intensity information for the user US1. The storage device 11 of the client device 10 stores exercise intensity information for each of a plurality of selectable exercise types. The exercise intensity information is information indicating the standard exercise intensity required of the subject when performing the corresponding exercise type. Specifically, the storage device 11 stores an exercise type database, which will be described later. The exercise type database associates, for each exercise type, a predetermined (standard) exercise intensity for that exercise type.

[0058] Here, each exercise type stored in the exercise type database consists of repeated movements of the same movement at a specific pace or within a specific range of motion. For example, when a user performs an exercise type with a wide variety of variations, such as squats, there is room for interpretation of small details such as how far to lower the hips, how wide the stance, and how many seconds it takes to perform one rep, which can lead to significant variations in exercise intensity. Therefore, for example, by focusing on the range of motion, squats can be classified into different exercise types, such as half squats and full squats, which reduces the variation in exercise intensity. By defining each exercise type in this way, the specifications of the exercise type are clarified, reducing the room for interpretation by the user and reducing the variation in exercise intensity when performing that exercise type.

[0059] The client device 10 refers to the exercise type database (exercise intensity information for each exercise type) and selects an exercise type corresponding to the desired exercise intensity. The client device 10 presents information indicating the selected exercise type to the user US1.

[0060] In this way, the information processing system 1 can suggest exercise types appropriate for a given exercise intensity. Each suggested exercise type consists of repeating the same movement at a specific pace or within a specific range of motion, so there is little variation in exercise intensity when performing that exercise type. Therefore, this embodiment can expand the range of available exercise types without sacrificing the effectiveness and safety of exercise therapy.

[0061] (3) Database The database of this embodiment will be described. The following database is stored in the storage device 11 or the storage device 31.

[0062] (3-1) Exercise Event Database The exercise event database of this embodiment will be described below. Fig. 6 is a diagram showing the data structure of the exercise event database of this embodiment.

[0063] The exercise type database stores exercise type information. The exercise type information is information about exercise types available to the user. In this embodiment, the exercise types include exercise types that can be performed without using devices with adjustable exercise loads, such as gymnastics, bodyweight training, dancing, walking, running, and treadmills. These exercise types are rich in variety because they include types performed in a standing position. Furthermore, the exercise types available in this embodiment may also include types consisting of repeated exercises within a specific range of motion without using a machine (especially a machine with a function to fix the range of motion). Furthermore, in this embodiment, even an exercise type that is generally considered to be a single type, such as squats, is subdivided and defined as multiple exercise types with different exercise intensities by varying the form (e.g., the positional relationship between body parts, the angle of the body parts, the range of motion of the body parts moved during exercise, etc.), pace, number of repetitions, or the duration or number of rest periods. However, the exercise types of this embodiment may further include exercise types performed using equipment capable of adjusting the exercise load, such as an ergometer or strength training using training equipment.

[0064] The exercise types available in this embodiment consist of repeated movements of the same movement at a specific pace or within a specific range of motion. However, even among such exercise types, excluding exercise types with any of the following characteristics can provide exercise therapy with greater consideration for effectiveness and safety: - The exercise intensity (e.g., perceived exertion) fluctuates beyond an acceptable range during the exercise type (hereinafter referred to as the "first characteristic"); - The inter-individual variation in exercise intensity (e.g., oxygen intake, energy expenditure, or heart rate) exceeds an acceptable range (hereinafter referred to as the "second characteristic"). Exercise types with the first characteristic are difficult to maintain at a stable exercise intensity for a long period of time, and therefore are unsuitable from the perspective of controlling the user's exercise intensity at a specific level over a long period of time. Typically, exercise types that repeatedly perform movements that strain small muscles, such as the arms, may have the first characteristic. Exercise types with the second characteristic are unsuitable from the perspective of controlling the exercise intensity of a wide range of users at a specific level, because the actual exercise intensity experienced by the user is uncertain (difficult to predict). For example, suppose that measurements of exercise types for multiple people consistently show that the exercise intensity of exercise type A is higher than that of exercise type B. On the other hand, if the exercise intensity of exercise type C for each person varies among three patterns: "higher than that of exercise type A," "between the exercise intensities of exercise types A and B," and "lower than that of exercise type B," then exercise type C is considered to have the second characteristic.

[0065] 6, the exercise event database includes an "ID" field, a "name" field, an "exercise intensity" field, and an "exercise definition" field. Each field is associated with the others.

[0066] The "ID" field stores an exercise type ID. The exercise type ID is information for identifying the exercise type corresponding to the record.

[0067] The "Name" field stores information about the name of the exercise type. The exercise type name information is information about the name of the exercise type corresponding to the record.

[0068] The "exercise intensity" field stores exercise intensity information. The exercise intensity information is information about the standard exercise intensity of the exercise type corresponding to the record. Standard exercise intensity may refer to, for example, the exercise intensity when a person with standard physical function performs the corresponding exercise type as defined. As an example, such exercise intensity may be derived by, for example, actually measuring the exercise intensity (e.g., average oxygen consumption) when one or more people perform the corresponding exercise type as defined (i.e., according to a specific pace or a specific range of motion) using, for example, exhaled gas analysis (or estimating it by analyzing video footage of the user exercising), and then statistically processing the results (e.g., averaging). Here, whether a person is performing the exercise type as defined may be determined by an algorithm based on the person's sensing results, or may be determined by a human.

[0069] For example, exercise intensity may be derived by measuring (or estimating) the exercise intensity of one or more individuals performing a corresponding exercise type as defined for each section of the exercise type, applying the measurement results for each section to a predetermined formula for each individual, and then statistically processing (e.g., averaging) the values ​​obtained by this formula across individuals. Here, a section is a component of an exercise type, and if the exercise type consists of multiple movement patterns, each movement pattern may correspond to a section. For example, if the exercise type is dance, each choreography may correspond to a section. Furthermore, if the exercise type is squats, the transition from a standing position to a crouching position and the transition from a crouching position to a standing position may each correspond to a section.

[0070] The "exercise definition" field stores exercise definition information. The exercise definition information is information related to the definition of the exercise type corresponding to the record. The exercise definition information can include information related to at least one of the following elements: - Acceptable range of exercise pace (for example, the time required for one cycle of movement, or the speed or acceleration of the moving body part) - Acceptable range of positional relationship between body parts (for example, foot width, etc.) - Acceptable range of angle of body part (which may be one or multiple) (for example, the direction of the knee, or the angle formed by the upper arm and forearm) - Acceptable range of motion of body part (which may be one or multiple) moved during exercise (for example, the range of movement of each body part during one cycle of movement) - Number of repetitions - Rest time - Exercise load (for example, the magnitude of the external load set in the case of exercise performed using equipment with adjustable exercise load, such as an ergometer)

[0071] Even for an exercise that is generally recognized as a single event (e.g., squats), multiple events with slightly different exercise intensities can be defined by specifying and defining details of the pace, form (particularly the range of motion), number of repetitions, rest time, and exercise load. For example, for an exercise that is generally recognized as a single event, multiple events with exercise intensities that differ by 0.2 METs can be defined.

[0072] (3-2) User Profile Database The user profile database of this embodiment will now be described with reference to Fig. 7, which shows the data structure of the user profile database of this embodiment.

[0073] The user profile database stores user profile information, which is information relating to the profile of a user of the information processing system 1 (i.e., a person who exercises).

[0074] 7, the user profile database includes an "ID" field, a "Name" field, a "Target Strength" field, and a "Body" field. Each field is associated with the others.

[0075] The "ID" field stores a user ID, which is information for identifying the user corresponding to the corresponding record.

[0076] The "Name" field stores user name information, which is information about the name of the user (for example, name, account name, etc.) corresponding to the corresponding record.

[0077] The "target intensity" field stores target intensity information. The target intensity information is information regarding the target value of exercise intensity (e.g., oxygen consumption, energy consumption, heart rate, or a combination thereof) set for the user corresponding to the record. As an example, the target intensity information is specified by a person (e.g., a doctor) planning or instructing an exercise regimen based on the results of measuring the user's exercise tolerance, for example, by CPX while using an ergometer (e.g., oxygen consumption and heart rate at the anaerobic threshold (AT)). However, CPX is not required, and the target value may be specified at the doctor's discretion. As another example, the target intensity information is determined by an algorithm based on the results of measuring the user's exercise tolerance, for example, by CPX. To perform aerobic exercise more safely and effectively, it is preferable to exercise at an intensity near the anaerobic threshold. Therefore, the target value of exercise intensity is, for example, but not limited to, an exercise intensity corresponding to the anaerobic threshold. While an ergometer is typically used as the exercise type for CPX measurements, the oxygen consumption at the anaerobic threshold when using a treadmill, for example, is approximately 1.2 to 1.3 times that when using an ergometer. This is thought to be because the total muscle mass used on the treadmill exceeds the total muscle mass used on the ergometer. Therefore, as a first example, the target intensity information may be a value obtained by correcting the target value based on the results of CPX measurements when using an ergometer to approximately 1.2 to 1.3 times the original value, or a value obtained by further subtracting a predetermined value (e.g., 1 MET). As a second example, the target intensity information may be a value obtained by correcting the target value based on the results of CPX measurements when using an ergometer without correcting it. This prevents the target value from being excessively high when selecting an exercise type that uses a relatively small amount of muscle mass, such as an ergometer. As a third example, the target value for each exercise type may be corrected, for example, by a coefficient corresponding to the total muscle mass used.

[0078] A doctor may also set an upper limit on exercise intensity for a user (an example of exercise prescription). In this case, the user is not permitted to select an exercise type that exceeds the prescribed upper limit of exercise intensity. For exercise prescription, a UI (User Interface) screen for exercise prescription may be displayed on the display of the doctor's device. Such a UI screen may include, for example, the following information: The user's CPX data; and a display area for sample videos of multiple selectable exercise types. The display area for each sample video of each exercise type may be arranged according to the exercise intensity information corresponding to the exercise type. For example, if 3.6 METs is recommended as the upper limit based on the CPX data, a group of display areas for sample videos of exercise types corresponding to 3.4 METs, a group of display areas for sample videos of exercise types corresponding to 3.6 METs, and a group of display areas for sample videos of exercise types corresponding to 3.8 METs may be arranged on the UI screen. Information on exercise types (e.g., sample videos) may be arranged in units smaller or larger than 0.2 METs. When the doctor selects one of the display areas, the exercise intensity associated with the corresponding exercise type is set as the upper limit.

[0079] In addition, the upper limit specified by the doctor through exercise prescription may be raised or lowered by a medical professional under the supervision of the doctor during regular (e.g., every two weeks) medical guidance or doctor rounds.

[0080] The "Physical" field stores physical information. The physical information is information about the body (functions) of the user corresponding to the record. For example, the physical information may include information about the user's age, gender, weight, height, illnesses, etc.

[0081] In addition, the user profile database may store the following information: Information indicating the person who planned or instructed the user's exercise therapy Information indicating the user's doctor

[0082] (4) Information Processing Information processing in this embodiment will be described.

[0083] (4-1) Exercise Recommendation Processing The exercise recommendation processing of this embodiment will be described. Fig. 8 is a flowchart of the exercise recommendation processing of this embodiment. Fig. 9 is a diagram showing an example of a screen displayed in the exercise recommendation processing of this embodiment.

[0084] The exercise type recommendation process starts when, for example, one of the following start conditions is met: - The exercise type recommendation process is called by another process; - The user or a person who plans or instructs the user's exercise therapy performs an operation to call the exercise type recommendation process; - The client device 10 enters a predetermined state (for example, a predetermined app is launched); - A predetermined date and time has arrived; - A predetermined amount of time has passed since a predetermined event.

[0085] 8, the client device 10 acquires information (S110). Specifically, the client device 10 acquires information regarding criteria for determining a desired exercise intensity to be used to select a recommended exercise type.

[0086] As a first example of information acquisition (S110), the client device 10 acquires target strength information of the user. For example, the client device 10 may read the target strength information of the user stored in the storage device 11. Alternatively, the client device 10 may request the server 30 to transmit the target strength information of the user and receive the transmitted information.

[0087] As a second example of information acquisition (S110), the client device 10 acquires information related to the exercise tolerance of the user. For example, the client device 10 may acquire information on the results of measuring the exercise tolerance of the user by CPX while using an ergometer (for example, the oxygen consumption and heart rate at the anaerobic threshold (AT)).

[0088] As a third example of information acquisition (S110), the client device 10 acquires instructions from the user's instructor (e.g., a doctor or other person who plans or instructs the exercise therapy). For example, the client device 10 may acquire the instructions from the instructor via the server 30 or from the instructor terminal 70.

[0089] As a fourth example of information acquisition (S110), the client device 10 acquires information about the exercise intensity set by the user. The exercise intensity set by the user may be, for example, the exercise intensity desired by the user. Alternatively, the exercise intensity set by the user may be the perceived intensity of exertion (e.g., the Borg index) evaluated by the user for a type of exercise previously performed by the user.

[0090] As a fifth example of information acquisition (S110), the client device 10 acquires exercise intensity information of an exercise type previously performed by the user and the results of sensing the user while performing the exercise type.

[0091] Here, various sensing operations may be performed on the user. For example, the client device 10 may acquire user video data, which captures a video of the user exercising, from the camera 16. The client device 10 may also acquire user depth data, which measures the distance to each part of the user's body while exercising, from the depth sensor 17. The client device 10 may acquire user data, which collects sound (e.g., sound generated by the user's breathing or vocalization) from the microphone 18. The client device 10 may also acquire user heart rate data, which measures the heart rate using the heart rate sensor 56, from the wearable device 50. The client device 10 may also acquire user acceleration data, which measures the user's acceleration, from the acceleration sensor 19 or the wearable device 50. The client device 10 may also acquire user oxygen intake data, which measures the user's oxygen intake (an example of "exercise intensity"), from a device that performs an exhaled gas test (e.g., a CPX test).

[0092] Furthermore, the client device 10 may acquire data related to the user's bone structure, facial expression, skin color, or breathing, for example, by analyzing user video data. Furthermore, the client device 10 may estimate exercise intensity by applying a trained model (hereinafter referred to as an "estimation model") to the analysis results. The exercise intensity may be calculated as, for example, energy consumption (e.g., METs), oxygen consumption, exercise intensity based on heart rate (e.g., exercise intensity calculated using the Karvonen method), or a combination thereof. The client device 10 may request the server 30 or another external device to analyze the sensing data or apply the estimation model.

[0093] As a sixth example of information acquisition (S110), the client device 10 acquires exercise intensity information for an exercise type previously performed by the user and the results of a talk test administered to the user while performing that exercise type. The talk test may be administered to the user by having a conversation with a specialist (talk test examiner), such as a physical therapist, using the voice communication function of the client device 10. The client device 10 may acquire the talk test results via the server 30 or from the terminal of the talk test examiner.

[0094] After step S110, the client device 10 determines a desired exercise intensity (S111). Specifically, the client device 10 determines a desired exercise intensity based on the information acquired in step S110.

[0095] As a first example of determining the desired exercise intensity (S111), the client device 10 determines the target intensity indicated by the user's target intensity information or the target intensity corrected by a first parameter as the desired exercise intensity. The first parameter may be, for example, a coefficient set in consideration of the characteristics of the user's exercise tolerance.

[0096] As a second example of determining the desired exercise intensity (S111), the client device 10 determines the desired exercise intensity based on information about the user's exercise tolerance. For example, the client device 10 determines the exercise intensity when the user is in a specific state (e.g., near the anaerobic threshold (AT) or maximum exercise tolerance) or the exercise intensity corrected by a first parameter as the desired exercise intensity.

[0097] As a second example of determining the desired exercise intensity (S111), the client device 10 determines the desired exercise intensity based on instructions from the user's instructor. For example, if the instructor instructs the user to perform a specific exercise type and another exercise type with an equivalent exercise intensity, the client device 10 determines the exercise intensity indicated by the exercise intensity information for the instructed exercise type as the desired exercise intensity.

[0098] As a third example of the desired exercise intensity determination (S111), the client device 10 determines the desired exercise intensity as the exercise intensity associated with the type of exercise previously performed by the user, corrected as necessary using a second parameter. The second parameter may be a value determined based on at least one of the following: the perceived exertion evaluated by the user for the type of exercise previously performed by the user; the results of sensing the user while performing the type of exercise (e.g., heart rate) or information based thereon (e.g., respiratory rate); or the results of a talk test administered to the user while performing the type of exercise. For example, if the perceived exertion, heart rate, respiratory rate, or talk test results satisfy a predetermined increase condition, the client device 10 may determine the desired exercise intensity as a value obtained by adding a predetermined value to the exercise intensity associated with the type of exercise previously performed by the user. However, if a doctor has set an upper limit for the exercise intensity for the user, the client device 10 may determine the desired exercise intensity so as not to exceed that upper limit. On the other hand, if the perceived exertion, heart rate, respiration rate, or Talk Test results satisfy a predetermined decrease condition, the client device 10 may determine the desired exercise intensity as a value obtained by subtracting a predetermined value from the exercise intensity associated with the type of exercise the user previously performed. The increase condition may be, for example, that the perceived exertion, heart rate, or respiration rate falls below a lower limit (e.g., the perceived exertion is less than 10, or the average heart rate is 5 or more lower than the target heart rate), or that the Talk Test results indicate that the exercise intensity has not reached the anaerobic metabolic threshold. The decrease condition may be, for example, that the perceived exertion, heart rate, or respiration rate exceeds an upper limit (e.g., the perceived exertion is 14 or 16 or higher, or the average heart rate is 5 or more higher than the target heart rate), or that the Talk Test results indicate that the exercise intensity has exceeded the anaerobic metabolic threshold. The increase and decrease conditions may be defined in multiple stages.

[0099] After step S111, the client device 10 selects an exercise type (S112). Specifically, the client device 10 refers to the exercise type database (FIG. 6) and selects an exercise type (hereinafter referred to as a "recommended exercise type") that corresponds to the desired exercise intensity determined in step S111. The client device 10 may select one recommended exercise type or multiple recommended exercise types.

[0100] As an example, the client device 10 selects a recommended type of exercise from among exercise types whose exercise intensity indicated by the corresponding exercise intensity information (hereinafter referred to as "standard intensity") does not exceed the desired exercise intensity. For example, the client device 10 may include, in the recommended types of exercise, an exercise type whose standard intensity is the highest in a range equal to or less than the desired exercise intensity. Note that, when selecting a recommended type of exercise, the client device 10 may use, instead of the desired exercise intensity, a value obtained by adding or subtracting a margin to the desired exercise intensity, or a value obtained by multiplying the desired exercise intensity by a positive coefficient different from 1. Alternatively, when selecting a recommended type of exercise, the client device 10 may use, instead of the standard intensity, a value obtained by adding or subtracting a margin to the standard intensity, or a value obtained by multiplying the standard intensity by a positive coefficient different from 1.

[0101] After step S112, the client device 10 executes information presentation (S113). Specifically, the client device 10 presents information about the recommended exercise selected in step S112 (hereinafter referred to as "recommended exercise information") to the user. For example, the client device 10 may display a screen based on the recommended exercise information on the display 15 or output audio based on the recommended exercise information from a speaker.

[0102] For example, the client device 10 displays the screen of Fig. 9 on the display 15. The screen of Fig. 9 includes objects J20 to J23.

[0103] The object J20 displays a recommended exercise. The object J20 also accepts a user instruction to start the recommended exercise or to play a model video of the recommended exercise. When the object J20 is selected, the client device 10 may have the user perform the exercise corresponding to the object J20, and then re-execute the exercise recommendation process of this embodiment. The client device 10 may sense the user while performing the exercise and select additional recommended exercises based on the results of the sensing. Alternatively, when the object J20 is selected, the client device 10 may play a model video of the exercise corresponding to the object J20. The model video may include information indicating the pace or range of motion that defines the corresponding exercise (e.g., text or audio that conveys information such as the start and end of movement for a specific body part, or the number of seconds required to perform one cycle (rep) of movement).

[0104] The object J21 accepts a user instruction to select an exercise type other than the recommended exercise types. When the object J21 is selected, the client device 10 may, for example, display a list of exercise types other than the recommended exercise types and accept a user instruction to select an exercise type. In response to the user's instruction, the client device 10 may have the user perform the selected exercise type, and then re-execute the exercise type recommendation process of this embodiment. Here, the client device 10 may sense the user while performing the exercise type and select additional recommended exercise types based on the sensing results. Alternatively, when an exercise type is selected, the client device 10 may play a demonstration video of the selected exercise type. The demonstration video may include information indicating the pace or range of motion that defines the corresponding exercise type (e.g., text or audio that conveys information such as the start and end of movement of a specific body part, or the number of seconds required to perform one cycle (rep) of movement).

[0105] The object J22 receives a user instruction to end the exercise. When the object J22 is selected, the client device 10 ends the exercise type recommendation process of this embodiment.

[0106] After step S113, the client device 10 may end the exercise event recommendation process (FIG. 8).

[0107] (5) Summary As described above, the client device 10 of this embodiment determines a desired exercise intensity, and for each exercise type consisting of repeating the same movement at a specific pace or within a specific range of motion, references an exercise type database that associates predetermined exercise intensities with the exercise type and selects an exercise type corresponding to the desired exercise intensity. The client device 10 presents information indicating the selected exercise type to the user. This allows the client device 10 to suggest an exercise type appropriate for a given exercise intensity. Furthermore, because each suggested exercise type consists of repeating the same movement at a specific pace or within a specific range of motion, there is little variation in exercise intensity when the exercise type is performed. Therefore, this embodiment allows the range of available exercise types to be expanded without sacrificing the effectiveness and safety of exercise therapy.

[0108] The client device 10 may determine the desired exercise intensity based on the user's exercise tolerance. This allows the user to choose an exercise type that can be performed at an intensity close to the exercise intensity that matches the user's exercise tolerance. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0109] The client device 10 may determine the desired exercise intensity based on instructions from the user's instructor. This allows the user to choose exercises that can be performed at intensities close to those intended by the instructor. In other words, it is possible to provide an exercise regimen that takes into consideration both effectiveness and safety.

[0110] The client device 10 may determine the desired exercise intensity based on the exercise intensity associated with the type of exercise the user has previously performed and the information set by the user for that type of exercise. This allows the client device 10 to suggest to the user an exercise type that can be performed at an intensity close to the standard intensity of the type of exercise the user actually performed, corrected based on the information set by the user for that type of exercise. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0111] The client device 10 may determine the desired exercise intensity based on the exercise intensity associated with the type of exercise the user has previously performed and the results of sensing the user while performing that type of exercise. This makes it possible to suggest to the user an exercise type that can be performed at an intensity close to the standard intensity of the type of exercise the user actually performed, corrected based on the results of sensing the user while performing that type of exercise. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0112] The results of sensing the user may include the user's exercise intensity. This makes it possible to suggest to the user exercises that can be performed at an intensity close to the standard intensity of the exercise type actually performed by the user, corrected based on the exercise intensity experienced by the user while performing the exercise type. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0113] The client device 10 may determine the desired exercise intensity based on the exercise intensity associated with the type of exercise the user has previously performed and the results of a talk test administered to the user while performing that type of exercise. This allows the client device 10 to suggest to the user an exercise type that can be performed at an intensity close to the standard intensity of the type of exercise the user actually performed, corrected based on the results of a talk test administered to the user while performing that type of exercise. In other words, it is possible to provide an exercise therapy that takes into consideration both effectiveness and safety.

[0114] The client device 10 may also present information indicating a specific pace or range of motion corresponding to the selected exercise type, thereby encouraging the user to exercise as defined and preventing the user from exercising too hard or too hard.

[0115] The exercise type database may associate a first exercise type, which is composed of repeated exercises within a specific range of motion without using at least a machine, with a predetermined exercise intensity for the first exercise type. This allows exercises that do not use machines to be defined as one or more exercise types by limiting the range of motion, thereby reducing the variation in exercise intensity when performing the exercise type. In other words, the available exercise types can be expanded without sacrificing the effectiveness and safety of exercise therapy.

[0116] The exercise intensity associated with an exercise type may be determined based on the exercise intensity measured when one or more people perform the exercise type at a specific pace or in accordance with a specific range of motion corresponding to the exercise type, thereby reducing the difference between the exercise intensity when various users perform each exercise type and the standard intensity for the exercise type.

[0117] The exercise database does not need to store information about exercises whose exercise intensity fluctuates beyond an acceptable range during execution, making it easier to control the user's exercise intensity at a specific level over a long period of time.

[0118] The exercise type database does not need to include information on exercise types for which inter-individual variation in exercise intensity exceeds an acceptable range, making it easier to control the exercise intensity of a wide range of users to a specific level.

[0119] (6) Other Modifications The storage device 11 may be connected to the client device 10 via the network NW. Each input device or output device may be integrated with the client device 10. The storage device 31 may be connected to the server 30 via the network NW. Each input device or output device may be integrated with the wearable device 50.

[0120] Each step of the above information processing can be executed by either the client device 10 or the server 30. As an example, the server 30 may select a recommended exercise type. One or more steps of the above information processing may be performed using a trained model.

[0121] The client device 10 may further perform the following processes, for example, while the user is exercising. Specifically, the client device 10 estimates the user's movements during exercise (e.g., movements of the skeleton or other feature points over multiple time periods, or the state of the skeleton or other feature points at a single time) based on the sensing data. Then, if the estimated movements do not match at least one of the form or pace specified for the type of exercise the user is performing (e.g., the range of motion of a body part is too narrow or too wide, the angle of a body part deviates from the standard, or the pace is too fast or too slow), the client device 10 provides feedback to the user. The feedback may include at least one of the following: - Output of light, sound, or voice (e.g., voice informing the user of an incorrect part of the exercise) - Display of an image (e.g., an image informing the user of an incorrect part of the exercise) - Vibration of the wearable device. This can prevent the user's exercise intensity from deviating significantly from the standard intensity for the recommended type of exercise. Alternatively, the client device 10 may recommend that the user perform a different type of exercise if the number or frequency at which the results of the movement estimation do not conform to at least one of the form or pace defined for the type of exercise the user is performing exceeds a threshold.

[0122] In the above description, an example has been shown in which a user video is captured using the camera 16 of the client device 10. However, the user video may be captured using a camera other than the camera 16. In the above description, an example has been shown in which the user depth is measured using the depth sensor 17 of the client device 10. However, the user depth may be measured using a depth sensor other than the depth sensor 17.

[0123] In the above description, an example has been given in which the wearable device 50 measures the user's heart rate. However, the heart rate can also be obtained by analyzing video data or its analysis results (e.g., skin color data) (e.g., remote photoplethysmography (rPPG) analysis). The heart rate analysis may be performed using a trained model constructed using machine learning technology. Alternatively, the user may exercise while wearing electrodes for an electrocardiogram monitor, allowing the electrocardiogram monitor to measure the user's heart rate. In these variations, the user does not need to wear the wearable device 50 to measure the heart rate.

[0124] The wearable device 50 may be provided with a sensor for measuring at least one of the following items instead of or in addition to the heart rate sensor 56 and the acceleration sensor 57: blood glucose level; and oxygen saturation. The measurement results from each sensor may be used as appropriate to estimate exercise intensity or ventilation index, present information based on the estimation results, or in other situations. As one example, the measurement results of blood glucose level may be referenced to evaluate exercise intensity converted into energy consumption or oxygen consumption. As another example, the measurement results of acceleration may be used, for example, to determine the score of the user's exercise (e.g., gymnastics).

[0125] The acceleration data may be used as part of the input data for the estimation model. Alternatively, the user's skeletal structure may be analyzed by referring to the acceleration data. The acceleration data may be acquired by the acceleration sensor 19 or the acceleration sensor 57 when capturing a user video.

[0126] Oxygen saturation data can also be used as part of the input data for the estimation model. The oxygen saturation data can be obtained, for example, by having the user wear a wearable device equipped with a sensor (e.g., an optical sensor) capable of measuring blood oxygen levels or a pulse oximeter while recording the user's video. The oxygen saturation data can be estimated, for example, by performing rPPG analysis on the user's video data.

[0127] In addition to or instead of the microphone 18, a microphone of the wearable device 50 (a microphone provided in the wearable device 50 or connected to the wearable device 50) may receive sound waves emitted by the user when capturing the user's video, and generate sound data. The sound data may constitute input data for the estimation model described above. The sound emitted by the user may be, for example, at least one of the following: - Sound waves emitted by the rotation of the user's legs (for example, sound generated from the pedals or drive units connected to the pedals) - Sound generated by the user's breathing or vocalization

[0128] In the above description, a CPX test is exemplified as a test related to exhaled gas. In a CPX test, a gradually increasing exercise load is applied to the test subject. However, it is not necessary to gradually increase the exercise load applied to the user when recording the user video. Specifically, real-time exercise intensity can be estimated even when the user is subjected to a constant or constantly changeable exercise load. For example, the exercise performed by the user may be bodyweight exercise, calisthenics, or strength training.

[0129] Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited to the above-described embodiments. Furthermore, the above-described embodiments can be improved or modified in various ways without departing from the spirit of the present invention. Furthermore, the above-described embodiments and modifications can be combined.

[0130] 1: Information processing system 10: Client device 11: Storage device 12: Processor 13: Input / output interface 14: Communication interface 15: Display 16: Camera 17: Depth sensor 18: Microphone 19: Acceleration sensor 30: Server 31: Storage device 32: Processor 33: Input / output interface 34: Communication interface 50: Wearable device 51: Storage device 52: Processor 53: Input / output interface 54: Communication interface 55: Display 56: Heart rate sensor 57: Acceleration sensor 70: Instructor terminal

Claims

1. A program that causes a computer to function as means for determining a desired exercise intensity, means for referring to a database that associates a predetermined exercise intensity with each exercise type, where each exercise type is composed of an exercise that repeats the same action at at least one of a specific pace or a specific exercise range, and selecting an exercise type corresponding to the desired exercise intensity, and means for presenting information indicating the selected exercise type to the user.

2. The program according to claim 1, wherein the determining means determines the desired exercise intensity based on the user's exercise tolerance.

3. The program according to claim 1 or 2, wherein the determining means determines the desired exercise intensity based on an instruction from the user's instructor.

4. The program according to any one of claims 1 to 3, wherein the determining means determines the desired exercise intensity based on the exercise intensity associated with the exercise type the user has performed in the past and the information set by the user for that exercise type.

5. The program according to any one of claims 1 to 4, wherein the determining means determines the desired exercise intensity based on the exercise intensity associated with the exercise type the user has performed in the past and the result of sensing the user during the performance of that exercise type.

6. The program according to claim 5, wherein the result of sensing the user includes the user's exercise intensity.

7. The program according to any one of claims 1 to 6, wherein the determining means determines the desired exercise intensity based on the exercise intensity associated with the exercise type the user has performed in the past and the result of a talk test performed on the user during the performance of that exercise type.

8. The program according to any one of claims 1 to 7, wherein the presenting means presents information indicating a specific pace or a specific exercise range corresponding to the selected exercise type.

9. The program according to any one of claims 1 to 8, wherein the database associates a predetermined exercise intensity with a first exercise type composed of an exercise that repeats in a specific exercise range without using at least a machine.

10. The exercise intensity associated with the exercise type is determined based on the exercise intensity measured when causing one or more persons to perform the exercise type according to a specific pace or a specific motion range corresponding to the exercise type. The program according to any one of claims 1 to 9.

11. Information on exercise types in which the exercise intensity fluctuates beyond the allowable range during execution is not registered in the database. The program according to any one of claims 1 to 10.

12. Information on exercise types in which the inter-individual variation in exercise intensity exceeds the allowable range is not registered in the database. The program according to any one of claims 1 to 11.

13. An information processing apparatus comprising: means for determining a desired exercise intensity; means for selecting an exercise type corresponding to the desired exercise intensity by referring to a database that associates a predetermined exercise intensity with each exercise type, each of which is composed of an exercise that repeats the same motion at at least one of a specific pace or a specific motion range; and means for presenting information indicating the selected exercise type to a user.

14. A method in which a computer executes: a step of determining a desired exercise intensity; a step of selecting an exercise type corresponding to the desired exercise intensity by referring to a database that associates a predetermined exercise intensity with each exercise type, each of which is composed of an exercise that repeats the same motion at at least one of a specific pace or a specific motion range; and a step of presenting information indicating the selected exercise type to a user.

15. A system comprising a plurality of information processing apparatuses, the system comprising: means for determining a desired exercise intensity; means for selecting an exercise type corresponding to the desired exercise intensity by referring to a database that associates a predetermined exercise intensity with each exercise type, each of which is composed of an exercise that repeats the same motion at at least one of a specific pace or a specific motion range; and means for presenting information indicating the selected exercise type to a user.

Images