Information system, information processing method, and program

Abstract

Based on the relationship between the measurement results of sports items and the body's functions or abilities, the degree of the body's functions or abilities is detected. 【Solution means】The information system includes a control unit that measures the achievement value for each predetermined sports item from an image capturing a person's movement, and determines the degree of the person's physical vitality corresponding to a second sports item for which the correspondence relationship with the first sports item different from the first sports item is confirmed based on the achievement value for each sports item.

Description

Technical Field

[0001] The present invention relates to an information system, an information processing method, and a program.

Background Art

[0002] Regarding the decline in physical and mental functions associated with aging, for example, a method for measuring physical data has been proposed (see, for example, Patent Document 1 below).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the above conventional technology, the relationship between physical data, for example, the measurement results of exercise items, and the decline in physical and mental functions associated with aging has not necessarily been clearly specified. In particular, sufficient consideration has not been given to data items that are difficult to measure among physical data.

[0005] The problem of the disclosed technology is to detect the degree of physical function or ability based on the relationship between the measurement results of exercise items and the physical function or ability of the body.

Means for Solving the Problems

[0006] One aspect of the disclosed technology is exemplified by an information system. This information system measures achievement values for each predetermined exercise item from an image capturing a person's movement, and determines the degree of a person's physical vitality corresponding to a second exercise item for which a correspondence relationship with the first exercise item different from the first exercise item is confirmed based on the achievement values for each exercise item, and includes a control unit that executes the above.

Effects of the Invention

[0007] According to the information system of the present disclosure, the degree of a body function or ability can be detected based on the relationship between the measurement result of an exercise item and the body function or ability.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0009] Hereinafter, with reference to the drawings, an information system, an information processing method, and a program according to an embodiment will be described. The configurations of the following embodiments are examples, and the present information system, information processing method, and program are not limited to the configurations of the embodiments.

[0010] This information system includes a control unit that measures achievement values for each predetermined exercise item from an image of a person's movement, and determines the degree of physical vitality of a person (user) corresponding to a second exercise item for which a correspondence relationship with a first exercise item different from the first exercise item is confirmed based on the achievement values for each exercise item.

[0011] Here, the exercise items include dynamic items and static items. Examples of dynamic items include walking, vertical jumping, standing up from a chair, etc. Examples of static items include rotation to the maximum rotation angle position during neck rotation and maintaining the rotation state for a predetermined time, rotation to the maximum rotation angle position during shoulder rotation and maintaining the rotation state for a predetermined time, standing on one leg with eyes closed, standing on one leg with eyes open, movement of the fingertips during sitting forward bend and maintaining the forward bent state for a predetermined time, movement of the fingertips during standing forward bend and maintaining the forward bent state for a predetermined time, spreading the legs to the maximum abduction angle of the hip joint and maintaining the state for a predetermined time, extending the knees to the maximum opening angle of the knee joints while sitting and maintaining the state for a predetermined time, maintaining for a predetermined time at the maximum angle of the sole of the foot with respect to the axis of the lower leg at the ankle joint, etc. This information system recognizes the head, eyes, nose, ears, mouth, shoulders, hands, feet, etc. as feature points from an image of a person's movement, and measures the achievement values of the person in these exercise items. Also, dynamic exercise items can be said to be exercise items where speed, acceleration such as walking speed are the achievement values. Furthermore, dynamic exercise items can be said to be exercise items accompanied by a change in the position of the user due to muscle strength. On the other hand, static exercise items can also be said to be exercise items including maintaining a certain state such as body angle, body posture maintenance time, etc., or exercise items where parameters indicating body flexibility are the achievement values. Also, static exercise items can be said to be exercise items where the state of the body is maintained by muscle strength.

[0012] In addition, this information system determines the physical vitality of a person corresponding to a second exercise item whose correspondence with a first exercise item has been confirmed, which is different from the first exercise item. Here, the first exercise item is, for example, an exercise item performed while sitting, and the second exercise item is an exercise item performed while standing. Also, the first exercise item is, for example, a static exercise item, and the second exercise item is a dynamic exercise item. Based on the correspondence with the first exercise item, this information system estimates the physical vitality corresponding to the second exercise item from the achievement value in the first exercise item for such a second exercise item different from the first exercise item. Also, physical vitality can also be referred to as physical ability or function.

[0013] <Embodiment> (Configuration) Hereinafter, with reference to FIGS. 1 to 8, an information system according to an embodiment will be described. FIG. 1 is a diagram illustrating the configuration of this information system. This information system includes an information processing device 1 that measures the achievement value for each exercise item of a user from an image and determines the physical vitality of the user, and an information acquisition device 2 connected to the information processing device 1 via a network N1. Note that in this embodiment, measurement is synonymous with measurement.

[0014] The information processing device 1, also called a server, reports the determination result of the physical vitality to the user. The configuration of the information processing device 1 is the same as that of a normal computer. The information processing device 1 includes a CPU 101, a memory 102, an external storage device 103, a display device 104, an input device 105, and a communication device 106.

[0015] The CPU 101 executes a computer program developed to be executable in the memory 102 and provides the functions of the information processing device 1. The memory 102, also called a main storage device, stores the computer program executed by the CPU 101, the data processed by the CPU 101, and the like. The CPU 101 is also called a processor. The CPU 101 and the memory 102 can be called a control unit.

[0016] However, the CPU 101 is not limited to a single processor and may have a multi-processor configuration. Also, the CPU 101 may be a single processor connected by a single socket and may have a multi-core configuration. Furthermore, at least part of the processing of the information processing apparatus 1 may be provided by a dedicated processor such as a Digital Signal Processor (DSP), Graphics Processing Unit (GPU), numerical operation processor, vector processor, image processing processor, etc., or an Application Specific Integrated Circuit (ASIC), etc. Also , at least part of the information processing apparatus 1 may be a dedicated large scale integration (LSI) such as a Field-Programmable Gate Array (FPGA), or other digital circuits. Also, the information pro cessing apparatus 1 may include an analog circuit in at least part thereof.

[0017] The memory 102 is a Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), Read Only Memory (ROM), etc. Furthermore, the external storage device 1 03 is used, for example, as a storage area to assist the memory 102 and stores computer programs executed by the CPU 11, data processed by the CPU 101, etc. The external storage device 103 is a hard disk drive, Solid State Drive (SSD), etc. Furthermore, the information processing apparatus 1 may be provided with a drive device for a removable storage medium. The removable storage medium is, for example, a Blu-ray Disc, Digital Versatile Disc (DVD), Compact Disc (CD), flash memory card, etc.

[0018] The display device 104 is, for example, a liquid crystal display, an electroluminescence panel, or the like. The input device 105 is, for example, a keyboard, a pointing device, or the like. In the present embodiment, a mouse, a touch panel, or the like is exemplified as the pointing device. The communication device 106 exchanges data with other devices on the network N1.

[0019] The information acquisition device 2 includes a terminal 201 and a camera 202. Although the configuration of the terminal 201 varies in scale, the hardware configuration itself is the same as that of the information processing device 1. The terminal 201 transmits an image of the user captured by the camera 202 to the information processing device 1 through the network N1 and receives a determination result of the user's physical vitality from the information processing device 1. The terminal 201 may be, for example, a device called a smartphone or a mobile terminal. Also, the terminal 201 may be a device called a personal computer.

[0020] Note that the terminal 201 has an output device including a device similar to the display device 104 of the information processing device 1 and a speaker or the like. The terminal 201 guides the user by means of an image and voice output from this output device and causes the user to perform an operation of a motion item to be measured.

[0021] The camera 202 is a photographing device having an image sensor such as an SSD (Charge Coupled Devices) or a CMOS (Complementary Metal Oxide Semiconductor). The camera 202 acquires an image of the user at a predetermined frame period, accumulates it in the terminal 201, and transfers it to the information processing device 1. In FIG. 1, the camera 202 is externally attached to the terminal 201, but it may be built into the terminal 201. The network N1 includes a wired or wireless public network. The network N1 is an LTE (Long Term Evolution), 5G (5th Generation Mobile Communication System), or the like, or a wireless access network after these The network N1 includes the Internet. However, the network N1 does not include private networks such as VPNs (Virtual Private Networks). This may include a dedicated network or a dedicated line for each operator.

[0022] FIG. 2 is a schematic flow chart illustrating a process of determining the physical vitality of a user in this information system. In this embodiment, the information processing device 1 outputs guidance via the terminal 201 and causes the user to perform a predetermined exercise item. The information processing device 1 also registers attribute information of the user and performs calibration (S1). The attribute information of the user is, for example, height, weight, sex, and age. The information processing device 1 sets parameters such as the user's head length and limb length from, for example, the height and weight. More specifically, the information processing device 1 selects a model that is closest to the user from parameters of the internal model group formed in the memory 102, and obtains parameters such as the dimensions of each part of the user based on parameters such as the dimensions of each part of the body of the model, and reflects them in the measurement of the exercise items of the user in the image.

[0023] Calibration is a process of, for example, determining in advance the amount of change in the depth direction (also called the depth direction) of an image relative to the amount of change in the left-right direction (plane direction) of a feature point of a user when the user rotates his / her head on an image. Through such calibration, the information processing device 1 determines the measured values ​​of the movement of each part of the user in a three-dimensional space from the movement of the user on the image, and further calculates the angle, length, etc. of the rotation state, extension state, and bending state of each part of the human body, such as the rotation angle of the head from a state facing forward.

[0024] Note that the information processing apparatus 1 may hold calibration parameters for users who are models with a plurality of different body types, and interpolate the calibration parameters according to individual values such as height and weight for each different user. More precisely, for each user, the amount of change in the depth direction (also referred to as the depth direction) may be measured in advance with respect to the amount of change in the vertical, horizontal, and left-right directions (in the plane) on the screen.

[0025] Next, the information processing apparatus 1 outputs guidance via the terminal 201, causes the user to perform each exercise item, and collects an image of the user while performing the exercise item from the camera 202 (S2). Note that, according to the user, an exercise item that is difficult to perform is appropriately selected according to the response from the user. The information processing apparatus 1 omits an exercise item that is difficult for the user to perform according to the response from the user among the predetermined exercise items prepared in advance, and guides the user to perform the remaining exercise items. The information processing apparatus 1 measures and records the achievement value for each exercise item from the collected image. Then, the information processing apparatus 1 analyzes and determines the physical vitality of the user based on the measured achievement value for each exercise item. Then, the information processing apparatus 1 outputs the determination result of the physical vitality of the user from the terminal 201 in the form of a result report (S3).

[0026] (Example of measurement data) FIGS. 3 to 6 are diagrams illustrating the relationship between the achievement value for each exercise item measured by the information processing apparatus 1 and the physical vitality of the user who achieved the achievement value. Each of FIGS. 3 to 6 has the achievement value for each exercise item on the horizontal axis and the physical vitality of the user on the vertical axis, and is a diagram in which the measurement results are plotted as black circles. Further, in each diagram, a regression line illustrating the relationship between the value on the horizontal axis and the value on the vertical axis, and a correlation coefficient (R 2 ) are illustrated. Here, a large number of users execute each exercise item shown in FIGS. 3 to 6, and the information processing apparatus 1 measures the achievement value of each user from an image of the user while performing each exercise item.

[0027] On the one hand, the physical vitality of each user shown in FIGS. 3 to 6 is measured from each user before or after executing the exercise item. In FIGS. 3 to 6, the maximum walking speed (m / s) is adopted as the physical vitality. The maximum walking speed (m / s) can be obtained by measuring the moving time when each user walks at the maximum speed over a specified distance, for example, 10 m to 100 m. The maximum walking speed (m / s) does not have to be measured by the information processing apparatus 1. Instead, an administrator who groups users may measure the maximum walking speed (or the shortest walking time) of each user offline and input it into the information processing apparatus 1. It is not necessary to be measured by the information processing apparatus 1. Instead, an administrator who groups users may measure the maximum walking speed (or the shortest walking time) of each user offline and input it into the information processing apparatus 1.

[0028] FIG. 3(A) shows the result of measuring the maximum angle of neck rotation in the sitting position as an exercise item. The maximum angle of neck rotation in the sitting position is the maximum rotation angle when the user rotates the head around to the left and right while sitting on a chair. The information processing apparatus 1 measures the rotation angle of the head when the user faces right or left with the origin being when the user faces forward from an image taken of the user's upper body from the front. The information processing apparatus 1 identifies the positions of the user's both eyes, nose, mouth, and both ears, etc. as features, and may measure the angle when facing right or left from the change in the positions of these feature points. Also, the information processing apparatus 1 may average the maximum right rotation angle and the maximum left rotation angle. Further, the information processing apparatus 1 may adopt the larger or smaller value of the maximum right rotation angle and the maximum left rotation angle as the maximum angle of neck rotation in the sitting position. Additionally, the information processing apparatus 1 may measure only one of the maximum right rotation angle and the maximum left rotation angle. In any case, it can be understood from FIG. 3(A) that there is a clear correlation (correlation coefficient R 2 = 0.3322), that is, a linear relationship, between the maximum angle of neck rotation in the sitting position and the maximum walking speed.

[0029] FIG. 3(B) shows the result of measuring the maximum angle of shoulder rotation in the sitting position as an exercise item. The maximum angle of shoulder rotation in the sitting position is the maximum rotation angle when the user rotates the upper body around to the left and right while sitting.

[0030] The measurement method is the same as the maximum neck rotation angle in the sitting position. However, for the maximum shoulder rotation angle in the sitting position, as characteristic points, for example, the center of both eyes of the head, the midpoint between both ears, the center of the mouth, the tips of both shoulders, the center positions of the connection parts of both shoulders and arms, the tip parts of both sleeves in a short-sleeved garment, the positions of both elbows, the center positions of both wrists, the tip parts of the hands, etc. can be used. In any case, it can be understood from Fig. 3(B) that there is a clear correlation (correlation coefficient R 2 = 0.2649) between the maximum shoulder rotation angle in the sitting position and the maximum walking speed.

[0031] Fig. 4(A) shows the result of measuring the maximum hip joint flexion angle in the supine position as an exercise item. The maximum hip joint flexion angle in the supine position is the maximum angle when the user lies on their back and bends one knee to open the upper leg (femur) forward (upward). More specifically, the user keeps one foot (for example, the right foot) parallel to the trunk on the floor and bends the other knee (for example, the left knee) at a predetermined angle (for example, 90 degrees), and then pulls the knee upward in the direction of the upper body. At this time, the angle of the hip joint when the pulled-up knee moves to the maximum and the angle of the hip joint becomes the largest is the maximum hip joint flexion angle in the supine position.

[0032] The measurement method is the same as the maximum neck rotation angle in the sitting position. However, for the measurement of the maximum hip joint flexion angle in the supine position, as characteristic points, for example, the head, the waist, the knees, the tip parts of the feet, etc. can be used. It can be seen from Fig. 4(A) that the correlation between the maximum hip joint flexion angle in the supine position and the maximum walking speed is weaker than the correlation between the maximum neck rotation angle in the sitting position in Fig. 3(A) and the correlation between the maximum shoulder rotation angle in the sitting position in Fig. 3(B).

[0033] Figure 4(B) shows the result of measuring the maximum hip abduction angle in the supine position as a movement item. The maximum hip abduction angle in the supine position is the maximum angle when the user lies on their back, extends both knees, and spreads the two thighs (femurs) forward and backward relative to each other. More specifically, the user keeps one foot (e.g., the right foot) parallel to the trunk on the floor and, with the other knee (e.g., the left knee) extended, pulls the knee upward toward the upper body. At this time, the angle formed by the pulled-up foot with respect to the trunk when the pulled-up knee has moved to the maximum extent and the hip joint angle is at its maximum is the maximum hip abduction angle in the supine position.

[0034] The measurement method is the same as that for the maximum hip flexion angle in the supine position shown in Figure 4(A). From Figure 4(B), it can be seen that the correlation between the maximum hip abduction angle in the supine position and the maximum walking speed is weaker than the correlation between the maximum neck rotation angle in the sitting position shown in Figure 3(A) and the maximum walking speed, and the correlation between the maximum shoulder rotation angle in the sitting position shown in Figure 3(B) and the maximum walking speed.

[0035] Figures 5(A) and 5(B) show the results of measuring the maximum knee abduction angle in the sitting position as a movement item. The maximum knee abduction angle in the sitting position refers to the angle of the knee joint when the user is sitting on a chair or the like and extends the knee of the foot, that is, the opening angle between the thigh (femur) and the lower leg (fibula and tibia). The maximum knee abduction angle is, for example, 180 degrees when the knee is extended in a straight line. Note that Figure 5(A) shows the data of a user whose maximum knee abduction angle is close to 180 degrees, and Figure 5(B) shows the data of a user whose maximum knee abduction angle is close to 100 degrees.

[0036] The measurement method is the same as the maximum hip joint flexion angle in the supine position shown in Fig. 4(A). From Fig. 5(A), it can be seen that for users with a maximum knee joint extension angle close to 180 degrees in the seated position, the correlation with the maximum walking speed is weaker than the correlation between the maximum neck rotation angle and the maximum walking speed in the seated position shown in Fig. 3(A), and the correlation between the maximum shoulder rotation angle and the maximum walking speed in the seated position shown in Fig. 3(B). However, it can be seen that the correlation in Fig. 5(A) is stronger than the correlation between the maximum hip joint flexion angle and the maximum walking speed in the supine position shown in Fig. 4(A), and the correlation between the maximum hip joint extension angle and the maximum walking speed in the supine position shown in Fig. 4(B).

[0037] On the other hand, for users with a maximum knee joint extension angle close to 100 degrees in Fig. 5(B), it can be seen that the correlation with the maximum walking speed is as weak as the correlation between the maximum hip joint flexion angle and the maximum walking speed in the supine position shown in Fig. 4(A), and the correlation between the maximum hip joint extension angle and the maximum walking speed in the supine position shown in Fig. 4(B).

[0038] Fig. 6(A) shows the result of measuring the maximum ankle plantar flexion angle in the seated position as an exercise item. The maximum ankle plantar flexion angle in the seated position refers to the maximum value of the angle change of the sole of the foot when the user sits on a chair or the like, bends the knee of the foot at a predetermined angle, and presses the tip of the foot downward (toward the sole of the foot). In measuring the angle change of the sole of the foot, the information processing device 1 may measure, for example, the angle when the angle between the lower leg (fibula and tibia) and the sole of the foot is 90 degrees as a reference state, and the angle when the angle of the sole of the foot changes maximally in the sole-of-the-foot direction around the ankle joint. However, in this embodiment, the definition of the maximum ankle plantar flexion angle in the seated position is the angle of the sole of the foot with respect to the axis of the lower leg (fibula and tibia), and the larger the angle change of the sole of the foot, the closer the angle approaches 0 degrees (parallel) from 90 degrees (Fig. 6(A)).

[0039] The measurement method is, for example, to identify positions such as the tip of the toe, the heel, multiple points on the axis formed by the lower leg (fibula and tibia), the knee, the waist, etc., and measure the angle in the changed state with respect to the reference state (for example). In FIG. 6(A), it is understood that there is a negative correlation between the maximum plantar flexion angle of the ankle joint in the sitting position and the maximum walking speed. However, as described above, in this embodiment, for the maximum plantar flexion angle of the ankle joint in the sitting position, the angle of the sole of the foot with respect to the axis of the lower leg (fibula and tibia) is measured, and the larger the change in the angle of the sole of the foot, the closer the angle approaches from 90 degrees to 0 degrees (parallel). Therefore, FIG. 6(A) substantially shows a positive correlation between the magnitude of the change in the angle of the sole of the foot and the maximum walking speed. It can be seen that the correlation in FIG. 6(A) is of the same degree as the correlation between the maximum hip joint abduction angle and the maximum walking speed in the supine position in FIG. 4(B).

[0040] FIG. 6(B) shows the result of measuring the maximum dorsiflexion angle of the ankle joint in the sitting position as a movement item. The maximum dorsiflexion angle of the ankle joint in the sitting position refers to the maximum value of the change in the angle of the sole of the foot when the user sits on a chair or the like and bends the knee of the foot at a predetermined angle and then pulls up the toe. The change in the angle of the sole of the foot can be measured, for example, with respect to the reference state based on when the angle between the lower leg (fibula and tibia) and the sole of the foot is 90 degrees, and measuring the angle change when the angle of the sole of the foot changes maximally. That is, the angle change can be measured as the difference value from the reference state.

[0041] Similar to the maximum plantar flexion angle of the ankle joint, the measurement method is, for example, to identify positions such as the tip of the toe, the heel, the axis formed by the lower leg (fibula and tibia), the knee, the waist, etc., and the difference in the angle in the changed state from the reference state By measuring the score values. From FIG. 6(B), it can be seen that there is a positive correlation between the maximum ankle dorsiflexion angle in the sitting position and the maximum walking speed. Also, the correlation between the maximum ankle dorsiflexion angle in the sitting position and the maximum walking speed is weaker than the correlation between the maximum neck rotation angle in the sitting position and the maximum walking speed in FIG. 3(A), and the correlation between the maximum shoulder rotation angle in the sitting position and the maximum walking speed in FIG. 3(B). On the other hand, the correlation in FIG. 6(B) is stronger than the correlation between the maximum hip flexion angle in the supine position and the maximum walking speed in FIG. 4(A), and the correlation between the maximum hip abduction angle in the supine position and the maximum walking speed in FIG. 4(B). Also, the correlation in FIG. 6(B) is of the same degree as the correlation between the maximum knee abduction angle in the sitting position and the maximum walking speed in FIG. 5(A).

[0042] FIG. 7 is a diagram exemplifying the generalization of the measurement data obtained based on the results of FIGS. 3 to 6 and the like and the results of physical vitality. As described above, there is a correlation between the measurement data (each maximum value) of the exercise items in the sitting position and the maximum walking speed in the standing position, and between the measurement data (each maximum value) of the exercise items in the supine position and the maximum walking speed in the standing position. Each maximum value can also be said to be the achieved value for each user. The maximum walking speed in the standing position can be said to be an example of physical vitality.

[0043] FIG. 7 exemplifies that the relationship between the measurement data X of the exercise item and the physical vitality Y is represented by the regression line Y = A * X + B. Here, in this embodiment, * indicates multiplication. Therefore, by maintaining the relationship between the measurement data X of various exercise items and the physical vitality Y in the memory 102 in the form of, for example, a regression line by the information processing apparatus 1, it is exemplified that the measurement data X can be acquired from the image when the user executes various exercise items, and the physical vitality Y can be estimated.

[0044] Here, the movement items on the horizontal axis in FIG. 7 are, for example, movement items in the sitting or supine position. Therefore, by storing the relationship in FIG. 7 in the memory 102 by the information processing apparatus 1, the physical vitality Y in the standing position can be estimated from the data of the achievement values for each movement item measured in the sitting or supine position. Also, the maximum walking speed in the standing position is dynamic physical vitality, and the data measured in FIGS. 3 to 6 can also be said to be static measurement data of the movement items respectively. Therefore, by storing the relationship in FIG. 7 in the memory 102 by the information processing apparatus 1, the dynamic physical vitality Y can be estimated from the static measurement data of the movement items.

[0045] Furthermore, generalizing FIG. 7, the information processing apparatus 1 may hold in the memory 102 a relationship for obtaining the physical vitality Y from the data X1 to Xn (n is an integer indicating the number of independent variables) for each of a plurality of movement items. For example, let the maximum neck rotation angle in the sitting position in FIG. 3(A) be X1, the maximum shoulder rotation angle in the sitting position be X2, the maximum hip joint flexion angle in the supine position in FIG. 4(A) be X3, the maximum hip joint abduction angle in the supine position in FIG. 4(B) be X4, the maximum knee joint abduction angle in the sitting position in FIGS. 5(A)(B) be X5, the maximum ankle plantar flexion angle in the sitting position in FIG. 6(A) be X6, and the maximum ankle dorsiflexion angle in the sitting position in FIG. 6(B) be X7. At this time, the physical vitality may be defined by an empirical formula such as Y = A0 + A1*X1 + A2*X2 + ··· + A7*X7. Note that the empirical formula is not limited to a linear formula and may include higher-order terms of the second order or higher.

[0046] In addition, the information processing device 1 may hold in the memory 102 a correlation relationship for estimating the physical vitality Y in the sitting or supine position from the measurement data X in the standing position, and estimate the physical vitality Y in the sitting or supine position from the measurement data X in the standing position. For example, the information processing device 1 may estimate the achievement value of bench press in the sitting or supine position with respect to the walking speed in the standing position, the jumping distance in vertical jump, etc. Similarly, the information processing device 1 may hold in the memory 102 a correlation relationship for estimating the static physical vitality Y from the dynamic measurement data X of the exercise item, and estimate the static physical vitality Y from the dynamic measurement data X. Note that the measurement data of the exercise item is not limited to those illustrated in FIGS. 3 to 6. For example, as the exercise item, there may be the single-leg standing time with eyes open (or closed) in the standing position, the jumping distance in vertical jump. Also, as the item of physical vitality, there may be the single-leg standing time with eyes open (or closed) in the standing position, the jumping distance in vertical jump.

[0047] (Processing Example) FIG. 8 is a flowchart illustrating the processing of the information processing device 1. As illustrated in FIG. 1, the information processing device 1 receives an image of the user during the execution of the exercise item, analyzes the image, and measures the achievement value of the exercise item. Then, the information processing device 1 numerically specifies the physical vitality of the user from the measured achievement value of the exercise item, and outputs a result report to the user's terminal 201.

[0048] In the processing of FIG. 8, the information processing device 1 first sends guidance to the user via the terminal 201, prompts the user to execute each exercise item, and acquires an image of the user during the execution of each exercise item (S10). Then, the information processing device 1 measures, for example, the maximum neck rotation angle X1 in the sitting position (S11). Further, the information processing device 1 estimates the maximum walking speed Y1 of the user from an empirical formula such as the regression line illustrated in FIG. 7 based on the measured maximum neck rotation angle X1 in the sitting position (S12).

[0049] Next, the information processing apparatus 1 measures, for example, the maximum shoulder rotation angle X2 in a seated position (S13). Further, the information processing apparatus 1 estimates the maximum walking speed Y2 of the user from an empirical formula such as a regression line based on the measured maximum shoulder rotation angle X2 in the seated position (S14). Next, the information processing apparatus 1 measures, for example, the open-eye single-leg stance time X3 in a standing position (S15). Further, the information processing apparatus 1 estimates the maximum walking speed Y3 of the user from an empirical formula such as a regression line based on the measured open-eye single-leg stance time X3 in the standing position (S16).

[0050] Next, the information processing apparatus 1 measures, for example, the closed-eye single-leg stance time X4 in a standing position (S17). Further, the information processing apparatus 1 estimates the maximum walking speed Y4 of the user from an empirical formula such as a regression line based on the measured closed-eye single-leg stance time X4 in the standing position (S18). Next, the information processing apparatus 1 measures, for example, the jump distance X5 of a vertical jump (S19). Further, the information processing apparatus 1 estimates the maximum walking speed Y5 of the user from an empirical formula such as a regression line based on the measured jump distance X5 (S20).

[0051] Next, the information processing apparatus 1 measures, for example, the maximum hip joint flexion angle X6 in a supine position (S21). Further, the information processing apparatus 1 estimates the maximum walking speed Y6 of the user from an empirical formula such as a regression line based on the measured maximum hip joint flexion angle X6 in the supine position (S22). Next, the information processing apparatus 1 measures, for example, the maximum knee joint extension angle X7 in a seated position (S23). Further, the information processing apparatus 1 estimates the maximum walking speed Y7 of the user from an empirical formula such as a regression line based on the measured maximum knee joint extension angle X7 in the seated position (S24). Next, the information processing apparatus 1 measures, for example, the maximum ankle plantar flexion angle X8 in a seated position (S25). Further, the information processing apparatus 1 estimates the maximum walking speed Y8 of the user from an empirical formula such as a regression line based on the measured maximum ankle plantar flexion angle X8 in the seated position (S22). Note that, in addition to the maximum ankle plantar flexion angle X8 in the seated position, the information processing apparatus 1 may measure the maximum ankle dorsiflexion angle in the seated position. Also, the exercise items measured by the information processing apparatus 1 are not limited to the example in FIG. 8.

[0052] Then, based on the maximum walking speeds Y1 to Y8 estimated above, the information processing device 1 summarizes the physical vitality of the user in a result report, creates a comprehensive evaluation, and outputs it from the terminal 201 (S27). Here, the information processing device 1 stores the achievement values for each exercise item measured in the past or the degree of the user's physical vitality determined in the past in the memory 102, the external storage device 103, or the like. Then, the information processing device 1 may compare the achievement value for each current exercise item with the achievement value for each exercise item measured in the past. Also, the information processing device 1 may compare the degree of the current user's physical vitality with the degree of the user's physical vitality determined in the past. Thereby, the information processing device 1 can detect, for example, a decrease in physical vitality due to aging, or the maintenance and improvement of physical vitality as a result of training.

[0053] Note that FIG. 8 estimates the maximum walking speeds Y1 to Y8 of the user from the maximum neck rotation angle X1 in the sitting position to the maximum ankle plantar flexion angle X8 in the sitting position, which are the achievement values of the user measured by the information processing device 1. However, instead of such processing, the information processing device 1 may calculate the physical vitality Y (e.g., the maximum walking speed of the user) using an empirical formula such as physical vitality Y = A0 + A1*X1 + A2*X2 + ··· + An*Xn (n is an integer).

[0054] (Effects of the Embodiment) In this embodiment, the information processing device 1 measures the achievement value for each predetermined exercise item from an image capturing a person's movement. Then, based on the achievement value for each exercise item, the information processing device 1 determines the degree of the user's physical vitality corresponding to a second exercise item for which the correspondence relationship with a first exercise item different from the first exercise item has been confirmed. The first exercise item is an exercise item specified from the image, for example, illustrated on the horizontal axis in FIGS. 3 to 6. Also, the second exercise item is, for example, walking, and the physical vitality of a person corresponding to the second exercise item is the maximum walking speed. Therefore, the information processing device 1 can estimate the degree of the user's physical vitality exemplified by the maximum walking speed by measuring the first exercise item even for an environment in which the second exercise item is difficult to measure or for a user for whom the second exercise item is difficult to measure.

[0055] Here, the predetermined exercise items include a first type of exercise item in a sitting posture and a second type of exercise item in a standing posture. The information processing apparatus 1 determines the degree of physical vitality corresponding to the second type of exercise item from an image capturing the exercise of a user performing the first type of exercise item, and at least one of determining the degree of physical vitality corresponding to the first type of exercise item from an image capturing the exercise of a user performing the second type of exercise item. Therefore, the information processing apparatus 1 can estimate the degree of physical vitality corresponding to the other exercise item from the measurement result of at least one of the exercise items in the sitting posture and the standing posture.

[0056] Also, the predetermined exercise items include a first type of exercise item that is a static exercise item and a second type of exercise item that is a dynamic exercise item. The information processing apparatus 1 can estimate one from the achievement value of the other between the static exercise item and the dynamic exercise item.

[0057] Also, in the above comprehensive evaluation (S27), the information processing apparatus 1 compares the achievement value for each current exercise item with the achievement value for each exercise item measured in the past. Also, the information processing apparatus 1 compares the degree of physical vitality of the current user with the degree of physical vitality of the user determined in the past. Therefore, the information processing apparatus 1 can specify the degree of decrease in the physical vitality of each user or the degree of maintenance and improvement of the physical vitality of each user. Therefore, the information processing apparatus 1 can detect the decline in physical and mental functions associated with aging, for example, based on the relationship between the measurement result of the exercise item and the decline in physical and mental functions associated with aging. Also, even when the decline in the user's physical function progresses, the user is frail, and it is difficult to perform an exercise item that requires physical strength, the information processing apparatus 1 can measure the physical vitality corresponding to a second exercise item that requires more physical strength and has a higher load by using a first exercise item with less load on the user.

[0058] In addition, as shown in FIG. 1, the information processing apparatus 1 further includes a communication apparatus 106. Then, the information processing apparatus 1 measures the achievement value of each exercise item from an image of the user's exercise taken remotely via the communication apparatus 106. Therefore, the user can obtain the achievement value of each exercise item in various places and environments without depending on the installation location of the information processing apparatus 1, and can receive a result report regarding the degree of physical vitality.

Explanation of Signs

[0059] 1 Information processing apparatus 2 Information acquisition apparatus 101 CPU 102 Memory 103 External storage device 104 Display device 105 Input device 106 Communication device 201 Terminal 202 Camera

Claims

1. Measuring achievement values ​​for each predetermined data item from an image of a person; a control unit that executes determining a degree of physical vitality of the person corresponding to a second item that is different from the first item and has a correspondence relationship with the first item based on an achievement value for each of the data items; The predetermined data items include dynamic movement items and static items including at least one of maintaining a constant body state and measuring an achieved value of a parameter indicating body flexibility; The control unit executes at least one of: (1) determining a degree of physical vitality corresponding to the static action item from an image captured of the movement of a person performing the dynamic action item; and (2) determining a degree of physical vitality corresponding to the dynamic action item from an image captured of the state of the person performing the static action item; Furthermore, the predetermined data items include a first type of item in a sitting position and a second type of item in a standing position, The control unit performs at least one of determining a degree of physical vitality corresponding to the second type of item from an image of a person performing the first type of item, and determining a degree of physical vitality corresponding to the first type of item from an image of a person performing the second type of item.

2. Measuring achievement values ​​for each predetermined data item from an image of a person; a control unit that executes determining a degree of physical vitality of the person corresponding to a second item that is different from the first item and has a correspondence relationship with the first item based on an achievement value for each of the data items; The predetermined data items include dynamic movement items and static items including at least one of maintaining a constant body state and measuring an achieved value of a parameter indicating body flexibility; The control unit (1) determines a degree of physical vitality corresponding to the static item from an image captured of a person performing the dynamic movement item, and (2) determines a degree of physical vitality corresponding to the static item from an image captured of a person performing the dynamic movement item. and determining a degree of physical vigor corresponding to the item of dynamic motion from an image taken of the state of the person performing the motion; Further, the dynamic movement items include at least one of: (1) a movement item in which a speed or acceleration is an achievement value; and (2) a movement item in which a user's position is changed by muscle force; The control unit performs at least one of the following: acquiring measurement data (X1) from an image capturing the movement of a person performing the dynamic movement item, and estimating a degree of physical vitality (Y1) corresponding to the static movement item using a regression line; and acquiring measurement data (X2) from an image capturing the state of the person performing the static movement item, and estimating a degree of physical vitality (Y2) corresponding to the dynamic movement item using a regression line.

3. Further comprising a storage device for storing the previously measured achieved values ​​for each of the predetermined data items or the previously determined degree of physical vitality of the person; 3. The information system of claim 1 or 2, wherein the control unit performs at least one of comparing the current achievement value for each of the specified data items with the achievement value for each of the specified data items measured in the past, and comparing the person's current level of physical vitality with the person's level of physical vitality determined in the past.

4. Further comprising a communication device, The information system according to claim 1 or 2, wherein the control unit measures an achievement value for each of the specified data items from an image of a person taken remotely via the communication device, and determines a degree of physical vitality of the person.

5. A computer measures an achievement value for each predetermined data item from an image of a person; and determining a degree of physical vitality of the person corresponding to a second item different from the first item and having a correspondence relationship with the first item based on the achievement value for each of the data items; The predetermined data items include dynamic movement items and static items including at least one of maintaining a constant body state and measuring an achieved value of a parameter indicating body flexibility; The computer executes at least one of: (1) determining a degree of physical vigor corresponding to the static action item from an image captured of the movement of a person performing the dynamic action item; and (2) determining a degree of physical vigor corresponding to the dynamic action item from an image captured of the state of a person performing the static action item; Further, the dynamic movement items include at least one of: (1) a movement item in which a speed or acceleration is an achievement value; and (2) a movement item in which a user's position is changed by muscle force; The information processing method includes a computer that performs at least one of the following: acquiring measurement data (X1) from an image capturing the movement of a person performing the dynamic movement item, and estimating a degree of physical vitality (Y1) corresponding to the static movement item using a regression line; and acquiring measurement data (X2) from an image capturing the state of the person performing the static movement item, and estimating a degree of physical vitality (Y2) corresponding to the dynamic movement item using a regression line.

6. A computer measures an achievement value for each predetermined data item from an image of a person; and determining a degree of physical vitality of the person corresponding to a second item different from the first item and having a correspondence relationship with the first item, based on the achievement value for each of the data items; The predetermined data items include items of dynamic motion, maintaining a constant state of the body, and and a static item including at least one of measuring an achieved value of a parameter indicative of flexibility; The computer is caused to execute at least one of: (1) determining a degree of physical vigor corresponding to the static action item from an image captured of the movement of a person performing the dynamic action item; and (2) determining a degree of physical vigor corresponding to the dynamic action item from an image captured of the state of a person performing the static action item, Further, the dynamic movement items include at least one of: (1) a movement item in which a speed or acceleration is an achievement value; and (2) a movement item in which a user's position is changed by muscle force; A program written to cause the computer to perform at least one of the following: obtaining measurement data (X1) from an image capturing the movement of a person performing the dynamic movement item, and estimating a degree of physical vitality (Y1) corresponding to the static movement item using a regression line; and obtaining measurement data (X2) from an image capturing the state of the person performing the static movement item, and estimating a degree of physical vitality (Y2) corresponding to the dynamic movement item using a regression line.

Images