Information processing system, information processing method, and program

Abstract

Provided is an information processing system that comprises: a first presentation control unit that controls presentation of first evaluation results obtained by evaluation on the basis of biological information for a first user to the first user; and a second presentation control unit that controls presentation of second evaluation results that are based on the biological information but are different from the first evaluation results to a second user that is different from the first user.

Description

Information processing system, information processing method, and program

[0001] The present disclosure relates to an information processing system, an information processing method, and a program.

[0002] Recently, a technology has been known that presents a user with an evaluation result based on information about the user's body performing a predetermined movement. As an example, the user (hereinafter also referred to as a "first user") may be a trainee performing a predetermined training. For example, the trainee may be a person performing training for physical movement or posture (e.g., rehabilitation). For example, Patent Document 1 discloses a technology that presents the trainee with a range of motion, which indicates the range of movement of the trainee's body parts, as an evaluation result of the training.

[0003] Patent No. 6627044

[0004] However, there may be a situation where the first user performs a predetermined movement with assistance from another user (hereinafter also referred to as a "second user"). As an example, the second user may be an advisor who provides advice on training. For example, the advisor may be a medical professional who provides advice on the trainee's physical movement or posture training.

[0005] In such a situation, it is desirable to provide a technique that allows a first user to improve the quality of their actions while receiving assistance from a second user.

[0006] In order to solve the above problem, according to one aspect of the present disclosure, an information processing system is provided, comprising: a first presentation control unit that controls the presentation of a first evaluation result evaluated based on the biometric information of a first user to the first user; and a second presentation control unit that controls the presentation of a second evaluation result based on the biometric information, the second evaluation result being different from the first evaluation result, to a second user different from the first user.

[0007] According to another aspect of the present disclosure, an information processing method is provided, including controlling the presentation to a first user of a first evaluation result evaluated based on biometric information of the first user, and controlling, by a processor, the presentation to a second user different from the first user of a second evaluation result based on the biometric information, the second evaluation result being different from the first evaluation result.

[0008] According to another aspect of the present disclosure, a program is provided that causes a computer to function as a first presentation control unit that controls the presentation of a first evaluation result evaluated based on biometric information of a first user to the first user, and a second presentation control unit that controls the presentation of a second evaluation result based on the biometric information and different from the first evaluation result to a second user different from the first user.

[0009] 1 is a diagram illustrating an example configuration of an information processing system according to an embodiment of the present disclosure. FIG. 1 is a diagram illustrating an example functional configuration of a trainee terminal 10 according to an embodiment of the present disclosure. FIG. 2 is a diagram illustrating an example functional configuration of an advisor terminal 20 according to an embodiment of the present disclosure. FIG. 3 is a diagram illustrating an example configuration of a statistics DB 161. FIG. 4 is a diagram illustrating an example configuration of a posture score calculation method DB 162. FIG. 5 is a diagram illustrating an example configuration of a muscle score calculation method DB 163. FIG. 6 is a diagram illustrating an example configuration of a personal DB 164. FIG. 7 is a diagram illustrating an example configuration of a second evaluation result DB 165. FIG. 8 is a diagram illustrating an example configuration of a second evaluation result DB 265 according to a modified example. FIG. 9 is a diagram illustrating an example configuration of a game DB 166. FIG. 10 is a diagram illustrating an example configuration of a first evaluation result DB 167. FIG. 11 is a diagram illustrating the inclination of a trainee's trunk when the trainee stands up. FIG. 12 is a diagram illustrating the inclination of the trainee's shoulders when the trainee stands up. FIG. 13 is a diagram illustrating the horizontal rotation angle of the trainee's shoulders when the trainee stands up. FIG. 14 is a diagram illustrating an example presentation of a character having a posture similar to that of a trainee. FIG. 15 is a table illustrating an example of the correspondence between joint rotation direction, muscle weight, and maximum range of motion. FIG. 9 is a diagram showing an example of the ratio of muscle weight of each body part to the muscle weight of the entire body. FIG. 10 is a diagram showing an example of a warm-up screen. FIG. 11 is a diagram showing an example of a trainee screen. FIG. 12 is a diagram showing an example of an advisor screen. FIG. 13 is a flowchart showing an example of operation of the information processing system 1 according to an embodiment of the present disclosure. FIG. 14 is a diagram showing a modified example of the trainee screen. FIG. 15 is a diagram showing a first modified example of the advisor screen. FIG. 16 is a diagram showing an example of an advisor selection screen. FIG. 17 is a diagram showing a second modified example of the advisor screen. FIG. 18 is a block diagram showing an example of the hardware configuration of an information processing device 900.

[0010] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0011] The description will be given in the following order: 0. Overview 1. Details of the embodiment 1.1. Example of the configuration of the information processing system 1.2. Example of the functional configuration of the trainee terminal 10 1.3. Example of the functional configuration of the advisor terminal 1.4. Details of processing by the information processing system 1.5. Effects 1.6. Example of the operation of the information processing system 1.7. Various modifications 2. Example of the hardware configuration 3. Summary

[0012] <0. Overview> First, an overview of an embodiment of the present disclosure will be described.

[0013] Generally, a technology is known that presents a first user with an evaluation result based on information about the first user's body performing a predetermined movement. As an example, the first user may be a trainee who performs a predetermined training. Therefore, in the following description, the first user will mainly be referred to as a "trainee." Furthermore, in the following description, it is mainly assumed that the trainee is a person who trains physical movements or postures (e.g., rehabilitation). However, as will be explained later, the trainee may not be limited to a person who trains physical movements or postures.

[0014] For example, there is known a technique for presenting a range of motion, which indicates the range of movement of a body part of a trainee, to the trainee as an evaluation result of the training.

[0015] However, there may be situations where the trainee performs a predetermined movement with assistance from a second user. As an example, the second user may be an advisor who provides advice on training. Therefore, in the following description, the second user will mainly be referred to as an "advisor." For example, the advisor may be a medical professional who provides advice on the trainee's training of body movements or posture. Examples of medical professionals may include a physical therapist, an occupational therapist, or a doctor.

[0016] This specification mainly proposes a technique for a trainee to improve the quality of his / her movements while receiving advice from an advisor.

[0017] The outline of the embodiments of the present disclosure has been described above.

[0018] 1. Details of the embodiment Next, the embodiment of the present disclosure will be described in detail.

[0019] (1.1. Configuration Example of Information Processing System) First, with reference to FIG. 1, a configuration example of an information processing system according to an embodiment of the present disclosure will be described.

[0020] 1 is a diagram illustrating an example configuration of an information processing system according to an embodiment of the present disclosure. As shown in FIG. 1, the information processing system 1 according to the embodiment of the present disclosure includes a trainee terminal 10, an advisor terminal 20, and a network 30.

[0021] The trainee terminal 10 and the advisor terminal 20 are each connected to a network 30. The trainee terminal 10 and the advisor terminal 20 are configured to be able to communicate with each other via the network 30.

[0022] (Trainer Terminal 10) The trainer terminal 10 is an information processing device realized by a computer and used by a trainee. For example, the trainer terminal 10 may be a PC (Personal Computer), a smartphone, a game console, or other device. In the example shown in FIG. 1 , one trainer terminal 10 is connected to the network 30, but multiple trainer terminals 10 may be connected to the network 30. In addition, some of the functions of the trainer terminal 10 may be provided by a server (not shown).

[0023] (Advisor terminal 20) The advisor terminal 20 is an information processing device realized by a computer and used by an advisor. For example, the advisor terminal 20 may be a PC, a smartphone, or other device. In the example shown in FIG. 1, one advisor terminal 20 is connected to the network 30, but multiple advisor terminals 20 may be connected to the network 30.

[0024] (Network 30) The network 30 relays communications between the trainee terminal 10 and the advisor terminal 20. The type of network 30 need not be limited. As a specific example, the network 30 may be configured as a so-called wireless network, such as a network based on the Wi-Fi (registered trademark) standard. As another example, the network 30 may be configured as the Internet, a dedicated line, a LAN (Local Area Network), or a WAN (Wide Area Network). The network 30 may include multiple networks, and at least a portion of the network may be configured as a wired network.

[0025] The configuration example of the information processing system 1 according to the embodiment of the present disclosure has been described above.

[0026] (1.2. Example of Functional Configuration of Trainee Terminal 10) Next, with reference to FIG. 2, an example of the functional configuration of the trainee terminal 10 according to an embodiment of the present disclosure will be described.

[0027] 2 is a diagram illustrating an example of the functional configuration of the trainee terminal 10 according to an embodiment of the present disclosure. As shown in FIG. 2, the trainee terminal 10 includes a sensor unit 110, an operation unit 120, a control unit 140, a communication unit 150, a storage unit 160, and a presentation unit 170.

[0028] (Sensor Unit 110) The sensor unit 110 has a sensor that detects information about the trainee's body (hereinafter also referred to as "biometric information"). Here, the type of sensor does not need to be limited. For example, the sensor unit 110 may have an image sensor. In this case, the image sensor may obtain image data of the trainee's body as a subject as the biometric information.

[0029] The image sensor may be an RGB (Red, Green, Blue) camera or a depth sensor. Examples of depth sensors include a ToF (Time of Flight) sensor and a LiDAR (Light Detection and Ranging) sensor. Alternatively, as will be described later, the sensor unit 110 may include a sensor other than an image sensor.

[0030] The detection of biological information by the sensor unit 110 can be performed when the sensor unit 110 is set to one of a plurality of modes. In the following description, it is mainly assumed that the plurality of modes include a mode in which the trainee's entire body is the subject (hereinafter also referred to as "full body mode") and a mode in which the trainee's upper body is the subject (hereinafter also referred to as "upper body mode"). However, the plurality of modes may also include a mode in which the trainee's entire body in a standing position is the subject (full body standing mode) and a mode in which the trainee's upper limbs in a seated position are the subject (upper limb sitting mode).

[0031] (Operation Unit 120) The operation unit 120 detects various operations input by the trainee. The specific form of the operation unit 120 is not limited. For example, the operation unit 120 may have a mouse and a keyboard and detect operations using the mouse and keyboard. Alternatively, the operation unit 120 may have buttons and detect operations using the buttons. Alternatively, the operation unit 120 may have a touch panel and detect operations using the touch panel.

[0032] (Control Unit 140) The control unit 140 is configured by one or more processors. The processor may be a CPU (Central Processing Unit) or the like. When the control unit 140 is configured by a processor, the processor may be configured by an electronic circuit. The control unit 140 can be realized by the processor executing a program.

[0033] As shown in FIG. 2 , the control unit 140 includes an acquisition unit 141 , a processing unit 142 , a first presentation control unit 143 , and a second presentation control unit 144 .

[0034] The acquisition unit 141 acquires the trainee's biological information detected by the sensor unit 110 from the sensor unit 110 .

[0035] The processing unit 142 obtains a recognition result by performing recognition based on the biometric information of the trainee acquired by the acquisition unit 141. In the following description, it is mainly assumed that the recognition by the processing unit 142 is recognition of skeletal information of the trainee's body. However, the recognition by the processing unit 142 does not have to be limited to recognition of skeletal information.

[0036] The skeletal information may include the position of each of a plurality of joints that make up the trainee's body. For example, the position of each joint may be expressed using two-dimensional or three-dimensional coordinates. The position of each joint may also include the positions of the trainee's neck, right shoulder, left shoulder, right elbow, left elbow, right hand, left hand, right hip, left hip, right knee, left knee, right ankle, and left ankle. The skeletal information may also include the position of the trainee's head.

[0037] The processing unit 142 performs a first evaluation on the positions of some or all of the recognized joints. As a result, the processing unit 142 obtains a first evaluation result. The first presentation control unit 143 controls the presentation of the first evaluation result to the trainee. More specifically, the first presentation control unit 143 controls the presentation unit 170 so that the first evaluation result is presented to the trainee by the presentation unit 170, thereby controlling the presentation of the first evaluation result to the trainee.

[0038] Meanwhile, the processing unit 142 performs a second evaluation, which is different from the first evaluation, on the positions of some or all of the recognized joints. As a result, the processing unit 142 obtains a second evaluation result that is different from the first evaluation result. The second presentation control unit 144 controls the presentation of the second evaluation result to the advisor. More specifically, the second presentation control unit 144 controls the presentation of the second evaluation result to the advisor by controlling the communication unit 150 so that the second evaluation result is transmitted to the advisor terminal 20 by the communication unit 150.

[0039] In this manner, in an embodiment of the present disclosure, the evaluation results presented to the trainee and the advisor are different. This makes it possible to present the trainee with evaluation results that maintain the trainee's motivation, and to present the advisor with evaluation results that include information necessary to improve the quality of the trainee's movements. With this configuration, the trainee can improve the quality of their movements while receiving support from the advisor.

[0040] In particular, the following description mainly assumes that the positions of each of the multiple joints that make up the trainee's body are the positions of each joint corresponding to the game, obtained from the trainee while he or she is playing a game. In this way, by obtaining the positions of each of the trainee's joints from the trainee while he or she is playing a game, evaluation results for the trainee's movements can be obtained while the trainee is enjoying playing the game, making it easier for the trainee to continue training.

[0041] In the following description, it is mainly assumed that the processing unit 142 uses an evaluation result obtained by an evaluation based on information about the trainee's body (i.e., the position of each joint and changes in the position of each joint over time) as the first evaluation result to be presented to the trainee. The position of each joint may correspond to body posture information. Furthermore, changes in the position of each joint over time may correspond to body movement information. The first evaluation result presented to the trainee is an evaluation result associated with a mode (e.g., full body mode or upper body mode) and is evaluated using an evaluation method set for each mode. In the following description, the evaluation result obtained by an evaluation based on the evaluation method set for each mode is also mainly referred to as a "muscle score."

[0042] In the following description, it is mainly assumed that the processing unit 142 uses the evaluation result obtained by evaluation based on the trainee's physical information (i.e., the position of each joint and changes in the position of each joint over time) as the second evaluation result to be presented to the advisor. The second evaluation result presented to the advisor is an evaluation result associated with a movement, and is evaluated using an evaluation method set for each movement. The evaluation methods for the muscle score and the posture score are different. In the following description, the evaluation result obtained by evaluation based on the evaluation method set for each movement is also mainly referred to as the "posture score."

[0043] (Communication Unit 150) The communication unit 150 includes a communication interface, and communicates with the advisor terminal 20 via the network 30.

[0044] (Storage Unit 160) The storage unit 160 is a recording medium including a memory, and stores programs executed by the control unit 140 and data necessary for executing these programs. Examples of data necessary for executing these programs may include, as shown in FIG. 2 , a statistics DB 161, a posture score calculation method DB (database) 162, a muscle score calculation method DB 163, a personal DB 164, a second evaluation result DB 165, a game DB 166, and a first evaluation result DB 167. These databases will be described in detail later.

[0045] The storage unit 160 also temporarily stores data for calculations by the control unit 140. The storage unit 160 is configured by a magnetic storage device, a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.

[0046] (Presenter 170) The presenter 170 presents information to the trainee under the control of the controller 140. Here, the specific form of the presenter 170 is not limited. For example, the presenter 170 may have a display and present visual information to the trainee through the display. Alternatively, the presenter 170 may have a speaker and present auditory information to the trainee through the speaker.

[0047] An example of the functional configuration of the trainee terminal 10 according to an embodiment of the present disclosure has been described above.

[0048] (1.3. Example of Functional Configuration of Advisor Terminal) Next, with reference to FIG. 3, an example of the functional configuration of the advisor terminal 20 according to the embodiment of the present disclosure will be described.

[0049] 3 is a diagram illustrating an example of a functional configuration of the advisor terminal 20 according to an embodiment of the present disclosure. As illustrated in FIG. 3, the advisor terminal 20 includes an operation unit 220, a control unit 240, a communication unit 250, a storage unit 260, and a presentation unit 270.

[0050] (Operation Unit 220) The operation unit 220 detects various operations input by the advisor. The specific form of the operation unit 220 is not limited. For example, the operation unit 220 may have a mouse and a keyboard and detect operations using the mouse and keyboard. Alternatively, the operation unit 220 may have buttons and detect operations using the buttons. Alternatively, the operation unit 220 may have a touch panel and detect operations using the touch panel.

[0051] (Control Unit 240) The control unit 240 is configured by one or more processors. The processor may be a CPU (Central Processing Unit) or the like. When the control unit 240 is configured by a processor, the processor may be configured by an electronic circuit. The control unit 240 can be realized by the processor executing a program.

[0052] For example, when the second evaluation result transmitted from the trainee terminal 10 is received by the communication unit 250, the control unit 240 controls the presentation unit 270 so that the second evaluation result is presented to the advisor by the presentation unit 270.

[0053] (Communication Unit 250) The communication unit 250 includes a communication interface, and communicates with the trainee terminal 10 via the network 30.

[0054] (Storage unit 260) The storage unit 260 is a recording medium including a memory, which stores programs executed by the control unit 240 and stores data necessary for executing these programs. The storage unit 260 also temporarily stores data for calculations by the control unit 240. The storage unit 260 is configured by a magnetic storage device, a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.

[0055] (Presenting unit 270) The presenting unit 270 presents information to the advisor under the control of the control unit 240. Here, the specific form of the presenting unit 270 is not limited. For example, the presenting unit 270 may have a display and present visual information to the advisor via the display. Alternatively, the presenting unit 270 may have a speaker and present auditory information to the advisor via the speaker.

[0056] An example of the functional configuration of the advisor terminal 20 according to the embodiment of the present disclosure has been described above.

[0057] (1.4. Details of Processing by Information Processing System) Next, details of processing by the information processing system 1 according to an embodiment of the present disclosure will be described. First, configuration examples of various DBs used by the information processing system 1 according to an embodiment of the present disclosure will be described with reference to FIGS. 4 to 11. Note that specific processing using data stored in the various DBs shown in FIGS. 4 to 11 will be described later.

[0058] (Statistical DB 161) Fig. 4 is a diagram showing an example of the configuration of the statistical DB 161. As shown in Fig. 4, statistical data in which age, average weight, and average height are associated with each other may be registered in advance in the statistical DB 161. Furthermore, as shown in Fig. 4, the statistical data may be divided into statistical data for men and statistical data for women.

[0059] (Posture Score Calculation Method DB 162) Fig. 5 is a diagram showing an example of the configuration of the posture score calculation method DB 162. As shown in Fig. 5, posture score calculation method data in which body parts are associated with posture score calculation methods may be registered in advance in the posture score calculation method DB 162. For example, the body parts may include the trainee's face, neck, right shoulder, left shoulder, right elbow, left elbow, right hand, left hand, right hip, left hip, right knee, left knee, right foot, left foot, etc. Furthermore, it is desirable that such posture score calculation method data be separated for each movement, as shown in Fig. 5.

[0060] (Muscle Score Calculation Method DB163) Fig. 6 is a diagram showing an example of the configuration of muscle score calculation method DB163. As shown in Fig. 6, muscle score calculation method data in which muscle score calculation methods, parameter calculation methods, and muscle score calculation parameters are associated with each other may be registered in advance in muscle score calculation method DB163. Furthermore, as shown in Fig. 6, such muscle score calculation method data may be divided for each mode of sensor unit 110.

[0061] (Personal DB 164) Fig. 7 is a diagram showing an example of the configuration of the personal DB 164. As shown in Fig. 7, personal data of the trainee, in which a user ID, facial feature data, gender, and age are associated with each other, may be registered in the personal DB 164 at the time of user registration of the trainee.

[0062] For example, the user ID is an ID assigned to the trainee and may be automatically assigned when the trainee is registered as a user. The facial feature data is facial feature data of the trainee and may be extracted from image data detected by the sensor unit 110 when the trainee is registered as a user. The gender is the gender of the trainee and may be input by the trainee when the trainee is registered as a user. The age is the age of the trainee and may be input by the trainee when the trainee is registered as a user.

[0063] (Second evaluation result DB 165) Fig. 8 is a diagram showing an example of the configuration of the second evaluation result DB 165. As shown in Fig. 8, data in which a game ID, a timestamp, a user ID, a posture score for each movement, and a parameter for calculating a muscle score are associated with each other may be registered in the second evaluation result DB 165 every time a trainee finishes playing a game.

[0064] For example, the game ID is an ID for identifying the type of game. The timestamp is time information when the game ends. The user ID is the ID of the trainee who played the game. The posture score for each movement is a posture score based on posture information of the trainee's body while playing the game. The muscle score calculation parameters are information on the trainee's body movements while playing the game.

[0065] 9 is a diagram showing an example of the configuration of the second evaluation result DB 265 according to the modified example. As shown in Fig. 9, data in which a user ID, a game ID, a timestamp, a posture score for each movement, and a parameter for calculating a muscle score are associated with each other may be registered in the second evaluation result DB 265 according to the modified example every time a trainee finishes playing a game.

[0066] In the second evaluation result DB 165 shown in Fig. 8, data is stored for each game, but in the second evaluation result DB 265 according to the modified example shown in Fig. 9, data is stored for each user and for each game. That is, data may be registered in the second evaluation result DB 265 on a user-by-user basis and for each game.

[0067] (Game DB 166) FIG. 10 is a diagram showing an example of the configuration of the game DB 166. As shown in FIG. 10, game data may be registered in advance in the game DB 166, in which a game ID, a posture score action, a muscle score mode, a game score calculation method, and time are associated with each other. The posture score action is an action corresponding to the posture score calculated when the game is executed. The muscle score mode is a mode corresponding to the muscle score calculated when the game is executed. The time is the time required from the start to the end of the game. Note that games are divided into main games and sub-games, and the main game is a game for personal management and serves as a parent game for organizing the sub-games. Game data related to the sub-games is registered in the game DB 166.

[0068] (First evaluation result DB 167) Fig. 11 is a diagram showing an example of the configuration of the first evaluation result DB 167. As shown in Fig. 11 , data in which a game ID, a user ID, a timestamp, a game score, and exercise points are associated with each other may be registered in the first evaluation result DB 167 each time a trainee finishes playing a game.

[0069] Above, configuration examples of various DBs used by the information processing system 1 according to an embodiment of the present disclosure have been described.

[0070] (Posture Score) Next, an example of a method for calculating the posture score will be described. As described above, the posture score is an evaluation result obtained by an evaluation based on posture information of the trainee's body, and a posture score calculation method is determined for each movement as shown in the posture score calculation method DB 162 ( FIG. 5 ). The posture score may be an evaluation result based on the difference between the trainee's body posture and a preset posture. The greater the difference between the trainee's body posture and the preset posture, the larger or smaller the posture score may be.

[0071] The posture of the trainee's body may include the angle or change in angle of a line passing through multiple joints of the trainee relative to a specified plane or line, or may include the distance traveled by the trainee's joints, changes in the distance between multiple joints, movement time, etc.

[0072] To explain this more specifically using the example of standing up, the trainee's body posture may include at least one of the angle based on the vertical direction of a line passing through the trainee's right hip and right shoulder (or a line passing through the trainee's left shoulder and left hip) (hereinafter also referred to as the "tilt of the trunk"), the angle based on the horizontal plane of a line passing through the trainee's right shoulder and left shoulder (hereinafter also referred to as the "tilt of both shoulders"), and the angle of horizontal rotation of a line passing through the trainee's right shoulder and left shoulder (hereinafter also referred to as the "angle of horizontal rotation of both shoulders").

[0073] For example, the trainee's body posture may include one or two of the following: the inclination of the trainee's trunk, the inclination of both shoulders, and the horizontal rotation angle of both shoulders. Alternatively, the trainee's body posture may include three of the following: the inclination of the trainee's trunk, the inclination of both shoulders, and the horizontal rotation angle of both shoulders. In other words, the trainee's posture score may be calculated based on these three, as shown in the "Posture Score Calculation Method" corresponding to "Movement: Standing Up" in the posture score calculation method DB 162 ( FIG. 5 ).

[0074] 12 to 15, an example of a method for calculating a posture score based on the inclination of the trainee's trunk, the inclination of both shoulders, and the horizontal rotation angle of both shoulders will be described. FIG. 12 is a diagram showing the inclination of the trainee's trunk when the trainee stands up. FIG. 13 is a diagram showing the inclination of the trainee's shoulders when the trainee stands up. FIG. 14 is a diagram showing the horizontal rotation angle of the trainee's shoulders when the trainee stands up. FIG. 15 is a diagram showing an example of a character presented with a posture similar to that of the trainee.

[0075] Referring to FIG. 12, the angle of the line L2 passing through the left shoulder joint P2 and the left hip joint P4 of the trainee U1 (or the line passing through the right hip and right shoulder) relative to the vertical direction L1 is shown as the inclination θ1 of the trunk of the trainee U1.

[0076] Referring to FIG. 13, the angle of a line L3 passing through the right shoulder joint P1 and the left shoulder joint P2 of the trainee U1 relative to the horizontal plane is shown as the inclination θ2 of both shoulders.

[0077] 14, the rotation angle of a line L5 passing through the right shoulder joint P1 and the left shoulder joint P2 of the trainee U1 with respect to a line L6 is shown as the horizontal rotation angle θ3 of both shoulders. Note that the line L6 may be a line passing through the right hip joint P3 and the left hip joint P4 of the trainee U1. Alternatively, since there may be cases where the right hip joint P3 and the left hip joint P4 are not recognized, the line L6 may be a line that is set in advance.

[0078] The posture score of trainee U1 may be calculated based on the inclination θ1 of the trunk (FIG. 12), the inclination θ2 of both shoulders (FIG. 13), and the horizontal rotation angle θ3 of both shoulders (FIG. 14).

[0079] 15, the first presentation control unit 143 may generate a character C1 having a posture (specifically, joint positions p1 to p4 and head position p5) that is similar to the posture of the trainee U1 (specifically, joint positions P1 to P4 and head position P5). Then, the first presentation control unit 143 may control the presentation unit 170 so that the generated character C1 is presented to the trainee U1.

[0080] The method of calculating the posture score does not have to be limited to the examples described with reference to Figures 12 to 15. For example, the posture score may be calculated based on the time required for a predetermined part of the trainee to move from a predetermined start position to a predetermined end position. For example, the shorter the time required for a predetermined part of the trainee to move from a predetermined start position to a predetermined end position, the larger or smaller the posture score may be.

[0081] Alternatively, the posture score may be calculated based on the accuracy of the trainee's movement of a predetermined part of the body from a predetermined start position to a predetermined end position. For example, the greater the accuracy of the trainee's movement of a predetermined part of the body from a predetermined start position to a predetermined end position, the greater or smaller the posture score may be. Note that the accuracy of the movement of the predetermined part can also be expressed as the amount of shaking during the movement of the predetermined part.

[0082] The predetermined part may be the trainee's hand (right hand or left hand). For example, the trainee's posture score may be calculated based on both the "time required to move the hand" from a predetermined start position to a predetermined end position and the "accuracy of the hand movement," as shown in the "posture score calculation method" corresponding to "movement: movement of moving the hand" in the posture score calculation method DB 162 ( FIG. 5 ).

[0083] (Muscle Score) Next, an example of a method for calculating a muscle score will be described with reference to FIGS. 16 and 17 . The muscle score is a score that evaluates the exercise load on the body. It is desirable that the muscle score be obtained by evaluating the exercise load on each body part. The body parts can be divided into the face, neck, shoulders, right arm, left arm, right hand, left hand, trunk, right foot, left foot, etc. As described above, the muscle score is an evaluation result obtained by an evaluation based on muscle score calculation parameters. The muscle score calculation parameters are information about the trainee's body movement, and may include at least one of the range of motion (hereinafter also referred to as "joint range of motion") indicating the range of movement of the joints that make up the trainee's body, the weight of the muscles involved in the joint movement, and the speed of the joint movement.

[0084] For example, the muscle score calculation parameters may include one or two of the range of motion of the joint, the weight of the muscles involved in the joint movement, and the speed of the joint movement, or may include three of the range of motion of the joint, the weight of the muscles involved in the joint movement, and the speed of the joint movement.

[0085] FIG. 16 is a table showing an example of the correspondence relationship between joint rotation direction, muscle weight, and maximum range of motion. As shown in FIG. 16, "joint rotation direction" is the rotation direction of the shoulder joint. "muscle weight" is the weight of the muscle involved in the movement of the shoulder joint. "maximum range of motion" is the maximum range of motion of the shoulder joint, and is indicated by the rotation angle of the arm. For example, the processing unit 142 can obtain the maximum range of motion from such a table ( FIG. 16 ).

[0086] For example, the range of motion of a shoulder (right or left) joint in the external rotation or internal rotation direction may be measured by the processing unit 142 as the rotatable angle range of a line passing through the position of the elbow joint and the position of the hand joint, with reference to the line passing through the position of the shoulder joint and the position of the elbow joint.

[0087] The weight of the muscles involved in joint movement may be calculated by the processing unit 142 based on the gender and age of the trainee. More specifically, the processing unit 142 may obtain from the statistics DB 161 (FIG. 4) the average weight and average height corresponding to the combination of gender and age of the trainee registered in the personal DB 164 (FIG. 7). The processing unit 142 may then calculate the weight of the muscles of the entire body of the trainee based on the obtained average weight and average height and the gender and age of the trainee.

[0088] For example, the processing unit 142 may calculate the body fat percentage by adding the value obtained by multiplying the average weight by the square of the average height by a first coefficient to the value obtained by multiplying the age by a second coefficient, and subtracting a constant corresponding to gender from the sum.The processing unit 142 may then calculate the body fat mass by multiplying the average weight by the body fat percentage, calculate the lean body mass by subtracting the body fat mass from the average weight, and calculate the muscle weight of the trainee's entire body by multiplying the lean body mass by a predetermined multiplier.

[0089] 17 is a diagram showing an example of the ratio of muscle weight of each part to the total muscle weight of the whole body. Referring to FIG. 17, the ratio of muscle weight of the upper arm to the total muscle weight of the whole body is 4%. Also, the ratio of muscle weight of the upper limb (upper arm + forearm + hand) to the total muscle weight of the whole body is 8%.

[0090] Since the muscles used to rotate the shoulder joint are the muscles of the upper arm, as an example, the processing unit 142 may calculate the weight of the muscles involved in the movement of the shoulder joint by multiplying the weight of the trainee's muscles in the entire body by the ratio of the weight of the muscles of the upper arm to the weight of the muscles in the entire body (= 4%).

[0091] Alternatively, since the muscles that move in conjunction with the rotation of the shoulder joint are the muscles of the upper limbs, as another example, the processing unit 142 may calculate the weight of the muscles involved in the movement of the shoulder joint by multiplying the weight of the trainee's muscles in the entire body by the ratio of the weight of the muscles of the upper limbs to the weight of the muscles in the entire body (= 8%).

[0092] Alternatively, the processing unit 142 may estimate the weight of the muscles involved in the movement of the shoulder joint based on the biometric information detected by the sensor unit 110, or may obtain the weight from a table prepared in advance (Figure 16).

[0093] The speed of the joint movement may be the rotational speed of the joint.

[0094] The processing unit 142 preferably calculates muscle score calculation parameters defined for each muscle region based on the mode and calculates the muscle score based on the sum of the muscle score calculation parameters for each muscle region. As shown in the “Parameter Calculation Method” in the muscle score calculation method DB 163 ( FIG. 6 ), the processing unit 142 calculates the weight of the muscles that primarily move in each joint rotation direction (e.g., flexion, extension, abduction, adduction, external rotation, internal rotation, etc.) and the weight of each part of the body as parameters. As described above, the muscle weight may be weight based on average body weight, average height, gender, and age. The processing unit 142 then calculates the muscle score calculation parameters in the whole-body mode based on the range of motion of each actual joint in each joint rotation direction (i.e., the angle of joint movement), the speed of joint movement, the weight of the primarily moving muscle, and the weight of the part that moves in conjunction with the muscle movement. For example, as shown in the "muscle score calculation parameters" in "whole body mode" in the muscle score calculation method DB 163 ( FIG. 6 ), the processing unit 142 calculates the following "muscle score calculation parameters": a "sum of weights of muscles and parts that moved," which is a value corresponding to the sum of the weight of the muscle that moved primarily and the weight of parts that moved in conjunction with the movement of that muscle; a "sum of joint mobility," which is a value corresponding to the sum of the ratio of the range of motion of the joint to a predetermined maximum range of motion (hereinafter also referred to as "mobility rate"); a "sum of fast movement flags," which is a sum of values ​​corresponding to the number of joints that moved quickly; a "sum of slow movement flags," which is a sum of values ​​corresponding to the number of joints that moved slowly; and a "sum of large movement flags," which is a sum of values ​​corresponding to the number of joints that moved rapidly. Then, the processing unit 142 calculates the muscle score in "whole body mode" using the sum of the muscle score calculation parameters.

[0095] As shown in the "muscle score calculation parameters" in "upper body mode" in muscle score calculation method DB 163 ( FIG. 6 ), processing unit 142 calculates muscle score calculation parameters based on the range of motion (i.e., the angle of joint movement) for each joint rotation direction of each real joint and each virtual joint, the speed of joint movement, the weight of the muscle that moves primarily, and the weight of the body part that moves in conjunction with the muscle movement. For example, the range of motion for each joint rotation direction of a virtual joint, the speed of joint movement, the weight of the muscle that moves primarily, and the weight of the body part that moves in conjunction with the muscle movement can be set based on the angle of the real joint. Processing unit 142 calculates the muscle score in "upper body mode" using the sum of the muscle score calculation parameters, similar to the muscle score in "whole body mode."

[0096] The muscle score may be an evaluation result based on at least one of the ratio of the range of motion of the joint to a predetermined maximum range of motion (mobility rate), the weight of the muscles involved in the movement of the joint, and the speed of the movement of the joint.

[0097] For example, the muscle score may be an evaluation result based on one or two of the mobility of the joint, the weight of the muscles involved in the joint movement, and the speed of the joint movement, or the muscle score may be an evaluation result based on three of the mobility of the joint, the weight of the muscles involved in the joint movement, and the speed of the joint movement.

[0098] For example, the greater the mobility, the greater or smaller the muscle score may be. Also, the greater the weight of the muscle involved in the joint movement, the greater or smaller the muscle score may be. Also, the greater the speed of the joint movement, the greater or smaller the muscle score may be.

[0099] In the "whole body mode," the processing unit 142 may calculate, as the muscle score, the sum of the muscle score calculation parameters corresponding to the joints in the whole body that have moved. In the "upper body mode," the processing unit 142 may calculate, as the muscle score, the sum of the muscle score calculation parameters corresponding to the joints in the upper body that have moved, plus a predetermined correction value.

[0100] (Warm-up) In an embodiment of the present disclosure, a trainee may directly select and play a game, but before playing the game, the trainee may practice basic movements required for playing the game as a warm-up. The warm-up will be described with reference to FIG. 18 .

[0101] FIG. 18 is a diagram illustrating an example of a warm-up screen. Referring to FIG. 18 , an example of a screen displayed during warm-up is shown as a warm-up screen G11. The first presentation control unit 143 controls the presentation unit 170 so that the warm-up screen G11 is presented to the trainee while the trainee is warming up. The number of warm-ups may be one or more. Furthermore, the warm-up may be set in advance, or the trainee may select a warm-up that the trainee wants to practice, or a movement that the trainee is having trouble with may be selected as the warm-up. Alternatively, the trainee may select a warm-up based on instructions from an advisor. Here, it is assumed that the trainee will perform standing and sitting movements as warm-ups. Therefore, it is desirable that the warm-up screen G11 include a warning message M11 for performing sitting movements and the character C1 generated as described above.

[0102] In the trainee terminal 10, the sensor unit 110 detects biometric information of the trainee during warm-up, and the acquisition unit 141 acquires the biometric information of the trainee during warm-up. The processing unit 142 recognizes skeletal information of the trainee during warm-up based on the biometric information of the trainee during warm-up. Skeletal information of the trainee during game play corresponds to an example of a first recognition result, while skeletal information of the trainee during warm-up corresponds to an example of a second recognition result.

[0103] Furthermore, the processing unit 142 obtains a posture score based on the skeletal information of the trainee during the warm-up. The first presentation control unit 143 may control the presentation unit 170 so that the posture score of the trainee during the warm-up obtained in this manner is presented to the trainee. The posture score of the trainee during the warm-up may also be used for subsequent processing.

[0104] For example, the trainee's posture score during warm-up may be used to recommend a type of game, a combination of games, or a game duration for the trainee. For example, the first presentation control unit 143 may control the presentation unit 170 so that, when the trainee's posture score during warm-up is smaller than a threshold, information recommending a game with a low level of difficulty or a short game duration is presented. Alternatively, the first presentation control unit 143 may control the presentation unit 170 so that, when the trainee's posture score during warm-up is equal to or greater than a threshold, information recommending a game with a high level of difficulty is presented. The first presentation control unit 143 may control the presentation unit 170 so that, when some movements are smaller than a threshold, information recommending a combination of games related to the some movements is presented.

[0105] For example, the trainee's posture score during warm-up may be presented to the advisor. For example, the second presentation control unit 144 may control the communication unit 150 so that the trainee's posture score during warm-up (third evaluation result) is transmitted to the advisor terminal 20 at the end of the game, along with the trainee's posture score during game play. At this time, the advisor terminal 20 may present the trainee's posture score during warm-up to the advisor, along with the trainee's posture score during game play.

[0106] The trainee may perform a warm-up each time the game is started, or may perform a warm-up at regular intervals. Alternatively, if the posture score for a specific movement during the game exceeds a certain value, the trainee may perform a warm-up and double-check the posture score for the warm-up and the posture score for the game. Alternatively, the results of the warm-up may be used for calibration. The file size of the trainee's biometric information during the warm-up, or the skeletal information during the warm-up recognized from the biometric information, is smaller than the file size of the biometric information and skeletal information during the game, so some or all of it may be saved.

[0107] (Playing a Game) In an embodiment of the present disclosure, after the warm-up is completed, the trainee can play a game of the trainee's choice.

[0108] For example, while playing a game, the presentation unit 170 places a display object in the virtual space, and also places an operation object at a position in the virtual space that corresponds to the trainee's biological position in the real space (for example, the position of the hand, etc.) As an example, the trainee operates the operation object by moving his / her biological position while standing or sitting, and when the operation object comes into contact with the display object, a value corresponding to the display object is added to the game score.

[0109] As an example, assume that a trainee is playing a game (hereinafter also referred to as "game A") with a game ID of "A" in game DB 166 (FIG. 10). That is, in this game, the display objects are assumed to be "apples" and "enemies," as indicated by the "game score calculation method" corresponding to "game A" indicating "how many apples were picked" and "how many enemies were defeated." Game A takes "five minutes" to play. Game DB 166 (FIG. 10) contains one of each of four types of games. However, the types, number, and duration of games played by the trainee do not necessarily have to be limited.

[0110] In the trainee terminal 10, the sensor unit 110 detects biometric information of the trainee while playing the game, and the acquisition unit 141 acquires the biometric information of the trainee while playing the game. The processing unit 142 recognizes skeletal information of the trainee while playing the game, based on the biometric information of the trainee while playing the game.

[0111] Furthermore, the processing unit 142 calculates a posture score for each movement based on the skeletal information of the trainee while playing the game. For example, when the trainee is playing game A, the processing unit 142 acquires from the game DB 166 ( FIG. 10 ) the "movements for posture score" corresponding to "game A" the "movement of standing up" and the "movement of moving hands," and calculates posture scores corresponding to the "movement of standing up" and the "movement of moving hands" of the trainee while playing game A.

[0112] Furthermore, for example, when a trainee plays a game with a game ID of "B" (hereinafter also referred to as "game B"), the processing unit 142 obtains "hand movement action" from the game DB 166 (Figure 10) as the "posture score action" corresponding to "game B," and calculates the posture score corresponding to the trainee's "hand movement action" while playing game B.

[0113] Furthermore, the processing unit 142 calculates a muscle score for each mode (i.e., for each muscle part) based on the skeletal information of the trainee while playing the game. For example, when the trainee is playing game A, the processing unit 142 obtains "whole body mode" from the game DB 166 ( FIG. 10 ) as the "muscle score mode" corresponding to "game A," and calculates a muscle score corresponding to the "whole body mode" of the trainee while playing game A.

[0114] Also, for example, when game B is played by a trainee, the processing unit 142 obtains the "upper body mode" from the game DB 166 (Figure 10) as the "muscle score mode" corresponding to "game B," and calculates the muscle score corresponding to the "upper body mode" of the trainee while playing game B.

[0115] For example, "Game A" is associated with "posture score action" and "muscle score mode" (FIG. 10). The posture score action is associated with "posture score calculation method" as an example of the first evaluation method (FIG. 5), and the muscle score mode is associated with "muscle score calculation method" as an example of the second evaluation method (FIG. 6).

[0116] Therefore, by simply selecting and playing a game according to one's preferences, a trainee can accumulate muscle scores for each mode across games while playing the game. Accumulating muscle scores for each mode across games while playing the game also enables evaluation of changes in muscle scores over time for each mode across games. This reduces the possibility that a trainee will become bored with a game by repeatedly playing the same game.

[0117] Furthermore, by simply selecting and playing a game according to one's preferences, the posture score while playing the game can be accumulated for each movement across games. Also, by accumulating the posture score while playing the game for each movement across games, it becomes possible to evaluate the time-series changes in posture score for each movement across games. This can reduce the possibility that the trainee will become bored with the game by repeatedly playing the same game.

[0118] Furthermore, the processing unit 142 calculates a game score based on the skeletal information of the trainee while he or she is playing the game. The first presentation control unit 143 controls the presentation unit 170 so that the trainee screen is presented to the trainee when the trainee has finished playing the game.

[0119] FIG. 19 is a diagram showing an example of a trainee screen. Referring to FIG. 19, a trainee screen G12 is shown. As shown in FIG. 19, the trainee screen G12 may include the game name "Apple Collecting Game," the trainee's name "Mr. A," the current game score "1100," the best score up to the previous game "0," the future goal "Collect 20 apples," and the exercise points earned today "25." Note that the exercise points may correspond to the muscle score, but may also be calculated from the muscle score, or may be calculated from the muscle score and the posture score.

[0120] In this way, the first presentation control unit 143 may control the presentation unit 170 so that the exercise points for each game are presented to the trainee. The exercise points presented to the trainee may be the aggregated result of the exercise points for the same day as the day on which the game is currently being played (i.e., the current day). Alternatively, the exercise points presented to the trainee may be the aggregated result of the exercise points for all games played on the same day as the day on which the game is currently being played (i.e., the current day). Alternatively, the first presentation control unit 143 may control the presentation unit 170 so that the trainee is presented with the exercise points corresponding to one play of a game by the trainee.

[0121] The second presentation control unit 144 controls the presentation of the advisor screen to the advisor by controlling the communication unit 150 so that the advisor screen is sent to the advisor terminal 20 when the trainee has finished playing the game.

[0122] Fig. 20 is a diagram showing an example of an advisor screen. Referring to Fig. 20, an advisor screen G13 is shown. As shown in Fig. 20, the advisor screen G13 may include an "average score for all trainees" which is the average of the posture scores of all trainees, and an "average score for person A" which is the average of person A's posture scores.

[0123] The posture score included in the advisor screen G13 may be a posture score for each action. In the example shown in Fig. 20, the advisor screen G13 includes a posture score when the action "sitting" is performed and a posture score when the action "standing" is performed.

[0124] The posture scores included in the advisor screen G13 may also be posture scores for each fixed period of time at which the trainee's skeletal information was obtained. In the example shown in Fig. 20, the advisor screen G13 includes posture scores based on the trainee's skeletal information obtained for each month from "January" to "June." In this way, the posture scores presented to the advisor may be time-series data that show how the posture scores have changed over time.

[0125] 20, the advisor screen G13 may include the total muscle score for each body part for a predetermined period (six months in the example shown in Fig. 20). For example, as shown in Fig. 20, the total muscle score for each body part may be displayed using a heat map in which a human-shaped object is shaded in accordance with the total muscle score.

[0126] The processing unit 142 sets "A" to the "game ID," sets the current time to the "timestamp," sets the trainee's ID to the "user ID," sets the posture score obtained from the trainee's biometric information to the "posture score for each movement," and registers the data in which the calculated muscle score calculation parameters are set to the "muscle score calculation parameters" in the second evaluation result DB 165.

[0127] Furthermore, the processing unit 142 sets "A" to the "game ID," sets the trainee's ID to the "user ID," sets the current time to the "timestamp," sets the calculated game score to the "game score," and sets the exercise points obtained from the trainee's biometric information to the "muscle score," and registers this data in the first evaluation result DB 167.

[0128] The details of the processing performed by the information processing system 1 according to an embodiment of the present disclosure have been described above.

[0129] (1.5. Effects) According to an embodiment of the present disclosure, an information processing system 1 is provided, which includes a first presentation control unit 143 that controls the presentation to a trainee of a first evaluation result evaluated based on the trainee's biometric information, and a second presentation control unit 144 that controls the presentation to an advisor of a second evaluation result based on the biometric information and different from the first evaluation result.

[0130] With this configuration, the evaluation results presented to the trainee and the advisor are different. This makes it possible to present the trainee with evaluation results that maintain his or her motivation, and to present the advisor with evaluation results that include information necessary to improve the quality of the trainee's movements. With this configuration, the trainee can improve the quality of his or her movements while receiving support from the advisor.

[0131] (1.6. Example of Operation of Information Processing System) Next, the operation of the information processing system 1 according to an embodiment of the present disclosure will be summarized with reference to Fig. 21. Fig. 21 is a flowchart showing an example of operation of the information processing system 1 according to an embodiment of the present disclosure. Note that the example shown in Fig. 21 assumes a scene in which a trainee warms up, then selects a game, and plays the selected game.

[0132] 21 , in the trainee terminal 10, the sensor unit 110 acquires biometric information of the trainee playing a game. The acquisition unit 141 acquires the biometric information of the trainee obtained by the sensor unit 110 from the sensor unit 110 (S11). The processing unit 142 recognizes skeletal information of the trainee based on the biometric information of the trainee (S12). The processing unit 142 calculates movement information and posture information based on the skeletal information of the trainee (S13).

[0133] The processing unit 142 calculates a score for the trainee (S14). More specifically, as examples of the score for the trainee, the processing unit 142 calculates a muscle score based on the body movement information and posture information of the trainee, and calculates a game score based on the skeletal information of the trainee. The first presentation control unit 143 controls the presentation unit 170 so that the trainee's score is presented to the trainee (S15).

[0134] Furthermore, the processing unit 142 calculates a score for the advisor (S16). More specifically, the processing unit 142 calculates a posture score, as an example of the score for the advisor, based on the body movement information and posture information of the trainee. The second presentation control unit 144 controls the presentation of the score for the advisor to the advisor by controlling the communication unit 150 so that the score for the advisor is transmitted to the advisor terminal 20 (S17).

[0135] In the advisor terminal 20, the presenting unit 270 presents the advisor score received by the communication unit 250 to the advisor.

[0136] The operation of the information processing system 1 according to the embodiment of the present disclosure has been summarized above.

[0137] (1.7. Various Modified Examples) Next, modified examples of score display by the information processing system 1 according to an embodiment of the present disclosure will be described with reference to FIGS.

[0138] Fig. 22 is a diagram showing a modified example of the trainee screen. Referring to Fig. 22, a trainee screen G14 is shown. As shown in Fig. 22, the trainee screen G14 includes a total game score of "2000". In addition, the trainee screen G14 may include a game score for each type of display object that is the contact partner of the operation object.

[0139] More specifically, the trainee screen G14 includes the number of times the operation object has come into contact with the display object "apple" as "80 apples picked," and the game score corresponding to the number of times the operation object has come into contact with the display object "apple" as "1600."

[0140] Similarly, the trainee screen G14 includes the number of times the operation object has come into contact with the display object "enemy" as "2 enemies defeated," and the game score corresponding to the number of times the operation object has come into contact with the display object "enemy" as "400."

[0141] The trainee screen G14 may also include the exercise points gained through this play as "+10."

[0142] Fig. 23 is a diagram showing a first modified example of the advisor screen. Referring to Fig. 23, an advisor screen G15 is shown. As shown in Fig. 23, the advisor screen G15 may include scores for each of "exercise speed," "play time," "achievement rate," "range of motion," and "hand shake."

[0143] The score for "movement speed" may be higher the faster the trainee moves the joints. The score for "play time" may be higher the longer the trainee plays the game. The score for "achievement rate" may be higher the higher the rate at which the trainee achieves their goal. The score for "range of motion" may be higher the greater the range of motion of the trainee's joints. The score for "hand shake" may be higher the less shake the trainee moves their hand.

[0144] The advisor screen G15 may also include an overall rating of "68 points", which is the sum of these scores.

[0145] Furthermore, the advisor screen G15 may include a determination result indicating whether the overall rating "68 points" is higher than a threshold value. For example, if the overall rating "68 points" is higher than the threshold value, the "good" arrow may be colored. Alternatively, if the overall rating "68 points" is equal to or lower than the threshold value, the "weak" arrow may be colored. In the example shown in FIG. 23, the threshold value is "60 points," and the overall rating "68 points" is higher than the threshold value "60 points," so the "good" arrow is colored.

[0146] 24 is a diagram showing an example of an advisor selection screen. Referring to FIG. 24, an advisor selection screen G16 is shown. As shown in FIG. 24, the advisor selection screen G16 includes the total game play time, recovery rate, and update time (last play time) of each of multiple trainees, "Mr. A," "Mr. B," and "Mr. C." The "recovery rate" may be the current rate of increase, based on the start of training, of the ratio of the range of motion of the joint to the maximum range of motion (i.e., the mobility rate of the joint).

[0147] For example, when an advisor inputs an operation to select "Mr. A," the screen displayed by the presentation unit 270 in the advisor terminal 20 transitions from the advisor selection screen G16 to the advisor screen G17 shown in FIG. 25.

[0148] Fig. 25 is a diagram showing a second modified example of the advisor screen. Referring to Fig. 25, an advisor screen G17 is shown. As shown in Fig. 25, the advisor screen G17 includes the mobility rate and recovery rate of each joint of the trainee "Mr. A" selected by the advisor. For example, the advisor screen G17 includes a shoulder mobility rate of "80%" and a recovery rate of "+22%".

[0149] In this way, the evaluation results presented to the advisor may include the mobility of the joints instead of the posture score, or may include the mobility of the joints in addition to the posture score.

[0150] The modified example of the score display by the information processing system 1 according to the embodiment of the present disclosure has been described above.

[0151] 2. Example of Hardware Configuration Next, an example of the hardware configuration of an information processing device 900 as an example of the trainee terminal 10 according to an embodiment of the present disclosure will be described with reference to Fig. 26. Fig. 26 is a block diagram showing an example of the hardware configuration of the information processing device 900. Note that the trainee terminal 10 does not necessarily have to have all of the hardware configuration shown in Fig. 26, and some of the hardware configuration shown in Fig. 26 may not be present in the trainee terminal 10.

[0152] 26 , the information processing device 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, and a RAM (Random Access Memory) 903. The information processing device 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925. The information processing device 900 may include a processing circuit such as a DSP (Digital Signal Processor) or an ASIC (Application Specific Integrated Circuit) instead of or in addition to the CPU 901.

[0153] The CPU 901 functions as an arithmetic processing unit and control unit, and controls all or part of the operations within the information processing device 900 in accordance with various programs recorded in the ROM 902, RAM 903, storage device 919, or removable recording medium 927. The ROM 902 stores programs and calculation parameters used by the CPU 901. The RAM 903 temporarily stores programs used in the execution of the CPU 901 and parameters that change as appropriate during the execution. The CPU 901, ROM 902, and RAM 903 are interconnected by a host bus 907, which is composed of an internal bus such as a CPU bus. Furthermore, the host bus 907 is connected to an external bus 911, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 909.

[0154] The input device 915 is a device operated by a user, such as a button. The input device 915 may include a mouse, a keyboard, a touch panel, a switch, a lever, or the like. The input device 915 may also include a microphone that detects the user's voice. The input device 915 may be, for example, a remote control device that uses infrared or other radio waves, or an externally connected device 929 such as a mobile phone that supports operation of the information processing device 900. The input device 915 includes an input control circuit that generates an input signal based on information input by the user and outputs the signal to the CPU 901. The user operates the input device 915 to input various data and instruct processing operations to the information processing device 900.

[0155] The output device 917 is configured with a device capable of visually or audibly notifying the user of acquired information. The output device 917 may be, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display, or an audio output device such as a speaker or headphones. The output device 917 may also include a PDP (Plasma Display Panel), a projector, a hologram, a printer, or the like. The output device 917 outputs the results obtained by the processing of the information processing device 900 as video such as text or images, or as sound such as voice or audio. The output device 917 may also include a light for illuminating the surroundings.

[0156] The storage device 919 is a data storage device configured as an example of a storage unit of the information processing device 900. The storage device 919 is configured, for example, by a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. This storage device 919 stores programs and various data executed by the CPU 901, as well as various data acquired from the outside.

[0157] The drive 921 is a reader / writer for a removable recording medium 927 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and is built into or externally attached to the information processing device 900. The drive 921 reads information recorded on the attached removable recording medium 927 and outputs the information to the RAM 903. The drive 921 also writes information to the attached removable recording medium 927.

[0158] The connection port 923 is a port for directly connecting a device to the information processing device 900. The connection port 923 may be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface) port, or the like. The connection port 923 may also be an RS-232C port, an optical audio terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, or the like. By connecting an external device 929 to the connection port 923, various types of data can be exchanged between the information processing device 900 and the external device 929.

[0159] The communication device 925 is, for example, a communication interface configured with a communication device for connecting to the network 931. The communication device 925 may be, for example, a communication card for a wired or wireless local area network (LAN), Bluetooth (registered trademark), or wireless USB (WUSB). The communication device 925 may also be a router for optical communication, a router for an asymmetric digital subscriber line (ADSL), or a modem for various communications. The communication device 925 transmits and receives signals between the Internet and other communication devices using a predetermined protocol such as TCP / IP. The network 931 connected to the communication device 925 is a wired or wireless network, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.

[0160] 3. Summary Although preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical idea described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0161] For example, it has been mentioned above that some of the functions of the trainee terminal 10 may be realized by a server (not shown). Specifically, the acquisition unit 141 may be realized by a server (not shown), the processing unit 142 may be realized by a server (not shown), and the second presentation control unit 144 may be realized by a server (not shown).

[0162] In the above description, it is assumed that the sensor unit 110 obtains image data of the trainee's entire body or upper body as the subject of the biometric information of the trainee. However, the sensor unit 110 may also obtain image data of the trainee's face as the subject. In this case, the positions of facial feature points (e.g., the degree of mouth opening in the vertical or horizontal directions, the position of the tongue, etc.) may be recognized from the image data. Furthermore, the evaluation results presented to the trainee may be the amount of movement of the facial feature points based on the positions of the facial feature points. Furthermore, the evaluation results presented to the advisor may be evaluation results based on the difference between the positions of the facial feature points and the positions of predetermined facial feature points. In this case, the trainee may be a person who trains to move facial muscles, and the advisor may be a person (e.g., a speech-language-hearing therapist) who provides advice on the trainee's training.

[0163] In the above description, it is mainly assumed that the sensor unit 110 has an image sensor, and that the image sensor obtains image data of the trainee's body as a subject as the trainee's biometric information. However, the sensor unit 110 may have a sensor other than an image sensor.

[0164] For example, the sensor unit 110 may include a microphone. In this case, the microphone may acquire voice data emitted by the trainee as the trainee's biometric information. The processing unit 142 may then recognize text information, pitch, tempo, or the like as the recognition result based on the voice data.

[0165] When the recognition result is text information, the evaluation result presented to the trainee may be the number of characters contained in the text information, etc. Also, the evaluation result presented to the advisor may be an evaluation result based on the difference between text information based on speech data uttered by the trainee and predetermined text information. In this case, the trainee may be a person who trains the pronunciation of a language, and the advisor may be a teacher who provides advice to the trainee on the training of pronunciation of a language.

[0166] If the recognition result is pitch, the evaluation result presented to the trainee may be a total value indicating the pitch from the start to the end of the speech. The evaluation result presented to the advisor may be an evaluation result based on the difference between the pitch based on the speech data uttered by the trainee and a predetermined pitch. In this case, the trainee may be a person who trains to sing or play an instrument, and the advisor may be a teacher who provides advice to the trainee on his or her singing training.

[0167] If the recognition result is the tempo of the sound, the evaluation result presented to the trainee may be a total value indicating the tempo of the sound from the start to the end of the voice production. The evaluation result presented to the advisor may be an evaluation result based on the difference between the tempo of the sound based on the voice data produced by the trainee and a predetermined tempo of the sound. In this case, the trainee may be a person who trains to sing or play an instrument, and the advisor may be a teacher who provides advice to the trainee on his or her training in singing or playing an instrument.

[0168] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that are apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects.

[0169] Note that the following configurations also fall within the technical scope of the present disclosure. (1) An information processing system comprising: a first presentation control unit that controls presentation of a first evaluation result, which is evaluated based on biometric information of a first user, to the first user; and a second presentation control unit that controls presentation of a second evaluation result, which is based on the biometric information and is different from the first evaluation result, to a second user different from the first user. (2) The information processing system described in (1), in which the biometric information of the first user is biometric information corresponding to a game obtained from the first user while playing the game. (3) The information processing system described in (2), in which the first presentation control unit controls presentation of a game score, which is calculated based on biometric information corresponding to the game, to the first user. (4) The information processing system described in (2) or (3), in which the first presentation control unit controls presentation of the first evaluation result for each game to the first user. (5) The information processing system according to (4), wherein the first presentation control unit controls presentation to the first user of the first evaluation result corresponding to one play of the game by the first user. (6) The information processing system according to any one of (2) to (5), wherein the second presentation control unit controls presentation to the second user of a third evaluation result based on biological information of the first user during practice conducted before playing the game. (7) The information processing system according to any one of (2) to (5), wherein a first evaluation method of the first evaluation result and a second evaluation method of the second evaluation result are associated with the game. (8) The information processing system according to (7), wherein the first evaluation method is associated with motion information of the user, and the second evaluation method is associated with muscle site information of the user. (9) The information processing system according to any one of (1) to (8), wherein the second presentation control unit controls presentation to the second user of the second evaluation result for each motion of the first user.(10) The information processing system according to any one of (1) to (8), wherein the second presentation control unit controls presentation of the second evaluation result to the second user for each time the biometric information is obtained. (11) The information processing system according to any one of (1) to (10), wherein the first evaluation result is an evaluation result for a first recognition result recognized based on the biometric information of the first user, and the first recognition result is skeletal information of the body of the first user. (12) The information processing system according to any one of (1) to (11), wherein the first evaluation result includes a muscle score which is an evaluation result obtained by evaluating each muscle site of the first user using a first evaluation method based on the body information of the first user. (13) The information processing system according to (12), wherein the body information includes movement information, and the movement information includes at least one of a range of motion indicating a range of movement of a joint constituting the body of the first user, a weight of a muscle involved in the movement of the joint, and a speed of the movement of the joint. (14) The information processing system according to (13), wherein the muscle score is an evaluation result based on at least one of a ratio of the range of motion to a predetermined maximum range of motion, a weight of the muscle involved in the movement of the joint, and a speed of the movement of the joint. (15) The information processing system according to any one of (1) to (14), wherein the second evaluation result includes a posture score which is an evaluation result obtained by evaluation using a second evaluation method for each movement of the first user based on physical information of the first user. (16) The information processing system according to (15), wherein the posture score is an evaluation result based on a difference between the posture of the body of the first user and a preset posture. (17) The information processing system according to any one of (1) to (16), wherein the biometric information is image data of the body of the first user. (18) The information processing system according to (8), wherein the movement information includes at least one of a standing up movement, a hand movement, a mouth opening and closing movement, and a foot movement.(19) The information processing system according to (8), wherein the muscle site information includes at least one of a whole body mode, an upper body mode, a face mode, and a foot mode. (20) The information processing system according to any one of (1) to (10), wherein the first evaluation result is an evaluation result for a first recognition result recognized based on biometric information of the first user, the biometric information being voice data uttered by the first user, and the first recognition result being text information, pitch, or tempo recognized based on the voice data. (21) An information processing method, comprising: controlling presentation of a first evaluation result evaluated based on the biometric information of the first user to the first user; and controlling, by a processor, presentation of a second evaluation result based on the biometric information, the second evaluation result being different from the first evaluation result, to a second user different from the first user. (22) A program that causes a computer to function as: a first presentation control unit that controls the presentation of a first evaluation result, which is evaluated based on biometric information of a first user, to the first user; and a second presentation control unit that controls the presentation of a second evaluation result, which is based on the biometric information and is different from the first evaluation result, to a second user different from the first user.

[0170] REFERENCE SIGNS LIST 1 Information processing system 10 Trainee terminal 110 Sensor unit 120 Operation unit 140 Control unit 141 Acquisition unit 142 Processing unit 143 First presentation control unit 144 Second presentation control unit 150 Communication unit 160 Storage unit 170 Presentation unit

Claims

1. An information processing system comprising: a first presentation control unit that controls the presentation of a first evaluation result evaluated based on biometric information of a first user to the first user; and a second presentation control unit that controls the presentation of a second evaluation result based on the biometric information, the second evaluation result being different from the first evaluation result, to a second user different from the first user.

2. The information processing system according to claim 1, wherein the biometric information of the first user is biometric information corresponding to the game obtained from the first user while playing the game.

3. The information processing system according to claim 2, wherein the first presentation control unit controls the presentation to the first user of a game score calculated based on biometric information corresponding to the game.

4. The information processing system according to claim 2, wherein the first presentation control unit controls the presentation of the first evaluation result for each game to the first user.

5. The information processing system according to claim 4, wherein the first presentation control unit controls the presentation to the first user of the first evaluation result corresponding to one play of the game by the first user.

6. The information processing system described in claim 2, wherein the second presentation control unit controls the presentation to the second user of a third evaluation result based on the first user's biometric information during practice conducted before playing the game.

7. The information processing system according to claim 2, wherein the game is associated with a first evaluation method for the first evaluation result and a second evaluation method for the second evaluation result.

8. The information processing system according to claim 7, wherein the first evaluation method is associated with the user's motion information, and the second evaluation method is associated with the user's muscle site information.

9. The information processing system according to claim 1, wherein the second presentation control unit controls the presentation of the second evaluation result for each action of the first user to the second user.

10. The information processing system according to claim 1, wherein the second presentation control unit controls the presentation of the second evaluation result to the second user for each time the biometric information is obtained.

11. The information processing system of claim 1, wherein the first evaluation result is an evaluation result for a first recognition result recognized based on biometric information of the first user, and the first recognition result is skeletal information of the first user's body.

12. The information processing system of claim 1, wherein the first evaluation result includes a muscle score, which is an evaluation result obtained by evaluating each muscle part of the first user using a first evaluation method based on physical information of the first user.

13. The information processing system of claim 12, wherein the physical information includes movement information, and the movement information includes at least one of a range of motion indicating the range of movement of the joints that make up the first user's body, the weight of the muscles involved in the movement of the joints, and the speed of the movement of the joints.

14. The information processing system of claim 13, wherein the muscle score is an evaluation result based on at least one of the ratio of the range of motion to a predetermined maximum range of motion, the weight of the muscles involved in the movement of the joint, and the speed of the movement of the joint.

15. The information processing system of claim 1, wherein the second evaluation result includes a posture score, which is an evaluation result obtained by evaluation using a second evaluation method for each movement of the first user based on physical information of the first user.

16. The information processing system according to claim 15, wherein the posture score is an evaluation result based on a difference between the body posture of the first user and a preset posture.

17. The information processing system according to claim 1, wherein the biometric information is image data of the body of the first user.

18. The information processing system according to claim 8, wherein the motion information includes at least one of a standing up motion, a hand movement motion, a mouth opening and closing motion, and a foot movement motion.

19. The information processing system according to claim 8, wherein the muscle region information includes at least one of a whole body mode, an upper body mode, a face mode, and a foot mode.

20. The information processing system of claim 1, wherein the first evaluation result is an evaluation result for a first recognition result recognized based on biometric information of the first user, the biometric information being voice data uttered by the first user, and the first recognition result being text information, pitch, or tempo recognized based on the voice data.

21. An information processing method comprising: controlling the presentation to a first user of a first evaluation result evaluated based on biometric information of the first user; and a processor controlling the presentation to a second user different from the first user of a second evaluation result based on the biometric information, the second evaluation result being different from the first evaluation result.

22. A program that causes a computer to function as: a first presentation control unit that controls the presentation to a first user of a first evaluation result evaluated based on the biometric information of the first user; and a second presentation control unit that controls the presentation to a second user different from the first user of a second evaluation result based on the biometric information and different from the first evaluation result.

Images