Information processing apparatus, information processing method, and program

Abstract

To provide an information processor capable of appropriately setting the content of next training from a past training result SOLUTION: The information processing device 30 includes the storage unit 31 that stores the acquired result of the training of the user and the acquired moving image of the face of the user during the training, and the control unit 32 that determines the degree of concentration of the user based on the moving image of the face of the user stored in the storage unit 31 and sets the content of the training of the user based on the determined degree of concentration and the result of the training of the user stored in the storage unit 31.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and a program used for managing training. [Background technology]

[0002] Conventionally, there have been proposed information processing devices that set the content of a user's next training based on the user's past training results stored in a storage unit, such as the configuration described in Patent Document 1. The information processing device described in Patent Document 1 determines the user's ability values, such as concentration, leg strength, and explosive power, from the training results, and sets the content of the user's next training based on the determined ability values. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-313280 Summary of the Invention [Problem to be solved by the invention]

[0004] Unlike leg strength or explosive power, concentration changes from moment to moment, and the results of training conducted in a non-concentrated state are often not useful when planning the next training session.

[0005] In contrast, when concentration is determined from training results, as in the configuration described in Patent Document 1, it is not possible to determine whether the results are due to the level of concentration or to abilities other than concentration. As a result, it is not possible to determine whether the training results are useful as a reference when setting the next training content, and there is a risk that the set training content will be inappropriate.

[0006] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide an information processing device that can appropriately set the content of the next training session based on the results of past training sessions. [Means for solving the problem]

[0007] A typical configuration of an information processing device according to the present invention for solving the above-mentioned problems is characterized by comprising: a storage means for storing the acquired results of a user's training and an acquired image of the user's face during the training; a determination means for determining the user's level of concentration based on the image stored in the storage means; and a setting means for setting the content of the user's training based on the results of the training stored in the storage means and the user's level of concentration determined by the determination means.

[0008] According to the present invention, the information processing device can appropriately set the content of the next training session based on the results of past training sessions. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing the configuration of a training management system including an information processing device according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the configuration of a training terminal and a management terminal of the training management system. [Figure 3] FIG. 1 is a block diagram showing a configuration of an information processing device. [Figure 4] 1 is a list of action units. [Figure 5] 10 is a flowchart of a management sequence executed by a management terminal. [Figure 6] This is a questionnaire regarding whether or not you are frail. [Figure 7] 10 is a flowchart of a concentration level determination sequence executed by the information processing device. [Figure 8] 10 is a flowchart of a setting sequence executed by the information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, the overall configuration of a training management system 50 including an information processing device 30 according to one embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the configuration of the training management system 50. FIG. 2A is a block diagram showing the configuration of a training terminal 10 included in the training management system 50. FIG. 2B is a block diagram showing the configuration of a management terminal 20 included in the training management system 50. FIG. 3 is a block diagram showing the configuration of the information processing device 30.

[0011] 1, the training management system 50 is made up of a training terminal 10 used for user training, an administrative terminal 20 used by an administrator who manages the user training, and an information processing device 30 that sets the training content. The training terminal 10, administrative terminal 20, and information processing device 30 are connected via a communication network N such as the Internet, and are configured to be able to send and receive various information to and from each other via the communication network N. These may also be connected by wired cables to enable the sending and receiving of information.

[0012] Any number of users can be considered, but in this embodiment, we assume elderly people who are trying to return from frailty to a healthy state, and healthy elderly people who are trying to avoid becoming frail. Frailty refers to a state in which physical and mental vitality (motor function, cognitive function, etc.) declines with age, and, due to the influence of the coexistence of multiple chronic diseases, daily living functions are impaired and physical and mental fragility appears, but at the same time, daily living functions can be maintained and improved with appropriate intervention and support.

[0013] Training terminal 10 is a computer such as a personal computer, tablet terminal, or smartphone. As shown in Fig. 2A, training terminal 10 includes a data input unit 11 for inputting data, a storage unit 12 such as a memory for storing various data, a control unit 13 such as a CPU for controlling training terminal 10 in accordance with computer programs stored in storage unit 12, a monitor 14 for outputting image data, and a communication unit 15 for transmitting and receiving information to and from external devices. Data input unit 11, storage unit 12, control unit 13, monitor 14, and communication unit 15 are configured to be able to transmit and receive data to and from external devices via a system bus 16.

[0014] The control unit 13 controls the components that make up the training terminal 10 and reads and writes data stored in the memory unit 12. The control unit 13 also controls external devices by sending and receiving signals via the communication unit 15. The data input unit 11 is a keyboard, mouse, etc. if the training terminal 10 is a personal computer. If the training terminal 10 is a tablet terminal or a smartphone, the monitor 14 is generally configured as a touch panel display, and therefore the monitor 14 also serves as the data input unit 11.

[0015] The storage unit 12 also stores an application program used for training the user. The control unit 13 sets the content of the training to be performed on the application program based on the setting information received from the information processing device 30. The control unit 13 also transmits the results of the training performed on the application program to the information processing device 30 as needed when the training ends.

[0016] Furthermore, a training device 17 is connected to the training terminal 10 as an external device used for training the user. In this embodiment, the training device 17 is a cylindrical leaf spring with a strain gauge attached. The strain gauge detects the amount of deformation of the leaf spring when the user grips it, and transmits the detected amount to the control unit 13.

[0017] The control unit 13 displays instructions on the monitor 14 via the application program to grip the training device 17 with a predetermined force, and the user grips it in accordance with the instructions. The control unit 13 changes the magnitude of the predetermined force and repeats the instructions. The user repeatedly grips the training device 17 in accordance with the instructions, thereby training the user's ability to adjust the grip force. The control unit 13 also converts the amount of deformation of the leaf spring of the training device 17 detected by the strain gauge into the user's grip force, and determines the training results based on the difference between the instruction on the monitor 14 and the user's grip force. The difficulty level of the training is set to one of 12 levels, and the control unit 13 sets the difficulty level based on setting information received from the information processing device 30.

[0018] The management terminal 20 is a computer such as a personal computer, a tablet terminal, or a smartphone. As shown in Fig. 2B, the management terminal 20 includes a data input unit 21 for inputting data, a storage unit 22 such as a memory for storing various data, a control unit 23 such as a CPU for controlling the management terminal 20 in accordance with a computer program stored in the storage unit 22, a monitor 24 for outputting image data, and a communication unit 25 for transmitting and receiving information to and from external devices. The data input unit 21, storage unit 22, control unit 23, monitor 24, and communication unit 25 are configured to be able to transmit and receive data to and from external devices via a system bus 26.

[0019] The control unit 23 controls the components constituting the management terminal 20 and reads and writes data stored in the memory unit 22. The control unit 23 also controls external devices by sending and receiving signals via the communication unit 25. The data input unit 21 is a keyboard, a mouse, etc. if the management terminal 20 is a personal computer. If the management terminal 20 is a tablet terminal or a smartphone, the monitor 24 is generally configured as a touch panel display, and therefore the monitor 24 also serves as the data input unit 21. The memory unit 22 stores application programs used for managing users.

[0020] Furthermore, a camera 27 as an external device is connected to the management terminal 20 via a wired cable. The camera 27 captures video of the user under the control of the control unit 23 and transmits the captured video data to the management terminal 20. If the management terminal 20 has a function for capturing video, this function may be used instead of the camera 27. Furthermore, the camera 27 may be connected to the management terminal 20 via a communication network N.

[0021] The information processing device 30 is, for example, a computer such as a server. As shown in Fig. 3, the information processing device 30 includes a storage unit 31 such as a memory that stores various data, a control unit 32 such as a CPU that controls the information processing device 30 in accordance with a computer program stored in the storage unit 31, and a communication unit 33 that transmits and receives information to and from external devices. The storage unit 31, control unit 32, and communication unit 33 are configured to be able to transmit and receive data to and from each other via a system bus 34.

[0022] The control unit 32 (determination means, setting means) controls each component constituting the information processing device 30, reads and writes data stored in the memory unit 31, determines the user's concentration level, sets the training content, etc. The training content set by the control unit 32 is sent as setting information to the training terminal 10 via the communication unit 33, and training is carried out on the training terminal 10 based on the setting information.

[0023] Various data are stored in the storage unit 31 (storage means). This data includes an ID for identifying the user, personal information such as the user's name, address, age, and gender that is stored in association with the ID, an image of the user's face, a password, the user's cumulative training results received from the training terminal 10, and the results of determining the user's concentration level during the training.

[0024] The storage unit 31 also includes an execution program for a concentration level determination sequence that is executed by the control unit 32 to determine the user's concentration level, and an execution program for a training setting sequence that is executed by the control unit 32 to set the content of the training to be performed on the training terminal 10. The details of these sequences will be described later.

[0025] Furthermore, three artificial intelligence (AI) engines, namely, a blink determination engine 31a, a facial expression determination engine 31b, and a face recognition engine 31c, are stored in the storage unit 31. The blink determination engine 31a and the facial expression determination engine 31b are used to determine the user's concentration level, and are trained models that have been trained by machine learning (deep learning) using as training data a combination of video data of the faces of multiple subjects and self-reported data on the subjects' concentration levels during video capture.

[0026] The blink determination engine 31a detects blinking from multiple image frames included in the input facial video data, and then determines the level of concentration based on the detected blinking into three levels: "non-concentrated," "normal," and "concentrated."

[0027] The facial expression determination engine 31b detects a facial expression from one image frame included in the input facial video data. Then, based on the detected facial expression, it determines the concentration level in three levels: "unfocused," "normal," and "concentrated." When detecting facial expressions, the facial expression determination engine 31b is configured to evaluate all or some of the action units AU1 to AU46 shown in FIG. 4, which are defined by the FACS (Facial Action Coding System). In this embodiment, the open-source Py-Feat is used to detect faces, landmarks, and action units from image frames, and the detected data is converted into visualized data. This visualized data becomes data on the action units to be evaluated. FACS is a system of movements of specific parts of the face that appear when expressing facial expressions, and is widely used to describe and identify facial expressions. The magnitude relationship of the above-mentioned concentration levels is "unfocused" < "normal" < "concentrated."

[0028] The face recognition engine 31c authenticates the user by comparing the input image frame of the user's face with the image of the user's face stored in association with the user's ID in the storage unit 31. The face recognition engine 31c is a trained model that has been trained by machine learning (deep learning) using images of multiple people's faces and their attribute information such as gender and age as training data.

[0029] Next, the management sequence executed by control unit 23 of management terminal 20 will be described using the flowchart shown in Figure 5. In the management sequence, control unit 23 transmits information about the user who is training using training terminal 10 and video data of the user's face during training to information processing device 30. The management sequence will be described below using as an example a case where a user uses training terminal 10 to perform the above training for 93 seconds.

[0030] 5, first, in response to an administrator's operation of the data input unit 21, the control unit 23 of the management terminal 20 starts an application program used to manage users who train using the training terminal 10 (S1). This causes a reception screen to be displayed on the monitor 24 of the management terminal 20. This reception screen includes input fields for entering the user's ID and password, a login button, and a user registration button.

[0031] Next, if the user has already registered, the administrator enters the user's ID and password on the reception screen and selects the login button. In response, the control unit 23 transmits the user's ID and password information entered on the reception screen to the information processing device 30 via the communication network N (S2). If the user's ID and password received from the management terminal 20 match those stored in the storage unit 31, the control unit 32 of the information processing device 30 transmits a signal to the management terminal 20 notifying that they match. Upon receiving this signal, the control unit 23 of the management terminal 20 displays an operation screen on the monitor 24 (S3). This operation screen includes a start button that is selected to start photographing the user.

[0032] When a user starts training using training terminal 10, the administrator selects a start button on the operation screen. In response to the selection of this start button, control unit 23 controls camera 27 to cause camera 27 to start capturing video of the user's face (S4). In this embodiment, camera 27 captures video of the user's face at a frame rate of 30 fps. Control unit 23 also switches the display screen on monitor 24 to a capture screen indicating that video is being captured (S5). This capture screen includes an end button that can be selected to end video capture.

[0033] While capturing video of the user's face, camera 27 transmits image frames included in the video every 5.0 seconds to management terminal 20 as needed. Control unit 23 stores the image frames received from camera 27 in storage unit 22, and transmits the image frames stored in storage unit 22 to information processing device 30 as needed (S6). In other words, while the user is training, control unit 23 transmits image frames included in the video of the user's face to information processing device 30 approximately every 5.0 seconds.

[0034] The administrator selects the end button when the 93-second training is completed. In response to the selection of this end button, control unit 23 controls camera 27 to stop capturing video of the user's face (S7). Next, control unit 23 controls camera 27 to transmit the captured video data of the user's face to management terminal 20. Control unit 23 stores the video data received from camera 27 in storage unit 22, and transmits this video data stored in storage unit 22 to information processing device 30 via communication network N (S8). Thereafter, control unit 23 ends the management sequence.

[0035] If the user is new, the administrator selects the user registration button on the reception screen. In response, the control unit 23 displays a user registration screen on the monitor 24. The administrator operates the management terminal 20 and inputs the user's personal information, such as the user's name, address, age, and gender, as well as an optional password, on the user registration screen. The administrator also selects the capture button displayed on the user registration screen, activates the camera 27 connected to the management terminal 20, and captures an image of the user's face. After that, when the registration button is selected on the user registration screen, the control unit 23 transmits the user's personal information, facial image data, password information, and other information input on the user registration screen to the information processing device 30. The control unit 32 of the information processing device 30 associates this information received from the management terminal 20 with a user ID issued by the control unit 32 for each user, and stores it in the storage unit 31.

[0036] Furthermore, when the registration button is selected on the user registration screen, the control unit 23 displays a questionnaire screen on the monitor 24. The questionnaire screen displays a questionnaire regarding applicability to frailty, as shown in FIGS. 6A and 6B, and a send answer button. The user operates the management terminal 20 to answer the questionnaire, and after completing the answer, selects the send answer button. In response, the control unit 23 transmits the questionnaire results to the information processing device 30. The control unit 32 of the information processing device 30 receives the questionnaire results from the management terminal 20 (frailty information acquisition means), and stores them in the memory unit 31 in association with the above ID.

[0037] In the questionnaire shown in Figure 6A, those who answered three or more questions were considered frail, those who answered one or two questions were considered pre-frail, and those who answered none were considered healthy. However, even for those considered healthy, if any of the answers No. 1 to No. 25 in the questionnaire shown in Figure 6B were abnormal, they were presumed to be close to pre-frail. In this way, the questionnaire response results shown in Figures 6A and 6B can be considered information regarding the user's applicability to frailty.

[0038] Next, a concentration level determination sequence for determining the user's concentration level, which is executed by the control unit 32 of the information processing device 30, will be described with reference to the flowchart shown in Fig. 7. Below, the concentration level determination sequence will be described using as an example how the user's concentration level is determined while the user is performing the above-mentioned 93-second training.

[0039] 7, first, the control unit 32 stores the video data of the user's face during training received from the management terminal 20 in step S8 of the above management sequence in the storage unit 31. That is, the control unit 32 stores the video data of the user's face acquired from the management terminal 20 in the storage unit 31 (S11).

[0040] Next, the control unit 32 inputs the video data of the user's face stored in the storage unit 31 to the blink determination engine 31a stored in the storage unit 31. The blink determination engine 31a detects the user's blinking behavior from α image frames included in the input video data, and determines the user's concentration level in three levels: "non-concentrated," "normal," and "concentrated" based on the detected blinking behavior. In this embodiment, the blink determination engine 31a detects the user's blinking behavior based on all 2,790 image frames included in the 93 seconds of video data.

[0041] That is, in the above step, the control unit 32 uses the blink determination engine 31a to determine the user's concentration level based on the user's blinking detected from α image frames included in the video data of the user's face stored in the storage unit 31 (S12). When the control unit 32 determines that the user's concentration level is "non-concentration," it stores this in the storage unit 31 and sends a signal to the management terminal 20 to display the concentration level determination result on the monitor 24 of the management terminal 20 (S13, S15, S16). Upon receiving this signal, the control unit 23 of the management terminal 20 displays the concentration level determination result on the monitor 24. The control unit 32 then ends the concentration level determination sequence.

[0042] On the other hand, if the control unit 32 determines that the user's concentration level is "normal" or "concentrated" in step S13, it inputs the video data of the user's face stored in the storage unit 31 to the facial expression determination engine 31b also stored in the storage unit 31. The facial expression determination engine 31b detects the user's facial expression for each of 93 image frames corresponding to image frames every 1.0 second out of 2,790 image frames included in the input video data, and determines the user's concentration level into three levels: "non-concentrated," "normal," and "concentrated" based on the detected facial expression. In other words, the facial expression determination engine 31b outputs 93 determination results as concentration level determination results.

[0043] If there is a time series transition from "concentrated" to "normal" to "non-concentrated" among the 93 concentration level determination results output from the facial expression determination engine 31b, the control unit 32 determines the user's concentration level as "non-concentrated." On the other hand, if there is no such time series transition, the control unit 32 compares the number of "normal" and "concentrated" among the 93 determination results. If there are more "concentrated" than "normal," the control unit 32 determines the user's concentration level as "concentrated," and if there are more "normal" than "concentrated," the control unit 32 determines the user's concentration level as "normal." Note that if the number of "concentrated" and "normal" is the same, the control unit 32 determines the user's concentration level as "concentrated."

[0044] That is, in the above step, the control unit 32 uses the facial expression determination engine 31b to determine the user's concentration level based on changes in the user's facial expression detected from β image frames, which are fewer than the α frames, included in the video data of the user's face stored in the storage unit 31 (S14). Thereafter, the control unit 32 stores the determination result in the storage unit 31, and transmits a signal to the management terminal 20 to display the concentration level determination result on the monitor 24 of the management terminal 20 (S15, S16). Upon receiving the signal, the control unit 23 of the management terminal 20 displays the concentration level determination result on the monitor 24. Thereafter, the control unit 32 ends the concentration level determination sequence.

[0045] In this way, the control unit 32 executes the concentration level determination sequence and determines the user's concentration level based on the user's blinking and facial expression changes, which improves the accuracy of determining the user's concentration level compared to a configuration in which the concentration level is determined based on only one of the blinking and facial expression changes.

[0046] Furthermore, the control unit 32 determines the user's concentration level based on the user's blinking detected from α image frames among the image frames included in the video of the user's face stored in the storage unit 31 and changes in the user's facial expression detected from β image frames, which is less than α. This allows for a reduction in the number of image frames used for the detection compared to a configuration in which the user's concentration level is determined based on the user's blinking and changes in facial expression detected from the same number of image frames, thereby reducing the workload on the information processing device 30. This prevents a decrease in the speed at which the information processing device 30 determines the concentration level and freezing of the information processing device 30. Note that facial expressions generally do not change instantaneously like blinking. Therefore, reducing the number of image frames used to detect changes in facial expression as described above has little effect on the accuracy of the concentration level determination.

[0047] Furthermore, when the user's concentration level determined based on the user's blinking is "non-concentrated," the control unit 32 stores the determination result in the storage unit 31 without determining the concentration level based on changes in the user's facial expression, and outputs a signal to display the determination result on the monitor 24 of the management terminal 20. On the other hand, when the user's concentration level determined based on the user's blinking is "normal" or "concentrated," the control unit 32 determines the concentration level based on changes in the user's facial expression, stores the determination result in the storage unit 31, and outputs a signal to display the determination result on the monitor 24 of the management terminal 20. This provides the following effects.

[0048] That is, when determining the user's concentration level in order to set training content, it is important to find that the user's concentration level is "non-concentrated" and determine that the training results are not useful for setting the content of the next training. Also, as described above, when determining the concentration level based on facial expression, the facial expression determination engine 31b is used to evaluate the action units AU1 to AU46 shown in Fig. 4, which imposes a greater workload on the information processing device 30 than when only blinking actions are evaluated using the blink determination engine 31a.

[0049] In contrast, when the concentration level determined based on the user's blinking is less than a predetermined level, the control unit 32 stores the concentration level used for setting training details (described below) in the storage unit 31 without determining the concentration level based on changes in the user's facial expression. This makes it possible to determine that the concentration level is "non-concentrated" and set the training details without determining the concentration level based on changes in facial expression that involve a heavy workload. This makes it possible to further suppress an increase in the workload of the information processing device 30.

[0050] Next, a setting sequence executed by the control unit 32 for setting the content of the training the user will perform using the training terminal 10 will be described using the flowchart shown in Figure 8. The setting sequence will be described below using as an example the situation when the user starts the above-mentioned 93-second training.

[0051] As shown in Figure 8, when the control unit 32 first receives the user's ID from the management terminal 20 in step S2 of the above management sequence, it determines whether the result of the determination of the user's concentration level during the previous training session, which is stored in association with the ID in the memory unit 31, is "non-concentration" (S21, S22).

[0052] If the determination result of the user's concentration level is "non-concentration," it is highly likely that the results of the previous training are not useful as a reference when determining the content of the current training. Therefore, the control unit 32 treats the results of the previous training as "invalid" and transmits setting information to the training terminal 10 to set the difficulty level of the current training to the same level as the previous training. In other words, if the determination result of the user's concentration level during the previous training is "non-concentration," the control unit 32 sets the training content so that the difficulty level of the current training will be the same as the previous difficulty level (S25). The training terminal 10 runs the training application with training content according to the set difficulty level.

[0053] On the other hand, if the judgment result of the user's concentration level during the previous training stored in the memory unit 31 is "normal" or "concentrated," the results of the previous training are likely to be useful as a reference when determining the content of the current training. Therefore, in this case, the control unit 32 treats the results of the previous training as "valid." The control unit 32 then judges whether the training score P stored in the memory unit 31 as the result of the user's previous training satisfies any of the following conditions (1) to (3) (S23, S24).

[0054] ω1≦P≦ω2 (1) ω2 <P≦ω3···(2) ω3 <P≦ω4···(3)

[0055] Here, the magnitude of the score P is ω1<ω2<ω3<ω4, with ω4 being the best result and ω1 being the worst result. In other words, simply put, if the training result meets condition (1), the training result is "bad," if it meets condition (2), the training result is "average," and if it meets condition (3), the training result is "good."

[0056] If the control unit 32 determines that the previous training result satisfies condition (1), it transmits setting information to the training terminal 10 for setting the difficulty level of the current training to be one level easier than the previous training. In other words, if the previous training result was poor, the control unit 32 sets the difficulty level of the current training to be one level easier than the previous training (S23, S27). Thereafter, the training terminal 10 runs a training application program with training content according to the set difficulty level.

[0057] Furthermore, if the control unit 32 determines that the user's previous training result satisfies condition (2), it transmits setting information to the training terminal 10 for setting the difficulty level of the current training to the same as that of the previous training. That is, if the previous training result was average, the control unit 32 sets the difficulty level so that the difficulty level of the current training will be the same as that of the previous training (S24, S25). Thereafter, the training terminal 10 runs a training application program with training content according to the set difficulty level.

[0058] Furthermore, if the control unit 32 determines that the user's previous training results do not meet either condition (1) or (2) but meet condition (3), it transmits setting information to the training terminal 10 for setting the difficulty level of the current training to be one level higher than the previous training. That is, if the previous training results were good, the control unit 32 sets the difficulty level of the current training to be one level higher than the previous training (S24, S26). Thereafter, the training terminal 10 runs a training application program with training content according to the set difficulty level.

[0059] After the training is completed, the information processing device 30 receives the score P as a training result from the training terminal 10. The received score P is then stored in the storage unit 31 (S28). The control unit 32 also receives video data of the user's face during training from the management terminal 20. The received video data of the user's face is then used to execute the above-described concentration level determination sequence (S29).

[0060] Thereafter, the control unit 32 determines whether the information processing device 30 has received a signal from the management terminal 20 indicating that the user has logged out (S30). If the control unit 32 has not received the signal, it returns to step S22 and repeats the above process. On the other hand, if the control unit 32 has received the signal indicating that the user has logged out, it ends the setting sequence.

[0061] In this way, in the setting sequence described above, the information processing device 30 stores in the storage unit 31 the training results acquired from the training terminal 10 and the video of the user's face during training received from the management terminal 20. The information processing device 30 then determines the user's concentration level during training from the video of the user's face stored in the storage unit 31. Thereafter, the control unit 32 sets the content of the user's training based on the determined concentration level of the user during training and the training results stored in the storage unit 31.

[0062] With this configuration, the control unit 32 can determine whether the quality of the training results is due to the user's level of concentration or to abilities other than concentration. Therefore, it can determine whether the level of concentration is low and the training results are not worth considering when setting the content of the next training, or whether the level of concentration is above a certain level and the training results are worth considering when setting the content of the next training, and set the content of the next training based on this determination. Therefore, the information processing device 30 according to this embodiment can appropriately set the content of the next training based on the results of past training.

[0063] Specifically, if the user's concentration level in the previous training session is below a predetermined level, the control unit 32 sets the content of the next training session to be the same as the content of the previous training session. As a result, if the concentration level is low and the training results are not useful for setting the content of the next training session, the control unit 32 can have the user do the same training session again to determine the user's true ability.

[0064] Note that when a user trains for the first time after user registration on management terminal 20, there are no previous training results for the user. Therefore, instead of performing steps S22 to S27 above, control unit 32 sets the training content based on the results of the questionnaire shown in Figures 6A and 6B stored in storage unit 31.

[0065] That is, if the questionnaire results show three or more applicable items in the questionnaire shown in Fig. 6A, the user is considered to be frail, and therefore the control unit 32 sets the training content to be the easiest level of difficulty for the training to be carried out on the training terminal 10. Also, if the questionnaire results show one or two applicable items in the questionnaire shown in Fig. 6A, the user is considered to be pre-frail, and therefore the control unit 32 sets the training content to be the third easiest level of difficulty on a twelve-level scale.

[0066] Furthermore, if there are no applicable items in the questionnaire shown in Fig. 6A but at least one item in the answers No. 1 to No. 25 in the questionnaire shown in Fig. 6B corresponds to an abnormality, the control unit 32 considers the user to be close to pre-frailty and sets the training content to a difficulty level of the fifth easiest on a twelve-point scale. Furthermore, if there are no applicable items in the questionnaire shown in Fig. 6A and no item in the answers No. 1 to No. 25 in the questionnaire shown in Fig. 6B corresponds to an abnormality, the control unit 32 considers the user to be healthy and sets the training content to a difficulty level of the seventh easiest on a twelve-point scale.

[0067] In this way, the control unit 32 sets the content of the training to be performed on the training terminal 10 based on information about whether the user is frail, when the user's training results are not stored in the storage unit 31. This allows the control unit 32 to set training content suitable for the user, even when the user is training for the first time.

[0068] Furthermore, if the face recognition engine 31c determines during the above setting sequence that the person using the training terminal 10 is not the logged-in user, the control unit 32 performs the following control. That is, the control unit 32 displays on the monitor 14 of the training terminal 10 a message indicating that the user of the training terminal 10 does not match the user. Furthermore, when the face recognition engine 31c determines that the user is not the actual user, the control unit 32 treats the results of the training performed on the training terminal 10 as "invalid" and sets the training content so that the difficulty level of the logged-in user's next training will be the same as the difficulty level of the previous training. This allows the logged-in user's next training content to be set appropriately even if the logout process is forgotten on the management terminal 20 when a user is replaced and the logged-in user and the person training do not match.

[0069] Furthermore, the control unit 32 of the information processing device 30 transmits information such as the user's past training results, concentration level during training, training content, and questionnaire results stored in the storage unit 31 to the management terminal 20 in response to a request from the management terminal 20. This allows the manager to operate the management terminal 20 to view information about the user's past training and questionnaire results, making it easier to consider the user's recovery status from frailty to healthy status and measures to prevent frailty.

[0070] In this embodiment, a configuration has been described in which the difficulty level of training is set as the setting of training content by the information processing device 30. However, the present invention is not limited to this, and as long as the configuration sets the training content, a configuration for changing to another type of training or a configuration for changing the training time can also achieve the same effects as described above.

[0071] Furthermore, in this embodiment, the training management system 50 is described as being divided into three computers: a training terminal 10 used for user training, an administration terminal 20 used for administration, and an information processing device 30 for setting up training content. However, the present invention is not limited to this, and the training management system 50 may be configured with one, two, four or more computers by appropriately separating or combining these. For example, the same effect as above can be achieved by configuring the training terminal 10 and the administration terminal 20 as a single computer and sending information necessary for setting up training content from that computer to the information processing device 30. Similarly, the same effect as above can be achieved by configuring the administration terminal 20 and the information processing device 30 as a single computer. [Explanation of symbols]

[0072] 30...information processing device, 31...storage unit (storage means), 32...control unit (determination means, setting means, frailty information acquisition means)

Claims

1. a storage means for storing the acquired training results of the user and the acquired image of the user's face during the training; a determination means for determining a concentration level of the user based on the video stored in the storage means; a setting means for setting the content of the user's training based on the results of the training stored in the storage means and the user's concentration level determined by the determination means; An information processing device comprising:

2. The information processing device according to claim 1, characterized in that the setting means sets the content of the next training so that the content of the next training will be the same as the content of the previous training if the user's concentration level in the previous training determined by the determination means is below a predetermined level.

3. The information processing device includes a frailty information acquisition means for acquiring information regarding whether the user is frail, The information processing device according to claim 1 or 2, characterized in that, when the results of the user's training are not stored in the storage means, the setting means sets the content of the training based on information regarding the user's applicability to frailty acquired by the frailty information acquisition means.

4. The determination means If the level of concentration of the user determined based on the blinking behavior of the user detected from the image frames included in the video is equal to or greater than a predetermined level, the level of concentration is determined based on changes in facial expressions of the user detected from the image frames included in the video, and the level of concentration of the user is output as a result of the setting means for setting training content for the user. The information processing device described in claim 1, characterized in that if the user's concentration level determined based on the user's blinking behavior detected from image frames included in the video is less than a predetermined level, the user's concentration level to be used for setting the user's training content by the setting means is output without determining the concentration level based on changes in the user's facial expression.

5. an acquisition step in which a computer acquires the results of the user's training and an image of the user's face during the training; a determination step in which the computer determines a concentration level of the user based on the video acquired in the acquisition step; a setting step in which the computer sets the content of the user's training based on the results of the training acquired in the acquisition step and the user's concentration level determined in the determination step; An information processing method comprising:

6. The information processing method described in claim 5, characterized in that if the user's concentration level in the previous training determined in the judgment process is below a predetermined level, the computer sets the content of the next training in the setting process so that the content of the next training is the same as the content of the previous training.

7. The information processing method includes a frailty information acquisition step of acquiring information regarding whether the user is frail, The information processing method described in claim 5 or 6, characterized in that if the computer cannot obtain the results of the user's training in the acquisition process, in the setting process, it sets the content of the training based on information regarding the user's applicability to frailty obtained in the frailty information acquisition process.

8. In the determination step, the computer If the level of concentration of the user determined based on the blinking behavior of the user detected from the image frames included in the video is equal to or greater than a predetermined level, the level of concentration is determined based on changes in facial expressions of the user detected from the image frames included in the video, and the level of concentration of the user is output as a result of the setting means for setting training content for the user. The information processing method described in claim 5, characterized in that if the user's concentration level determined based on the user's blinking behavior detected from image frames included in the video is less than a predetermined level, the user's concentration level to be used for setting the user's training content by the setting means is output without determining the concentration level based on changes in the user's facial expression.

9. an acquisition step of acquiring the results of the user's training and an image of the user's face during the training; a determination step of determining a concentration level of the user based on the video acquired in the acquisition step; a setting step of setting the content of the user's training based on the results of the training acquired in the acquisition step and the user's concentration level determined in the determination step; A program characterized by causing a computer to execute the above.

10. The program described in claim 9, characterized in that if the user's concentration level in the previous training determined by the computer in the judgment process is below a predetermined level, the computer is operated to set the content of the next training in the setting process so that the content of the next training is the same as the content of the previous training.

11. The program described in claim 9 or 10, characterized in that if the computer is unable to acquire the results of the user's training in the acquisition process, the setting process causes the computer to execute a frailty information acquisition process to acquire information regarding the user's frailty, thereby operating the computer to set the content of the training based on information regarding the user's frailty acquired by the computer.

12. In the determination step, If the level of concentration of the user determined based on the blinking behavior of the user detected from the image frames included in the video is equal to or greater than a predetermined level, the level of concentration is determined based on changes in facial expressions of the user detected from the image frames included in the video, and the level of concentration of the user is output as a result of the setting means for setting training content for the user. The program described in claim 9, characterized in that if the user's concentration level determined based on the user's blinking behavior detected from image frames included in the video is less than a predetermined level, the computer is operated to output the user's concentration level to be used for setting the user's training content by the setting means without determining the concentration level based on changes in the user's facial expression.

Images