Information processing device, information processing method, information processing system, and program

Abstract

To provide technology to maintain motivation of an object person who performs actions to improve a body function.SOLUTION: An information processor (3) includes: an information acquisition part (36) which acquires information on physical conditions of an object person; a selection part (39) which refers to the information on the physical conditions of the object person, and selects a movie image of the object person after treatment, the movie image including another object person whose physical condition is similar to that of the object person in question as a subject; and an output part (38) which outputs the selected movie image.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, an information processing system, a terminal device, and a program. [Background technology]

[0002] There are known technologies for supporting rehabilitation, which is one type of treatment for injured or disabled subjects. Patent Document 1 discloses a technology for automatically determining a rehabilitation menu based on the movements of the subject. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-24580 Summary of the Invention [Problem to be solved by the invention]

[0004] For injured or disabled subjects, treatment, including rehabilitation, is painful, making it difficult to maintain motivation. The technology of Patent Document 1 leaves room for improvement in terms of maintaining the subject's motivation.

[0005] An object of one aspect of the present invention is to provide a technology that can maintain the motivation of a subject undergoing treatment to improve physical function. [Means for solving the problem]

[0006] In order to solve the above problem, an information processing device according to one aspect of the present invention includes an information acquisition unit that acquires information regarding the physical condition of a subject, a selection unit that refers to the information regarding the physical condition of the subject and selects a video of the other subject having a physical condition similar to that of the subject as a subject, after the other subject has completed treatment, and an output unit that outputs the video selected by the selection unit. [Effects of the Invention]

[0007] According to one aspect of the present invention, it is possible to maintain the motivation of a subject undergoing treatment to improve physical function. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing an example of the configuration of a terminal device and an information processing device included in an information processing system according to a first embodiment of the present invention. [Figure 2] 4 is a table showing an example of data that an accumulation unit accumulates in a storage unit according to the first embodiment of the present invention. [Figure 3] FIG. 3 is a sequence diagram showing a processing flow in the information processing system according to the first embodiment of the present invention. [Figure 4] 3A and 3B are diagrams showing an example of a moving image displayed on a display panel by a display unit according to the first embodiment of the present invention. [Figure 5] FIG. 10 is a block diagram showing an example of the configuration of a terminal device, an input device, and an information processing device included in an information processing system according to a second embodiment of the present invention. [Figure 6] FIG. 1 is a schematic diagram illustrating an overview of an information processing system 100 according to a second embodiment of the present invention. [Figure 7] FIG. 10 is a sequence diagram showing a processing flow in an information processing system according to a second embodiment of the present invention. [Figure 8] 10 is a table showing an example of data stored in a storage unit by a storage unit according to the first modification of the present invention. [Figure 9] 10A and 10B are diagrams showing an example of a moving image displayed on a display panel by a display unit according to Modification 1 of the present invention. [Figure 10] 10A and 10B are diagrams showing another example of a moving image displayed on a display panel by a display unit according to the first modification of the present invention. [Figure 11] 10 is a table showing an example of data stored in a storage unit by a storage unit according to Modification 2 of the present invention. [Figure 12] FIG. 1 is a block diagram illustrating the physical configuration of a terminal device, an input device, and a computer used as an information processing device according to each embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0009] [Embodiment 1] An information processing system 100 according to an embodiment of the present invention will be described below.

[0010] (Configuration of information processing system 100) FIG. 1 is a block diagram showing an example of the configuration of a terminal device 1 and an information processing device 3 included in an information processing system 100 according to this embodiment.

[0011] 1, a terminal device 1 and an information processing device 3 are connected to each other so as to be able to communicate with each other via a network N. Examples of the terminal device 1 include a smartphone, a PC (Personal Computer), and a tablet. Examples of the information processing device 3 include a server.

[0012] The specific configuration of the network N does not limit this embodiment, but as an example, a wireless LAN (Local Area Network), a wired LAN, a WAN (Wide Area Network), a public line network, a mobile data communication network, or a combination of these networks can be used.

[0013] In the information processing system 100, the information processing device 3 acquires information about the physical condition of the subject from the terminal device 1, refers to the information, and selects a video that includes another subject whose physical condition is similar to that of the subject as a subject, and that shows the other subject after the other subject has completed treatment.The information processing device 3 then outputs the selected video to the terminal device 1.The terminal device 1 displays the video output from the information processing device 3.

[0014] In the following, the subject will also be referred to as "subject A," and the other subject will also be referred to as "subject B." Furthermore, "subject B" may be a subject different from "subject A," and any subject among multiple subjects different from "subject A" will be referred to as "subject B." In other words, in the following, multiple "subjects B" may be the same person or different people. In the following, when referring to both "subject A" and "subject B," they will simply be referred to as "subjects."

[0015] Here, examples of subject A include patients who are about to start treatment for an injury or disability, patients currently being treated for an injury or disability, and trainees who exercise. Examples of subject B include patients currently being treated for an injury or disability or patients who have fully recovered, and trainees who exercise. Furthermore, examples of users of the terminal device 1 include therapists who care for patients currently being treated for an injury or disability and trainers who instruct trainees who exercise. However, these do not limit the present embodiment.

[0016] Examples of information regarding the subject's physical condition include, but are not limited to, the following: Information showing symptoms in areas where the subject feels that their function is declining -Video images of the subject's movements Information indicating the treatment to be given to the subject to correct the functional impairment of the subject's body - Doctor's diagnosis of the subject Information indicating the exercise the subject is performing Examples of information indicating symptoms in a part of the body where the subject feels that function has deteriorated include pain in the knee and inability to lift the shoulder. Examples of video images of the subject's movements include video images of the subject walking, raising their arms, standing up, etc. Examples of treatments given to the subject include procedures (such as surgery) given to the subject, medications prescribed to the subject, and rehabilitation training programs the subject is undergoing. Examples of doctor's diagnosis of the subject include the name of the disease the subject is suffering from, the location and name of the injury the subject has sustained, and the time until full recovery. Examples of exercises the subject is performing include squats and bench presses. These do not limit the present embodiment.

[0017] (Configuration of terminal device 1) As shown in FIG. 1, the terminal device 1 includes a communication unit 10, a display panel 11, an imaging unit 12, and a control unit 15.

[0018] The communication unit 10 is a communication module for performing communication via the network N. The communication unit 10 supplies data acquired from the information processing device 3 via the network N to the control unit 15, and outputs data acquired from the control unit 15 to the information processing device 3 via the network N.

[0019] The display panel 11 is a display that displays data supplied from the control unit 15, which will be described later.

[0020] The imaging unit 12 is a camera capable of capturing moving images. As an example, the imaging unit 12 is directed toward the subject A by the user of the terminal device 1 so that the angle of view of the imaging unit 12 includes the subject A. The imaging unit 12 then captures moving images including the subject A performing a predetermined action (for example, walking, raising an arm, standing up, etc.) as a subject, and generates imaging data representing the moving images. The imaging unit 12 supplies the imaging data obtained by capturing the images to the control unit 15.

[0021] (Control unit 15) The control unit 15 controls each component of the terminal device 1. For example, the control unit 15 acquires imaging data indicating moving images captured by the imaging unit 12 and supplies data to be displayed on the display panel 11.

[0022] As shown in FIG. 1, the control unit 15 also functions as an information acquisition unit 16 (terminal device acquisition unit), a display unit 17, and an output unit 18 (terminal device output unit).

[0023] The information acquisition unit 16 acquires data output from the information processing device 3 and imaging data supplied from the imaging unit 12. As an example, the information acquisition unit 16 acquires from the imaging unit 12 the moving image output from the information processing device 3 and imaging data indicating the moving image including the subject A as a subject.

[0024] The display unit 17 supplies data to the display panel 11 and displays an image on the display panel 11. Examples of images that the display unit 17 displays on the display panel 11 include a moving image output from the information processing device 3 and a moving image showing the imaging data supplied from the imaging unit 12. The display unit 17 may also display a moving image including the subject A and a moving image output from the information processing device 3 on the display panel 11 so that they can be compared. Examples of images in which the display unit 17 displays a moving image including the subject A and a moving image output from the information processing device 3 on the display panel 11 so that they can be compared will be described later with reference to different drawings.

[0025] The output unit 18 outputs data to the information processing device 3 via the communication unit 10. As an example, the output unit 18 outputs a moving image captured by the imaging unit 12, which is information relating to the physical condition of the subject A.

[0026] (Configuration of information processing device 3) As shown in FIG. 1, the information processing device 3 includes a communication unit 30, a storage unit 34, and a control unit 35.

[0027] The communication unit 30 is a communication module for performing communication via the network N. The communication unit 30 supplies data acquired from the terminal device 1 via the network N to the control unit 35, and outputs data acquired from the control unit 35 to the terminal device 1 via the network N.

[0028] The storage unit 34 stores various types of data referenced by the control unit 35, which will be described later. More specifically, the storage unit 34 stores information relating to the physical condition of the subject B and imaging data showing moving images acquired from the terminal device 1, in association with each other. Examples of data stored in the storage unit 34 will be described later with reference to different drawings.

[0029] (Control unit 35) The control unit 35 controls each component of the information processing device 3. For example, the control unit 35 acquires data from the terminal device 1 via the communication unit 30 and outputs data to the terminal device 1 via the communication unit 30.

[0030] As shown in FIG. 1, the control unit 35 also functions as an information acquisition unit 36 ​​(information processing device acquisition unit), an output unit 38 (information processing device output unit), a selection unit 39, an extraction unit 40, and a storage unit 41.

[0031] The information acquisition unit 36 ​​acquires data from the terminal device 1 via the communication unit 30. An example of the data acquired by the information acquisition unit 36 ​​is a moving image including the subject A as a subject.

[0032] The output unit 38 outputs data to the terminal device 1 via the communication unit 30. As an example, the output unit 38 outputs to the terminal device 1 a video selected by a selection unit 39, which will be described later.

[0033] The selection unit 39 refers to the moving images including subject A as a subject, acquired by the information acquisition unit 36, and selects a moving image including subject B whose physical condition is similar to that of subject A, the moving image being taken after subject B has finished treatment. The selection unit 39 also acquires imaging data indicating the selected moving image from the storage unit 34. Details of the processing performed by the selection unit 39 will be described later.

[0034] Examples of the method by which the selection unit 39 distinguishes between the moving image after the subject B has finished treatment and other moving images include the following, but these do not limit the present embodiment. Tag information indicating the treatment stage is attached to the video, and by referencing the tag information, video images whose tag information indicates "after treatment" are determined to be "video images after treatment is completed." Tag information indicating the subject and the date and time of shooting is attached to the video, and by referring to the tag information, a video acquired after a predetermined period (e.g., two months) has elapsed since the first acquisition of a video of the subject indicated by the tag information is determined to be a "video after treatment has been completed." -Analyze the audio contained in the video from the start to a specified time (for example, 10 seconds), and determine that the video is "video after treatment" if the analyzed audio contains words indicating that the treatment has been completed (for example, "after treatment," "complete recovery," etc.). - Performs image analysis of objects contained in video images, and determines that video images containing objects indicating that treatment has been completed (such as a piece of paper with the words "After treatment" or "Complete recovery") are "video images taken after treatment has been completed." Here, the "treatment stage" refers to a stage in which treatment is divided until a diagnosis of complete recovery is made, and may be, for example, a stage set according to the content of treatment, a stage set according to the duration of treatment, or a stage set according to the physical condition. In the following example, the treatment stages are divided into five stages: pre-treatment, treatment stages 1 to 3, and post-treatment, but are not limited to this.

[0035] An example of a case where the "treatment stage" is set according to the content of the treatment is a configuration in which, in a treatment where a complete cure is diagnosed after n injections, the stage before injection is set as "pre-treatment," the stage after n / 4 injections is set as "treatment stage 1," the stage after n / 2 injections is set as "treatment stage 2," the stage after 3n / 4 injections is set as "treatment stage 3," and the stage after n injections is set as "post-treatment."

[0036] An example of a case where the "treatment stage" is set according to the duration of treatment is a configuration in which, for an injury that takes m months to heal, the time before treatment is set as "pre-treatment," the time after m / 4 months has passed is set as "treatment stage 1," the time after m / 2 months has passed is set as "treatment stage 2," the time after 3m / 4 months has passed is set as "treatment stage 3," and the time after 4 months has passed is set as "post-treatment."

[0037] An example of a case in which the "treatment stage" is set according to the physical condition is a treatment in which a complete recovery is diagnosed when the range of motion of a joint reaches k degrees, where the stage before treatment is set as "pre-treatment," the stage at which the range of motion reaches k / 4 degrees is set as "treatment stage 1," the stage at which the range of motion reaches k / 2 degrees is set as "treatment stage 2," the stage at which the range of motion reaches 3k / 4 degrees is set as "treatment stage 3," and the stage at which the range of motion reaches k degrees is set as "post-treatment."

[0038] The extraction unit 40 applies a skeleton extraction process to the moving image indicated by the imaging data acquired by the information acquisition unit 36, and extracts the skeleton of the subject A included in the moving image. The extraction unit 40 outputs an extraction result indicating the result of skeleton extraction to the selection unit 39.

[0039] The accumulation unit 41 accumulates data in the memory unit 34. More specifically, the accumulation unit 41 accumulates information relating to the physical condition of the subject B and imaging data showing video images of the movements of the subject B after treatment in association with each other in the memory unit 34. Details of the data accumulated in the memory unit 34 by the accumulation unit 41 will be described with reference to FIG. 2. FIG. 2 is a table T1 showing an example of data accumulated in the memory unit 34 by the accumulation unit 41 according to this embodiment.

[0040] As shown in Table T1, the accumulation unit 41 associates previously acquired information about the physical condition of subject B with imaging data showing video images of subject B's movements after treatment, and stores the associated information in the storage unit 34. In Table T1, the information about subject B's physical condition, "Knee pain," is associated with imaging data "Imaging Data A," showing video images of subject B's movements after treatment. In other words, "Imaging Data A" is imaging data showing video images of subject B, a patient with the symptom "Knee pain," performing a movement after treatment. Similarly, in Table T1, the information about the physical condition of each of the multiple subjects B, "Slow walking speed," "Knee joint replaced with an artificial joint," "Prescribed drug X," and "Arm lifting movement differs between the left and right arms," ​​is associated with imaging data "Imaging Data B," "Imaging Data C," "Imaging Data D," and "Imaging Data E," showing video images of each subject B's movements after treatment.

[0041] Here, it is preferable that the movements of subject B included in the moving image represented by the imaging data stored in the storage unit 34 are movements related to information related to the physical condition of subject B associated with the imaging data. More specifically, it is preferable that the movements of subject B included in the moving image are movements using the body parts indicated by the information related to the physical condition of subject B.

[0042] As an example, if the information regarding subject B's physical condition is "my knee hurts," it is preferable that the movement of subject B included in the moving image shown by the associated imaging data is an movement using the "knee" body part indicated by the information regarding subject B's physical condition (e.g., walking, standing up, etc.).

[0043] As another example, if the information regarding the physical condition of subject B is "prescribed drug X," it is preferable that the movements of subject B included in the video images shown by the associated imaging data are movements using a part of the body whose function is improved by "drug X." For example, if "drug X" is a drug that improves the function of the "shoulder," it is preferable that the movements of subject B included in the video images shown by the imaging data are movements using the "shoulder" (e.g., raising the arm).

[0044] (Processing example 1 executed by the selection unit 39) The process executed by the selection unit 39 will now be described.

[0045] The selection unit 39 refers to the indices derived from the moving images indicated by the imaging data acquired by the information acquisition unit 36, and selects a moving image that includes subject B, whose physical condition is similar to that of subject A, as a subject, after subject B has completed treatment.

[0046] As an example, the selection unit 39 derives the walking speed of subject A from the video as an index, and, with reference to the walking speed, selects a video of subject B, whose physical condition is similar to that of subject A, as a subject, after subject B has completed treatment. For example, if the walking speed of subject A derived from the video is slower than a predetermined speed, the selection unit 39 selects, from the imaging data stored in the storage unit 34, imaging data whose information on the physical condition is associated with "slow walking speed."

[0047] Taking table T1 shown in FIG. 2 as an example, the selection unit 39 selects "imaging data B," imaging data whose information on the physical condition is associated with "slow walking speed." That is, the selection unit 39 selects "imaging data B," which includes, as a subject, subject B whose physical condition is similar to subject A's physical condition of "slow walking speed." The selection unit 39 supplies the moving image indicated by the selected imaging data to the output unit 38, and the output unit 38 outputs the acquired moving image to the terminal device 1 via the communication unit 30.

[0048] Here, examples of indicators related to the subject's behavior are as follows: Speed ​​of movement (an indicator of the speed of movement) - Rhythm of movement (an indicator of whether the movement is performed at the same rhythm each time) Body unsteadiness during movement (an index showing the fluctuation of the center of gravity in the left-right direction during movement) Laterality of movement (an index showing the symmetry of movement) Range of motion (an indicator of the range of movement of each part of the body during movement) These include, but are not limited to:

[0049] The selection unit 39 may also be configured to refer to information other than the indices derived from the moving images. In other words, the selection unit 39 may be configured to refer to the moving images and information other than the moving images, that is, information related to the physical condition of the subject A. For example, when the selection unit 39 derives the walking speed of subject A from the moving image as an index and the information acquisition unit 36 ​​acquires information indicating the symptom of subject A, "knee pain," the selection unit 39 selects imaging data in which the associated information on the physical condition is "knee pain" and "slow walking speed" from among the imaging data stored in the storage unit 33. The configuration when the information acquisition unit 36 ​​acquires information other than moving images will be described in detail in the embodiment described later.

[0050] (Processing example 2 executed by the selection unit 39) As another example, the extraction unit 40 may extract the skeleton of subject A included in the video, and the selection unit 39 may refer to indices derived from the skeleton extracted by the extraction unit 40 and select a video including subject B, whose physical condition is similar to that of subject A, as a subject.

[0051] As an example, if subject A included in a video acquired by the information acquisition unit 36 ​​is raising his / her arms, the extraction unit 40 extracts the arms of subject A. Next, the selection unit 39 refers to the arms extracted by the extraction unit 40 and derives an index based on the time difference until the left and right arms are raised to the top. Then, the selection unit 39 refers to the derived index and selects a video including subject B, whose physical condition is similar to that of subject A, as a subject.

[0052] For example, if the time difference between the left and right arms until they reach the top is greater than a predetermined value, the selection unit 39 selects, from the imaging data stored in the memory unit 34, imaging data associated with information on the body condition that indicates "there is a difference between the left and right arms in the arm-raising movement."

[0053] Taking table T1 shown in FIG. 2 as an example, the selection unit 39 selects "imaging data E," imaging data associated with information on the physical condition "there is a difference between the left and right sides in the movement of raising the arms." That is, the selection unit 39 selects "imaging data E," which includes, as a subject, subject B, whose physical condition is similar to that of subject A, "there is a difference between the left and right sides in the movement of raising the arms." The selection unit 39 supplies the moving image indicated by the selected imaging data to the output unit 38.

[0054] (Processing in information processing system 100) The processing in the information processing system 100 will be described with reference to Fig. 3. Fig. 3 is a sequence diagram showing the flow of processing in the information processing system 100 according to this embodiment.

[0055] (Step S12) In step S12, the information acquisition unit 16 of the terminal device 1 acquires, via the imaging unit 12, a moving image including subject A as a subject, as information relating to the subject's physical condition.

[0056] (Step S13) In step S13, the output unit 18 outputs the moving image acquired by the information acquisition unit 16 in step S12 to the information processing device 3 via the communication unit 10.

[0057] (Step S14) In step S14, the information acquisition unit 36 ​​of the information processing device 3 acquires, via the communication unit 30, the video output from the terminal device 1 in step S13.

[0058] (Step S15) In step S15, the extraction unit 40 extracts the skeleton of the subject A included in the moving image acquired by the information acquisition unit 36 ​​in step S14. Note that if there is no need to extract the skeleton of the subject A included in the moving image, the process of step S15 does not need to be executed, and in that case, step S16 may be executed after step S14 is completed.

[0059] (Step S16) In step S16, the selection unit 39 refers to the video that is information about the physical condition of subject A, and selects a video that includes, as a subject, subject B whose physical condition is similar to that of subject A. If the extraction unit 40 has extracted the skeleton of subject A included in the video in step S15, the selection unit 39 refers to the extraction result that indicates the skeleton of subject A extracted by the extraction unit 40, and selects a video indicated by the imaging data that includes, as a subject, subject B whose physical condition is similar to that of subject A. The detailed processing by the selection unit 39 has been described above, and therefore will not be described here.

[0060] (Step S17) In step S17, the output unit 38 outputs the moving image represented by the imaging data selected by the selection unit 39 in step S16 to the terminal device 1 via the communication unit 30.

[0061] (Step S18) In step S18, the information acquisition unit 16 of the terminal device 1 acquires, via the communication unit 10, the video output from the information processing device 3 in step S17.

[0062] (Step S19) In step S19, the display unit 17 displays on the display panel 11 the moving image acquired by the information acquisition unit 16 in step S18.

[0063] (Example of moving image displayed on the display unit 17) An example of a moving image displayed on the display panel 11 by the display unit 17 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of a moving image displayed on the display panel 11 by the display unit 17 according to this embodiment.

[0064] As shown in Fig. 4, the display unit 17 displays a moving image MI2 including, as a subject, a subject TP2 who is subject B and whose physical condition is similar to that of subject A. As shown in Fig. 4, the display unit 17 may display, in a comparable manner, a moving image MI1 including, as a subject, subject TP1 who is subject A, and a moving image MI2 including, as a subject, subject TP2 who is subject B, both acquired by the information acquisition unit 16. Furthermore, the display unit 17 may perform processing such as pixelating or blurring the face of subject TP2 who is subject B so that it is not possible to identify him or her.

[0065] Thus, in the information processing system 100, the information processing device 3 includes an information acquisition unit 36 ​​that acquires information about the physical condition of subject A and a moving image including subject A as a subject, a selection unit 39 that refers to the moving image and selects a moving image of subject B, whose physical condition is similar to that of subject A, after subject B has completed treatment, and an output unit 38 that outputs the moving image selected by the selection unit 39.

[0066] Therefore, the information processing device 3 can present to the subject A a moving image of the subject B, whose physical condition is similar to that of the subject A, after the subject B has completed treatment. Therefore, when the subject A undergoes treatment to improve physical function, such as rehabilitation, the information processing device 3 can present to the subject A the extent to which the physical function of the subject B, who has a similar physical condition, has improved after the rehabilitation, thereby maintaining the motivation of the subject A.

[0067] [Embodiment 2] An information processing system 100A according to one embodiment of the present invention will be described below.

[0068] (Overview of information processing system 100A) First, an overview of the information processing system 100A will be described with reference to Fig. 6. Fig. 6 is a schematic diagram showing an overview of the information processing system 100A according to this embodiment. As shown in Fig. 2, the information processing system 100A includes a terminal device 1, an input device 2, and an information processing device 3A.

[0069] 6, a terminal device 1, an input device 2, and an information processing device 3A are connected to each other so as to be able to communicate with each other via a network N. Examples of the terminal device 1 and the input device 2 include a smartphone, a PC, and a tablet. An example of the information processing device 3A is a server.

[0070] In the information processing system 100A, the information processing device 3A acquires, from the terminal device 1, a moving image as an example of information relating to the physical condition of the subject A, and acquires, from the input device 2, information relating to the physical condition of the subject A other than the moving image.

[0071] In addition, in the information processing system 100A, the information processing device 3A refers to at least one of the acquired moving images and information other than the moving images regarding the physical condition of the subject, and selects a moving image that includes subject B, whose physical condition is similar to that of subject A, as a subject, after subject B has completed treatment.

[0072] Then, the information processing device 3A outputs the selected video to the terminal device 1. The terminal device 1 displays the acquired video. Here, the configuration in which the information processing device 3A acquires the video from the terminal device 1 has been explained in the above embodiment, and therefore, explanation thereof will be omitted as appropriate in this embodiment.

[0073] Here, examples of users of the input device 2 include a doctor examining a patient who is about to start treatment for an injury or disability or a patient currently being treated for an injury or disability, and a trainer who instructs a trainee who is exercising. As in the first embodiment, examples of subject A include a patient who is about to start treatment for an injury or disability, a patient currently being treated for an injury or disability, and a trainee who is exercising, and examples of subject B include a patient currently being treated for an injury or disability or a patient who has completely recovered, and a trainee who is exercising. Furthermore, examples of users of the terminal device 1 include a therapist who cares for a patient currently being treated for an injury or disability, and a trainer who instructs a trainee who is exercising. However, these do not limit this embodiment.

[0074] (Terminal device 1) Next, a configuration example of the terminal device 1 according to this embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing a configuration example of the terminal device 1, the input device 2, and the information processing device 3A included in the information processing system 100A according to this embodiment.

[0075] As shown in Fig. 5, the terminal device 1 has the same main configuration as the terminal device 1 in the above-described first embodiment. That is, in the present embodiment as well, the information acquisition unit 16 of the terminal device 1 acquires a moving image including the subject A as a subject and a moving image output from the information processing device 3A. The output unit 18 outputs the moving image including the subject A as a subject acquired by the information acquisition unit 16 to the information processing device 3A. The display unit 17 displays the moving image including the subject A as a subject and the moving image acquired from the information processing device 3A on the display panel 11. The specific processing by the terminal device 1 is the same as in the first embodiment, and therefore will not be described here.

[0076] (Input device 2) As shown in FIG. 5, the input device 2 includes a communication unit 20, a display panel 21, an operation reception unit 23, and a control unit 25.

[0077] The communication unit 20 is a communication module for performing communication via the network N. The communication unit 20 supplies data acquired from the information processing device 3A via the network N to the control unit 25, and outputs data acquired from the control unit 25 to the information processing device 3A via the network N.

[0078] The display panel 21 is a display that displays data supplied from the control unit 25, which will be described later.

[0079] The operation accepting unit 23 is a user interface that accepts input from a user. As an example, the operation accepting unit 23 accepts input of information regarding the physical condition of the subject A, such as a diagnosis result of the subject by a doctor, information indicating the symptoms of the subject A, and details of treatment to be performed on the subject A. The operation accepting unit 23 supplies the input information to the control unit 25.

[0080] (Control unit 25) The control unit 25 controls each component of the input device 2. For example, the control unit 25 acquires information about the physical condition of the subject A accepted by the operation acceptance unit 23, and supplies data to be displayed on the display panel 21.

[0081] As shown in FIG. 5, the control unit 25 also functions as an information acquisition unit 26 (input device acquisition unit), a display unit 27, and an output unit 28 (input device output unit).

[0082] The information acquisition unit 26 acquires data acquired from the information processing device 3A via the communication unit 20 and information relating to the physical condition of the subject A supplied from the operation acceptance unit 23.

[0083] The display unit 27 supplies data to the display panel 21 and displays an image on the display panel 21. An example of an image that the display unit 27 displays on the display panel 21 is an image corresponding to an input received by the operation receiving unit 23.

[0084] Furthermore, when the above-described information acquisition unit 26 acquires a moving image from the information processing device 3A, the display unit 27 displays the moving image acquired by the information acquisition unit 26 on the display panel 21. Furthermore, when the information acquisition unit 26 acquires a moving image including the target person as a subject and a moving image output from the information processing device 3A, the display unit 27 may, like the above-described display unit 17, display the moving image including the target person as a subject and the moving image output from the information processing device 3A on the display panel 21 so that they can be compared.

[0085] The output unit 28 outputs data to the information processing device 3A via the communication unit 20. As an example, the output unit 28 outputs information regarding the physical condition of the subject A acquired by the information acquisition unit 26 to the information processing device 3A via the communication unit 20.

[0086] (Information processing device 3A) 5, the information processing device 3A includes a communication unit 30, a storage unit 34, and a control unit 35A. The communication unit 30 and the storage unit 34 are as described above.

[0087] (Control unit 35A) The control unit 35A controls the components of the information processing device 3A. As shown in Fig. 5, the control unit 35A also functions as an information acquisition unit 36A, an output unit 38, a selection unit 39A, an extraction unit 40, and a storage unit 41. The output unit 38, the extraction unit 40, and the storage unit 41 are as described above.

[0088] In addition to the functions of the information acquisition unit 36 ​​described above, the information acquisition unit 36A acquires information relating to the physical condition of the subject A output from the input device 2 via the communication unit 30.

[0089] In addition to the functions of the selection unit 39 described above, the selection unit 39A refers to information regarding the physical condition of the subject A acquired by the information acquisition unit 36A, and selects a video image that includes subject B, whose physical condition is similar to that of subject A, as a subject, after subject B has completed treatment.

[0090] (Processing example 1 executed by the selection unit 39A) The process executed by the selection unit 39A will be described.

[0091] As an example, if the information regarding the physical condition of subject A acquired by information acquisition unit 36A indicates "my knee hurts," which is information indicating symptoms in an area where subject A himself feels that function is declining, selection unit 39A selects, from the imaging data stored in memory unit 34, imaging data whose information regarding the physical condition is associated with "my knee hurts."

[0092] Taking table T1 shown in FIG. 2 as an example, the selection unit 39A selects "imaging data A," imaging data in which information related to the physical condition is associated with "my knee hurts." That is, the selection unit 39A selects "imaging data A," which includes subject B, whose physical condition is similar to that of subject A, "my knee hurts," as a subject, and which is imaging data A taken after subject B has finished treatment. The selection unit 39A outputs a moving image indicated by the selected imaging data to the output unit 38.

[0093] (Processing example 2 executed by the selection unit 39A) As another example, if the information regarding the physical condition of subject A acquired by information acquisition unit 36A is information indicating that "the subject's knee joint has been replaced with an artificial joint," which indicates the treatment to be performed on subject A to cure a part of the subject A's body that has weakened function, selection unit 39A selects, from the imaging data stored in memory unit 34, imaging data whose information regarding the physical condition is associated with "the subject's knee joint has been replaced with an artificial joint."

[0094] Taking table T1 shown in FIG. 2 as an example, the selection unit 39A selects "imaging data C," imaging data associated with information on the physical condition that "the subject's knee joint has been replaced with an artificial joint." In other words, the selection unit 39A selects "imaging data C," which includes subject B, whose physical condition is similar to that of subject A, "the knee joint has been replaced with an artificial joint." The selection unit 39A outputs a moving image indicated by the selected imaging data to the output unit 38.

[0095] (Processing Example 3 Executed by Selector 39A) As yet another example, if the information regarding the physical condition of subject A acquired by information acquisition unit 36A is information indicating that "subject A has been prescribed medicine X," which indicates the treatment to be performed on subject A to cure a part of the subject A's body that has weakened function, selection unit 39A selects, from the imaging data stored in memory unit 34, imaging data whose information regarding the physical condition is associated with "medicine X has been prescribed."

[0096] Taking table T1 shown in FIG. 2 as an example, the selection unit 39A selects "imaging data D," imaging data associated with information on the physical condition "prescribed drug X." That is, the selection unit 39A selects "imaging data D," which includes subject B, whose physical condition is similar to that of subject A, "prescribed drug X," as a subject, and which is taken after subject B has finished treatment. The selection unit 39A outputs a moving image indicated by the selected imaging data to the output unit 38.

[0097] (Processing in information processing system 100A) The processing in the information processing system 100A will be described with reference to Fig. 7. Fig. 7 is a sequence diagram showing the flow of processing in the information processing system 100A according to this embodiment.

[0098] (Step S31) In step S31, the information acquisition unit 26 of the input device 2 acquires information about the physical condition of the subject A via the operation acceptance unit 23.

[0099] (Step S32) In step S32, the output unit 28 outputs the information on the physical condition of the subject A acquired by the information acquisition unit 26 in step S31 to the information processing device 3A via the communication unit 20.

[0100] (Step S33) In step S33, the information acquisition unit 36A of the information processing device 3A acquires, via the communication unit 30, the information on the physical condition of the subject A output from the input device 2 in step S32.

[0101] (Step S34) In step S34, the selection unit 39A refers to the information related to the physical condition of the subject A acquired by the information acquisition unit 36A in step S33, selects imaging data that includes, as a subject, subject B whose physical condition is similar to that of subject A, after subject B has finished treatment, and acquires the imaging data from the storage unit 34. The detailed processing by the selection unit 39A has been described above, and therefore will not be described here.

[0102] (Steps S17 to S19) Steps S17 to S19, in which the output unit 38 outputs the moving image selected by the selection unit 39A to the terminal device 1 and the display unit 17 of the terminal device 1 displays the moving image on the display panel 11, are the same as the processes described above, and therefore will not be described again.

[0103] Here, in step S17, the output unit 38 may be configured to output the moving image selected by the selection unit 39A to the input device 2 instead of or together with the terminal device 1. In this case, the information acquisition unit 26 of the input device 2 acquires the moving image output from the information processing device 3A. Then, the display unit 27 displays the moving image acquired by the information acquisition unit 26 on the display panel 21.

[0104] Thus, in the information processing system 100A, the information processing device 3A is equipped with an information acquisition unit 36A that acquires information other than moving images, such as information regarding the physical condition of subject A, from the input device 2, a selection unit 39A that refers to the information regarding the physical condition of subject A and selects a moving image of subject B after subject B has completed treatment, the moving image including subject B whose physical condition is similar to that of subject A as a subject, and an output unit 38 that outputs the moving image selected by the selection unit 39A.

[0105] Therefore, similar to the above-described embodiment, the information processing device 3A can present to the subject A a moving image of the subject B after the subject B has completed treatment, the moving image including the subject B, whose physical condition is similar to that of the subject A, as a subject. Therefore, when the subject A undergoes treatment to improve physical function, such as rehabilitation, the information processing device 3A can present to the subject A the extent to which the physical function of the subject B, who has a similar physical condition, has improved after the rehabilitation, thereby maintaining the motivation of the subject A.

[0106] [Variations] Modifications of the present invention will be described below. In the following modifications, the information processing device 3, the information acquisition unit 36, and the selection unit 39 can be read as the information processing device 3A, the information acquisition unit 36A, and the selection unit 39A, respectively.

[0107] (Variation 1) The information processing device 3 may be configured to acquire, in advance, as imaging data to be stored in the storage unit 34, pre-treatment imaging data showing moving images including the subject B as a subject before treatment, in addition to post-treatment imaging data showing moving images after the subject B has finished treatment. In this case, the storage unit 41 associates the pre-treatment imaging data and the post-treatment imaging data with information on the physical condition of the subject B and stores them in the storage unit 34. Details of the data stored in the storage unit 34 in this configuration will be described with reference to FIG. 8. FIG. 8 is a table T2 showing an example of data stored in the storage unit 34 by the storage unit 41 according to this modification.

[0108] In Table T2, "Knee pain," which is information about the physical condition of subject B, is associated with "imaging data A1," which is imaging data before treatment, and "imaging data A2," which is imaging data after treatment. Similarly, in Table T2, information about the physical condition of subject B other than "knee pain," is associated with each of the information about the physical condition of each subject B, and the imaging data before treatment and the imaging data after treatment.

[0109] One example of a method by which the information processing device 3 identifies the pre-treatment imaging data and the post-treatment imaging data is to attach tag information indicating the treatment stage to the imaging data. In this method, the accumulation unit 41 associates information about the physical condition, the imaging data attached with tag information indicating the treatment stage, and the tag information, and stores the associated information in the storage unit 34. With this configuration, the information processing device 3 can identify the pre-treatment imaging data and the post-treatment imaging data by referring to the associated tag information.

[0110] In this modification, the selection unit 39 selects the pre-treatment imaging data and the post-treatment imaging data as imaging data showing a moving image including, as a subject, subject B whose physical condition is similar to that of subject A. For example, if the information on the physical condition of subject A acquired by the information acquisition unit 36 ​​indicates "my knee hurts," the selection unit 39 selects the pre-treatment imaging data "imaging data A1" and the post-treatment imaging data "imaging data A2," which are associated in table T2 with the information on the physical condition "my knee hurts." The moving image shown by the imaging data selected by the selection unit 39 is transmitted to the terminal device 1 and displayed on the display panel 11 by the display unit 17 of the terminal device 1, as described above.

[0111] That is, the selection unit 39 includes as a subject a subject B whose physical condition is similar to that of subject A, "my knee hurts," and selects imaging data of the subject before treatment, "imaging data A1," and imaging data of the subject after treatment, "imaging data A2."

[0112] (Example 1 of moving image displayed by display unit 17 in this modification) An example of a moving image displayed on the display panel 11 by the display unit 17 will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of a moving image displayed on the display panel 11 by the display unit 17 according to this modification.

[0113] 9, the display unit 17 displays a moving image MI3 shown by imaging data after treatment, which includes as a subject a subject TP3 who is subject B and whose physical condition is similar to that of subject A. As shown in FIG. 9, the display unit 17 may display a moving image MI1 which includes as a subject a subject TP1 who is subject A, and a moving image MI3 which includes as a subject a subject TP3 who is subject B and whose physical condition is similar to that of subject A and whose imaging data is shown by imaging data after treatment, in a manner that allows comparison.

[0114] (Example 2 of moving image displayed by display unit 17 in this modification) Another example of a moving image displayed on the display panel 11 by the display unit 17 will be described with reference to Fig. 10. Fig. 10 is a diagram showing another example of a moving image displayed on the display panel 11 by the display unit 17 according to this modification.

[0115] 10, the display unit 17 displays a moving image MI4 shown by imaging data before treatment, including as a subject a subject TP4 who is subject B and whose physical condition is similar to that of subject A. As shown in Fig. 10, the display unit 17 may display a moving image MI1 shown by imaging data before treatment, including as a subject a subject TP1 who is subject A, and a moving image MI3 shown by imaging data before treatment, including as a subject a subject TP4 who is subject B and whose physical condition is similar to that of subject A, so that they can be compared.

[0116] In this way, the information processing device 3 according to this modification includes, as a subject, subject B whose physical condition is similar to that of subject A, and selects a moving image MI3 represented by the imaging data after treatment and a moving image MI4 represented by the imaging data before treatment. Therefore, by selecting the moving image MI3 represented by the imaging data after treatment and then the moving image MI4 represented by the imaging data before treatment, the information processing device 3 can present to the subject how much the physical condition of the other subject has improved as a result of the treatment, thereby maintaining the motivation of subject A.

[0117] Furthermore, the information acquisition unit 36 ​​of the information processing device 3 may acquire, as information regarding the physical condition of subject A, moving images of the movements of subject A before treatment, and may further acquire, after the treatment, moving images of the movements of subject A after treatment. In other words, the information acquisition unit 36 ​​may acquire moving images including subject A as a subject before and after the treatment administered to subject A. With this configuration, the moving images of subject A before and after treatment acquired by the information acquisition unit 36 ​​are associated with information regarding the physical condition by the accumulation unit 41 and stored in the storage unit 34 as moving images of subject B before and after treatment. Therefore, the information processing device 3 can increase the amount of imaging data stored in the storage unit 34.

[0118] (Variation 2) The information acquisition unit 36 ​​may be configured to acquire imaging data before and after each of a plurality of treatments in advance as imaging data to be stored in the storage unit 34. In this case, the storage unit 41 associates the imaging data at each treatment stage with information on the physical condition of the subject B and stores the data in the storage unit 34. Details of the data stored in the storage unit 34 in this configuration will be described with reference to Fig. 11. Fig. 11 is a table T3 showing an example of data stored in the storage unit 34 by the storage unit 41 according to this modification.

[0119] In Table T3, "My knee hurts," which is information about the physical condition of subject B, is associated with "imaging data A1," which is imaging data before treatment, "imaging data A1-1," which is imaging data at treatment stage 1, "imaging data A1-2," which is imaging data at treatment stage 2, "imaging data A1-3," which is imaging data at treatment stage 3, and "imaging data B2," which is imaging data after treatment. Similarly, in Table T3, information about the physical condition of subject B other than "my knee hurts" is associated with the imaging data at each treatment stage.

[0120] One example of a method by which the information processing device 3 identifies which treatment stage the imaging data belongs to is to attach tag information indicating the treatment stage to the imaging data. In this method, the accumulation unit 41 associates information about the physical condition, the imaging data attached with tag information indicating the treatment stage, and the tag information and stores them in the storage unit 34. With this configuration, the information processing device 3 can identify which treatment stage the imaging data belongs to by referring to the associated tag information.

[0121] Here, the "treatment stage" refers to a stage in which treatment is divided until a diagnosis of complete recovery is made, and may be, for example, a stage set according to the content of treatment, a stage set according to the duration of treatment, or a stage set according to the physical condition. In this modification, the treatment stages are divided into five stages: pre-treatment, treatment stages 1 to 3, and post-treatment, but are not limited to this.

[0122] An example of a case where the "treatment stage" is set according to the content of the treatment is a configuration in which, in a treatment where a complete cure is diagnosed after n injections, the stage before injection is set as "pre-treatment," the stage after n / 4 injections is set as "treatment stage 1," the stage after n / 2 injections is set as "treatment stage 2," the stage after 3n / 4 injections is set as "treatment stage 3," and the stage after n injections is set as "post-treatment."

[0123] An example of a case where the "treatment stage" is set according to the duration of treatment is a configuration in which, for an injury that takes m months to heal, the time before treatment is set as "pre-treatment," the time after m / 4 months has passed is set as "treatment stage 1," the time after m / 2 months has passed is set as "treatment stage 2," the time after 3m / 4 months has passed is set as "treatment stage 3," and the time after 4 months has passed is set as "post-treatment."

[0124] An example of a case in which the "treatment stage" is set according to the physical condition is a treatment in which a complete recovery is diagnosed when the range of motion of a joint reaches k degrees, where the stage before treatment is set as "pre-treatment," the stage at which the range of motion reaches k / 4 degrees is set as "treatment stage 1," the stage at which the range of motion reaches k / 2 degrees is set as "treatment stage 2," the stage at which the range of motion reaches 3k / 4 degrees is set as "treatment stage 3," and the stage at which the range of motion reaches k degrees is set as "post-treatment."

[0125] In this modified example, the selection unit 39 may select all videos associated with information regarding the physical condition of subject B as videos containing subject B whose physical condition is similar to that of subject A, or may select videos at a pre-specified treatment stage.

[0126] For example, if the information regarding the physical condition of subject A acquired by the information acquisition unit 36 ​​indicates "my knee hurts," the selection unit 39 selects the imaging data "imaging data A1," "imaging data A1-1," "imaging data A1-2," "imaging data A1-3," and "imaging data A2" associated with the information regarding the physical condition of subject A in table T3 as "my knee hurts." Then, the moving image indicated by the imaging data selected by the selection unit 39 is transmitted to the terminal device 1 and displayed on the display panel 11 by the display unit 17 of the terminal device 1, as described above.

[0127] Here, the display unit 17 may sequentially display the acquired multiple moving images. Furthermore, the terminal device 1 may receive an instruction indicating which treatment stage moving images should be displayed via an operation receiving unit (not shown). In this case, the display unit 17 may display the moving image of the corresponding treatment stage from among the acquired multiple moving images in accordance with the received instruction.

[0128] As another example, if the information acquiring unit 36 ​​acquires information indicating that the information on the physical condition of subject A indicates "slow walking speed" and that the subject's treatment stage is "treatment stage 2," the selecting unit 39 selects "imaging data B1-2," which is "treatment stage 2," from among the imaging data associated in table T3 with the information on the physical condition as "slow walking speed." Then, the moving image indicating the "imaging data B1-2" selected by the selecting unit 39 is transmitted to the terminal device 1, as described above, and displayed on the display panel 11 by the display unit 17 of the terminal device 1.

[0129] In this way, the information processing device 3 according to this modification includes subject B, whose physical condition is similar to that of subject A, as a subject, and selects videos to present from videos before and after each of a plurality of treatments. Therefore, the information processing device 3 can present to subject A how much treatment will improve his or her physical condition, thereby maintaining subject A's motivation.

[0130] Furthermore, the information acquisition unit 36 ​​of the information processing device 3 may acquire, as information regarding the physical condition of subject A, moving images of subject A's movements before treatment at a certain treatment stage, and may further acquire moving images of subject A's movements after treatment at the certain treatment stage. In other words, the information acquisition unit 36 ​​may acquire moving images including subject A as a subject before and after each of one or more treatments performed on subject A. With this configuration, the moving images of subject A before and after treatment at a certain treatment stage acquired by the information acquisition unit 36 ​​are associated with information regarding the physical condition and stored in the storage unit 34 as moving images of subject B before and after treatment at a certain treatment stage by the storage unit 41. Therefore, the information processing device 3 can increase the amount of imaging data stored in the storage unit 34.

[0131] (Variation 3) The selection unit 39 may be configured to select imaging data according to the body part indicated by the acquired information on the subject A's physical condition.

[0132] As an example, if the information regarding the physical condition of subject A acquired by the information acquisition unit 36 ​​indicates that "my knee hurts," the selection unit 39 first identifies the body part "knee" indicated by the information regarding subject A's physical condition.

[0133] Next, the selection unit 39 selects information on the subject's physical condition related to "knee" from the information on physical conditions stored in the storage unit 34. Taking the table T1 shown in Fig. 3 as an example, the selection unit 39 selects "my knee hurts" and "my knee joint was replaced with an artificial joint" related to "knee."

[0134] Then, the selection unit 39 selects imaging data associated with the selected information on the physical condition. Taking the table T1 shown in Fig. 3 as an example, the selection unit 39 selects imaging data "imaging data A" and "imaging data C" associated with "knee pain" and "knee joint replaced with artificial joint", respectively.

[0135] Furthermore, for example, if drug X can improve knee function, the selection unit 39 may select "prescribed drug X" as information about a physical condition related to "knee" in the above example. In this case, the selection unit 39 also selects imaging data "imaging data D" associated with "prescribed drug X." Then, similar to the above-described embodiment, the display unit 17 of the terminal device 1 displays the imaging data selected by the selection unit 39 on the display panel 11.

[0136] In this way, the information processing device 3 selects moving images according to the body part indicated by the acquired information on the physical condition of subject A. With this configuration, the information processing device 3 can present, for example, to subject A who has knee pain, moving images including subject B, who has had his knee joint replaced with an artificial joint, as a subject, and moving images including subject B, who has been prescribed drug X, as a subject. Therefore, the information processing device 3 can allow subject A to compare the case where the knee is replaced with an artificial joint with the case where drug X is prescribed, thereby allowing subject A to select a treatment method.

[0137] [Software implementation example] The functions of the terminal device 1, the input device 2, and the information processing device 3, 3A can be realized by a program for causing a computer to function as the device, and a program for causing a computer to function as each control block of the device (particularly each part included in the control unit 15, 25, 35, 35A).

[0138] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing the functions described in each of the above embodiments.

[0139] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0140] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.

[0141] Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI ​​may run on the control device or on another device (for example, an edge computer or a cloud server).

[0142] (Physical configuration of terminal device 1) 12 is a block diagram illustrating the physical configuration of a computer used as the terminal device 1, the input device 2, and the information processing device 3. As shown in Fig. 12, the terminal device 1 can be configured by a computer including a bus 110, a processor 101, a main memory 102, an auxiliary memory 103, a communication interface 104, a display panel 105, and a camera 106. The processor 101, the main memory 102, the auxiliary memory 103, the communication interface 104, the display panel 105, and the camera 106 are connected to one another via the bus 110.

[0143] The processor 101 may be, for example, a CPU (Central Processing Unit), a microprocessor, a digital signal processor, a microcontroller, or a combination of these.

[0144] The main memory 102 may be, for example, a semiconductor RAM (random access memory).

[0145] The auxiliary memory 103 may be, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a combination of these. The auxiliary memory 103 stores a program for causing the processor 101 to execute the above-described operations of the terminal device 1. The processor 101 loads the program stored in the auxiliary memory 103 onto the main memory 102 and executes each command included in the loaded program.

[0146] The communication interface 104 is an interface for connecting to the network N.

[0147] The display panel 105 is an example of a hardware element that realizes the display panel 11 .

[0148] The camera 106 is an example of a hardware element that realizes the imaging unit 12 .

[0149] In this example, the processor 101 is an example of a hardware element that realizes the control unit 15. The main memory 102 and the auxiliary memory 103 are also examples of hardware elements that realize a storage unit (not shown). The communication interface 104 is also an example of a hardware element that realizes the communication unit 10.

[0150] (Physical configuration of input device 2) 12, the input device 2 can be configured by a computer including a bus 210, a processor 201, a main memory 202, an auxiliary memory 203, a communication interface 204, a display panel 205, and a keyboard 207. The processor 201, the main memory 202, the auxiliary memory 203, the communication interface 204, the display panel 205, and the keyboard 207 are connected to one another via the bus 210.

[0151] The keyboard 207 is an example of a hardware element that realizes the operation receiving unit 23 .

[0152] In this example, the processor 201 is an example of a hardware element that realizes the control unit 25. The main memory 202 and the auxiliary memory 203 are also examples of hardware elements that realize a storage unit (not shown). The communication interface 204 is also an example of a hardware element that realizes the communication unit 20. The display panel 205 is also an example of a hardware element that realizes the display panel 21.

[0153] (Physical configuration of information processing device 3) 12, the information processing device 3 can be configured by a computer including a bus 310, a processor 301, a main memory 302, an auxiliary memory 303, and a communication interface 304. The processor 301, the main memory 302, the auxiliary memory 303, and the communication interface 304 are connected to one another via the bus 310.

[0154] In this example, the processor 301 is an example of a hardware element that realizes the control unit 35. The main memory 302 and the auxiliary memory 303 are also examples of hardware elements that realize the storage unit 34. The communication interface 304 is also an example of a hardware element that realizes the communication unit 30.

[0155] [summary] An information processing device according to one aspect of each embodiment includes an information acquisition unit that acquires information relating to the subject's physical condition, a selection unit that refers to the information relating to the subject's physical condition and selects a video of the other subject having a physical condition similar to that of the subject as a subject, after the other subject has completed treatment, and an output unit that outputs the video selected by the selection unit.

[0156] According to the above configuration, the subject can be presented with video images of other subjects whose physical conditions are similar to the subject's, including as subjects, after the other subjects have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve physical function.

[0157] It is preferable that the information acquisition unit in the information processing device relating to one aspect of each embodiment acquires a moving image including the subject as a subject, and the selection unit refers to an index derived from the moving image acquired by the information acquisition unit and selects a moving image including another subject as a subject whose physical condition is similar to that of the subject after the other subject has completed treatment.

[0158] According to the above configuration, the subject can be presented with video images of other subjects whose physical conditions are similar to the subject's, including as subjects, after the other subjects have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve physical function.

[0159] It is preferable that the information processing device according to one aspect of each embodiment further includes an extraction unit that extracts the subject's skeleton contained in the moving image acquired by the information acquisition unit, and the selection unit refers to the index derived from the skeleton extracted by the extraction unit and selects a moving image that includes as a subject another subject whose physical condition is similar to that of the subject, after the other subject has completed treatment.

[0160] According to the above configuration, the subject can be presented with video images of other subjects whose physical conditions are similar to the subject's, including as subjects, after the other subjects have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve physical function.

[0161] It is preferable that the information acquisition unit in the information processing device according to one aspect of each embodiment acquires moving images including the subject as a subject before and after each of one or more treatments performed on the subject.

[0162] According to the above configuration, the number of moving images presented to the subject increases, so that the motivation of the subject undergoing treatment to improve physical function can be maintained.

[0163] It is preferable that the information acquisition unit in the information processing device relating to one aspect of each embodiment acquires information indicating the treatment content to be performed on the subject, and the selection unit refers to the information indicating the treatment content acquired by the information acquisition unit, includes as a subject another subject whose physical condition is similar to that of the subject, and selects a video image of the other subject after the treatment has been completed.

[0164] According to the above configuration, the subject can be presented with video images of other subjects whose physical conditions are similar to the subject's, including as subjects, after the other subjects have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve physical function.

[0165] An information processing method according to one aspect of each embodiment includes an information acquisition step of acquiring information regarding the subject's physical condition, a selection step of referring to the information regarding the subject's physical condition and selecting a moving image of another subject whose physical condition is similar to that of the subject as a subject, after the other subject has completed treatment, and an output step of outputting the moving image selected in the selection step.

[0166] According to the above configuration, the subject can be presented with video images of other subjects whose physical conditions are similar to the subject's, including as subjects, after the other subjects have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve physical function.

[0167] An information processing system according to one aspect of each embodiment is an information processing system including a terminal device, an input device, and an information processing device, wherein the terminal device includes a terminal device acquisition unit that acquires from the information processing device a moving image including a subject as a subject, and a moving image of another subject whose physical condition is similar to that of the subject and after the other subject has completed treatment, a terminal device output unit that outputs the moving image including the subject as a subject acquired by the terminal device acquisition unit to the information processing device, and a display unit that displays the moving image including the other subject as a subject and after the other subject has completed treatment, acquired by the terminal device acquisition unit. and an input device output unit that outputs the information on the subject's physical condition acquired by the input device acquisition unit, wherein the information processing device comprises: an information processing device acquisition unit that acquires at least one of a moving image output from the terminal device and information output from the input device; a selection unit that refers to at least one of the moving image and information acquired by the information processing device acquisition unit and selects a moving image of the other subject after the other subject has completed treatment, the moving image including as a subject another subject whose physical condition is similar to that of the subject; and an information processing device output unit that outputs the moving image selected by the selection unit to the terminal device.

[0168] According to the above configuration, the subject can be presented with video images of other subjects whose physical conditions are similar to the subject's, including as subjects, after the other subjects have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve physical function.

[0169] A terminal device according to one aspect of each embodiment includes an acquisition unit that acquires moving images including another subject whose physical condition is similar to that of the subject as a subject, and which are referenced to select moving images of the other subject after treatment has been completed, the moving images including the subject as a subject and the moving images of the other subject after treatment has been completed, an output unit that outputs the moving images acquired by the acquisition unit, and a display unit that displays the moving images of the other subject after treatment has been completed, which are acquired by the acquisition unit.

[0170] According to the above configuration, the subject can be presented with video images of other subjects whose physical conditions are similar to the subject's, including as subjects, after the other subjects have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve physical function.

[0171] It is preferable that the display unit in the terminal device according to one aspect of each embodiment displays a moving image including the subject as a subject and a moving image of the other subject after the treatment has been completed in a comparable manner.

[0172] According to the above configuration, the subject can compare a video image including the subject as a subject with a video image including another subject as a subject whose physical condition is similar to that of the subject, after the other subject has completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve physical function.

[0173] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0174] 1 Terminal device 2 Input devices 3. 3A Information Processing Equipment 10, 20, 30 Communications Department 11, 21, 31 Display panel 12 Imaging unit 15, 25, 35, 35A control unit 16, 26, 36, 36A Information acquisition section 17, 27 Display section 18, 28, 38 Output section 23 Operation reception section 34 Storage section 39, 39A selection section 40 Extraction part 41 Storage Unit 100, 100A Information Processing System

Claims

1. an information acquisition unit that acquires information about the subject's physical condition; a storage unit that stores information about the physical condition of the other subject and a moving image of the other subject after the other subject has finished treatment in association with each other in the storage unit; a selection unit that identifies information about the physical condition of the other subject that indicates a physical condition similar to a physical condition indicated by the information about the physical condition of the subject, and selects, in the storage unit, a video associated with the identified information about the physical condition of the other subject; an output unit that outputs the moving image selected by the selection unit; An information processing device comprising:

2. the information acquisition unit acquires a moving image including the target person as a subject; The selection unit refers to an index derived from the moving image acquired by the information acquisition unit, and selects a moving image including, as a subject, another subject whose physical condition is similar to that of the subject, after the other subject has completed treatment. The information processing device according to claim 1 .

3. further comprising an extraction unit that extracts a skeleton of the subject included in the moving image acquired by the information acquisition unit; The selection unit refers to the indices derived from the skeleton extracted by the extraction unit, and selects a video image including, as a subject, another subject whose physical condition is similar to that of the subject, after the other subject has completed treatment. The information processing device according to claim 2 .

4. The information acquisition unit acquires moving images including the subject as a subject before and after each of one or more treatments performed on the subject.

4. The information processing device according to claim 2 or 3.

5. The information acquisition unit acquires information indicating a treatment content to be performed on the subject, The selection unit refers to information indicating the treatment content acquired by the information acquisition unit, and selects a video image including another subject whose physical condition is similar to that of the subject as a subject, after the other subject has finished treatment.

5. The information processing device according to claim 1.

6. An information processing device, an information acquisition step of acquiring information about the subject's physical condition; a storage step of associating information about the physical condition of the other subject with a moving image including the other subject as a subject and obtained after the other subject has completed treatment, and storing the information in a storage unit; a selection step of identifying information about the physical condition of the other subject that indicates a physical condition similar to a physical condition indicated by the information about the physical condition of the subject, and selecting, in the storage unit, a video associated with the identified information about the physical condition of the other subject; an output step of outputting the moving image selected in the selection step; An information processing method that performs the above.

7. An information processing system including a terminal device, an input device, and an information processing device, The terminal device a terminal device acquisition unit that acquires, from the information processing device, a moving image including the subject as a subject, and a moving image of another subject having a physical condition similar to that of the subject, the other subject having completed treatment; a terminal device output unit that outputs a moving image including the subject as a subject, which is acquired by the terminal device acquisition unit, to the information processing device; a display unit that displays a moving image of the other subject after the other subject has finished treatment, the moving image including the other subject acquired by the terminal device acquisition unit as a subject, The input device is an input device acquisition unit that acquires information about the subject's physical condition; an input device output unit that outputs information regarding the physical condition of the subject acquired by the input device acquisition unit, The information processing device includes: an information processing device acquisition unit that acquires at least one of a moving image output from the terminal device and information output from the input device; a storage unit that stores information about the physical condition of the other subject and a moving image of the other subject after the other subject has finished treatment in association with each other in the storage unit; a selection unit that identifies information about the physical condition of the other subject that indicates a physical condition similar to a physical condition indicated by at least one of the moving image and the information acquired by the information processing device acquisition unit, and selects, in the storage unit, the moving image associated with the identified information about the physical condition of the other subject; an information processing device output unit that outputs the moving image selected by the selection unit to the terminal device. Information processing system.

8. 2. A program for causing a computer to function as the information processing device according to claim 1, the program causing the computer to function as the information acquisition unit, the storage unit, the selection unit, and the output unit.

Images