Information processing device, information processing system, information processing method, and program

Abstract

In the prior art, specialized knowledge or experience is required for specifying information relating to the kinematics state of the body of a user or proposing suggestions, and there is a problem that labor is required or the cost is relatively high. By means of an information processing device (100) provided with a sole information acquisition unit (141) that acquires sole information relating to the sole of a user, a determination information acquisition unit (149) that acquires the sole information relating to the sole of the user, an output information acquisition unit (151) that outputs the acquired sole information, and an output unit (161) that outputs the acquired sole information relating to the sole of the user. And a determination information acquisition unit (149) that uses the sole information and learning information prepared in advance to acquire determination information relating to the kinematic state of the body of the user, an output information acquisition unit (151) that acquires output information on the basis of the determination information, and an output unit (161) that outputs the output information.

Description

Technical Field

[0001] The present invention relates to an information processing device, an information processing system, an information processing method, and a program for performing information processing using information related to the soles of a user's feet. Background Art

[0002] Conventionally, there is a device configured to output information related to the health of a user (for example, refer to Patent Document 1 listed below).

[0003] In addition, Patent Document 2 listed below describes a technique for obtaining symptom data related to a subject's physical symptoms or physical condition based on skeleton data generated based on image or video data taken of the subject's body.

[0004] Patent Literature Patent Document 1: Japanese Patent Application Publication No. 2021-135554 Patent Document 2: Japanese Patent Application Publication No. 2021-115471 Summary of the invention

[0005] In recent years, for example, information related to the state of each user's posture or walking style is determined, and the determined information is provided to the user, or various suggestions are given to the user based on the determined information. Generally speaking, in order to determine such information related to the user's body motor function state or give suggestions, specialized knowledge or experience is required, which is labor-intensive or costly.

[0006] Regarding such a problem, the symptom data of the subject can be obtained through information processing according to the technology disclosed in the above-mentioned Patent Document 2. However, in such a technology, skeleton data needs to be generated, which is time-consuming and bears the load of information processing.

[0007] The present invention has been made to solve such a problem, and an object of the present invention is to provide an information processing device, an information processing system, an information processing method, and a program that can easily identify information related to the motor functional state of a user's body.

[0008] The information processing device of the first invention is as follows, comprising: a sole information acquisition unit, which acquires sole information related to the sole of the user's foot; a judgment information acquisition unit, which uses the sole information and pre-prepared learning information to acquire judgment information related to the motor functional state of the user's body; and an output unit, which outputs output information based on the judgment information.

[0009] With such a configuration, it is possible to easily identify information related to the motor functional state of the user's body.

[0010] Furthermore, the information processing device of the second invention is as follows: with respect to the first invention, the sole information includes information on a ground contact state in which the sole of the user contacts the ground.

[0011] With such a configuration, it is possible to determine information related to the motor functional state of the user's body based on the ground contact state of the sole of the foot.

[0012] Furthermore, the information processing device of the third invention is as follows: with respect to the second invention, the sole information includes information indicating the ground contact state of the sole of the user in time series.

[0013] With such a configuration, it is possible to identify information on the motor functional state of the user's body based on changes in the ground contact state of the sole of the foot.

[0014] Furthermore, the information processing device of the fourth invention is as follows: regarding any one of the first to third inventions, the sole information includes an image captured of the sole of the user.

[0015] With such a configuration, it is possible to identify information related to the motor functional state of the user's body based on easily obtainable information.

[0016] In addition, the information processing device of the fifth invention is as follows: regarding any one of the first to fourth inventions, the sole information includes information on pressure distribution of the sole of the user who has contacted the ground.

[0017] With such a configuration, it is possible to identify information on the motor functional state of the user's body based on the ground contact state of the sole of the foot.

[0018] Furthermore, the information processing device of the sixth invention is as follows, regarding any one of the first to fifth inventions, wherein the sole information includes information indicating a three-dimensional shape of the sole of the user.

[0019] With such a configuration, it is possible to identify information related to the motor functional state of the user's body based on easily obtainable information.

[0020] In addition, the information processing device of the seventh invention is as follows: regarding any one of the first to sixth inventions, the judgment information acquisition unit is configured to perform high-resolution processing on the image, namely, the sole information, and obtain the judgment information using the processing result and the learning information.

[0021] With such a configuration, it is possible to identify information on the motor functional state of the user's body with high accuracy.

[0022] Furthermore, the information processing device of the eighth invention is as follows, regarding any one of the first to seventh inventions, wherein the sole information includes shape information related to the shape of the sole of the user.

[0023] With such a configuration, it is possible to identify information on the motor functional state of the user's body with high accuracy.

[0024] Furthermore, the information processing device of the ninth invention is as follows: with respect to the eighth invention, the shape information includes at least one of the length and width of the foot of the user.

[0025] With such a configuration, it is possible to identify information on the motor functional state of the user's body with high accuracy.

[0026] In addition, the information processing device of the tenth invention is as follows, regarding any one of the first to ninth inventions, comprising a user information acquisition unit that acquires information about the user and information different from sole information as user information, and a judgment information acquisition unit acquires judgment information using the user information.

[0027] With such a configuration, it is possible to identify information on the motor functional state of the user's body with high accuracy.

[0028] Furthermore, the information processing device of the eleventh invention is as follows: with respect to the tenth invention, the determination information acquisition unit acquires the determination information using learning information corresponding to the user information among a plurality of learning information prepared in advance.

[0029] With such a configuration, it is possible to identify information on the motor functional state of the user's body with high accuracy.

[0030] In addition, the information processing device of the twelfth invention is as follows: regarding any one of the first to eleventh inventions, the determination information includes information related to two or more observation results regarding the landing of the sole of the human foot.

[0031] With such a configuration, it is possible to easily identify information related to two or more observation results regarding the landing of the sole of the user's foot.

[0032] Furthermore, the information processing device of the thirteenth invention is as follows: regarding the twelfth invention, the determination information includes respective scores of two or more observation results.

[0033] With such a configuration, it is possible to easily determine scores related to two or more observation results regarding the landing of the sole of the user's foot.

[0034] In addition, the information processing device of the fourteenth invention is as follows: regarding the twelfth or thirteenth invention, regarding information related to two or more observation results, the judgment information acquisition unit uses learning information corresponding to the observation result from a plurality of learning information prepared in advance to acquire it.

[0035] With such a configuration, it is possible to specify information regarding two or more observation results regarding the landing of the sole of the user's foot with high accuracy.

[0036] Furthermore, the information processing device of the fifteenth invention is as follows, regarding any one of the first to fourteenth inventions, wherein the output information includes a determination result related to the walking posture of the user.

[0037] With such a configuration, it is possible to easily output a determination result regarding the user's walking posture.

[0038] Furthermore, the information processing device of the sixteenth invention is as follows, regarding any one of the first to fifteenth inventions, wherein the output information includes a proposal for improvement related to the motor functional state of the user's body.

[0039] With such a configuration, it is possible to easily output improvement proposals related to the motor functional state of the user's body.

[0040] Furthermore, the information processing device of the seventeenth invention is as follows, regarding any one of the first to sixteenth inventions, wherein the output information includes information on a commodity recommended to the user for ingestion.

[0041] With such a configuration, it is possible to easily output information on products recommended to the user.

[0042] Furthermore, the information processing device of the eighteenth invention is as follows, regarding any one of the first to seventeenth inventions, wherein the output information includes information on a symptom that may be currently occurring in the user.

[0043] With such a configuration, it is possible to easily output information related to symptoms that may currently be occurring in the user.

[0044] Furthermore, the information processing device of the nineteenth invention is as follows, regarding any one of the first to eighteenth inventions, wherein the output information includes information on the risk of future occurrence of symptoms in the user.

[0045] With such a configuration, it is possible to easily output information related to the risk of future symptoms occurring in the user.

[0046] In addition, the information processing device of the twentieth invention is as follows: regarding the nineteenth invention, the output information includes two or more information related to the risk of occurrence of symptoms, and the output unit outputs the information related to the risk of occurrence of two or more symptoms in an order corresponding to the predicted occurrence period of each symptom.

[0047] With such a configuration, the risk of two or more symptoms and the predicted time of their occurrence can be easily grasped.

[0048] In addition, the information processing device of the twenty-first invention is as follows: regarding any one of the first to twentieth inventions, the output information is information obtained based on the judgment information about the user that has been obtained this time and the judgment information that has been obtained before this time.

[0049] With such a configuration, it is possible to output information based on each of past and present judgment information.

[0050] In addition, the information processing system of the twenty-second invention is as follows, comprising: any one of the information processing devices from the first to the twenty-first; and an information acquisition device that can communicate with the information processing device, the information acquisition device is configured to record information related to the soles of the user and output the recorded results as sole information, and the sole information acquisition unit is configured to acquire the sole information output by the information acquisition device.

[0051] With such a configuration, information on the user's motor functional state can be easily identified.

[0052] According to the information processing device and the like according to the present invention, it is possible to easily identify information related to the motor functional state of the user's body. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 This is a diagram showing an overview of an information processing system according to an embodiment of the present invention. Figure 2 is a block diagram of the information processing system. Figure 3 This is a flowchart showing an example of the operation of the information processing device. Figure 4 This is a flowchart showing an example of the determination process of the information processing device. Figure 5 This is a flowchart showing an example of output information acquisition processing of the information processing device. Figure 6 This is a flowchart showing a modified example of the output information acquisition process of the information processing device. Figure 7 This is a flowchart showing a modified example of the determination process of the information processing device. Figure 8 The figure is a specific example of a display screen showing output information of the information acquisition device. Fig. 9 This is a diagram showing an example of information indicating a correspondence relationship between determination information and output information, etc., according to a modification example of the present embodiment. Fig.10 This is a flowchart showing an example of output information acquisition processing of an information processing device according to a modification example of the present embodiment. Fig.11 It is a diagram showing a specific example of a display screen of output information of an information acquisition device according to a modification example of the present embodiment. Fig.12 It is an external view of the computer system in the above-mentioned embodiment. Fig.13 is a block diagram of the computer system. Explanation of symbols 1-information processing system; 100-information processing device; 110-storage unit; 111-learning information storage unit; 115-user information storage unit; 117-foot sole information storage unit; 120-receiving unit; 130-accepting unit; 140-processing unit; 141-foot sole information acquisition unit; 145-user information acquisition unit; 149-judgment information acquisition unit; 151-output information acquisition unit; 161-output unit; 170-sending unit; 600-information acquisition device; 610-terminal storage unit; 620-terminal receiving unit; 630-terminal accepting unit; 640-terminal processing unit; 660-terminal output unit; 670-terminal sending unit; 680-detection unit. DETAILED DESCRIPTION

[0054] Hereinafter, embodiments of the information processing device and the like will be described with reference to the drawings. In the embodiments, components denoted by the same reference numerals perform the same operations, and therefore duplicate descriptions may be omitted.

[0055] Furthermore, the terms used below are generally defined as follows. Furthermore, the semantics of these terms should not always be interpreted as the meanings shown here, but should be interpreted with reference to the description thereof when they are described separately below, for example.

[0056] A user is a user who uses an information processing system. In addition to users who operate the information processing system (also called operators, managers, etc.), users who are the objects of obtaining judgment information of the information processing system (also called patients, subjects, etc.) can also be included. The operator can be the same person as the patient or a different person.

[0057] An identifier for a certain item is a word or symbol that specifically represents the item. Although the identifier is, for example, an ID, its type is not limited as long as it is information that can identify the corresponding item. That is, the identifier can be the name of the item it represents, or it can be a combination of symbols in a specifically corresponding manner.

[0058] Acquisition may include acquisition of items input by a user, etc., and may also include acquisition of information stored in its own device or other devices (which may be information that has been stored in advance or information generated by information processing in the device). Acquisition of information stored in other devices may include acquisition of information stored in other devices via an API, etc., and may also include acquisition of the contents of document files (including the contents of web pages, etc.) provided by other devices. In addition, acquisition of information by optical character reading of image files may also include acquisition of information in a different format from the original information.

[0059] In addition, the acquisition of information can also utilize the so-called machine learning method. The utilization of the machine learning method can be done as follows, for example. That is, the machine learning method is used to form learning information that takes a specific type of input information as input and outputs the type of information you want to obtain. For example, a group of more than two input information and information obtained as output (it can also be said to be output information) is prepared in advance, and the two or more groups of information are provided to a module for constituting learning information for machine learning to constitute learning information, and the constituted learning information is accumulated in a storage unit. In addition, the learning information can also be referred to as a learning machine or a classifier. In addition, as a method of machine learning, there are, for example, deep learning, random forest, SVM, etc., and their types are not limited. In addition, in machine learning, for example, functions in various machine learning frameworks such as fastText, tinySVM, random forest, TensorFlow, and various existing program libraries can be used.

[0060] In addition, it is not limited to obtain learning information through machine learning. The learning information can also be, for example, a table representing the correspondence between an input vector based on input information and the acquired information. At this time, the acquired information corresponding to the feature vector based on the input information can be obtained from the table, or two or more input vectors in the table and parameters such as weighting of each input vector can be used to generate a vector that is similar to the feature vector based on the input information, and the final acquired information can be obtained using the acquired information and parameters corresponding to each input vector used in the generation. The acquisition of information using such learning information is sometimes referred to as acquisition using a corresponding relationship. In addition, the learning information can also be, for example, a function representing the relationship between an input vector based on input information and the information used to generate the acquired information. At this time, for example, the information corresponding to the feature vector based on the input information can be obtained by a function, and the acquired information can be obtained using the obtained information. The acquisition of information using such learning information is sometimes referred to as acquisition using a function.

[0061] The output of information is a concept that includes display on a display, projection using a projector, typing using a printer, audio output, transmission to an external device, accumulation on a storage medium, transmission of processing results to other processing devices or other programs, etc. Specifically, it includes, for example, display of information on a web page, transmission as an e-mail, etc., or output of information for printing.

[0062] The acceptance of information is a concept that includes the acceptance of information input from input devices such as a keyboard, mouse, or touch screen, the reception of information sent from other devices via wired or wireless communication lines, or the acceptance of information read from storage media such as optical disks, magnetic disks, and semiconductor memories.

[0063] Regarding various information stored in an information processing device, etc., updating is a concept that includes not only changing the stored information, but also adding new information to the stored information or deleting part or all of the stored information.

[0064] Implementation

[0065] In this embodiment, the information processing device uses the sole information and learning information related to the sole of the user to obtain the judgment result, and outputs the output information according to the judgment result. The sole information is, for example, information related to the grounding state of the sole or information representing its grounding state in a time series. The sole information can also be information related to the pressure distribution of the sole that has contacted the ground. In addition, the sole information is not limited to these, but can also be, for example, an image taken of the sole or information representing the three-dimensional shape of the sole. The information processing device can also be configured to obtain the judgment result using information and learning information that high-resolution the image, i.e., the sole information, by methods such as GAN (Generative Adversarial Network). The information processing device can obtain shape information from the sole information and obtain the judgment result using the sole information, shape information and learning information, or it can obtain the judgment result using the user information and learning information of the user. The judgment result is, for example, information such as scores related to two or more observation results. The output information can include, for example, a judgment result related to the user's walking posture, and can also include improvement proposals related to the walking posture. The output information can also include information related to the goods recommended to the user to take. The following describes the configuration of an information processing system including the information processing device configured as described above.

[0066] Figure 1 It is a diagram showing an overview of an information processing system 1 according to one embodiment of the present invention.

[0067] In this embodiment, the information processing system 1 includes an information processing device 100 and an information acquisition device 600. The information processing device 100 and the information acquisition device 600 can communicate with each other via a network such as a local area network or the Internet. In addition, the configuration of the information processing system 1 is not limited thereto. The number of each device included in the information processing system 1 is not limited, and the information processing system 1 may also include other devices.

[0068] The user of the information processing system 1 can use the information acquisition device 600 to use the information processing system 1. In addition, in the figure, a portable information terminal device such as a so-called smart phone or a personal computer (PC) such as a notebook computer is shown as the information acquisition device 600, but this is just an example, and for example, a tablet-type information terminal device or a measuring device that is not usually called a portable information terminal device or a PC can also be used as the information acquisition device 600. The information acquisition device 600 can also be called a terminal device.

[0069] Figure 2 is a block diagram of the information processing system 1.

[0070] As shown in the figure, the information processing device 100 includes a depositing unit 110, a receiving unit 120, a receiving unit 130, a processing unit 140, and a sending unit 170. The information processing device 100 is, for example, a server device.

[0071] The storage unit 110 includes a learning information storage unit 111 , a user information storage unit 115 , and a foot sole information storage unit 117 .

[0072] The learning information storage unit 111 stores the learning information that has been acquired in advance. The learning information may also be referred to as a learning machine, a classifier, a prediction model, or a learned model. The learning information is generated using a so-called machine learning method. In the information processing device 100, for example, although the learning information is generated as described below and stored in the learning information storage unit 111, it is not limited to this. That is, the learning information storage unit 111 may also store learning information generated in a device different from the information processing device 100.

[0073] In this embodiment, information including sole information is used as input information, and judgment information is used as output information to generate learning information. In other words, learning information is information applied to input information including sole information to output judgment information.

[0074] The sole information is information related to the sole of the user's foot. In the present embodiment, the sole information is information based on a captured image taken by a camera of the sole of the user in contact with the ground. That is, in the present embodiment, the sole information includes information related to the ground contact state of the sole of the user's foot in contact with the ground. In addition, the information based on the captured image can be the captured image itself, or information obtained using the captured image. The information obtained using the captured image can also be, for example, an image obtained as a result of a prescribed image processing, or information obtained as a result of a prescribed image recognition. The information about the ground contact state can be an image obtained by capturing an image or processing it, or can include the value of a prescribed indicator related to the sole of the user in contact with the ground. The prescribed indicator can be, for example, an indicator related to the shape of the length (foot length) or width (foot width) of the sole of the foot in the ground contact state, or other indicators such as the ground contact area of ​​the sole of the foot or the position of the center of gravity of the ground contact part.

[0075] Furthermore, the sole information may also be information that represents the change of the ground contact state of the sole of the user's foot in a time series. For example, it may be a moving picture (an example of a captured image) of the sole of the user contacting the ground. In addition, it may be two or more images that are captured at intervals of the sole of the user contacting the ground. In addition, for example, it may also include the time series value of the specified indicator as described above. For example, the sole information may also be information that represents the change of the ground contact state of the sole of the user in a specified action state such as when walking or jumping in a time series.

[0076] In this embodiment, the judgment information is information related to the motor function state of the user's body. The motor function state is, for example, walking posture, standing posture, walking style, etc. The motor function state can also be the state of the skeletal state or muscle state and other motor organs. The judgment information is whether it meets the observation results related to the motor function state, or the score of each of the multiple observation results. It can also be said that the judgment information is diagnostic information.

[0077] In the present embodiment, the judgment information includes, for example, information related to the observation result of the provisions of the landing of the sole of the human foot. More specifically, for example, it is the respective information of more than two observation results considered when distinguishing whether the user's walking style (walking posture) is foot eversion. The multiple observation results are four of floating toe (floating toe), the landing state of the root of the toe is not good (root landing), the state of the sole of the foot is flat foot (flat foot) and the state of the sole of the foot is high arch (high arch), but are not limited to these. The observation result of floating toe can also be that floating toe does not occur, the observation result of root landing can also be that the landing state is good, the observation result of flat foot can also be that it is not flat foot, and the observation result of high arch can also be that it is not high arch. In the present embodiment, the judgment information includes, for example, the respective scores of the four observation results of floating toe, root landing, flat foot and high arch. In addition, the judgment information can also include information related to observation results such as osteoarthritis or low back pain (lumbar disc herniation).

[0078] Furthermore, the learning information may also be information such as a prepared correspondence table so that it can be obtained using the above correspondence relationship. The correspondence table may, for example, represent the correspondence relationship between the vector of the input information and the judgment information. Furthermore, the learning information may also be information related to a prepared function so that it can be obtained using the above function.

[0079] Here, in this embodiment, a plurality of learning information is prepared. Each learning information is stored in the learning information storage unit 111 in correspondence with the four observation results of the judgment information. That is, the learning information storage unit 111 has stored therein learning information corresponding to the output of the score of floating toe, learning information corresponding to the output of the score of root landing, learning information corresponding to the output of the score of flat feet, and learning information corresponding to the output of the score of high arches. The corresponding learning information is used in the output of the score of each observation result.

[0080] User information about the user who is being diagnosed is stored in the user information storage unit 115. In the present embodiment, user information is information that matches an identifier for identifying a user, i.e., a user identifier, with information about the user. The user information may include various information. For example, it may include information sent from the information acquisition device 600, and information about the user obtained through the information processing device 100 as described later. The information sent from the information acquisition device 600 may include various attribute values ​​about the user (for example, gender, age, weight, height, presence or absence of a specific disease, etc.). In addition, for example, judgment information or output information as described later, etc., conform to information about the user that has been obtained through the information processing device 100. User information sent from other external devices, etc. may also be stored in the user information storage unit 115.

[0081] Furthermore, in the description of this embodiment, the sole information of the user is considered not to be included in the user information. Furthermore, the sole information may also be considered to be included in the user information. In this case, the sole information storage unit 117 may be considered to be included in the user information storage unit 115.

[0082] The sole information is stored in the sole information storage unit 117. In this embodiment, the sole information is, for example, information acquired and transmitted by the information acquisition device 600, but is not limited thereto. The sole information storage unit 117 may also store sole information acquired by the information processing device 100 based on, for example, an image of the sole of the foot. The sole information of each user is stored in the sole information storage unit 117 in correspondence with the user identifier of the user.

[0083] The receiving unit 120 receives information sent from other devices. The receiving unit 120 stores the received information in the storage unit 110, for example. In the present embodiment, a user as an operator or a user as a person being diagnosed uses the information acquisition device 600, for example, to input information, etc., and sends it to the information processing device 100. At this time, the information is sent in correspondence with the user identifier of the user being diagnosed. The receiving unit 120 can store each sent information in the storage unit 110 in correspondence with the user identifier. In addition, as described later, in the present embodiment, it is possible to receive the sole information sent from each information acquisition device 600, and store it in the storage unit 110 in correspondence with the user identifier.

[0084] The receiving unit 130 receives information inputted using an input means (not shown) connected to the information processing device 100. The receiving unit 130 stores the received information in, for example, the storage unit 110. The input means may be any one of a numeric keypad, a keyboard, a mouse, or a menu screen. The receiving unit 130 may also receive information inputted by an input operation (for example, including information read by the device) using a reading device (for example, an encoder, etc.) connected to the information processing device 100.

[0085] Furthermore, the receiving unit 130 may be regarded as receiving the information received by the receiving unit 120 as information input to the information processing device 100. That is, the input of information to the information processing device 100 may be interpreted as the information being indirectly input to the information processing device 100 by the user as an operator via the information acquisition device 600 or the like, or as being directly input to the information processing device 100 by the user using input means. In addition, the user providing information to the information processing device 100 by executing a program that automatically generates information or providing various information to the program to make it function, etc., may also be regarded as the information being input to the information processing device 100.

[0086] The processing unit 140 includes a sole information acquisition unit 141, a user information acquisition unit 145, a determination information acquisition unit 149, an output information acquisition unit 151, and an output unit 161. The processing unit 140 performs various processes. The various processes are, for example, processes performed by each unit of the processing unit 140 as follows.

[0087] The sole information acquisition unit 141 acquires sole information of a user. In this embodiment, the sole information acquisition unit 141 acquires sole information sent from the information acquisition device 600 and received by the receiving unit 120. The sole information acquisition unit 141 can acquire sole information corresponding to the user from the sole information storage unit 117.

[0088] The user information acquisition unit 145 acquires user information of one user. In this embodiment, the user information acquisition unit 145 may acquire the user information from the user information storage unit 115 .

[0089] The determination information acquisition unit 149 acquires determination information about the user using the sole information and the learning information prepared in advance.

[0090] In this embodiment, the judgment information acquisition unit 149 acquires judgment information including scores for each of the four observation results using the learning information stored in the learning information storage unit 111. The judgment information acquisition unit 149 is configured to acquire information for each of the four observation results using the learning information corresponding to each observation result. Thus, more accurate information for each observation result can be acquired.

[0091] In the present embodiment, the judgment information acquisition unit 149 is configured to perform a process of processing the captured image, i.e., the sole information, to high resolution, and obtain the judgment information using the processing result, i.e., the sole information (an image based on the captured image) and the learning information. Furthermore, the learning information is formed using the sole information having the same high resolution as the sole information that has been high resolution. The judgment information acquisition unit 149 can obtain the high resolution sole information, for example, by the well-known GAN (Generative Adversarial Network) method. By using such a high resolution image, it is possible to easily obtain higher precision judgment information.

[0092] In addition, in the present embodiment, the sole information includes shape information related to the shape of the sole of the user. For example, the judgment information acquisition unit 149 is configured to acquire shape information, and acquire judgment information using the sole information including the shape information and the learning information. It can also be said that the judgment information acquisition unit 149 is configured to acquire judgment information using the shape information and the sole information other than the shape information. The judgment information acquisition unit 149 is configured, for example, to acquire judgment information by including the shape information in the input information. And, in this case, the learning information is configured to use the sole information and the shape information as input information, and the judgment information as output information.

[0093] Here, in this embodiment, the shape information used is, for example, the value of the foot width (the largest horizontal width) and the foot length (the length from the longest toe tip to the heel). Moreover, it is not limited to this, and the shape information may also be either the foot width or the foot length. In addition, the shape information may be the toe length, the heel width, the first toe side angle, the fifth toe side angle, the anti-big toe angle, etc.

[0094] The judgment information acquisition unit 149 is configured, for example, to acquire shape information from sole information. The judgment information acquisition unit 149 is configured, for example, to perform a predetermined image recognition process on an image, i.e., sole information, thereby acquiring shape information. That is, the judgment information acquisition unit 149 can also be configured, for example, to acquire shape information from sole information based on a captured image, and use the sole information based on the captured image (sole information excluding shape information) and sole information including shape information for acquiring judgment information. The judgment information acquisition unit 149 can also be configured to acquire information input by a user or the like as shape information. Furthermore, the shape information is not limited to the above-mentioned example, but can also be, for example, information indicating the outer shape of the ground-contacting portion of the sole, etc.

[0095] By acquiring the determination information using the shape information in this way, it is possible to acquire more accurate determination information.

[0096] Furthermore, the judgment information acquisition unit 149 may also be configured to select learning information corresponding to the shape information and apply the selected learning information to the input information, thereby acquiring the judgment information. Even in this case, it can be said that the judgment information is acquired using the sole information including the shape information and the learning information. In this case, the learning information may be configured and accumulated in the learning information storage unit 111 in advance in each case where the shape information meets the prescribed conditions (for example, each prescribed range of the shape information).

[0097] In addition, in the present embodiment, the judgment information acquisition unit 149 can also be configured to acquire the judgment information using the learning information corresponding to the user information among the plurality of learning information prepared in advance. In this case, the learning information is configured and accumulated in the learning information storage unit 111 in advance in each case where the attribute value of the user information meets the prescribed conditions (for example, each weight range, each BMI range, each age group, etc.).

[0098] By acquiring the determination information using the learning information corresponding to the user information in this way, it is possible to acquire more accurate determination information.

[0099] The output information acquisition unit 151 acquires output information based on the determination information. The output information is information generated based on the score, which is the determination information, for example, but may also be the determination information itself.

[0100] In the present embodiment, the output information acquisition unit 151 is configured to acquire information related to the state of the user's body's motor function, more specifically, to acquire output information including a determination result related to the user's walking posture. More specifically, in the present embodiment, the output information acquisition unit 151 is configured to acquire, as output information, a determination result of whether the user's walking posture is valgus. That is, when floating toes occur, or when the grounding state of the base of the toes is not good, or when the state of the sole of the foot is flat feet, or when the state of the sole of the foot is high arched, it can be said that the degree of valgus is increased respectively. The output information acquisition unit 151 is configured to, for example, calculate the comparison result of the score of each of these observation results and the prescribed threshold value corresponding to each observation result, and judge whether the prescribed determination condition of valgus is satisfied based on the comparison result of each observation result. At this time, as the determination condition, the number of observation results that can be said to have a tendency of valgus is more than the prescribed number, etc. The determination method is not limited to this. For example, it is also possible to determine whether the foot is everted (also known as diagnosis) by determining whether the comparison result of the total value of the scores of each observation result and the specified threshold value meets the specified judgment condition. In addition, the output information acquisition unit 151 can also use the input information as information containing the scores of more than two observation results, and the output information as the judgment result of whether the foot is everted, and use the pre-constructed learning information (hereinafter, for convenience, referred to as the second learning information) to obtain the judgment result. Even in this case, any method of acquisition based on a machine learning method, acquisition based on a correspondence, and acquisition based on a function can be used. In addition, the output information is not limited to information indicating whether the user's walking posture is everted, but can also be information that can be said to be in accordance with the degree of eversion of the foot, or a score, for example.

[0101] Furthermore, the present invention is not limited thereto. In the present embodiment, the output information may be a score for each observation result, or judgment information such as information indicating whether the observation result is suitable, or may include the same. For example, the output information indicating whether the observation result is suitable may be obtained based on the comparison result between the score and a predetermined threshold. In addition, the output information may be information generated from judgment information such as the score, or may include the same. For example, the value (e.g., a total value, etc.) calculated using the score of each observation result, or information indicating the score of each observation result as a curve graph, or information such as an image or annotation selected according to a predetermined correspondence relationship corresponding to the score of each observation result, or a radar chart generated using the score of each observation result.

[0102] In addition, the output information may also include improvement proposals related to the motor function state of the user's body. For example, such output information can be obtained as follows. For example, when the judgment information indicates that the user's walking posture has a strong tendency to turn the foot outward, the output information acquisition unit 151 may also acquire improvement proposal information as output information, which introduces efforts that are considered to be effective in improving the turning of the foot. Although the output information acquisition unit 151 is configured to acquire the output information using a correspondence table that predetermines the correspondence relationship between the improvement proposal information to be acquired as judgment information and output information, the acquisition method is not limited to this. In addition, in this embodiment, specifically, the improvement proposal information is, for example, information related to the conduct of a prescribed exercise, or information related to matters that the user should take care of, but is not limited to these. It can also be said that the improvement proposal related to the motor function state of the user's body is, for example, an improvement proposal related to the user's walking posture. The improvement proposal related to the walking posture may be, for example, an improvement item for the posture during walking, or an improvement item that affects the posture during walking. The improvement item may be for the state during walking or for the state other than walking. For example, improvement items related to the way the toes exert force when walking, or improvement items related to the way the feet touch the ground, etc., can be improvement items for the state of walking. In addition, improvement items related to the standing posture, or improvement items related to the position of the soles of the feet where the body weight is consciously and actively applied, etc., can be improvement items for states other than walking.

[0103] In addition, the output information may also include information related to the goods recommended to the user for intake. For example, when a specified state is indicated in relation to the motor function state of the user's body, the output information acquisition unit 151 may also be configured to acquire the product information corresponding to the state from the judgment information as output information. Product information is, for example, information such as the product name, the product number, the image of the product, information such as the place where the product can be purchased, information such as the discount code that can be exchanged for the product, etc., but is not limited to these. Although the output information acquisition unit 151 is configured to acquire the output information using, for example, a correspondence table that predetermines the correspondence between the judgment information and the output information and the product information to be acquired, the acquisition method is not limited to this.

[0104] Furthermore, the output information acquisition unit 151 may be configured to acquire output information based on the judgment information acquired this time and the judgment information acquired before this time about a user. For example, the output information acquisition unit 151 may be configured to compare the judgment information acquired about a user with the judgment information acquired in the past, and acquire output information based on the comparison result. In such a case, for example, when it can be determined that the observation result this time indicates a better state than in the past based on the judgment information in the past and the judgment information acquired this time, output information containing information indicating this can be acquired. For example, when the score of a predetermined observation result is acquired as judgment information, information indicating whether the user's walking posture this time is improved compared with the past can be acquired as output information based on the comparison result of the past score and the score this time. By using such output information, the user can easily recognize whether his or her own state has a tendency to improve. Furthermore, when the output information includes product information related to the product recommended to the user for intake, the output information acquisition unit 151 may be configured to acquire the product information based on the judgment information acquired about a user and the judgment information acquired in the past. For example, the output information acquisition unit 151 may be configured to acquire product information when the result of comparison between current and past determination information satisfies a predetermined acquisition condition.

[0105] The output unit 161 outputs the output information acquired by the output information acquisition unit 151. In the present embodiment, the output unit 161 is configured to output the output information by sending it to the information acquisition device 600 or other external devices. Moreover, the output unit 161 may also be configured to output the output information by displaying the output information on a display provided by the information processing device 100 through text or images. The output information is output in a manner that the user can recognize, so that the user can, for example, see the score, i.e., the output information, and know the score of the observation result, or can see the output information indicating whether the foot is everted with respect to the walking posture, and recognize whether the foot is everted.

[0106] The transmission unit 170 transmits information to other devices constituting the information processing system 1 via the network. The transmission unit 170 transmits information to the information acquisition device 600, for example. In other words, the transmission unit 170 outputs information to the information acquisition device 600, for example.

[0107] Furthermore, in this embodiment, the information processing device 100 may be configured to generate learning information. For example, the learning information may be generated as follows.

[0108] For example, the learning information can be generated by the processing unit 140. The processing unit 140 generates the learning information by, for example, a machine learning method. For example, the machine learning method can be used as follows. That is, using the machine learning method, a classifier is formed that takes the learning input information containing the sole information as input and the judgment information as the output value. For example, two or more sets of learning input information and output values ​​(also known as teaching data) are prepared in advance, and the two or more sets of information are provided to the module for constituting the classifier of machine learning to constitute the classifier, and the constructed classifier is accumulated in the learning information storage unit 111 as learning information. In addition, as a method of machine learning, there are deep learning such as convolutional neural network (CNN), random forest, SVM, etc., and their types are not limited. In addition, in machine learning, for example, functions in various machine learning frameworks such as fastText, tinySVM, random forest, TensorFlow, and various existing program libraries can be used. It is sufficient to prepare a combination of learning input information and output values ​​in advance. In addition, it can also be configured to generate learning information again at a specified time using the teaching data of the sole information and output value newly obtained in the information processing device 100.

[0109] Next, the configuration of the information acquiring device 600 will be described.

[0110] As shown in the figure, the information acquisition device 600 includes a terminal storage unit 610, a terminal receiving unit 620, a terminal accepting unit 630, a terminal processing unit 640, a terminal output unit 660, a terminal sending unit 670, and a detection unit 680. The information acquisition device 600 can be used to acquire sole information of a user who is a diagnosed person, for example.

[0111] The foot sole information acquired by the detection unit 680 is accumulated in the terminal storage unit 610. Although the foot sole information is sent to the information processing device 100 by the terminal transmission unit 670, it can be deleted from the terminal storage unit 610 when the transmission is completed, or it can be stored until a predetermined period has passed, or it can be stored permanently until the user deletes it. In addition, the terminal storage unit 610 can also accumulate user information such as the user who is receiving the diagnosis.

[0112] The terminal receiving unit 620 receives information transmitted from the information processing device 100 or other devices via the network. The terminal receiving unit 620 accumulates the received information in the terminal storage unit 610, for example, and makes the terminal processing unit 640 and the like available.

[0113] The terminal accepting unit 630 accepts various input operations performed on the information acquiring device 600 by a user who uses the information acquiring device 600. For example, the operation is performed using an input device (not shown), but the present invention is not limited to this.

[0114] The terminal processing unit 640 uses various components of the information acquisition device 600 to perform various information processing operations.

[0115] The terminal output unit 660 includes, for example, a display device, etc. The terminal output unit 660 outputs information by displaying the information on the display device, etc. The method of outputting information is not limited thereto, and the information may be output by outputting sound from a speaker, etc.

[0116] The terminal transmission unit 670 transmits the information acquired by the terminal processing unit 640 and the like, for example, via the network.

[0117] The detection unit 680 is configured to obtain sole information. In the present embodiment, the detection unit 680 is, for example, a camera or other photographing device. In the present embodiment, the detection unit 680 is configured to capture images of the soles of the user, who is the person being diagnosed, in a grounded state. For example, when the user is standing barefoot on a transparent glass plate, the soles of the user's feet can be photographed from below the glass plate. In this way, the images captured by the detection unit 680 are accumulated in the terminal storage unit 610 as sole information. Furthermore, the detection unit 680 can obtain images by either capturing a specified area or scanning with a line sensor.

[0118] Furthermore, although it is preferred that the storage unit 110 and the terminal storage unit 610 are non-volatile storage media, they can also be implemented using volatile storage media. These respectively store information etc. that has been acquired in their respective devices, but the process of storing information etc. is not limited to this. For example, information etc. can be stored by a storage medium, information etc. sent by a communication line etc. can be stored, or information etc. input by an input device etc. can be stored.

[0119] In addition, the above-mentioned processing unit 140 or terminal processing unit 640 can usually be realized by MPU or memory. Usually, the processing sequence of the processing unit 140 or terminal processing unit 640 is realized by software, and the software is recorded in a storage medium such as ROM. However, it can also be realized by hardware (dedicated circuit).

[0120] In addition, the input means that can be used to input information that can be accepted by the accepting unit 130 or the terminal accepting unit 630 may be any one of a numeric keypad, a keyboard, a mouse, a menu screen, etc. The accepting unit 130 or the terminal accepting unit 630 can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or control software of a menu screen, etc.

[0121] In addition, although the receiving unit 120 or the terminal receiving unit 620 is usually realized by wireless or wired communication means, it can also be realized by means of receiving broadcasts.

[0122] In addition, although the transmission unit 170 or the terminal transmission unit 670 is usually realized by wireless or wired communication means, it can also be realized by broadcasting means.

[0123] Furthermore, the information processing device 100 may be composed of one server, or a plurality of servers working in cooperation with each other, or may be an electronic computer built into other equipment, etc. Furthermore, the server may be a so-called cloud server, or an ASP server, etc., and needless to say, the server may be of any type.

[0124] Next, an example of the operation of the information processing device 100 that occurs when a user uses the information processing system 1 according to the present embodiment will be described. In the present embodiment, the user can use the information processing system 1 by, for example, connecting to the information processing device 100 through the information acquisition device 600 or other external device, or receiving information sent from the information processing device 100.

[0125] In the present embodiment, the information processing system 1 is typically used, for example, as follows. That is, the user as an operator uses the information acquisition device 600 to acquire the sole information of the user (which may also be the same as the operator) as the person being diagnosed. In this way, the sole information is sent from the information acquisition device 600 to the information processing device 100, and the information processing device 100 acquires the output information. The information processing device 100 sends (outputs) the acquired output information to the information acquisition device 600, etc. Thus, the user can confirm the output information. When such an information processing system 1 is in operation, the information processing device 100 performs various actions, for example, as follows. The processing unit 140 performs control actions, etc. while using each part, thereby performing these actions.

[0126] Figure 3 This is a flowchart showing an example of the operation of the information processing device 100 .

[0127] (Step S11) The processing unit 140 determines whether information transmitted from the information acquisition device 600 or the like has been received through the receiving unit 120. If it is determined that the information has been received, the process proceeds to step S12, otherwise the process proceeds to step S13.

[0128] (Step S12) The processing unit 140 identifies the user based on the received information, and accumulates the received information in the storage unit 110 in correspondence with the user identifier. For example, when the sole information is sent from the information acquisition device 600 in correspondence with the user identifier of the user who is the person receiving the diagnosis, the processing unit 140 accumulates the received information in the sole information storage unit 117 in correspondence with the user identifier. In addition, even when the user information has been sent, the processing unit 140 accumulates it in the user information storage unit 115 in correspondence with the user identifier.

[0129] (Step S13) The processing unit 140 determines whether a trigger for obtaining output information has occurred. In other words, the processing unit 140 determines whether a condition for starting to obtain output information has been satisfied. If it is determined that a trigger has occurred, the process proceeds to step S14. Otherwise, the process returns to step S11.

[0130] Furthermore, for example, the user's instruction to obtain output information (sending information corresponding to the instruction) through the information acquisition device 600 can be used as the above-mentioned opportunity, but the opportunity is not limited to this. For example, the new reception of sole information can be used as an opportunity when various conditions are met.

[0131] (Step S14) The processing unit 140 performs a determination process for acquiring output information. Such a process will be described later. Thus, the determination information or the output information is acquired and accumulated in the storage unit 110.

[0132] (Step S15) The processing unit 140 outputs the output information to the target user through the output unit 161. The processing unit 140 outputs the output information to the information acquisition device 600 or the like used by the user as the operator, for example, through the transmission unit 170. Thus, the information acquisition device 600 or the like that has received the information can display the output information or the like.

[0133] Figure 4 1 is a flowchart showing an example of the determination process of the information processing device 100 .

[0134] (Step S111 ) The processing unit 140 obtains the sole information and user information of the user from the storage unit 110 based on the user identifier of the user who is the diagnosed person.

[0135] (Step S112 ) The processing unit 140 performs high-resolution processing on the sole information, which is an image, and obtains the high-resolution sole information.

[0136] (Step S113) The processing unit 140 acquires shape information based on the sole information. Here, for example, image recognition processing is performed on the sole information to acquire the shape information.

[0137] (Step S114) The processing unit 140 acquires learning information corresponding to the user information from the learning information storage unit 111. For example, regarding a predetermined attribute such as age or weight, the processing unit 140 acquires learning information formed using teaching data of a user who is in the same group as the user being diagnosed.

[0138] (Step S115) The processing unit 140 applies the acquired sole information and shape information as input information to the learning information, and acquires the determination information. For example, as the determination information, the scores for each of the four observation results are acquired as described above.

[0139] (Step S116) The processing unit 140 obtains output information using the determination information. For example, the output information acquisition process is performed as described below. Thereafter, the process returns to the upper level process.

[0140] Furthermore, the user information may not necessarily be acquired. In addition, the high-resolution processing of the sole information may not be performed. The shape information may not be acquired. In this case, the determination information may be acquired using the sole information and the learning information in step S115.

[0141] Figure 5 1 is a flowchart showing an example of output information acquisition processing of the information processing device 100.

[0142] (Step S141 ) The processing unit 140 resets the counter n and the determination variable to initial values ​​(for example, zero).

[0143] (Step S142 ) The processing unit 140 increases the count n by 1.

[0144] (Step S143) The processing unit 140 determines whether the score of the nth observation result in the determination information satisfies a predetermined determination condition. If it is determined that the determination condition is satisfied, the process proceeds to step S144, otherwise, the process proceeds to step S145. The predetermined determination condition may be, for example, that the score is greater than a predetermined value, but is not limited thereto.

[0145] (Step S144) The processing unit 140 increases the determination variable by 10 points.

[0146] (Step S145) The processing unit 140 determines whether the count n is equal to 4. If n=4, the process proceeds to step S146, otherwise it returns to step S142. That is, in this embodiment, after determining whether the determination condition is satisfied for each of the four observation results, the process after step S146 is performed.

[0147] (Step S146) The processing unit 140 determines whether the determination variable is less than a predetermined value. If it is determined to be less than the predetermined value, the process proceeds to step S147, otherwise, the process proceeds to step S148. For example, the predetermined value can be set to 10. That is, at this time, when there is a score that satisfies the determination condition among the scores of each observation result, the process proceeds to step S147. In addition, the predetermined value can also be set to other values ​​such as 20 or 30.

[0148] (Step S147) The processing unit 140 obtains output information indicating that the user's walking posture is not a knock-footed posture.

[0149] (Step S148) On the other hand, the processing unit 140 obtains output information indicating that the user's walking posture is foot eversion.

[0150] When step S147 or step S148 is completed, the process returns to the upper processing. When such output information is output, the processing unit 140 outputs the output information. Thereafter, a series of processing ends.

[0151] Furthermore, the output information acquisition process may be a process of acquiring the output information using the second learning information as described above. In this case, the output information acquisition process may be performed, for example, as follows.

[0152] Figure 6 1 is a flowchart showing a modified example of the output information acquisition process of the information processing device 100 .

[0153] (Step S151 ) The processing unit 140 obtains the second learning information from the learning information storage unit 111 .

[0154] (Step S152) The processing unit 140 applies the obtained judgment information as input information to the learning information and obtains output information. For example, information indicating that the user's walking posture is foot valgus or information indicating that the user's walking posture is not foot valgus is obtained as output information. Then, the process returns to the upper processing.

[0155] In addition, in the determination process, for example, determination information indicating whether the foot is turned down may be obtained as output information. In this case, the determination process may be performed, for example, as follows.

[0156] Figure 7 : is a flowchart showing a modified example of the determination process of the information processing device 100 .

[0157] (Step S181) The processing unit 140 obtains the sole information of the user from the storage unit 110 based on the user identifier of the user who is the person being diagnosed.

[0158] (Step S182 ) The processing unit 140 performs high-resolution processing on the image, that is, the sole information, and obtains the high-resolution sole information.

[0159] (Step S183) The processing unit 140 acquires learning information that includes sole information as input information and outputs determination information indicating whether the foot is in valgus from the learning information storage unit 111. The learning information may be configured in advance and stored in the learning information storage unit 111.

[0160] (Step S184) The processing unit 140 applies the acquired sole information as input information to the learning information and acquires the determination information. In this modification, the processing unit 140 acquires the determination information indicating whether the foot is in valgus as output information. After that, the process returns to the upper processing.

[0161] And, in Figure 7 In the process shown, Figure 4 The user information and shape information can also be acquired and used in the same manner as the processing shown.

[0162] In the present embodiment, the output information acquired by the information processing device 100 can be output to a user as an operator or a user as a person being diagnosed, for example, as follows. In the following specific example, it is assumed that the output information is sent to a portable information terminal used by a user, namely, an information acquisition device 600, and is displayed on its display screen. In the information acquisition device 600, the output information can be displayed, for example, by a prescribed application. If the user executes a prescribed application in the information acquisition device 600, communication occurs between the information acquisition device 600 and the information processing device 100, and the terminal output unit 660 displays the screen according to the control of the terminal processing unit 640, thereby realizing the function of the prescribed application.

[0163] Figure 8 FIG. 6 is a diagram showing a specific example of a display screen of output information of the information acquisition device 600 .

[0164] In the figure, a result display screen 904 of a specified application is displayed. The result display screen 904 includes, for example: a judgment result display unit 941 indicating whether the foot is everted; and a score display unit 942 indicating the score of each observation result obtained as judgment information. The user can confirm the information indicating whether the foot is everted and the judgment information that is the basis of the judgment through the result display screen 904. In addition, the display form of the output information is not limited to this. In addition, it is also possible to display not for the user who is the person being diagnosed, but for the user who is the operator and other users who are not the person being diagnosed.

[0165] As described above, the information processing device 100 obtains the judgment information using the learning information and the sole information stored in the storage unit 110, so that the information related to the motor function state of the user's body can be easily determined. In this embodiment, an image of the sole of the foot in the grounding state is used as the sole information, so the sole information can be easily prepared.

[0166] In this embodiment, the information processing device 100 can obtain output information related to whether the foot is everted using the judgment information. Thus, it is easy to make a judgment that could not be made by a judge without specialized knowledge in the past. In addition, there will be no judgment deviation due to the judge, so a consistent judgment can be made.

[0167] Furthermore, the processing in this embodiment can also be implemented by software. Furthermore, the software can also be distributed by software downloading, etc. In addition, the software can also be recorded on a storage medium such as a CD and distributed. Furthermore, the software that implements the information processing device 100 in this embodiment is the following program. In other words, the program is a program executed in the computer of the information processing device 100, which enables the computer to function as a sole information acquisition unit, a judgment information acquisition unit, an output information acquisition unit, and an output unit, the sole information acquisition unit acquires sole information related to the sole of the user's foot, the judgment information acquisition unit uses the sole information and the learning information prepared in advance, and acquires the judgment information related to the user's motor function state, the output information acquisition unit acquires the output information according to the judgment information, and the output unit outputs the output information.

[0168] Description of Modifications Related to Foot Sole Information

[0169] In the above-mentioned embodiment, the following information can also be used as the sole information.

[0170] For example, information about the sole of the foot that is not in the ground may be used as the sole information. For example, an image captured of the sole of the foot that is not in the ground may be used.

[0171] In addition, information representing the three-dimensional shape of the sole of the user's foot can also be used as sole information. Such information can also be point group data obtained by scanning the sole of the foot using a laser radar scanner or the like, for example. In this case, the three-dimensional shape of the sole of the foot that is not in a grounded state can be used, and the three-dimensional shape of the sole of the foot that is in a grounded state can also be used. For example, a foot model obtained by taking a mold of a foot that is in a grounded state or a foot that is not in a grounded state can also be scanned to obtain the three-dimensional shape of the sole of the foot. For example, plaster, foamed resin, silicone resin, clay, etc. can be used for taking a mold. By using such a three-dimensional shape, i.e., sole information, it is possible to obtain more accurate judgment information.

[0172] In addition, information related to the pressure distribution of the ground where the sole of the user's foot touches the ground can also be used as sole information. The information related to the pressure distribution can be, for example, information including the pressure values ​​of each point on the ground where the foot touches the ground, or an image representing the pressure distribution. When an image representing the pressure distribution is used as sole information, similar to the above-mentioned embodiment, the judgment information acquisition unit 149 can also be configured to obtain the judgment information using the sole information obtained by high-resolution processing of the sole information. Since such information related to the pressure distribution can be obtained instantly, it can also be easily obtained as information that dynamically represents the changes in the ground contact state of the user's sole when walking, etc. Therefore, it is easy to obtain a high-precision judgment result related to the posture when walking, etc.

[0173] Furthermore, when such information related to pressure distribution is used as sole information, a known pressure sensor can be used to obtain the sole information. That is, as the detection unit 680 of the information acquisition device 600, for example, a thin plate-shaped pressure distribution sensor such as a pressure sensor pad that can detect the two-dimensional distribution of pressure on the surface can be used. In addition, as the detection unit 680 of the information acquisition device 600, for example, a so-called wearable pressure distribution sensor such as a pressure distribution sensor configured to be arranged in the insole part of a shoe can also be used. Since such a wearable device can be used to obtain sole information, the sole information can be monitored at a higher frequency to obtain a judgment result, and the measurement time can be reduced.

[0174] In addition, the sole information may also be information read from a medium on which the user's sole has been recorded. As a medium, for example, a pressure-sensitive paper in which a portion where pressure is applied changes color may be used. In addition, as a medium, for example, a paper on which the user's foot shape is transferred by ink or the like may be used. As sole information, images obtained by reading these media through the detection unit 680 of the information acquisition device 600, i.e., a scanner, or photographing them with a camera may be used. In this way, since the sole information can be obtained using a medium on which the user's sole has been recorded, when obtaining the sole information, the restrictions of location or equipment may be eliminated, and the sole information may be obtained more easily.

[0175] In the above-mentioned embodiment, the sole information is, for example, information related to the sole of one foot of the user, but is not limited thereto. For example, as the sole information, information related to the soles of the two feet of the user can also be used. At this time, for example, the judgment information corresponding to each foot can also be obtained based on the information related to the sole of each foot. For example, the sole information corresponding to the right foot can also be applied to the learning information as input information, thereby obtaining the judgment information corresponding to the right foot, and the sole information corresponding to the left foot can be applied to the learning information as input information, thereby obtaining the judgment information corresponding to the left foot. At this time, as the learning information, the sole information corresponding to the right foot and the sole information corresponding to the left foot can also be used separately. In addition, it can also be configured that the sole information corresponding to one foot is used as a mirror image. In addition, the information related to the sole of the right foot and the information related to the sole of the left foot can also be applied to the learning information as input information to obtain the judgment information. When the judgment information corresponding to the right foot and the left foot is obtained, these can also be used to obtain the output information about the right foot and the output information about the left foot respectively. In addition, the output information that is not distinguished between left and right can also be obtained. By using sole information related to the soles of both feet, it is possible to obtain more accurate judgment information and output information.

[0176] Description of Modifications Related to Output Information

[0177] In the above-mentioned embodiment, the output information may further include the following information. For example, based on the above-mentioned determination result related to the user's walking posture, the output information may further include the following information, or instead of the above-mentioned determination result related to the user's walking posture, the output information may further include the following information.

[0178] That is, the output information may also include, for example, information related to symptoms that may be currently occurring in the user (hereinafter referred to as symptom information). In addition, the output information may also include information related to the risk of future symptoms occurring in the user (hereinafter referred to as risk information). In other words, the output information acquisition unit 151 may also be configured to acquire symptom information based on the judgment information as output information, or to acquire risk information based on the judgment information as output information. Furthermore, the output information acquisition unit 151 may also be configured to acquire symptom information but not risk information, may not acquire symptom information but acquire risk information, or may acquire both symptom information and risk information as output information.

[0179] Here, the symptom is, for example, a feeling or symptom felt by the user himself, that is, a symptom called a subjective symptom, but is not limited to this. For example, the symptom may also be a state of the user felt by a person other than the user, that is, an external symptom. The symptom may also be a symptom obtained by removing the content included as judgment information from the observation results related to the motor function state of the user.

[0180] Along with such symptom information or risk information, the output information may also include improvement suggestions related to the motor function state of the user's body. In other words, the output information may also include improvement suggestions related to the walking posture as described above.

[0181] Furthermore, the output information may include more than two symptom information and more than two risk information. When the output information includes more than two risk information, the output unit 161 may also be configured to output more than two risk information in the order corresponding to the predicted occurrence period of each symptom. For example, it may also be configured to output the risk information related to the symptom predicted to occur earlier in more than two risk information in advance compared with other risk information. In addition, for example, it may also be configured to output the risk information related to the symptom predicted to occur earlier in more than two risk information in a delayed manner compared with other risk information. Outputting a certain information in advance compared with other information, for example, means that it can be displayed at an earlier time, or it can be displayed at a position closer to the upper position when listing and displaying more than two information. That is, the order of output here can be the order in time or the order in position. Furthermore, the output unit 161 may be configured as follows, that is, according to the corresponding information that is matched in advance with the risk information that can be used as output information and the sequence information related to the predicted occurrence period of the symptom corresponding to the risk information, the more than two risk information included in the output information are output in such an order. The corresponding information may be stored in advance in the storage unit 110, for example, but is not limited thereto. The order information herein may also be information indicating an output order determined according to a pre-predicted symptom occurrence period. The method of determining the output order of risk information is not limited thereto.

[0182] For example, when the output information includes judgment information, symptom information, risk information, and improvement proposals, the output unit 161 preferably outputs the output information in the order shown below so that the user can recognize the information. The order here can represent both the order in time and the order in position. Moreover, the order of output is not necessarily limited to this. In addition, there may be information that is not included in the output information.

[0183] That is, the output unit 161 outputs the judgment information first, for example. For example, it is possible to display information on whether the observation result is consistent with each observation result. In this embodiment, for example, for the observation results of floating toes, heel landing, flat feet, high arches, etc., information on whether the observation result is consistent is displayed. It is consistent with the observation result like this.

[0184] Next, the output unit 161 outputs the symptom information. As the symptom information, for example, a conscious symptom that the user is likely to feel and that may be caused by the user's walking posture or walking style, etc., can be output. As an example, the conscious symptom that corresponds to each symptom, such as swelling of the calves, fatigue of the feet, tightness of the front thighs, lateral expansion tendency of the buttocks, and a tendency to lean forward, can be output. In this way, information related to the symptoms that the user is likely to feel is output, thereby enabling the user to effectively recognize that there may be a problem with his or her walking posture or walking style. For the user, since the output information contains information about personal pain, the user can effectively recognize that there may be a problem with his or her walking posture or walking style.

[0185] Next, the output unit 161 outputs the risk information. As risk information, for example, the user's subjective symptoms or other symptoms that may occur in the future to a certain extent due to the user's walking posture or walking style can be output. As an example of risk information, corns are easily formed, ankles become stiff, muscles grow on the inner side of the knees, hammer toes, big toes are turned outward or little toes are turned inward, chronic pain occurs on the knees, chronic pain occurs on the hip joints, and the risk of falling increases. In this way, by outputting information related to the risk of symptoms that will occur in the user in the future, the user can effectively recognize that there may be problems with his or her walking posture or walking style. By prompting future risks, the user can effectively recognize the necessity of taking improvement actions to prevent the occurrence of symptoms. Since the risk information is output together with the symptom information, the user can be more effectively motivated to take improvement actions. Then, the symptom information that the user may feel now can also make the user aware of the risks related to the symptoms that may not have occurred yet, so the user can be more strongly motivated to take improvement actions.

[0186] After that, the output unit 161 outputs the improvement proposal. As an improvement proposal, for example, it can be an item about posture, an item about walking, or an item about both. As an example of an item about posture, it can be cited that attention is paid to correcting the standing posture, attention is paid to standing with the outside of the foot, and the direction of the knee and toe are aligned. In addition, as an example of an item about walking, it can be cited that walking with the toes relaxed, and walking with the legs raised instead of kicking the ground. In this way, by outputting the improvement proposal, the user can be made aware of the actions to be taken to improve the problems related to his or her walking posture or walking style. Since the content of the specific improvement action can be output and the user can be proposed, it is easy for the user to commit to taking the improvement action. Since the improvement proposal is output together with the symptom information or risk information, the user can be motivated to take the improvement action, and the content can be guided, so that the user can easily and surely complete the improvement action. Since the improvement proposal is output on the basis of displaying the symptom information or risk information, the specific content can be guided on the basis of more strongly motivating the user to take the improvement action, and the user can more surely complete the improvement action.

[0187] Furthermore, the improvement proposal may be outputted in a form such as illustrations or images so that the user can recognize more specific items of the improvement proposal. In addition, the improvement proposal may be guided to the user through a video or the like.

[0188] Fig. 9 This is a diagram showing an example of information indicating a correspondence relationship between determination information and output information, etc., according to a modification example of the present embodiment.

[0189] For example, as shown in the figure, the processing involved in the above-mentioned modified example can be implemented using corresponding information representing the corresponding relationship between judgment information and output information. In the example shown here, combined information of information indicating compliance ("1") or non-compliance ("0") with respective observation results of floating toes, heel landing, flat feet, and high arches is used as judgment information. As output information, etc., items of more than two symptom information, risk information, and improvement proposals are included respectively. In each item, for each judgment information, there is corresponding information indicating compliance ("1") or non-compliance ("0") with the output information.

[0190] Based on such corresponding information, the output information acquisition unit 151 can obtain the corresponding symptom information, risk information, improvement proposals, etc. from the judgment information as output information. For example, in the illustrated example, when "1001" (which meets the observation results of floating toes and high arches) is used as the judgment information, the output information will include the following information. That is, as symptom information, information related to symptoms such as easy fatigue of the feet, easy tension of the front thighs, and a tendency to lean forward will be included. In addition, as risk information, information indicating the risks related to symptoms such as the long muscles on the inner side of the knee, the big toe being turned outward or the little toe being turned inward, and hip joint pain is included. In addition, as improvement proposals, items such as correcting the standing posture, standing with the outside of the foot on the ground, and aligning the direction of the knee and toes are included.

[0191] In addition, sequence information is set for each item of risk information. The output unit 161 can output the risk information included in the output information according to the sequence information. That is, when the information is judged to be "1001" as described above, for example, the risk information is output in the order of long muscles of the medial knee, big toe anti-external or little toe anti-external, and hip joint pain according to the sequence information corresponding to each information.

[0192] Furthermore, such corresponding information is an example and is not limited thereto. In addition, the output information acquisition unit 151 can also acquire symptom information, risk information, improvement proposals, etc. based on the judgment information by other methods. For example, it can also be configured to acquire such information according to a predetermined rule based on the judgment result of whether a plurality of respective branch conditions are satisfied.

[0193] The output information according to the present modification is acquired as follows: Here, it is assumed that information indicating whether or not the four observation results described above are satisfied is acquired as the determination information.

[0194] Fig.10 This is a flowchart showing an example of output information acquisition processing of the information processing device 100 according to a modification example of the present embodiment.

[0195] For example, the process shown in the figure is performed as step S116 in the determination process in the above-mentioned embodiment. In step S115 of the determination process, determination information indicating whether or not each of the four observation results is met is acquired.

[0196] (Step S241) The processing unit 140 acquires correspondence information indicating the correspondence relationship between the determination information and the output information, etc. For example, the processing unit 140 acquires the correspondence information previously stored in the storage unit 110, but the present invention is not limited thereto and may acquire the information from an external device, etc.

[0197] (Step S242) The processing unit 140 searches the corresponding information for each item of symptom information, risk information, and improvement proposal corresponding to the determination information, thereby acquiring each item corresponding to the determination information.

[0198] (Step S243) The processing unit 140 obtains output information including the corresponding items and then returns to the upper level processing.

[0199] By acquiring the output information in this way, the output information is subsequently output by the output unit 161 .

[0200] Fig.11 It is a diagram showing a specific example of a display screen of output information of the information acquisition device 600 according to a modification example of the present embodiment.

[0201] In the figure, a result display screen 1904 of a prescribed application program is shown for outputting output information including judgment information, symptom information, risk information, improvement proposals, etc. as output information. The result display screen 1904 includes an output information display unit 946, and the output information display unit 946 includes output information. In addition, regarding the improvement proposal, a display button 947 for displaying specific content is included. By pressing the display button 947, guidance information such as a practical method of a specific improvement action is displayed regarding the improvement proposal. Such guidance information can also be included in the result display screen 1904. In addition, as with the above-mentioned result display screen 904, a judgment result display unit indicating whether the foot is turned outward can also be included. The user can confirm the symptom information, risk information and improvement proposal respectively through the result display screen 1904. In addition, the display form of the output information is not limited to this. For example, one or more of the judgment information, symptom information, risk information and improvement proposal can also be displayed by transitioning to other screens.

[0202] As described above, in this variation, since the output information includes symptom information, risk information, improvement proposals, etc., the user can effectively recognize that there may be problems with his or her walking posture or walking method, or the need to take corrective actions for symptoms that have occurred or the risk of symptoms occurring in the future.

[0203] other

[0204] Fig.12 It is an external view of the computer system 800 in the above-mentioned embodiment. Fig.13 is a block diagram of the computer system 800 .

[0205] These figures show configuration examples of computers such as information processing devices that implement the above-described embodiments by executing the programs described in this specification. The above-described embodiments can be implemented by computer hardware and computer programs executed thereon.

[0206] The computer system 800 includes a computer 801 having an optical disk drive, a keyboard 802 , a mouse 803 , and a monitor 804 .

[0207] In addition to the optical disk drive (ODD) 8012, the computer 801 also includes: MPU 8013; bus 8014 connected to the optical disk drive 8012, etc.; ROM 8015 for storing programs such as a boot program; RAM 8016 connected to the MPU 8013 and used to temporarily store application commands and provide temporary storage space; and a hard disk (HDD) 8017 for storing application programs, system programs, and data. Although not shown in the figure, the computer 801 may also include a network card that provides connection to a LAN.

[0208] In the computer system 800, the program for executing the functions of the information processing device and the like of the above-mentioned embodiment can also be stored in the optical disk 8101, and further transferred to the hard disk 8017 by inserting it into the optical disk drive 8012. Alternatively, the program can also be sent to the computer 801 via a network (not shown) and stored in the hard disk 8017. The program is loaded into the RAM 8016 when it is executed. The program can also be directly loaded from the optical disk 8101 or the network.

[0209] The program may not necessarily include an operating system (OS) or a third-party program that enables the computer 801 to execute the functions of the information processing device of the above-mentioned embodiment. As long as the program calls appropriate functions (modules) in a controlled form and only includes the command part that can obtain the desired result, it will be sufficient. How the computer system 800 works is well known, and a detailed description is omitted.

[0210] Furthermore, in the above-mentioned program, the sending step of sending information or the receiving step of receiving information does not include processing performed by hardware, such as processing performed by a modem or an interface card in the sending step (processing that can only be performed by hardware).

[0211] In addition, the computer that executes the above program may be a single computer or multiple computers, that is, centralized processing or distributed processing may be performed.

[0212] Furthermore, in the above-described embodiments, two or more components present in one device may be physically realized by one medium.

[0213] In addition, in the above-mentioned embodiment, each processing (each function) can be implemented by a single device (system) through centralized processing, or can be implemented by multiple devices through distributed processing (in this case, the system composed of multiple devices performing distributed processing can be grasped as a whole as one "device").

[0214] In addition, in the above-mentioned embodiment, the handover of information between the constituent elements, for example, when the two constituent elements that perform the handover of the information are physically different, can be performed by the output of information from one constituent element and the acceptance of information from the other constituent element, or when the two constituent elements that perform the handover of the information are physically the same, it can also be performed by transferring from the processing phase corresponding to one constituent element to the processing phase corresponding to the other constituent element.

[0215] In addition, in the above-mentioned embodiment, even if it is not clearly described in the above description, information related to the processing performed by each component may be temporarily or long-term stored in a storage medium not shown in the figure, such as information accepted, acquired, selected, generated, sent, received by each component and information such as thresholds, formulas, addresses, etc. used by each component in the processing. In addition, each component or an accumulation unit not shown in the figure may also accumulate information in the storage medium not shown in the figure. In addition, each component or a reading unit not shown in the figure may also read information from the storage medium not shown in the figure.

[0216] In addition, in the above-mentioned embodiments, when information used in each component, such as threshold values ​​or addresses, various set values, etc. used in processing by each component, can be changed by the user, even if it is not clearly stated in the above description, the user can appropriately change this information, or may not change it. When the user can change this information, the change can be achieved, for example, by an unillustrated receiving unit that receives a change instruction from the user and an unillustrated changing unit that changes the information according to the change instruction. The acceptance of the change instruction by the unillustrated receiving unit can be, for example, acceptance from an input device, reception of information sent via a communication line, or acceptance of information read from a specified storage medium.

[0217] The present invention is not limited to the above-described embodiments and their modifications, and various modifications may be made, and the modifications are also included in the scope of the present invention.

[0218] Some components or functions of the above-mentioned embodiments and their modifications may be omitted. In addition, the specific examples of the above-mentioned embodiments and their modifications may be appropriately combined to form the above-mentioned embodiments and their modifications.

[0219] It can also be said that the information processing device according to the above-mentioned embodiment and its modified example is configured as follows. That is, such an information processing device comprises: a sole information acquisition unit for acquiring sole information related to the sole of the user's foot; a determination information acquisition unit that acquires determination information related to the motor function state of the user's body using the sole information and pre-prepared learning information; an output information acquisition unit, which acquires output information according to the diagnostic information; and an output unit for outputting the output information. Industrial Applicability

[0220] As described above, the information processing device according to the present invention has an effect of being able to easily identify information related to the motor functional state of the user's body, and is useful as an information processing device or the like.

Claims

1. An information processing device, characterized in that: The method comprises: a sole information obtaining unit for obtaining sole information related to the sole of a user; a determination information acquisition unit that acquires determination information related to the motor function state of the user's body using the sole information and pre-prepared learning information; and an output unit that outputs output information based on the determination information.

2. The information processing device according to claim 1, characterized in that: The sole information includes information on a ground contact state of a user's sole.

3. The information processing device according to claim 2, characterized in that: The sole information includes information indicating the ground contact state of the sole of the user in time series.

4. The information processing device according to claim 1, characterized in that: The sole information includes an image captured of the sole of the user.

5. The information processing device according to claim 1, characterized in that: The sole information includes information on pressure distribution of the sole of the user that has come into contact with the ground.

6. The information processing device according to claim 1, characterized in that: The sole information includes information indicating the three-dimensional shape of the sole of the user.

7. The information processing device according to claim 1, characterized in that: The determination information acquisition unit is configured to perform high-resolution processing on the foot sole information which is an image, and acquire the determination information using the processing result and the learning information.

8. The information processing device according to claim 1, characterized in that: The sole information includes shape information related to the shape of the sole of the user.

9. The information processing device according to claim 8, characterized in that: The shape information includes at least one of the length and width of the user's foot.

10. The information processing device according to claim 1, characterized in that: A user information acquisition unit is provided for acquiring information related to the user and different from the sole information as user information, The determination information acquisition unit acquires the determination information using the user information.

11. The information processing device according to claim 10, characterized in that: The determination information acquisition unit acquires the determination information using learning information corresponding to the user information among a plurality of learning information prepared in advance.

12. The information processing device according to claim 1, characterized in that: The determination information includes information related to two or more observation results regarding the landing of the sole of a person's foot.

13. The information processing device according to claim 12, characterized in that: The determination information includes respective scores of two or more of the observation results.

14. The information processing device according to claim 12, characterized in that: The determination information acquisition unit acquires information related to each of the two or more observation results by using learning information corresponding to the observation result among a plurality of learning information prepared in advance.

15. The information processing device according to claim 1, characterized in that: The output information includes a determination result regarding the walking posture of the user.

16. The information processing device according to claim 1, characterized in that: The output information includes improvement proposals related to the motor functional state of the user's body.

17. The information processing device according to claim 1, characterized in that: The output information includes information related to a product recommended to the user for consumption.

18. The information processing device according to claim 1, characterized in that: The output information includes information related to symptoms that may be currently occurring in the user.

19. The information processing device according to claim 1, characterized in that: The output information includes information related to the risk of future symptoms occurring in the user.

20. The information processing device according to claim 19, characterized in that: The output information includes two or more pieces of information related to the risk of occurrence of the symptom, The output unit outputs the information on the risk of occurrence of the two or more symptoms in an order corresponding to a predicted occurrence time of each symptom.

21. The information processing device according to claim 1, characterized in that: The output information is information obtained based on the judgment information about the user that has been obtained this time and the judgment information that has been obtained before this time.

22. An information processing system, characterized in that: Having: an information processing device as described in any one of claims 1 to 21; and an information acquisition device capable of communicating with the information processing device, The information acquisition device is configured to record information related to the soles of the user and output the recorded result as sole information. The foot sole information acquisition unit is configured to acquire the foot sole information output by the information acquisition device.

23. An information processing method, implemented using a foot sole information acquisition unit, a judgment information acquisition unit and an output unit, characterized in that: The method comprises: a foot sole information obtaining step, wherein the foot sole information obtaining unit obtains foot sole information related to the foot sole of the user; a determination information acquisition step, wherein the determination information acquisition unit acquires determination information related to the motor function state of the user using the sole information and pre-prepared learning information; and an output step, wherein the output unit outputs output information based on the judgment information.

24. A program, characterized in that it is used to make a computer function as a foot sole information acquisition unit, a judgment information acquisition unit and an output unit, The sole information acquisition unit acquires sole information related to the sole of the user's foot. The determination information acquisition unit acquires determination information related to the motor function state of the user by using the sole information and the learning information prepared in advance. The output unit outputs output information based on the determination information.

Images