Terminal, method for controlling the terminal, and program

Abstract

Provided is a terminal that contributes to more reliably preventing recurrence of a disease. This terminal comprises an acquisition means, an estimation means, a calculation means, and a provision means. The acquisition means acquires biometric information pertaining to a user. The estimation means estimates vital data on the basis of the acquired biological information. The calculation means calculates a disease recurrence risk value indicating a risk of disease recurrence in the user on the basis of the estimated vital data. The provision means provides information that corresponds to the calculated disease recurrence risk value.

Description

Technical Field

[0008] , , , , , , , ,

[0007] , ,

[0001] The present invention relates to a terminal, a control method for the terminal, and a storage medium.

Background Art

[0002] There is a technology for warning a user of a recurrence of illness.

[0003] For example, Patent Document 1 describes providing a device that can automatically record the weights of those who have experienced the onset of heart failure or kidney failure and notify a warning when the likelihood of illness recurrence increases.

[0004] Also, there is a technology for estimating a user's weight based on a face image.

[0005] For example, Patent Document 2 describes enabling weight measurement by analyzing a plurality of face images and the correlation between parts that affect weight and those that do not.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0007] As described in Patent Document 1, there is a correlation between the onset of heart failure and weight gain. However, to prevent the recurrence of diseases such as heart failure, it is necessary to grasp not only weight but also other vital data (e.g., blood pressure, heart rate) and the patient's subjective symptoms (e.g., swelling, shortness of breath, etc.).

[0008] In other words, as disclosed in Patent Document 1, simply observing weight changes may be insufficient to prevent disease recurrence. Furthermore, Patent Document 2 only discloses weight measurement through facial image analysis and is unrelated to preventing disease recurrence.

[0009] The primary objective of this invention is to provide a terminal, a method for controlling the terminal, and a storage medium that contribute to more reliably preventing disease recurrence. [Means for solving the problem]

[0010] According to a first aspect of the present invention, a terminal is provided that includes: an acquisition means for acquiring a user's biometric information; an estimation means for estimating vital data based on the acquired biometric information; a calculation means for calculating a disease recurrence risk value indicating the user's risk of disease recurrence based on the estimated vital data; and a provision means for providing information corresponding to the calculated disease recurrence risk value.

[0011] A second aspect of the present invention provides a terminal control method that acquires the user's biometric information, estimates vital data based on the acquired biometric information, calculates a disease recurrence risk value indicating the user's risk of disease recurrence based on the estimated vital data, and provides information according to the calculated disease recurrence risk value.

[0012] A third aspect of the present invention is provided, which is a computer-readable storage medium that stores a program for causing a computer mounted on a terminal to execute the following: a process for acquiring a user's biometric information; a process for estimating vital data based on the acquired biometric information; a process for calculating a disease recurrence risk value indicating the user's risk of disease recurrence based on the estimated vital data; and a process for providing information according to the calculated disease recurrence risk value. [Effects of the Invention]

[0013] According to each aspect of the present invention, a terminal, a control method for the terminal, and a storage medium are provided that contribute to more reliably preventing disease recurrence. Note that the effects of the present invention are not limited to the above. Instead of, or together with, the above effects, other effects may be achieved by the present invention.

Brief Description of the Drawings

[0014] [Figure 1] FIG. 1 is a diagram for explaining the outline of an embodiment. [Figure 2] FIG. 2 is a flowchart for explaining the operation of an embodiment. [Figure 3] FIG. 3 is a diagram showing an example of the schematic configuration of an information processing system according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of the processing configuration of a user terminal according to the first embodiment. [Figure 5] FIG. 5 is a diagram showing an example of the display of a user terminal according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing an example of a health management database according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing an example of the display of a user terminal according to the first embodiment. [Figure 8] FIG. 8 is a diagram for explaining the operation of a health information providing unit according to the first embodiment. [Figure 9] FIG. 9 is a diagram showing an example of the display of a supporter terminal according to the first embodiment. [Figure 10] FIG. 10 is a flowchart showing an example of the operation of a user terminal according to the first embodiment. [Figure 11] FIG. 11 is a diagram showing an example of the hardware configuration of a user terminal according to the present disclosure.

Modes for Carrying Out the Invention

[0015] First, an overview of an embodiment will be described. Note that the reference numerals in the drawings appended to this overview are for convenience attached to each element as an example to assist understanding, and the description of this overview is not intended to be limiting in any way. Also, unless otherwise specified, the blocks shown in each drawing represent a configuration of functional units rather than a configuration of hardware units. The connection lines between the blocks in each figure include both bidirectional and unidirectional ones. For a unidirectional arrow, it schematically shows the flow of the main signal (data) and does not exclude bidirectionality. In this specification and the drawings, for elements that can be similarly described, duplicate descriptions may be omitted by assigning the same reference numerals.

[0016] The terminal 100 according to an embodiment includes an acquisition unit 101, an estimation unit 102, a calculation unit 103, and a provision unit 104 (see FIG. 1). The acquisition unit 101 acquires biometric information of a user (step S1 in FIG. 2). The estimation unit 102 estimates vital data based on the acquired biometric information (step S2). The calculation unit 103 calculates a disease recurrence risk value indicating the disease recurrence risk of the user based on the estimated vital data (step S3). The provision unit 104 provides information according to the calculated disease recurrence risk value (step S4).

[0017] The terminal 100 acquires biometric information of a user (a user at risk of disease recurrence) and estimates vital data based on the acquired biometric information. For example, the terminal 100 estimates vital data such as the user's weight, blood pressure, heart rate, etc. from the biometric information. The terminal 100 calculates a disease recurrence risk value of the user using the estimated vital data and provides information according to the calculated risk value. For example, when it is determined that the risk (possibility) of disease recurrence is high, the terminal 100 notifies the user himself / herself or his / her supporter to that effect. That is, the terminal 100 calculates a disease recurrence risk value using not only the weight but also other vital data, and provides appropriate information to the user himself / herself or his / her supporter based on the risk value. As a result, an accurate disease recurrence risk is calculated, and with appropriate support from the supporter, the recurrence of the disease is more reliably prevented.

[0018] Specific embodiments will be described in more detail below with reference to the drawings.

[0019] [First Embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0020] [System Overview] Figure 3 is a diagram showing an example of the schematic configuration of an information processing system (information provision system) according to the first embodiment. As shown in Figure 3, the information processing system includes a user and a supporter.

[0021] In this disclosure, the primary users are assumed to be patients at risk of disease recurrence. For example, patients suffering from heart failure are assumed to be users. Users possess a user terminal 10 such as a smartphone. Users input various information into the user terminal 10 and retrieve information from the user terminal 10.

[0022] Supporters assist users with chronic illnesses in their daily lives. Examples of supporters include family doctors, family members, relatives, acquaintances, friends, care staff, and welfare commissioners. Supporters carry a supporter terminal 20, such as a smartphone. Supporters input various information into the supporter terminal 20 and retrieve information from the supporter terminal 20.

[0023] Users at risk of disease recurrence input daily health information into an application installed on user terminal 10. For example, a patient suffering from heart failure will use a "health management application" to input "medical questionnaire information" to prevent a recurrence of heart failure.

[0024] Medical interview information is necessary for doctors to determine whether or not a patient's illness will recur. For example, medical interview information includes "medication information," "subjective symptoms," "medical visit records," "sleep information," "diet information," and "exercise information."

[0025] A "health record book (heart failure record book)" is created when the user enters their medical questionnaire information into the user terminal 10 on a daily basis.

[0026] Furthermore, the user terminal 10 acquires the user's biometric information and estimates the user's vital data from the acquired biometric information. The user terminal 10 calculates the user's disease recurrence risk using the estimated vital data and provides information corresponding to that disease recurrence risk to the user and / or their supporter.

[0027] [User terminal] Figure 4 shows an example of the processing configuration (processing module) of the user terminal 10 according to the first embodiment. Referring to Figure 4, the user terminal 10 includes a communication control unit 201, an identity verification unit 202, a medical interview information control unit 203, a recurrence risk management unit 204, a health information provision unit 205, and a storage unit 206.

[0028] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the support terminal 20. The communication control unit 201 also transmits data to the support terminal 20. The communication control unit 201 passes the data received from other devices to other processing modules. The communication control unit 201 transmits the data acquired from other processing modules to other devices. In this way, other processing modules send and receive data with other devices via the communication control unit 201. The communication control unit 201 has the function of a receiving unit that receives data from other devices and the function of a transmitting unit that transmits data to other devices.

[0029] Of the processing modules that make up the user terminal 10, the "health management application" is mainly realized by the identity verification unit 202, the medical interview information control unit 203, the recurrence risk management unit 204, and the health information provision unit 205.

[0030] The identity verification unit 202 is a means of verifying the identity of the user operating the user terminal 10. The identity verification unit 202 verifies the user's identity before the user enters the medical questionnaire information. In other words, the identity verification unit 202 prevents a third party other than the user from entering the medical questionnaire information into the health management application.

[0031] The user terminal 10 stores the owner's biometric information (e.g., facial information, fingerprint information). When the user performs an action to launch the health management application (e.g., clicking the corresponding icon), the identity verification unit 202 obtains biometric information (e.g., facial information, fingerprint information) to authenticate the user.

[0032] The identity verification unit 202 determines that identity verification has been successful if the biometric information registered in advance and the biometric information acquired when the health management application is launched substantially match. If identity verification fails, the identity verification unit 202 cancels the launch of the health management application. If identity verification is successful, the identity verification unit 202 completes the launch of the health management application.

[0033] The process of verifying identity using biometric information is self-evident to those skilled in the art, so a detailed explanation is omitted. For example, the identity verification unit 202 calculates the similarity between feature quantities generated from the facial image. If the similarity is equal to or greater than a predetermined value, the identity verification unit 202 determines that the identity verification has been successful.

[0034] Furthermore, the identity verification unit 202 may perform identity verification using other information instead of or in addition to biometric information. For example, the identity verification unit 202 may perform identity verification (authentication) using a password or the like.

[0035] The medical interview information control unit 203 is a means for controlling medical interview information obtained from the user. The medical interview information control unit 203 includes the function of an acquisition unit (acquisition means) that acquires the user's biological information and medical interview information, and the function of an estimation unit (estimation means) that estimates vital data based on the acquired biological information.

[0036] Once the user's identity has been successfully verified and a predetermined action has been performed on the health management application (for example, pressing the health record input button), the medical questionnaire information control unit 203 displays a GUI (Graphical User Interface) for acquiring medical questionnaire information. For example, the medical questionnaire information control unit 203 acquires medical questionnaire information using a GUI as shown in Figure 5.

[0037] In the example shown in Figure 5, subjective symptoms such as "shortness of breath," "swelling," "easy fatigue," "decreased appetite," and "insomnia" are acquired. Exercise information, such as whether or not exercise was performed, is also acquired. Furthermore, medication information, such as whether or not medication was taken at each time of day (morning, noon, and evening), is acquired. Note that the display shown in Figure 5 is an example and is not intended to limit the items or display methods. For example, the medical interview information control unit 203 may automatically display and record the date and time (year, month, day, hour, minute, second) when the user enters information into the health record. Alternatively, considering that users are often elderly, the medical interview information control unit 203 may provide an interface that allows input of one item at a time on a larger screen, rather than an interface that allows input of all items on a single screen. Alternatively, the medical interview information control unit 203 may support not only information input using a touch panel but also information input by voice. Alternatively, the medical interview information control unit 203 may automatically acquire input data from other wearable devices or health applications and automatically display the acquired data.

[0038] The medical interview information control unit 203 stores the acquired medical interview information in the health management database (see Figure 6). Note that the health management database shown in Figure 6 is an example and is not intended to limit the items to be stored. For example, the acquired user's biometric information may also be registered in the health management database.

[0039] The medical interview information control unit 203 acquires the user's biometric information while the user is entering medical interview information. Specifically, the medical interview information control unit 203 acquires image data (still image data, video data) including the user's face image by taking a picture of the user while they are entering the medical interview information.

[0040] When the medical interview information control unit 203 acquires video data, it will, for example, acquire video data of about 30 seconds.

[0041] When the medical information control unit 203 acquires the user's biometric information (for example, video data obtained by photographing the user), it uses the acquired biometric information to estimate the user's vital data.

[0042] For example, the medical interview information control unit 203 analyzes the acquired biometric information to obtain estimated values ​​of vital data such as the user's weight, heart rate, blood pressure, blood glucose level, and oxygen saturation.

[0043] Furthermore, the analysis of biometric information (video data including facial information) for estimating vital data may be performed using a machine learning model. For example, a company developing a health management application might generate a learning model using a large amount of training data consisting of combinations of video data including facial information and vital data measurement results.

[0044] For example, a user's weight is related to the contours of their face, and a learning model utilizing this relationship (a learning model that can obtain weight when a face image is input) can be generated. Also, heart rate is related to changes in the brightness of the face surface (brightness of the face surface resulting from blood flow), and a learning model utilizing this relationship (a learning model that can obtain heart rate when multiple face images are input) can be generated. Furthermore, facial swelling can be estimated from the physical distance of facial feature points and blood flow, and a learning model for estimating facial swelling can be generated.

[0045] The generated learning model is implemented on the user terminal 10 as part of the health management application.

[0046] The medical interview information control unit 203 inputs the acquired biometric information (for example, video data including facial information) into the learning model to obtain estimated vital data. The medical interview information control unit 203 stores the acquired estimated vital data in the health management database.

[0047] The recurrence risk management unit 204 is a means for managing the user's risk of disease recurrence. The recurrence risk management unit 204 functions as a calculation unit (calculation means) that calculates a disease recurrence risk value indicating the user's risk of disease recurrence based on estimated vital data.

[0048] The recurrence risk management unit 204 quantifies the risk of a user's illness recurring periodically or at predetermined intervals. For example, the recurrence risk management unit 204 calculates the "disease recurrence risk value" when it successfully estimates vital data from the biometric information obtained when the medical questionnaire information is entered. For example, the recurrence risk management unit 204 calculates a disease recurrence risk value on a 10-point scale.

[0049] For example, the recurrence risk management unit 204 calculates a disease recurrence risk value using estimated vital data. The recurrence risk management unit 204 can use a learning model to calculate the disease recurrence risk value.

[0050] Companies developing health management applications prepare a large amount of vital data (or a combination of multiple vital data) with disease recurrence risk values ​​assigned as labels, as training data. These companies collect the above training data in cooperation with doctors and other professionals who possess specialized knowledge.

[0051] Machine learning is performed using the collected training data, and a learning model (classifier) ​​is generated. Any algorithm, such as support vector machines, boosting, or neural networks, can be used to generate the learning model. Since the above-mentioned algorithms, such as support vector machines, are based on publicly known techniques, their explanation is omitted.

[0052] The generated learning model is implemented on the user terminal 10 as part of the health management application.

[0053] The recurrence risk management unit 204 obtains disease recurrence risk values ​​by inputting the latest vital data into a learning model.

[0054] Alternatively, the recurrence risk management unit 204 may calculate the disease recurrence risk value based on the medical questionnaire information entered by the user. For example, if medical questionnaire information such as coughing and insomnia is entered, the recurrence risk management unit 204 will calculate a higher disease recurrence risk value. In this case as well, the recurrence risk management unit 204 may use a learning model to calculate the disease recurrence risk value.

[0055] Alternatively, the health management application (recurrence risk management unit 204) may calculate the disease recurrence risk value based on interview information (e.g., subjective symptoms, exercise information, etc.) and estimated vital data. In this case, the recurrence risk management unit 204 can use a learning model generated using interview information and vital data to which labels (disease recurrence risk value) have been assigned.

[0056] The recurrence risk management unit 204 stores the calculated disease recurrence risk value in the health management database.

[0057] The health information provision unit 205 is a means of providing information related to the user's health. Specifically, the health information provision unit 205 provides information in accordance with the calculated disease recurrence risk value. For example, based on the disease recurrence risk value, the health information provision unit 205 provides information related to the user's health to at least one of the user and their supporter.

[0058] The health information provision unit 205 performs processing according to the calculated disease recurrence risk value. The health information provision unit 205 accesses the health management database periodically or at predetermined intervals to obtain the latest disease recurrence risk value.

[0059] For example, if the disease recurrence risk value is lower than a predetermined value, the health information provision unit 205 does not take any special action.

[0060] If the disease recurrence risk value is above a predetermined value, the health information provision department 205 will notify the individual and / or their supporter of the fact that the disease recurrence risk is high.

[0061] Specifically, the health information provision unit 205 generates health information that includes information about the user's health. For example, the health information provision unit 205 generates health information that includes disease recurrence risk values, estimated vital data values, and medical interview information.

[0062] The Health Information Provision Unit 205 provides (notifies) the generated health information to the individual and / or their caregiver.

[0063] When providing health information to the individual, the health information provision unit 205 displays a message as shown in Figure 7 to notify the user of the fact that the risk of disease recurrence is high. In this case, the health information provision unit 205 may also notify the user of the disease recurrence risk value as shown in Figure 7.

[0064] When providing health information to a supporter, the health information provision unit 205 sends a "health information notification" containing health information and the user's personal information (e.g., name) to the supporter's terminal 20 (e.g., family doctor, family member, care staff, etc.) (see Figure 8). The supporter's terminal 20 displays the health information and other information contained in the received health information notification.

[0065] For example, upon receiving a health information notification, the support terminal 20 displays information as shown in Figure 9. Note that the display shown in Figure 9 is illustrative and not intended to limit the content or display method displayed on the support terminal 20. For example, the support terminal 20 may display a graph showing the time-series changes in the user's vital data (blood pressure, heart rate, etc.) or data such as medication status, either in place of or in addition to the disease recurrence risk value.

[0066] The recipients of health information notifications are pre-stored on the user terminal 10. For example, the email address of a primary care physician is registered on the user terminal 10 as a recipient of health information notifications. When a user registers the contact information of a supporter on the user terminal 10, it is treated as if consent (user consent) has been obtained for the information to be provided to that supporter. Alternatively, the recipients of health information notifications may be stored on a server on the network (a server on the cloud) or on other devices. The user terminal 10 accesses the server on the cloud or other devices as needed. The server on the cloud or other devices may verify the permissions of the user terminal 10, and if there are no problems with the verification, they may send the recipients of health information notifications to the user terminal 10.

[0067] Thus, if the disease recurrence risk value is above a predetermined value (first threshold), the health information provision unit 205 notifies the user that the risk of disease recurrence is high. Alternatively, if the disease recurrence risk value is above a predetermined value (second threshold), the health information provision unit 205 notifies the supporter assisting the user that the risk of disease recurrence is high. The first threshold and the second threshold may be the same value or different values.

[0068] The memory unit 206 is a means for storing information necessary for the operation of the user terminal 10.

[0069] The operation of the user terminal 10 described above can be summarized as shown in the flowchart in Figure 10.

[0070] First, the user terminal 10 verifies the identity of the user who is launching the health management application (step S101).

[0071] If identity verification is successful, the user terminal 10 obtains medical questionnaire information from the user (step S102).

[0072] The user terminal 10 acquires the user's biometric information by taking a photograph of the user while they are entering medical questionnaire information (step S103). For example, the user terminal 10 acquires still image data or video data obtained by taking a photograph of the user as biometric information.

[0073] The user terminal 10 estimates the user's vital data using the acquired biometric information (step S104).

[0074] The user terminal 10 calculates the disease recurrence risk value using at least estimated vital data (step S105).

[0075] If the risk of disease recurrence is high, the user terminal 10 notifies the user and / or their caregiver of this fact (notification of disease recurrence risk; step S106).

[0076] [Supporter terminal] Examples of supporter terminals 20 include mobile devices such as smartphones, mobile phones, game consoles, and tablets, as well as computers (personal computers, laptops). The supporter terminal 20 can be any device that can receive input from the supporter and communicate with the user terminal 10, etc. Furthermore, the configuration of the supporter terminal 20 is obvious to those skilled in the art, so a detailed explanation is omitted.

[0077] As described above, the user terminal 10 according to the first embodiment acquires biometric information of users at risk of disease recurrence and estimates vital data based on the acquired biometric information. The user terminal 10 calculates the user's disease recurrence risk value using the estimated vital data and provides information according to the calculated risk value. For example, if the user terminal 10 determines that there is a high risk (possibility) of disease recurrence, it notifies the user or their caregiver accordingly. In order to prevent the recurrence of diseases such as heart failure, it is necessary to identify the signs in advance and take appropriate measures. If the user terminal 10 detects signs of disease recurrence from estimated vital data, it notifies the user or their caregiver (family doctor, family, care staff, etc.) of this fact. As a result, appropriate measures are taken before the disease actually recurs, and disease recurrence is prevented.

[0078] Next, we will describe the hardware of the user terminal 10. Figure 11 shows an example of the hardware configuration of the user terminal 10.

[0079] The user terminal 10 can be configured using an information processing device (a so-called computer), and has the configuration illustrated in Figure 11. For example, the user terminal 10 includes a processor 311, memory 312, input / output interface 313, and communication interface 314, etc. The components of the processor 311, etc., are connected by an internal bus or the like and are configured to communicate with each other.

[0080] However, the configuration shown in Figure 11 is not intended to limit the hardware configuration of the user terminal 10. The user terminal 10 may include hardware not shown, and it may not have an input / output interface 313 if necessary. Also, the number of processors 311 etc. included in the user terminal 10 is not intended to be limited to the example in Figure 11; for example, multiple processors 311 may be included in the user terminal 10.

[0081] The processor 311 is a programmable device such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or DSP (Digital Signal Processor). Alternatively, the processor 311 may be a device such as an FPGA (Field Programmable Gate Array) or ASIC (Application Specific Integrated Circuit). The processor 311 executes various programs, including an operating system (OS).

[0082] Memory 312 includes RAM (Random Access Memory), ROM (Read Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc. Memory 312 stores the OS program, application programs, and various data.

[0083] The input / output interface 313 is an interface for a display device or input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a device that accepts user input such as a keyboard or mouse.

[0084] The communication interface 314 is a circuit, module, etc., that communicates with other devices. For example, the communication interface 314 includes a NIC (Network Interface Card), etc.

[0085] The functions of the user terminal 10 are realized by various processing modules. These processing modules are realized, for example, by the processor 311 executing a program stored in memory 312. The program can also be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as semiconductor memory, hard disk, magnetic recording medium, or optical recording medium. In other words, the present invention can also be embodied as a computer program product. Furthermore, the program can be downloaded via a network or updated using the storage medium on which the program is stored. Moreover, the processing module may be realized by a semiconductor chip.

[0086] The user terminal 10, which is an information processing device, is equipped with a computer, and its functions can be realized by having the computer execute a program. Furthermore, the user terminal 10 executes a control method for the user terminal 10 through this program.

[0087] [Differentiation] The configuration and operation of the information processing system described in the above embodiment are illustrative examples and are not intended to limit the system configuration.

[0088] In the above embodiment, heart failure was used as an example of a disease with a risk of recurrence. However, the diseases to which the present disclosure can be applied are not limited to heart failure. The present disclosure can be applied to any disease. For example, the user terminal 10 (health management application) of the present disclosure can provide information on the recurrence or worsening of other diseases, not limited to heart failure, such as other cardiovascular diseases and diabetes.

[0089] In the above embodiment, it was explained that identity verification is performed when the health management application is launched. However, if identity verification is performed when the user terminal 10 is launched, identity verification when launching the health management application may be omitted.

[0090] When acquiring biometric information (still image data or video data) of a user while they are entering medical questionnaire information, the user terminal 10 may obtain consent from the user to photograph them. Alternatively, the user terminal 10 may display the image data being captured on the medical questionnaire input screen.

[0091] In the above embodiment, the user terminal 10 was described as acquiring medical questionnaire information using a GUI as shown in Figure 5. However, medical questionnaire information may be acquired by other methods. For example, the user terminal 10 may acquire medical questionnaire information by voice input. Alternatively, the user terminal 10 may acquire medical questionnaire information by selecting questions or answering them using a chatbot or the like.

[0092] In the above embodiment, the case in which the user terminal 10 obtains medical information from the user using a GUI was described. However, the user terminal 10 may estimate all or part of the medical information depending on the manner in which the user operates the user terminal 10 (how it is operated). For example, the user terminal 10 may estimate the presence or absence of "dementia" based on the accuracy and smoothness of the user's text input. For example, the user terminal 10 may estimate that a user is suffering from "dementia" if it determines that the user is spending a lot of time on data input or that the number of input errors has increased drastically, based on the time taken for past data input and the frequency of input errors.

[0093] In the above embodiment, it was explained that the user terminal 10 acquires biometric information (image data including facial images) necessary for estimating vital data while the user is inputting medical questionnaire information. However, this biometric information may be acquired not only when the user is inputting medical questionnaire information, but also when the user is operating other applications, etc. For example, the user terminal 10 may acquire biometric information while the user is using an SNS (Social Networking Service) application or browsing a web page.

[0094] The user terminal 10 may obtain all or part of the medical questionnaire information (e.g., medication information, sleep information, etc.) from an application other than the health management application. For example, the user terminal 10 may obtain the medical questionnaire information from an application that manages medication or an application that measures the quality of sleep.

[0095] If the user terminal 10 detects that medical questionnaire information has not been entered regularly, it may notify the support person (e.g., the primary care physician or family member). Alternatively, if the user terminal 10 determines, based on the acquired medical questionnaire information, that the user is not taking the necessary medication (in the case of forgotten medication), it may notify the user or their support person (e.g., family member). Alternatively, if the user terminal 10 is able to acquire information about the user's meals, and the user has consumed too much salt or not enough fluids, it may notify the user or their support person.

[0096] Users may wear a device capable of measuring blood pressure, heart rate, etc. (a so-called wearable device). User terminal 10 may acquire vital data from the wearable device. Specifically, user terminal 10 may acquire vital data measured by the wearable device using short-range wireless communication means such as Bluetooth®. User terminal 10 may use all or part of the vital data acquired from the wearable device to calculate the disease recurrence risk value. That is, user terminal 10 may calculate the disease recurrence risk value using vital data acquired from other devices (health equipment; for example, wearable devices, scales, blood pressure monitors).

[0097] The user terminal 10 may acquire biometric information from image data showing the user's entire body, not just their face. Alternatively, the user terminal 10 may acquire biometric information from image data showing only a part of the user's face. For example, the user terminal 10 may acquire biometric information from image data (still image data, video data) showing both of the user's eyes (pupils).

[0098] The user terminal 10 may estimate vital data using acquired whole-body image data and pupil image data. For example, the user terminal 10 may estimate heart rate, respiratory rate, etc., from shoulder movement, or acquire pupil size (dilation) as vital data.

[0099] The user terminal 10 (medical information control unit 203) may use different biometric information (still image data, video data) and learning models depending on the type of vital data to be estimated. For example, when estimating weight, the user terminal 10 estimates the user's weight by inputting still image data (part of video data) into a learning model dedicated to weight estimation. Alternatively, when estimating blood pressure or heart rate, the user terminal 10 estimates the user's blood pressure and heart rate by inputting video data (multiple still image data) into a learning model dedicated to blood pressure estimation or heart rate estimation. By using biometric information and learning models suitable for the vital data to be estimated, the user terminal 10 can obtain more accurate vital data. Alternatively, the user terminal 10 may acquire video data, etc., suitable for the vital data to be estimated. For example, the user terminal 10 may acquire (generate) video with a frame rate suitable for the vital data to be estimated.

[0100] The user terminal 10 may use the acquired biometric information for purposes other than estimating vital data. For example, the user terminal 10 may use the acquired biometric information to estimate whether or not the user has dementia or a genetic disorder. For example, the user terminal 10 may input still image data, including the user's face image, into a learning model to determine whether or not the user has dementia or a genetic disorder.

[0101] Alternatively, the user terminal 10 may estimate (generate) medical interview information using the acquired biometric information. For example, the user terminal 10 may estimate "ease of fatigue" by inputting a facial image into a learning model. Alternatively, the user terminal 10 may estimate the user's emotions (joy, anger, sadness, pleasure) by inputting the acquired biometric information into a learning model. That is, the user terminal 10 may estimate the user's emotions (feelings, mood) by analyzing the user's "facial expressions." Alternatively, the user terminal 10 may use different learning models depending on the user's age.

[0102] The user terminal 10 may calculate the disease recurrence risk value using not only the latest estimated vital data but also estimated vital data acquired in the past. For example, the user terminal 10 may calculate the disease recurrence risk value by inputting estimated vital data acquired over a predetermined period (e.g., one week) into a learning model. In this case, the disease recurrence risk value is calculated taking into account changes (percentage of change) in the estimated vital data, so the disease recurrence risk can be grasped more accurately. Similarly, the user terminal 10 may calculate the disease recurrence risk value using estimated vital data and medical interview information over a predetermined period.

[0103] In the above embodiment, it was explained that the user terminal 10 does not perform any special action (notification) if the disease recurrence risk value is lower than a predetermined value. However, if the disease recurrence risk value is low, the user terminal 10 may notify the user or their supporter of the fact that the disease recurrence risk is low.

[0104] The user terminal 10 may change the recipient and content of health information notifications depending on the degree of disease recurrence risk. For example, if the disease recurrence risk is very high (the disease recurrence risk value is greater than a predetermined threshold), the user terminal 10 will notify the user and their supporter accordingly. Conversely, if the recurrence risk is not very high, the user terminal 10 may limit itself to providing the user with advice on lifestyle improvements, etc. The user terminal 10 may send health information to the user if the disease recurrence risk value exceeds a first threshold, and may send health information to the user and their supporter if the disease recurrence risk value exceeds a second threshold.

[0105] The health record (a collection of medical questionnaire information and estimated vital data) generated by the user terminal 10 may be shared with medical institutions, etc. For example, the user may submit the health record (contents of the health management database) to the medical institution during an online consultation by operating the user terminal 10.

[0106] In the above embodiment, it was explained that health information (disease recurrence risk value, medical interview information, and estimated vital data values) generated by the user terminal 10 is provided to supporters, etc. However, this health information may also be provided to private companies or public institutions such as local governments. For example, with the user's consent, the user terminal 10 may provide medical interview information and estimated vital data values ​​to insurance companies or retailers. Users who provide such medical interview information and estimated vital data values ​​may be paid a sum of money. In other words, a data utilization business related to medical interview information and estimated vital data values ​​may be conducted. For example, data may be provided to insurance companies for the development of insurance products, or data may be provided to retailers for the promotion of health foods.

[0107] The user terminal 10 may award points to the user each time they enter medical questionnaire information, in order to motivate them to input medical questionnaire information.

[0108] In the above embodiment, a case was described in which a health management database is configured inside the user terminal 10, but the database may be built on an external database server or the like. That is, the information processing system may include a server device, and the server device may manage the health status of each user (medical interview information, estimated vital data). Furthermore, the server device may perform control related to the notification of health information (provision of health information). In other words, some functions of the user terminal 10 may be implemented in another device or the like.

[0109] The form of data transmission and reception between each device (user terminal 10, supporter terminal 20) is not particularly limited, but the data transmitted and received between these devices may be encrypted. Personal information such as medical interview information is transmitted and received between these devices, and it is desirable that encrypted data be transmitted and received in order to appropriately protect this information.

[0110] In the flowcharts (sequence diagrams) used in the above description, multiple processes (processes) are shown in order, but the execution order of the processes performed in the embodiment is not limited to the order in which they are shown. In the embodiment, the order of the illustrated processes can be changed to the extent that it does not impair the content, for example, by executing each process in parallel.

[0111] The embodiments described above are explained in detail to facilitate understanding of the disclosure, and it is not intended that all the configurations described above are necessary. Furthermore, when multiple embodiments are described, each embodiment may be used individually or in combination. For example, it is possible to replace parts of the configuration of one embodiment with those of another embodiment, or to add configurations from other embodiments to the configuration of one embodiment. In addition, it is possible to add, delete, or replace parts of the configuration of one embodiment with those of another.

[0112] As described above, the industrial applicability of the present invention is clear, and it is particularly suitable for application to information processing systems that provide users with health-related information.

[0113] Some or all of the above embodiments may also be described as follows, but are not limited to the following: [Note 1] Methods for acquiring the user's biometric information, Estimation means for estimating vital data based on the acquired biological information, A calculation means for calculating a disease recurrence risk value indicating the user's disease recurrence risk based on the estimated vital data, A means of providing information corresponding to the calculated disease recurrence risk value, A terminal equipped with the following features. [Note 2] The acquisition means acquires the user's medical interview information, The calculation means is a terminal as described in Appendix 1, which calculates the disease recurrence risk value based on the medical interview information and the estimated vital data. [Note 3] The acquisition means is the terminal described in Appendix 2, which acquires the biometric information while the user is inputting the medical questionnaire information. [Note 4] The providing means is a terminal as described in Appendix 3, which provides information about the user's health to at least one of the user and the user's supporter based on the disease recurrence risk value. [Note 5] The aforementioned means of providing information is a terminal as described in Appendix 4, which notifies the user that there is a high risk of disease recurrence when the disease recurrence risk value is above a predetermined value. [Note 6] The aforementioned means of providing information is a terminal as described in Appendix 4, which notifies a supporter assisting the user that the risk of disease recurrence is high when the disease recurrence risk value is above a predetermined value. [Note 7] The terminal described in Appendix 4, further comprising a means for verifying the identity of the user before the user enters the medical questionnaire information. [Note 8] The acquisition means is a terminal described in any one of the appendices 1 to 7, which acquires still image data or video data obtained by photographing the user as biometric information. [Note 9] On the device, By acquiring the user's biometric information, Based on the acquired biological information, vital data is estimated. Based on the estimated vital data, a disease recurrence risk value indicating the user's risk of disease recurrence is calculated. A terminal control method that provides information corresponding to the calculated disease recurrence risk value. [Note 10] On the computer installed in the terminal, The process of acquiring the user's biometric information, A process for estimating vital data based on the acquired biological information, A process for calculating a disease recurrence risk value indicating the user's disease recurrence risk based on the estimated vital data, The process involves providing information corresponding to the calculated disease recurrence risk value, A computer-readable storage medium that stores a program to execute.

[0114] Furthermore, each disclosure of the above-mentioned prior art documents cited herein is incorporated herein by reference. Although embodiments of the present invention have been described above, the present invention is not limited to these embodiments. It will be understood by those skilled in the art that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. That is, the present invention naturally includes the entire disclosure, including the claims, and various modifications and alterations that can be made by those skilled in the art in accordance with the technical idea. [Explanation of Symbols]

[0115] 10. User terminals 20 Supporter terminals 100 devices 101 Acquisition method 102 Estimation means 103 Calculation method 104 Means of provision 201 Communication Control Unit 202 Identity Verification Department 203 Medical Interview Information Control Unit 204 Recurrence Risk Management Department 205 Health Information Department 206 Memory section 311 Processors 312 memory 313 Input / Output Interfaces 314 Communication Interface

Claims

1. Methods for acquiring the user's biometric information, Estimation means for estimating vital data based on the acquired biological information, A calculation means for calculating a disease recurrence risk value indicating the user's disease recurrence risk based on the estimated vital data, A means of providing information corresponding to the calculated disease recurrence risk value, Equipped with, The aforementioned means of providing is If the disease recurrence risk value is greater than the first threshold and less than or equal to the second threshold, the user shall be provided with health information, which is information relating to the user's health. A terminal that provides the health information to the user and supporter when the disease recurrence risk value exceeds the second threshold.

2. The acquisition means acquires the user's medical interview information, The terminal according to claim 1, wherein the calculation means calculates the disease recurrence risk value based on the medical interview information and the estimated vital data.

3. The acquisition means is a terminal according to claim 2, which acquires the biometric information while the user is inputting the medical questionnaire information.

4. The terminal according to claim 3, wherein the providing means provides information about the user's health to at least one of the user and the user's supporter based on the disease recurrence risk value.

5. The terminal according to claim 4, wherein the providing means notifies the user that the risk of disease recurrence is high when the disease recurrence risk value is above a predetermined value.

6. The terminal according to claim 4, wherein the providing means notifies a supporter assisting the user that the risk of disease recurrence is high when the disease recurrence risk value is above a predetermined value.

7. The terminal according to claim 4, further comprising an identity verification means for verifying the identity of the user before the user inputs the medical questionnaire information.

8. The terminal according to any one of claims 1 to 7, wherein the acquisition means acquires still image data or video data obtained by photographing the user as the biometric information.

9. On the device, By acquiring the user's biometric information, Based on the acquired biological information, vital data is estimated. Based on the estimated vital data, a disease recurrence risk value indicating the user's risk of disease recurrence is calculated. A terminal control method that provides information corresponding to the calculated disease recurrence risk value, If the disease recurrence risk value is greater than the first threshold and less than or equal to the second threshold, the user shall be provided with health information, which is information relating to the user's health. A terminal control method that provides the health information to the user and supporter when the disease recurrence risk value exceeds the second threshold.

10. On the computer installed in the terminal, The process of acquiring the user's biometric information, A process for estimating vital data based on the acquired biological information, A process for calculating a disease recurrence risk value indicating the user's disease recurrence risk based on the estimated vital data, The process involves providing information corresponding to the calculated disease recurrence risk value, A program to execute, The process for providing the aforementioned information is: If the disease recurrence risk value is greater than the first threshold and less than or equal to the second threshold, the user shall be provided with health information, which is information relating to the user's health. A program that provides the user and supporter with the health information if the disease recurrence risk value exceeds the second threshold.

Images