Terminal, terminal control method and program

Abstract

Provided is a terminal that contributes to more reliably preventing recurrence of a disease. This terminal comprises an acquisition means, an estimation means, a calculation means, and a provision means. The acquisition means acquires biometric information pertaining to a user. The estimation means estimates vital data on the basis of the acquired biological information. The calculation means calculates a disease recurrence risk value indicating a risk of disease recurrence in the user on the basis of the estimated vital data. The provision means provides information that corresponds to the calculated disease recurrence risk value.

Description

Terminal, terminal control method, and storage medium

[0001] The present invention relates to a terminal, a terminal control method, and a storage medium.

[0002] Technology exists to warn users of recurrence of their illness.

[0003] For example, Patent Document 1 describes that a device is provided that can automatically record the weight of a person who has experienced heart failure or renal failure and issue a warning when the possibility of the disease recurring becomes high.

[0004] There is also a technology that estimates a user's weight based on a facial image.

[0005] For example, Patent Document 2 describes that it is possible to analyze a plurality of facial images and measure weight based on the correlation between parts that affect weight and parts that do not.

[0006] JP 2015-164502 A JP 2017-041218 A

[0007] As described in Patent Document 1, there is a correlation between the onset of heart failure and weight gain. However, in order to prevent the recurrence of diseases such as heart failure, it is necessary to understand not only weight but also other vital data (e.g., blood pressure, heart rate) and subjective symptoms of the patient (e.g., swelling, shortness of breath, etc.).

[0008] That is, there is a possibility that simply observing weight changes may not be sufficient to prevent disease recurrence, as disclosed in Patent Document 1. Patent Document 2 merely discloses measuring weight by analyzing facial images, and is unrelated to preventing disease recurrence.

[0009] A primary object of the present invention is to provide a terminal, a terminal control method, and a storage medium that contribute to more reliably preventing disease recurrence.

[0010] According to a first aspect of the present invention, there is provided a terminal comprising: an acquisition means for acquiring biometric information of a user; an estimation means for estimating vital data based on the acquired biometric information; a calculation means for calculating a disease recurrence risk value indicating the user's risk of disease recurrence based on the estimated vital data; and a provision means for providing information according to the calculated disease recurrence risk value.

[0011] According to a second aspect of the present invention, there is provided a method for controlling a terminal, in which the terminal acquires biometric information of a user, estimates vital data based on the acquired biometric information, calculates a disease recurrence risk value indicating the user's risk of disease recurrence based on the estimated vital data, and provides information according to the calculated disease recurrence risk value.

[0012] According to a third aspect of the present invention, a computer-readable storage medium is provided that stores a program for causing a computer mounted on a terminal to execute the following processes: acquiring a user's biometric information; estimating vital data based on the acquired biometric information; calculating a disease recurrence risk value indicating the user's risk of disease recurrence based on the estimated vital data; and providing information according to the calculated disease recurrence risk value.

[0013] According to each aspect of the present invention, a terminal, a terminal control method, and a storage medium are provided that contribute to more reliably preventing disease recurrence. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above.

[0014] FIG. 1 is a diagram illustrating an overview of an embodiment. FIG. 2 is a flowchart illustrating an operation of an embodiment. FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to a first embodiment. FIG. 4 is a diagram illustrating an example of a processing configuration of a user terminal according to the first embodiment. FIG. 5 is a diagram illustrating an example of a display of a user terminal according to the first embodiment. FIG. 6 is a diagram illustrating an example of a health management database according to the first embodiment. FIG. 7 is a diagram illustrating an example of a display of a user terminal according to the first embodiment. FIG. 8 is a diagram illustrating an operation of a health information providing unit according to the first embodiment. FIG. 9 is a diagram illustrating an example of a display of a supporter terminal according to the first embodiment. FIG. 10 is a flowchart illustrating an example of an operation of a user terminal according to the first embodiment. FIG. 11 is a diagram illustrating an example of a hardware configuration of a user terminal according to the present disclosure.

[0015] First, an overview of one embodiment will be described. Note that the reference numerals in the drawings are added to each element for convenience as an example to facilitate understanding, and the description of this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. Connection lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of the main signal (data) and do not exclude bidirectionality. Note that in this specification and drawings, elements that can be similarly described may be assigned the same reference numerals to avoid redundant explanation.

[0016] The terminal 100 according to one embodiment includes an acquisition unit 101, an estimation unit 102, a calculation unit 103, and a provision unit 104 (see FIG. 1). The acquisition unit 101 acquires biometric information of a user (step S1 in FIG. 2). The estimation unit 102 estimates vital data based on the acquired biometric information (step S2). The calculation unit 103 calculates a disease recurrence risk value indicating the user's disease recurrence risk based on the estimated vital data (step S3). The provision unit 104 provides information according to the calculated disease recurrence risk value (step S4).

[0017] The terminal 100 acquires biometric information of a user (a user at risk of disease recurrence) and estimates vital data based on the acquired biometric information. For example, the terminal 100 estimates vital data such as the user's weight, blood pressure, and heart rate from the biometric information. The terminal 100 calculates the user's disease recurrence risk value using the estimated vital data and provides information according to the calculated risk value. For example, if the terminal 100 determines that the risk (possibility) of disease recurrence is high, it notifies the user or their supporter of this fact. That is, the terminal 100 calculates the disease recurrence risk value using not only weight but also other vital data, and provides appropriate information to the user or their supporter based on the risk value. As a result, an accurate disease recurrence risk is calculated, and appropriate support from a supporter more reliably prevents disease recurrence.

[0018] Specific embodiments will be described in more detail below with reference to the drawings.

[0019] First Embodiment The first embodiment will be described in more detail with reference to the drawings.

[0020] [System Overview] Fig. 3 is a diagram showing an example of a schematic configuration of an information processing system (information providing system) according to the first embodiment. As shown in Fig. 3, the information processing system includes a user and a supporter.

[0021] In the present disclosure, a patient at risk of disease recurrence is assumed as a primary user. For example, a patient suffering from heart failure is assumed as a primary user. The user possesses a user terminal 10 such as a smartphone. The user inputs various information into the user terminal 10 and acquires information from the user terminal 10.

[0022] A supporter supports the daily life of a user with a chronic illness. Examples of supporters include a family doctor, family members, relatives, acquaintances, friends, caregivers, and welfare officers. The supporter carries a supporter terminal 20 such as a smartphone. The supporter inputs various information into the supporter terminal 20 and acquires information from the supporter terminal 20.

[0023] A user who is at risk of recurrence of an illness inputs daily health-related information into an application installed on the user terminal 10. For example, a patient suffering from heart failure inputs "medical interview information" using a "health management application" to prevent the recurrence of heart failure.

[0024] The medical interview information is information necessary for a doctor to determine whether the user's illness will recur. For example, the medical interview information includes "medication information," "subjective symptoms," "hospital visit records," "sleep information," "diet information," "exercise information," etc.

[0025] The user inputs medical interview information into the user terminal 10 every day, and a "health notebook (heart failure notebook)" is created.

[0026] The user terminal 10 also acquires biometric information of the user and estimates vital data of the user from the acquired biometric information. The user terminal 10 calculates the user's disease recurrence risk using the estimated vital data, and provides information corresponding to the disease recurrence risk to the user and / or their supporter.

[0027] [User Terminal] Fig. 4 is a diagram showing an example of the processing configuration (processing module) of the user terminal 10 according to the first embodiment. Referring to Fig. 4, the user terminal 10 includes a communication control unit 201, an identity verification unit 202, a medical interview information control unit 203, a recurrence risk management unit 204, a health information provision unit 205, and a storage unit 206.

[0028] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the supporter terminal 20. The communication control unit 201 also transmits data to the supporter terminal 20. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0029] Of the processing modules that make up the user terminal 10, the personal identification unit 202, the interview information control unit 203, the recurrence risk management unit 204, and the health information provision unit 205 mainly implement the "health management application."

[0030] The identity verification unit 202 is a means for verifying the identity of the user who operates the user terminal 10. The identity verification unit 202 verifies the identity of the user before the user inputs medical interview information. In other words, the identity verification unit 202 prevents a third party other than the user from inputting medical interview information into the health management application.

[0031] The user terminal 10 stores the owner's biometric information (e.g., facial information, fingerprint information). When the user launches a health management application (e.g., by clicking a corresponding icon), the identity verification unit 202 acquires the biometric information (e.g., facial information, fingerprint information) for authenticating the user.

[0032] If the pre-registered biometric information and the biometric information acquired when the health management application is launched substantially match, the identity verification unit 202 determines that identity verification has been successful. If identity verification has failed, the identity verification unit 202 cancels the launch of the health management application. If identity verification has been successful, the identity verification unit 202 completes the launch of the health management application.

[0033] Since identity verification using biometric information is clear to those skilled in the art, detailed explanation will be omitted. For example, the identity verification unit 202 calculates the similarity between feature quantities generated from facial images. If the similarity is equal to or greater than a predetermined value, the identity verification unit 202 determines that identity verification has been successful.

[0034] The personal identification unit 202 may perform personal identification using other information instead of or in addition to biometric information. For example, the personal identification unit 202 may perform personal identification (personal authentication) using a password or the like.

[0035] The medical interview information control unit 203 is a means for controlling the medical interview information acquired from the user. The medical interview information control unit 203 has a function as an acquisition unit (acquisition means) that acquires the user's biometric information and medical interview information, and a function as an estimation unit (estimation means) that estimates vital data based on the acquired biometric information.

[0036] When the user's identity is successfully verified and a predetermined operation is performed on the health management application (e.g., pressing the health record input button), the medical interview information control unit 203 displays a GUI (Graphical User Interface) for acquiring medical interview information. For example, the medical interview information control unit 203 acquires the medical interview information using a GUI such as that shown in FIG.

[0037] In the example of FIG. 5 , the presence or absence of subjective symptoms such as "shortness of breath," "swelling," "easily fatigued," "loss of appetite," and "insomnia" are acquired. Furthermore, the presence or absence of exercise is acquired as exercise information. Furthermore, the presence or absence of medication during each time period (morning, noon, and evening) is acquired as medication information. Note that the display shown in FIG. 5 is merely an example and is not intended to limit the displayed items or display format. For example, the medical interview information control unit 203 may automatically display and record the date and time (year, month, day, hour, minute, and second) when the user enters information into the health record. Alternatively, considering that many users are elderly, the medical interview information control unit 203 may provide an interface for entering information one item at a time on a large screen, rather than an interface for entering all items on a single screen. Alternatively, the medical interview information control unit 203 may support information input not only using a touch panel but also voice input. Alternatively, the medical interview information control unit 203 may automatically import input data from another wearable device or a health application and automatically display the imported data.

[0038] The medical interview information control unit 203 stores the acquired medical interview information in a health management database (see FIG. 6). Note that the health management database shown in FIG. 6 is an example and is not intended to limit the items to be stored. For example, the acquired biometric information of the user may be registered in the health management database.

[0039] The medical interview information control unit 203 acquires biometric information of the user while the user is inputting medical interview information (during input of medical interview information). Specifically, the medical interview information control unit 203 acquires image data (still image data, video data) including a facial image of the user by photographing the user while inputting medical interview information.

[0040] When acquiring video data, the medical interview information control unit 203 acquires video data of, for example, about 30 seconds.

[0041] When biometric information of the user (for example, video data obtained by photographing the user) is acquired, the medical interview information control unit 203 estimates the vital data of the user using the acquired biometric information.

[0042] For example, the medical interview information control unit 203 analyzes the acquired biological information to acquire estimated values ​​of vital data such as the user's weight, heart rate, blood pressure, blood glucose level, and oxygen saturation.

[0043] The analysis of biometric information (video data including facial information) for estimating vital data may be performed using a learning model obtained by machine learning. For example, a company developing a health management application may generate a learning model using a large amount of training data that is a combination of video data including facial information and vital data measurement results.

[0044] For example, a user's weight is related to the contours of their face, and a learning model utilizing this relationship (a learning model that can obtain weight when a face image is input) can be generated. Heart rate is also related to changes in the brightness of the face surface (brightness of the face surface resulting from blood flow), and a learning model utilizing this relationship (a learning model that can obtain heart rate when multiple face images are input) can be generated. Furthermore, facial swelling can be estimated from the physical distance between facial feature points and the amount of blood flow, and a learning model that estimates facial swelling can be generated.

[0045] The generated learning model is implemented in the user terminal 10 as part of a health management application.

[0046] The medical interview information control unit 203 inputs the acquired biometric information (e.g., video data including facial information) into the learning model to acquire estimated values ​​of vital data. The medical interview information control unit 203 stores the acquired estimated values ​​of vital data in the health management database.

[0047] The recurrence risk management unit 204 is a means for managing the user's risk of disease recurrence. The recurrence risk management unit 204 has a function as a calculation unit (calculation means) that calculates a disease recurrence risk value that indicates the user's risk of disease recurrence based on the estimated vital data.

[0048] The recurrence risk management unit 204 periodically or at a predetermined timing quantifies the risk of the user's disease recurrence. For example, the recurrence risk management unit 204 calculates a "disease recurrence risk value" when it successfully estimates vital data from biometric information obtained when entering interview information. For example, the recurrence risk management unit 204 calculates a disease recurrence risk value on a 10-point scale.

[0049] For example, the recurrence risk management unit 204 calculates a disease recurrence risk value using the vital data estimated value. The recurrence risk management unit 204 can use a learning model to calculate the disease recurrence risk value.

[0050] Health management application developers prepare training data, which is a large amount of vital data (or a combination of multiple vital data) labeled with disease recurrence risk values, in cooperation with doctors and other experts with specialized knowledge.

[0051] Machine learning is performed using the collected training data to generate a learning model (classifier). Any algorithm, such as a support vector machine, boosting, or neural network, can be used to generate the learning model. Since known techniques can be used for the algorithms, such as the support vector machine, a description thereof will be omitted.

[0052] The generated learning model is implemented in the user terminal 10 as part of a health management application.

[0053] The recurrence risk management unit 204 obtains a disease recurrence risk value by inputting the latest vital data into the learning model.

[0054] Alternatively, the recurrence risk management unit 204 may calculate the disease recurrence risk value based on medical interview information input by the user. For example, if medical interview information such as coughing and insomnia is input, the recurrence risk management unit 204 calculates a high disease recurrence risk value. In this case, too, the recurrence risk management unit 204 may calculate the disease recurrence risk value using a learning model.

[0055] Alternatively, the health management application (recurrence risk management unit 204) may calculate the disease recurrence risk value based on interview information (e.g., subjective symptoms, exercise information, etc.) and estimated vital data values. In this case, the recurrence risk management unit 204 may use a learning model generated using interview information and vital data to which labels (disease recurrence risk values) have been assigned.

[0056] The recurrence risk management unit 204 stores the calculated disease recurrence risk value in the health management database.

[0057] The health information providing unit 205 is a means for providing information related to the health of the user. Specifically, the health information providing unit 205 provides information according to the calculated disease recurrence risk value. For example, the health information providing unit 205 provides information related to the user's health to at least one of the user and the user's supporter based on the disease recurrence risk value.

[0058] The health information providing unit 205 performs processing according to the calculated disease recurrence risk value. The health information providing unit 205 accesses the health management database periodically or at a predetermined timing to obtain the latest disease recurrence risk value.

[0059] For example, if the disease recurrence risk value is lower than a predetermined value, the health information providing unit 205 does not perform any particular operation.

[0060] If the disease recurrence risk value is equal to or greater than a predetermined value, the health information providing unit 205 notifies the person and / or their supporter of the fact that there is a high risk of disease recurrence.

[0061] Specifically, the health information providing unit 205 generates health information including information related to the user's health. For example, the health information providing unit 205 generates health information including a disease recurrence risk value, vital data estimates, medical interview information, etc.

[0062] The health information providing unit 205 provides (notifies) the generated health information to the person and / or their supporter.

[0063] When providing health information to the user, the health information providing unit 205 notifies the user of the fact that the risk of disease recurrence is increasing by displaying a screen as shown in Fig. 7. In this case, the health information providing unit 205 may notify the user of the disease recurrence risk value as shown in Fig. 7.

[0064] When providing health information to a supporter, the health information providing unit 205 sends a "health information notification" including the health information and the user's personal information (e.g., name, etc.) to the supporter terminal 20 of the supporter (e.g., family doctor, family member, care staff, etc.) (see FIG. 8 ). The supporter terminal 20 displays the health information, etc. included in the received health information notification.

[0065] For example, upon receiving the health information notification, the supporter terminal 20 displays the display as shown in Fig. 9. Note that the display shown in Fig. 9 is an example and is not intended to limit the content or display format displayed on the supporter terminal 20. For example, the supporter terminal 20 may display a graph showing time-series changes in the user's vital data (blood pressure, heart rate, etc.) or data on medication status, instead of or in addition to the disease recurrence risk value.

[0066] The destination of the health information notification is stored in advance in the user terminal 10. For example, the email address of a family doctor or the like is registered in the user terminal 10 as the destination of the health information notification. When the user registers the contact information of a supporter in the user terminal 10, it is considered that consent (user consent) for information to be provided to the supporter has been obtained. Alternatively, the destination of the health information notification may be stored in a server on a network (a server on the cloud) or another device. The user terminal 10 accesses the server on the cloud or another device as necessary. The server on the cloud or another device may verify the authority of the user terminal 10, and if there are no problems with the verification, the destination of the health information notification may be sent to the user terminal 10.

[0067] In this way, if the disease recurrence risk value is equal to or greater than a predetermined value (first threshold), the health information providing unit 205 notifies the user that the risk of disease recurrence is high. Alternatively, if the disease recurrence risk value is equal to or greater than a predetermined value (second threshold), the health information providing unit 205 notifies the supporter supporting the user that the risk of disease recurrence is high. Note that the first threshold and the second threshold may be the same value or different values.

[0068] The storage unit 206 is a means for storing information necessary for the operation of the user terminal 10 .

[0069] The operation of the user terminal 10 described above can be summarized as shown in the flowchart of FIG.

[0070] First, the user terminal 10 performs identity verification of the user who launches the health management application (step S101).

[0071] If the user's identity is successfully verified, the user terminal 10 acquires medical interview information from the user (step S102).

[0072] The user terminal 10 acquires biometric information of the user by photographing the user while the user is inputting the medical interview information (step S103). For example, the user terminal 10 acquires still image data or video data obtained by photographing the user as biometric information.

[0073] The user terminal 10 estimates the user's vital data using the acquired biometric information (step S104).

[0074] The user terminal 10 calculates the disease recurrence risk value using at least the estimated value of the vital data (step S105).

[0075] If the risk of disease recurrence is increasing, the user terminal 10 notifies the user and / or the supporter of this (notification of disease recurrence risk; step S106).

[0076] [Supporter Terminal] Examples of the supporter terminal 20 include mobile terminal devices such as smartphones, mobile phones, game consoles, tablets, and computers (personal computers, laptops). The supporter terminal 20 can be any equipment or device that can accept operations by a supporter and communicate with the user terminal 10, etc. Furthermore, the configuration of the supporter terminal 20 is clear to those skilled in the art, so a detailed description will be omitted.

[0077] As described above, the user terminal 10 according to the first embodiment acquires biometric information of a user at risk of disease recurrence and estimates vital data based on the acquired biometric information. The user terminal 10 calculates the user's disease recurrence risk value using the estimated vital data and provides information according to the calculated risk value. For example, if the user terminal 10 determines that the risk (possibility) of disease recurrence is high, it notifies the user or their supporter. To prevent the recurrence of diseases such as heart failure, it is necessary to identify the signs of disease recurrence in advance and take appropriate measures. If the user terminal 10 detects signs of disease recurrence based on estimated vital data, etc., it notifies the user or their supporter (such as a family doctor, family member, or caregiver) of this fact. As a result, appropriate measures are taken before the disease actually recurs, preventing the disease recurrence.

[0078] Next, a description will be given of the hardware of the user terminal 10. Fig. 11 is a diagram showing an example of the hardware configuration of the user terminal 10.

[0079] The user terminal 10 can be configured by an information processing device (so-called computer), and has the configuration shown in Fig. 11. For example, the user terminal 10 includes a processor 311, a memory 312, an input / output interface 313, and a communication interface 314. The components such as the processor 311 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0080] However, the configuration shown in Fig. 11 is not intended to limit the hardware configuration of the user terminal 10. The user terminal 10 may include hardware not shown, and may not include the input / output interface 313 as necessary. Furthermore, the number of processors 311 and the like included in the user terminal 10 is not intended to be limited to the example shown in Fig. 11, and for example, the user terminal 10 may include multiple processors 311.

[0081] The processor 311 is a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).

[0082] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.

[0083] The input / output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display, etc. The input device is, for example, a device that accepts user operations, such as a keyboard or a mouse.

[0084] The communication interface 314 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 314 includes a network interface card (NIC).

[0085] The functions of the user terminal 10 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. Furthermore, the processing modules can be realized by semiconductor chips.

[0086] The user terminal 10, which is an information processing device, is equipped with a computer, and functions of the user terminal 10 can be realized by causing the computer to execute a program. The user terminal 10 also executes a control method for the user terminal 10 by the program.

[0087] [Modifications] The configuration, operation, etc. of the information processing system described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.

[0088] In the above embodiment, heart failure has been described as an example of a disease with a risk of recurrence. However, diseases to which the present disclosure is applicable are not limited to heart failure. The present disclosure can be applied to any disease. For example, the user terminal 10 (health management application) disclosed in the present disclosure can provide information on the recurrence or worsening of not only heart failure but also other diseases such as cardiovascular disease and diabetes.

[0089] In the above embodiment, it has been described that identity verification is performed when the health management application is launched. However, if identity verification is performed when the user terminal 10 is launched, identity verification when the health management application is launched may be omitted.

[0090] When acquiring biometric information (still image data or video data) of a user who is inputting medical interview information, the user terminal 10 may acquire consent from the user to photograph the user. Alternatively, the user terminal 10 may display the image data being photographed on the input screen for medical interview information.

[0091] In the above embodiment, the user terminal 10 acquires the medical interview information using a GUI such as that shown in FIG. 5 . However, the medical interview information may be acquired by other methods. For example, the user terminal 10 may acquire the medical interview information by voice input. Alternatively, the user terminal 10 may acquire the medical interview information by selecting questions or answering questions using a chatbot, etc.

[0092] In the above embodiment, the user terminal 10 has been described as acquiring medical interview information from the user himself / herself using a GUI. However, the user terminal 10 may infer all or part of the medical interview information based on the manner in which the user operates the user terminal 10 (the way of operation), etc. For example, the user terminal 10 may infer the presence or absence of "dementia" based on the accuracy and smoothness of the user's character input. For example, the user terminal 10 may infer that the user has "dementia" if it is determined that the user is spending a lot of time entering data or that the number of input errors has increased significantly, based on the time required for past data input or the frequency of input errors, etc.

[0093] In the above embodiment, the user terminal 10 acquires biometric information (image data including a facial image) necessary for estimating vital data while the user is inputting medical interview information. However, the biometric information may be acquired not only when the user is inputting medical interview information, but also when the user is operating another application, etc. For example, the user terminal 10 may acquire biometric information while the user is using a social networking service (SNS) application or browsing a web page.

[0094] The user terminal 10 may acquire all or part of the medical interview information (e.g., medication information, sleep information, etc.) from an application other than the health management application. For example, the user terminal 10 may acquire the medical interview information from an application that manages medication or an application that measures the quality of sleep.

[0095] When the user terminal 10 detects that the medical interview information has not been input periodically, the user terminal 10 may notify a supporter (e.g., a family doctor or a family member) to that effect. Alternatively, when the user terminal 10 determines that the user has not taken necessary medication (in the case of forgetting to take medication) based on the acquired medical interview information, the user terminal 10 may notify the user or a supporter (e.g., a family member) to that effect. Alternatively, when the user terminal 10 is able to acquire the user's dietary details and the user has consumed too much salt or not enough water, the user terminal 10 may notify the user or a supporter to that effect.

[0096] The user may wear a terminal (a so-called wearable device) capable of measuring blood pressure, heart rate, and the like. The user terminal 10 may acquire vital data from the wearable device. Specifically, the user terminal 10 may acquire vital data measured by the wearable device via short-range wireless communication means such as Bluetooth (registered trademark). The user terminal 10 may use all or part of the vital data acquired from the wearable device as vital data necessary for calculating the disease recurrence risk value. That is, the user terminal 10 may calculate the disease recurrence risk value using vital data acquired from another device (health equipment; for example, a wearable device, a scale, or a blood pressure monitor).

[0097] The user terminal 10 may acquire, as biometric information, image data showing not only the user's face but also the entire user. Alternatively, the user terminal 10 may acquire, as biometric information, image data showing only a part of the user's face. For example, the user terminal 10 may acquire, as biometric information, image data (still image data or video data) showing both of the user's eyes (pupils).

[0098] The user terminal 10 may estimate vital data using the acquired whole-body image data and pupil image data. For example, the user terminal 10 may estimate the heart rate, respiratory rate, etc. from shoulder movement, or may acquire pupil size (dilation) as vital data.

[0099] The user terminal 10 (medical interview information control unit 203) may use different biometric information (still image data, video data) and learning models depending on the type of vital data to be estimated. For example, when estimating weight, the user terminal 10 estimates the user's weight by inputting still image data (a portion of video data) into a learning model dedicated to weight estimation. Alternatively, when estimating blood pressure or heart rate, the user terminal 10 estimates the user's blood pressure and heart rate by inputting video data (multiple still image data) into a learning model dedicated to blood pressure estimation or heart rate estimation. The user terminal 10 can obtain more accurate vital data by using biometric information and a learning model suitable for the vital data to be estimated. Alternatively, the user terminal 10 may acquire video data, etc., suitable for the vital data to be estimated. For example, the user terminal 10 may acquire (generate) a video with a frame rate suitable for the vital data to be estimated.

[0100] The user terminal 10 may use the acquired biometric information for purposes other than estimating vital data. For example, the user terminal 10 may use the acquired biometric information to estimate whether the user has dementia or a genetic disease. For example, the user terminal 10 may input still image data including a facial image of the user into a learning model to determine whether the user has dementia or a genetic disease.

[0101] Alternatively, the user terminal 10 may estimate (generate) medical interview information using the acquired biometric information. For example, the user terminal 10 may estimate "fatigue susceptibility" by inputting a facial image into a learning model. Alternatively, the user terminal 10 may estimate the user's emotions (joy, anger, sadness, and happiness) by inputting the acquired biometric information into a learning model. That is, the user terminal 10 may estimate the user's emotions (feelings, moods) by analyzing the user's "facial expressions." Alternatively, the user terminal 10 may use different learning models, etc. depending on the user's age.

[0102] The user terminal 10 may calculate the disease recurrence risk value using not only the latest estimated vital data values ​​but also estimated vital data values ​​acquired in the past. For example, the user terminal 10 may calculate the disease recurrence risk value by inputting estimated vital data values ​​acquired over a predetermined period (e.g., one week) into a learning model. In this case, the disease recurrence risk value is calculated taking into account changes in the estimated vital data values ​​(rate of change), etc., thereby more accurately grasping the disease recurrence risk. Similarly, the user terminal 10 may calculate the disease recurrence risk value using estimated vital data values ​​over a predetermined period and medical interview information.

[0103] In the above embodiment, it has been explained that the user terminal 10 does not perform any particular operation (notification) when the disease recurrence risk value is lower than a predetermined value. However, when the disease recurrence risk value is low, the user terminal 10 may notify the user or a supporter that the disease recurrence risk is low.

[0104] The user terminal 10 may change the recipient and content of the health information notification depending on the degree of disease recurrence risk. For example, if the disease recurrence risk is very high (if the disease recurrence risk value is greater than a predetermined threshold), the user terminal 10 notifies the user and their supporter of this fact. On the other hand, if the recurrence risk is not very high, the user terminal 10 may only provide the user with advice on lifestyle improvements, etc. The user terminal 10 may send health information to the user if the disease recurrence risk value exceeds a first threshold, and may send health information to the user and their supporter if the disease recurrence risk value exceeds a second threshold.

[0105] The health notebook (a collection of medical interview information and estimated vital data values) generated by the user terminal 10 may be shared with a medical institution, etc. For example, the user may operate the user terminal 10 to submit the health notebook (contents of the health management database) to a medical institution during online medical consultation.

[0106] In the above embodiment, it has been described that health information (disease recurrence risk value, medical interview information, and vital data estimates) generated by the user terminal 10 is provided to supporters, etc. However, the health information may also be provided to public institutions such as private companies and local governments. For example, with the user's consent, the user terminal 10 may provide the medical interview information and vital data estimates to insurance companies or retailers. Users who provide the medical interview information and vital data estimates may be paid money. In other words, a data utilization business related to the medical interview information and vital data estimates may be conducted. For example, data may be provided to insurance companies for the development of insurance products, or to retailers for the promotion of health foods.

[0107] The user terminal 10 may give points to the user every time the user inputs medical inquiry information, in order to motivate the user to input medical inquiry information.

[0108] In the above embodiment, a case where a health management database is configured inside the user terminal 10 has been described, but the database may also be configured on an external database server or the like. That is, a server device may be included in the information processing system, and the server device may manage the health status (medical interview information, estimated vital data values) of each user. The server device may also control the notification of health information (provision of health information). That is, some functions of the user terminal 10 may be implemented in another device or the like.

[0109] The form of data transmission between the devices (user terminal 10, supporter terminal 20) is not particularly limited, but the data transmitted between these devices may be encrypted. Personal information such as medical interview information is transmitted between these devices, and in order to properly protect this information, it is desirable to transmit and receive encrypted data.

[0110] In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are described in order, but the order of execution of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the steps shown in the drawings can be changed to the extent that the content is not affected, such as by executing each process in parallel.

[0111] The above-described embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the above-described configurations are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.

[0112] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention is suitably applicable to information processing systems that provide users with health-related information.

[0113] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes. [Supplementary Note 1] A terminal comprising: an acquisition means for acquiring biometric information of a user; an estimation means for estimating vital data based on the acquired biometric information; a calculation means for calculating a disease recurrence risk value indicating the user's disease recurrence risk based on the estimated vital data; and a provision means for providing information according to the calculated disease recurrence risk value. [Supplementary Note 2] The terminal described in Supplementary Note 1, wherein the acquisition means acquires medical history information of the user, and the calculation means calculates the disease recurrence risk value based on the medical history information and the estimated vital data. [Supplementary Note 3] The terminal described in Supplementary Note 2, wherein the acquisition means acquires the biometric information while the user is inputting the medical history information. [Supplementary Note 4] The terminal described in Supplementary Note 3, wherein the provision means provides information about the user's health to at least one of the user and the user's supporter based on the disease recurrence risk value. [Supplementary Note 5] The terminal according to Supplementary Note 4, wherein the providing means notifies the user that the risk of disease recurrence is high when the disease recurrence risk value is equal to or greater than a predetermined value. [Supplementary Note 6] The terminal according to Supplementary Note 4, wherein the providing means notifies a supporter assisting the user that the risk of disease recurrence is high when the disease recurrence risk value is equal to or greater than a predetermined value. [Supplementary Note 7] The terminal according to Supplementary Note 4, further comprising an identity verification means for verifying the identity of the user before the user inputs the medical interview information. [Supplementary Note 8] The terminal according to any one of Supplements 1 to 7, wherein the acquiring means acquires still image data or video data obtained by photographing the user as the biometric information. [Supplementary Note 9] A method for controlling a terminal, comprising: acquiring biometric information of a user in a terminal; estimating vital data based on the acquired biometric information; calculating a disease recurrence risk value indicating the user's risk of disease recurrence based on the estimated vital data; and providing information according to the calculated disease recurrence risk value.[Supplementary Note 10] A computer-readable storage medium storing a program for causing a computer mounted on a terminal to execute the following processes: acquiring biometric information of a user; estimating vital data based on the acquired biometric information; calculating a disease recurrence risk value indicating the user's risk of disease recurrence based on the estimated vital data; and providing information according to the calculated disease recurrence risk value.

[0114] The disclosures of the above-cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the claims, and the technical concepts thereof.

[0115] 10 User terminal 20 Supporter terminal 100 Terminal 101 Acquisition means 102 Estimation means 103 Calculation means 104 Provision means 201 Communication control unit 202 Personal identification unit 203 Interview information control unit 204 Recurrence risk management unit 205 Health information provision unit 206 Storage unit 311 Processor 312 Memory 313 Input / output interface 314 Communication interface

Claims

1. An acquisition means for acquiring biometric information of a user; An estimation means for estimating vital data based on the acquired biological information; A calculation means for calculating a disease recurrence risk value indicating a disease recurrence risk of the user based on the estimated vital data; A providing means for providing information according to the calculated disease recurrence risk value; A terminal comprising:

2. The acquiring means acquires medical interview information of the user, The terminal according to claim 1 , wherein the calculation means calculates the disease recurrence risk value based on the interview information and the estimated vital sign data.

3. The terminal according to claim 2 , wherein the acquiring means acquires the biometric information while the user is inputting the medical interview information.

4. The terminal according to claim 3 , wherein the providing means provides information about the health of the user to at least one of the user and a supporter of the user based on the disease recurrence risk value.

5. The terminal according to claim 4 , wherein the providing means notifies the user that the risk of disease recurrence is high when the disease recurrence risk value is equal to or greater than a predetermined value.

6. The terminal according to claim 4 , wherein the providing means notifies a supporter supporting the user that the risk of disease recurrence is high when the disease recurrence risk value is equal to or greater than a predetermined value.

7. 5. The terminal according to claim 4, further comprising an identity verification unit that performs identity verification of the user before the user inputs the medical interview information.

8. The terminal according to claim 1 , wherein the acquisition means acquires still image data or video data obtained by photographing the user as the biometric information.

9. On the terminal, Acquire the user's biometric information, Estimating vital data based on the acquired biological information; calculating a disease recurrence risk value indicating a disease recurrence risk of the user based on the estimated vital data; A method for controlling a terminal that provides information according to the calculated disease recurrence risk value.

10. The computer installed in the terminal A process of acquiring biometric information of a user; A process of estimating vital data based on the acquired biological information; A process of calculating a disease recurrence risk value indicating a disease recurrence risk of the user based on the estimated vital data; A process of providing information according to the calculated disease recurrence risk value; A program for executing the above.