Health monitoring system and health monitoring method

Abstract

Provided is a health monitoring system and a health monitoring method that enable constant daily health monitoring with relatively little burden on a subject, that helps prevent and improve lifestyle-related diseases while maintaining the quality of sleep, and that leads to a long and healthy life. [Solution] A health monitoring system using a non-invasive biometric device to measure the biometrics of a subject, comprising a measurement means which is remotely operated from the outside to grasp the internal condition of the body, such as within the organs and the digestive system, and measures spatiotemporal internal environmental information using an in-vivo cybernetic avatar capable of interacting within the body, and a visualization means which visualizes the spatiotemporal internal environmental information measured by the measurement means, wherein the visualization means synthesizes and displays the measurement results from the biometric device and the measurement results of the spatiotemporal internal environmental information from the in-vivo cybernetic avatar.

Description

[Technical field]

[0001] The present invention relates to a health monitoring system and a health monitoring method, and more particularly to a health monitoring method suitable for preventing and improving lifestyle-related diseases while maintaining the quality of sleep. [Background technology]

[0002] Recently, research into the relationship between lifestyle-related diseases and sleep has progressed, and it has been shown that lack of sleep has a wide range of effects, including daytime sleepiness and fatigue, increased physical and mental complaints such as headaches, emotional instability, and reduced work efficiency related to impaired attention and judgment. It has also become clear that when various sleep problems, including lack of sleep, become chronic, they are associated with an increased risk of developing obesity, high blood pressure, type 2 diabetes, heart disease, and cerebrovascular disease, as well as worsening symptoms, and are involved in an increased mortality rate.

[0003] In the daily health monitoring method, the subject's biological information can be monitored using a biometric device, which can be any of a variety of biological devices, such as a blood pressure monitor, a weight scale, a smartphone-compatible predictive thermometer, a wristband-type life recorder, a pocket-type activity monitor, an upper arm-type hoseless blood pressure monitor, and a body composition monitor.

[0004] For example, many of the biometric devices mentioned above are designed to work with various devices from the same manufacturer, and cannot be used in combination with devices from other manufacturers. Also, wristband-type life recorders can measure sleep for 24 hours, but there is a problem with poor accuracy.

[0005] The results of an annual health check are not enough.

[0006] Frequent medical checkups and diagnoses at hospitals can lead to early detection of illness, but medical expenses are enormous.

[0007] It is desirable to realize a health monitoring method that enables healthy longevity by performing as simple health monitoring as possible, thereby reducing medical expenses and leading to healthy longevity while maintaining a healthy lifestyle.

[0008] As a recent trend, research is also being conducted on monitoring the spatiotemporal internal environment using cybernetic avatars. For example, an information processing system using cybernetic avatars has been proposed that assigns an avatar to an operator and provides a specific service (Patent Document 1). [Prior art documents] [Patent documents]

[0009] [Patent Document 1] JP 2023-145956 A [Patent Document 2] Patent Publication No. 2022-40919 [Patent Document 3] Patent No. 6719788 [Patent Document 4] JP 2018-81397 A [Patent Document 5] JP 2024-40773 A Summary of the Invention [Problem to be solved by the invention]

[0010] The biometric device of Patent Document 2 mentioned above can measure the sleep of the subject, but has a problem of low measurement accuracy. There is also a method of having the subject stay at a hospital and perform an all-night polysomnogram test, but although the measurement accuracy is accurate, it has a problem of placing too much strain on the subject. The electroencephalogram measuring device of Patent Document 2 is useful because it allows sleep measurement at home and can obtain measurement accuracy almost similar to that of an all-night polysomnogram test. However, this is insufficient because lifestyle-related diseases are not caused only by sleep problems.

[0011] The above-mentioned Patent Documents 3 and 4 claim to improve lifestyle-related diseases, but they are not something that can be easily done at home.

[0012] In the above-mentioned Patent Document 5, weight data is used to generate information on improving lifestyle-related diseases, but there is a problem in that the improvement effect is limited using weight data alone.

[0013] The present invention has been devised in view of the above problems, and an object of the present invention is to provide a health monitoring system and health monitoring method which enable constant daily health monitoring with relatively little burden on the subject, which helps to prevent and improve lifestyle-related diseases while maintaining sleep quality, and leads to healthy longevity.

[0014] Another object of the present invention is to provide a health monitoring system and a health monitoring method that enable highly accurate monitoring of health and pre-illness while maintaining sleep quality.

[0015] Another object of the present invention is to provide a health monitoring method that makes it possible to visualize health monitoring results, encourages behavioral changes in subjects, and enables them to live long and healthy lives.

[0016] It is still another object of the present invention to provide a health monitoring method capable of predicting a present health condition or a point at which a future disease will worsen. [Means for solving the problem]

[0017] In order to achieve the above object, a health monitoring system according to a first invention comprises a non-invasive biometric device for measuring the biometric status of a subject, a measuring means for remotely controlling the device from the outside to grasp the internal conditions of the subject's organs, digestive system, etc., and measuring spatiotemporal internal environment information using an in-vivo cybernetic avatar, and a visualizing means for visualizing the spatiotemporal internal environment information measured by the measuring means, wherein the visualizing means synthesizes and displays the measurement results by the biometric device and the measurement results of the spatiotemporal internal environment information by the in-vivo cybernetic avatar, and the visualizing means visualizes the daily life of the subject. the display device has a body display area in which body measurement data is displayed, an in-vivo cybernetic avatar display area in which time-space internal environment information of the subject's body is displayed, and a sleep state display area in which the subject's sleep state throughout the night on a particular day is displayed, and the display is performed using the body display area, the in-vivo cybernetic avatar display area, and the sleep state display area, and the time-space internal environment information measured by the measuring means is not displayed as is, but the type of the in-vivo cybernetic avatar is linked to the part of the human body on which the in-vivo cybernetic avatar is placed, and an avatar image showing a healthy state and a non-illness state is displayed; Furthermore, when the in-vivo cybernetic avatar is placed in the brain, heart, stomach or intestines, the visualization means changes the display form of the avatar images of the brain, heart, stomach and intestines depending on whether the avatar is in a healthy state or a non-disease state, and also displays disease avatar display patterns of at least "cancer", "cerebral infarction" and "heart disease". In the case of "cancer", an avatar image of the cancer cell attacking is displayed in the healthy state, and an avatar image of the cancer cell gaining momentum is displayed in the non-disease state. In the case of cerebral infarction, an avatar image of red blood cells swimming smoothly through the blood vessels is displayed in the healthy state, and an avatar image of red blood cells having difficulty swimming due to arteriosclerosis in the blood vessels is displayed in the non-disease state. In the case of heart disease, an avatar image of the heart with a smile is displayed in the healthy state, and an avatar image of the heart suffering in the non-disease state is displayed. The sleep status display area divides the sleep status into three stages: light sleep, medium sleep, and deep sleep, and displays the health and pre-illness status. It is characterized by:

[0018] No. 2 The health monitoring system of the present invention, in the first invention, has an electroencephalogram measuring device for measuring sleep at home, said electroencephalogram measuring device being composed of an electroencephalogram measuring unit to be attached to the forehead of the subject and a device main body for recording and storing the measurement results, said electroencephalogram measuring unit having a plurality of forehead electrodes integrally provided on a sheet-like horizontal portion, a vertically elongated flat cable extending vertically from said sheet-like horizontal portion, and a left arm portion and a right arm portion having left ear electrodes and right ear electrodes provided at the tips of the flat cable branching off to the left and right from said vertically elongated flat cable, said plurality of forehead electrodes being attached to the center of the subject's forehead, and said left ear electrodes and right ear electrodes being attached behind the left and right ears of the subject, to perform a sleep test of the overnight sleep state on a specific day.

[0019] No. 3 The health monitoring system of the present invention is characterized in that, in the first or second invention, the in vivo cybernetic avatar is a capsule-type device, a helical ring-type device, a stent-type device, or a combination thereof.

[0020] No. 4 The health monitoring system according to the present invention, in the first or second aspect of the present invention, further comprises a body-wearable device, and measures the amount of exercise of the subject using the body-wearable device.

[0022] The health monitoring method of the sixth invention is characterized by comprising a biometric information acquisition step of acquiring a subject's biometric information using at least a blood pressure monitor, a thermometer, and a weight scale; a behavioral information acquisition step of acquiring behavioral information, which is physical activity information, from a body-wearable device; a health checkup result information acquisition step of acquiring health checkup result information including at least a brain image and an in-vivo endoscopic image; an analysis step of analyzing the acquired biometric information, behavioral information, and health checkup result information of the subject; and an estimation step of estimating the subject's future health condition using the results of the above analysis and the subject's biometric information, behavioral information, and health checkup result information.

[0023] The health monitoring method according to the seventh invention is the same as that of the sixth invention, and further comprises an electroencephalogram (EEG) measurement step of measuring the electroencephalogram (EEG) of the subject's sleep state at home, and is characterized in that the electroencephalogram (EEG) measurement step performs a sleep test equivalent to a polysomnogram test. Effect of the Invention

[0024] According to the present invention having the above-mentioned configuration, it is possible to realize a health monitoring system and health monitoring method that enables constant daily health monitoring with relatively little burden on the subject, helps to prevent and improve lifestyle-related diseases while maintaining sleep quality, and leads to a long and healthy life.

[0025] According to the present invention, it is possible to realize a health monitoring system and a health monitoring method that are capable of maintaining sleep quality and monitoring health and pre-illness with high accuracy.

[0026] Furthermore, according to the present invention, it is possible to realize a health monitoring method that makes it possible to visualize health monitoring results, encourages behavioral changes in subjects, and enables them to live long and healthy lives.

[0027] According to the present invention, a health monitoring method can be realized that is capable of predicting the current health state or the location where a disease will worsen in the future. [Brief description of the drawings]

[0028] [Figure 1] FIG. 1 is a functional block diagram of a health monitoring system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a functional block diagram of a health monitoring system according to an embodiment of the present invention. [Diagram 3] FIG. 3 is a diagram showing an example of the time-space internal body environment information according to the embodiment of the present invention. [Figure 4] FIG. 4 is a diagram showing an example of a combined display of measurement results. [Diagram 5] FIG. 5(a) is an external configuration diagram showing an example of the electroencephalogram measuring device of FIG. 1, and FIG. 5(b) is a diagram showing an example of a device main body that records and transmits sleep measurement data. [Figure 6] FIG. 6 is a diagram showing an external view of a capsule endoscope as an in-vivo sensor and a configuration example of a tip portion. [Figure 7] FIG. 7(a) is a diagram showing an example of a helical-type device as an in vivo sensor, FIG. 7(b) is a diagram showing an example of a ring-type device as an in vivo sensor, and FIG. 7(c) is a diagram showing an example of a stent-type device as an in vivo sensor. [Figure 8] FIG. 8 is a system configuration diagram of a cloud server connected to a mobile communication terminal via a network. [Figure 9]FIG. 9 is a diagram showing an example of a portable communication terminal to which the present invention is applied. [Figure 10] FIG. 10 is a diagram showing an example of a personal computer to which the present invention is applied. [Figure 11] FIG. 11 is a diagram showing an example of a body display area in the embodiment of the present invention. [Figure 12] FIG. 12 is a diagram showing an example of an in-vivo cybernetic avatar display area of ​​the present invention. [Figure 13] FIG. 13 is a diagram showing an example of the three major disease avatar display. [Figure 14] FIG. 14 is a diagram showing an example of the sleep state display area. [Figure 15] FIG. 15 is a diagram showing the criteria to be displayed in the physical activity display area. [Figure 16] FIG. 16 is a flowchart illustrating a health monitoring method according to an embodiment of the present invention. [Figure 17] FIG. 17 is a flow chart illustrating a method for health monitoring in a biometric device. [Figure 18] FIG. 18 is a flow chart illustrating a method for health monitoring in a body-worn device. [Figure 19] FIG. 19 is a diagram showing examples of other lifestyle-related diseases. [Figure 20] FIG. 20 is a diagram showing an example of a physical activity display area in the embodiment of the present invention. [Figure 21] FIG. 21 is a diagram showing an example of personal medical examination data (part 1) utilized in an embodiment of the present invention. [Figure 22] FIG. 22 is a diagram showing an example of personal health checkup data (part 2) utilized in the embodiment of the present invention. [Figure 23] FIG. 23 is a configuration diagram of an online collaboration system for sharing the health monitoring results of subjects. [Figure 24] FIG. 24 is a diagram showing an example of measurement data of a body-worn device. [Diagram 25]FIG. 25 is a diagram for explaining a process of combining measurement data from various measuring devices. [Figure 26] FIG. 26 is a functional block diagram of a health management application in the embodiment of the present invention. [Figure 27] FIG. 27 is a flow chart illustrating a health monitoring method according to an embodiment of the present invention. [Figure 28] FIG. 28 is a flow chart illustrating a health monitoring method according to another embodiment of the present invention. [Figure 29] FIG. 29 is a schematic block diagram of an integrated data analysis service system to which the present invention is applied. [Diagram 30] FIG. 30 is a schematic block diagram of a biometric device verification service system to which the present invention is applied. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0029] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0030] First, health monitoring systems 100a and 100b according to an embodiment of the present invention will be described with reference to FIGS. 1, 2, 3 and 4. FIG.

[0031] Fig. 1 is a functional block diagram of a health monitoring system according to an embodiment of the present invention, and Fig. 2 is a functional block diagram of a health monitoring system according to an embodiment of the present invention. Fig. 3 is a diagram showing an example of time-space internal environment information according to an embodiment of the present invention. Fig. 4 is a diagram showing an example of a composite display of measurement results.

[0032] As shown in FIG. 1, the health monitoring system 100a of this embodiment has a biometric device 1, an in-vivo CA (cybernetic avatar) measurement unit 2, a measurement result synthesis unit 3, and a visualization unit 4.

[0033] As shown in Fig. 2, the health monitoring system 100b of this embodiment includes a biometric device 1, an in-vivo CA (cybernetic avatar) measurement unit 2, a measurement result synthesis unit 3, a visualization unit 4, and an electroencephalogram (EEG) measurement device 5. The health monitoring system 100b shown in Fig. 2 is the same as that shown in Fig. 1 except for the electroencephalogram measurement device 5.

[0034] The biometric device 1 is a device that non-invasively measures the biometric information of a subject in daily life. Examples of the biometric device 1 include a blood pressure monitor, a thermometer, and a weight scale. In the example of FIG. 1, the biometric device 1 is shown as an integrated device, but may be configured as a separate device and connected to the health monitoring system 100a via wireless communication. The biometric device may also include a blood glucose meter, and in the case of a blood glucose meter, blood is collected from a fingertip or the like and measured, so a non-invasive measuring device is also included. The biometric device 1 may measure every day and store the measurement data, or may measure every other day or on a weekly basis.

[0035] The in-vivo CA measurement unit 2 is remotely operated from the outside to grasp the internal conditions of the body, such as the internal organs and the digestive system, and measures spatiotemporal internal environment information using an in-vivo cybernetic avatar (CA) that can interact with the body.

[0036] The measurement result synthesizing section 3 synthesizes the measurement result of the biometric device 1 and the measurement result of the in-vivo CA measuring section 2 .

[0037] The visualization unit 4 visualizes the biometric data synthesized by the measurement result synthesis unit 3 and the spatiotemporal internal environment information measured by the in vivo CA measurement unit 2, and displays them on a mobile communication terminal or the like. The visualization unit 4 may be configured to synthesize and display the measurement results by the biometric device 1 and the measurement results of the spatiotemporal internal environment information by the in vivo CA measurement unit 2. An example of the spatiotemporal internal environment information is shown in FIG. 3. The spatiotemporal internal environment information includes in vivo PH measurement information, in vivo imaging information, deep body temperature information, sleep state information, blood glucose level information, and the like. Other biometric information may also be included. FIG. 4 shows an example of the visualization display by the visualization unit 4. FIG. 4 shows an example of a display screen of, for example, a mobile communication terminal, and is composed of a body display area, an in vivo cybernetic and avatar display area, a sleep state display area, and a physical activity display area. The body display area is an area where daily biometric data is displayed. The in vivo cybernetic and avatar display area is an area where in vivo spatiotemporal internal environment information is displayed. The sleep state display area is an area where the sleep state throughout the night on a specific day is displayed. In this embodiment, the visualization display form is characteristic. Although various measurement results may be displayed as they are, the visualization of the health state and non-disease state using avatars provides an opportunity for the subject to change his / her behavior. In particular, diseases such as lifestyle-related diseases are caused by daily lifestyle habits (diet, exercise, smoking, stress, etc.), so unless the subject's own lifestyle habits are improved, healthy longevity cannot be achieved. Therefore, the subject's health state and non-disease state are displayed using avatars to visualize the subject's visual appeal. Naturally, numerical information and trend display similar to conventional methods may also be performed. In recent research, it has become clear that sleep plays an important role in lifestyle-related diseases, so in order to maintain the quality of sleep, a well-known electroencephalogram measuring device 5 that can be easily measured at home is used. The electroencephalogram measuring device 5 will be described below.

[0038] The electroencephalogram measuring device 5 measures the sleep state of the subject at home or the like. An example of the electroencephalogram measuring device 5 is shown in FIG. 5(a)(b). The electroencephalogram measuring device 5 is composed of an electroencephalogram measuring unit that is attached to the head of the subject and a device main body 20 that records and stores the measurement results. The electroencephalogram measuring unit has a horizontally long portion 6 provided with a left center forehead electrode 6a, a reference electrode 6b, and a right center forehead electrode 6c, a vertically long portion 8 (flat cable) extending vertically from the horizontally long portion 6, and a left arm portion and a right arm portion having flat cables 9 branched to the left and right from the vertically long portion 8 (flat cable) and having a left ear electrode 7a and a right ear electrode 7b at their tips. A connector portion 10 for connecting to the device main body 20 is provided at the tip of the flat cable 8. Since the device has a very simple and unique shape, it can be easily attached by a single subject in a short time, and can be used at low cost. In addition, the shape is designed to be comfortable to wear and not disturb sleep. This allows the subject to use it easily at home, and enables sleep determination in everyday conditions. In addition, the forehead electrodes (6a, 6b, 6c) are integrally provided on the sheet-like horizontal portion 6, and the relative positions of the electrodes are fixed, so that the electrodes can be arranged in the same relative positions each time by simply attaching the sheet-like horizontal portion 6 to the forehead. In addition, the forehead electrodes (6a, 6b, 6c) can detect eye movements in addition to brain waves by attaching them to the forehead of the subject. In addition, the left ear electrode 7a and the right ear electrode 7b can detect neck myoelectricity in addition to brain waves by attaching them behind the left and right ears of the subject. Therefore, the accuracy of sleep determination can be improved because eye movements and neck myoelectricity signals can be used in addition to brain waves.

[0039] As shown in Fig. 6(b), the device main body 20 has a control unit 21, a connector unit 22, a storage unit 23, an operation unit 24, a display unit 25, and a battery 26. A known device (Patent Document 2) can be used as the electroencephalogram measuring device shown in Figs. 6(a) and (b). Details are as in Patent Document 2, so a description thereof will be omitted.

[0040] Although wearable devices can measure sleep, their accuracy is low, so the results can only be used as a reference. If you go to a hospital and have an overnight polysomnogram test, the sleep measurement is accurate, but the test subject is required to stay overnight at the hospital, which places a considerable burden on the test subject. If you can use the simple EEG measurement device described above to measure at home, the burden is relatively low and the sleep measurement accuracy is high, so the quality of your sleep can be measured accurately.

[0041] 6(a) and (b) are configuration diagrams of a capsule endoscope 30 serving as an in-vivo CA sensor used in the in-vivo CA measurement unit 2. FIG.

[0042] As shown in Fig. 6(a)(b), the capsule endoscope 30 has a tip cover 31, LED illuminations 32a, 32b, 32c, and 32d, and an objective lens 34. Although not shown, the capsule endoscope 30 is equipped with a CMOS sensor element that receives light from the LED illuminations 32a, 32b, 32c, and 32d that pass through the objective lens 34 to capture an image, an electric circuit, a built-in battery, and the like, and is placed in a case in a state where it does not consume power so that it can be used only when the capsule endoscope is in use. When the capsule endoscope is taken out of the case, the power switch is turned on. A wireless communication sensor for capturing image information from the capsule endoscope 30 and a device for recording signals from the wireless communication sensor are carried to perform measurements. Usually, the measurement takes about 8 hours. Fig. 6(a)(b) is similar to a known device, so a description thereof will be omitted.

[0043] FIG. 7(a) is a diagram showing an example of a helical-type device as an in vivo sensor, FIG. 7(b) is a diagram showing an example of a ring-type device as an in vivo sensor, and FIG. 7(c) is a diagram showing an example of a stent-type device as an in vivo sensor.

[0044] As shown in FIG. 7(a), a helical device 40 has a sensor 41 for measuring in vivo pH, deep body temperature, blood sugar level information, and the like.

[0045] As shown in FIG. 7(b), the ring-shaped device 42 has biosensors 42, 43, and 44 that measure in-vivo pH, deep body temperature, blood sugar level information, and the like.

[0046] As shown in FIG. 7(c), the stent-type device 42 has biosensors 47, 48, and 49 for measuring in vivo pH, core body temperature, blood glucose level information, and the like.

[0047] In the above embodiment, an in vivo sensor has been described, but the present invention can be implemented by applying the techniques disclosed in Japanese Patent Nos. 5,551,355 and 5,526,345 as intracellular sensing techniques.

[0048] FIG. 8 is a system configuration diagram of a mobile communication terminal 50 and a cloud server 63 connected to a network 62.

[0049] As shown in FIG. 8, the mobile communication terminal 50 has a CPU 51, a ROM 52, a RAM 53, a display 54, a biometric authentication memory unit 55, an ID / password authentication unit 56, a touch input unit 57, a camera 58, a speaker 59, a microphone 60, and a communication interface 61.

[0050] The mobile communication terminal 50 is connected to a cloud server 63 via a network 62 such as an internetwork or a broadband network. In such a communication system, a health monitoring system may be realized by software, and a health monitoring application 72 may be installed in a mobile communication terminal 70 as shown in FIG. 9, and health monitoring may be performed by executing the health monitoring application 72. In the example of FIG. 9, an icon of the health monitoring application 72 is displayed on a screen 71. FIG. 10 shows an example of a personal computer. The personal computer shows a camera 73, a display 74, a screen 75 that visualizes and displays the display form shown in FIG. 4, and a fingerprint authentication unit 76 displayed on the keyboard. For biometric authentication, face authentication using the camera 73 may be performed.

[0051] The visualization display of the present invention will be described below. FIG. 11 shows an example of the body display area. In the example of FIG. 11, blood pressure 120 / 80 mmHg, pulse 60 bpm, body temperature 36.8°C, and weight 54 kg are displayed. A minimum amount of personal information is registered in the health monitoring app when a user registers. For example, information such as height, age, sex, and BMI. Other information may be registered. A configuration may be adopted in which an individual's health checkup results (see FIG. 21 and FIG. 22) are digitized and stored in a mobile communication terminal or the like, and a comparison display is performed. For example, if the weight has increased significantly compared to the weight in the health checkup results, the user is not healthy, but is predicted to be in pre-disease (1) or pre-disease (2) (here, pre-disease (2) indicates a worse health condition than pre-disease (1)), and an estimate may be displayed.

[0052] FIG. 12 shows an example of a display pattern displayed in the in vivo cybernetic avatar display area. In the in vivo CA measurement unit 2, the type of in vivo CA measured is linked to the associated body part and turned into an avatar to show the healthy state and non-illness state. Since the subjects are not experts even if the numerical values ​​of the measurement information are displayed as is, it is designed to encourage behavioral changes in the subjects. When the in vivo sensor is placed in the brain part, the displayed image of the brain avatar changes depending on the healthy state, non-illness (1) state, and non-illness (2) state. In the case of health, an image of the brain smiling is displayed, in the case of non-illness (1), an image of the brain slightly suffering is displayed, and in the case of non-illness (2), an image of the brain suffering is displayed.

[0053] Similarly, if an in-vivo sensor is placed in the heart, the avatar image of the heart is changed and displayed as healthy, pre-disease (1), or pre-disease (2). If an in-vivo sensor is placed in the stomach, the avatar image of the stomach is changed and displayed as healthy, pre-disease (1), or pre-disease (2). Furthermore, if an in-vivo sensor is placed in the intestine, the avatar image of the intestine is changed and displayed as healthy, pre-disease (1), or pre-disease (2). The types of in-vivo CA may be configured to create and display an avatar image for each organ.

[0054] In this way, displaying an in vivo cybernetic avatar appeals intuitively to the subject's visual sense, and is expected to promote behavioral change.

[0055] FIG. 13 shows examples of display patterns of avatars for the three major diseases. Examples of the types of diseases shown are cancer, cerebral infarction, and heart disease. In the case of cancer, an avatar image of the cancer cells being attacked in the healthy state, an avatar image of the cancer cells slightly increasing in speed in the pre-disease (1) state, and an avatar image of the cancer cells increasing in speed in the pre-disease (2) state are shown. In the case of cerebral infarction, an avatar image of red blood cells swimming smoothly through blood vessels in the healthy state, an avatar image of the blood vessels slightly affected by arteriosclerosis in the pre-disease (1) state, and an avatar image of the blood vessels slightly affected by arteriosclerosis in the pre-disease (2) state are shown. In the case of heart disease, an avatar image of the heart's blood vessels slightly clogged in the healthy state, an avatar image of the heart's blood vessels slightly clogged in the pre-disease (1) state, and an avatar image of the heart's blood vessels slightly clogged and suffering in the pre-disease (2) state are shown.

[0056] FIG. 14 shows an example of a display pattern of the sleep state display area. It shows the relationship between the sleep state and health, non-illness (1), and non-illness (2). The sleep state data measured by the electroencephalogram measuring device shown in FIG. 6 is uploaded to the cloud server 63, and a report of the electroencephalogram analysis service result is received. For example, the sleep state is divided into three stages, "light sleep", "medium sleep", and "deep sleep". If the sleep is light, there is a high risk of getting sick, so non-illness (2) is displayed. If the sleep is medium, lifestyle habits are disturbed, so non-illness (1) is displayed. If the sleep is deep, it is estimated that the quality of sleep is maintained, and "healthy" is displayed. The quality of the sleep state can be determined at home, which is almost the same as an overnight polysomnogram test, so that it is possible to prevent and improve lifestyle-related diseases. FIG. 19 shows an example of a lifestyle-related disease. In FIG. 14, the display of avatar images of the three major diseases has been described, but avatar images may also be displayed for high blood pressure, dementia, diabetes, hyperlipidemia, hyperuricemia, pulmonary hypertension, and the like.

[0057] Figure 15 shows a list of recommendations in the 2023 Physical Activity and Exercise Guide for Health Promotion. The list of recommendations in Figure 15 is used as the standard for the amount of physical activity to be displayed in the physical activity display area. In Figure 15, the subjects are divided into elderly people, adults, and children, and into physical activity (including daily activities and exercise) and sedentary behavior. For elderly people, daily activities are walking or physical activity of an intensity of 3 METs or more for 40 minutes or more per day (6,000 steps or more per day), and exercise is multi-component exercise such as aerobic exercise, strength training, balance exercise, and flexibility exercise for 3 days or more per week, and strength training for 2 to 3 days per week.

[0058] For example, if the subject is an elderly person aged 67, the recommended value is 6000 steps or more per day. Therefore, in the physical activity display area shown in FIG. 20, the number of steps in daily activities was 7500 steps, which exceeds the above recommended value, and so OK is displayed. Among the exercises, aerobic exercise 1 time OK, strength training 3 times OK, balance exercise 2 times OK, etc. are displayed. Here, the exercise is displayed by converting it into METs and exercise. METs is a unit that expresses the intensity of physical activity as how many times it corresponds to resting. For example, sitting and resting corresponds to 1 MET, and normal walking corresponds to 3 METs. Exercise is a unit that expresses the amount of physical activity. It is the intensity of physical activity (METs) multiplied by the time (hours) during which the physical activity was performed. The more intense the physical activity, the shorter the time required for one exercise. Energy consumption (Kcal) is calculated by 1.05 x exercise (METs x hours) x body weight (kg).

[0059] FIG. 16 is a flowchart illustrating a health monitoring method according to an embodiment of the present invention. First, the in vivo CA measurement step is executed (step 101). By remotely controlling the device from the outside, the internal conditions of the body, such as the internal organs and digestive system, are grasped, and spatiotemporal internal environmental information is measured using an in-vivo cybernetic avatar that can interact with the body (step 102). Next, a measurement result recording step is executed (step 103). Next, the recorded measurement results are transmitted to the portable communication terminal (step 104). A measurement result synthesis step is executed to synthesize and display the measurement results from the biometric device and the measurement results of the time-space internal environment information from the in-vivo cybernetic avatar (step 105). A visualization step is executed to visualize the measurement results combined in the measurement result combination step 105, as shown in FIG. 4 (step 106).

[0060] FIG. 17 is a flow chart illustrating a method for health monitoring in a biometric device. First, a biometric measurement step is performed (step 201). Next, a measurement result recording step is executed (step 202). Next, the recorded measurement results are transmitted to the portable communication terminal (step 203). Next, the recorded measurement results are transmitted to the portable communication terminal (step 204).

[0061] FIG. 18 is a flowchart showing a health monitoring method in a body-worn device, and FIG. 24 shows an example of a body-worn device capable of 24-hour continuous monitoring. Devices that can be used 24 hours a day include ring-type (finger ring type), watch-type, and tracker-type devices, and there is no data compatibility between manufacturers. For example, a ring-type device made by company A has a health app A dedicated to company A, and can utilize physical activity data A. Similarly, a watch-type device made by company B has a health app B dedicated to company B, and can utilize physical activity data B. A tracker device made by company C has a health app B dedicated to company C, and can utilize physical activity data C. In the health monitoring method of this embodiment, a part of the data is extracted from any one or a combination of physical activity data A, B, and C obtained by measurement using these body-worn devices, and is synthesized with the in-vivo CA measurement data result and visualized. An example of a synthesized display of the measurement result is shown in FIG. 25. First, a physical activity measurement step is executed (step 301). Next, a measurement result recording step is executed (step 302). Next, the recorded measurement results are transmitted to the portable communication terminal (step 303). Next, the recorded measurement results are transmitted to the portable communication terminal (step 304).

[0062] FIG. 23 is a configuration diagram of an online collaboration system for sharing the health monitoring results of subjects.

[0063] As shown in FIG. 23, an online collaboration system 80 includes an online collaboration server 81, subject terminals 82a and 82b, a communication network 83, primary care doctor terminals 84a and 84b, and an administrator terminal 85.

[0064] Subject terminals 82a, 82b are connected to a family doctor terminal 84a or a hospital terminal 84b via a communication network 83, and measurement data of the subjects may be shared. By sharing data, the measurement data of the subjects can be obtained, enabling family doctors or doctors at the hospital to provide appropriate medical care, which is expected to lead to a reduction in medical expenses.

[0065] FIG. 26 is a functional block diagram of a health management application in the embodiment of the present invention.

[0066] As shown in FIG. 26 , the health management application 400 in this embodiment has a blood pressure recording unit 401, a weight recording unit 402, a body temperature recording unit 403, a body-worn device recording unit 404, a sleep recording unit 405, a step count recording unit 406, an exercise recording unit 407, a pre-illness visualization unit 408, an external linkage unit 409, and a health management dashboard unit 401.

[0067] The health management application 400 is installed in advance on a mobile communication terminal such as a smartphone, a tablet PC, a portable notebook computer, a desktop computer, or the like, and used. For example, it may be installed in advance on a mobile communication terminal, the health management application 400 may be started, and measurement data from a blood pressure monitor, a weight scale, and a thermometer may be automatically recorded using a short-range wireless communication function. Alternatively, the measured data may be manually input by the subject. When using the health management application 400, height data, age, and sex (male, female; if not desired, gender input may be omitted). The subject's name (nickname acceptable) should be input. This is because this is the minimum information required for effective health management.

[0068] The blood pressure recorder 401 records the systolic blood pressure data and diastolic blood pressure data of the subject, which are measurement data from the sphygmomanometer. If the sphygmomanometer can measure the pulse rate, the pulse data may be recorded at the same time. It is desirable to measure multiple times, such as in the morning, afternoon, and evening. If blood pressure cannot be measured in the afternoon, the afternoon measurement may be omitted. At the very least, the measurement should be made once when waking up in the morning and the record is made.

[0069] The weight recorder 402 receives and records weight data from a weight scale via wireless, wired, or manual input. The weight scale may be a body composition scale. Weight is measured and recorded at least once in the morning when the user wakes up.

[0070] If the thermometer has a communication function, the body temperature recorder 403 may automatically record the body temperature data from the thermometer. If the thermometer does not have a communication function, the subject must manually input the data.

[0071] The body-worn device recorder 404 records various measurement data from the body-worn device, such as sleep measurement data, heart sound data, pulse data, etc.

[0072] The sleep recording unit 405 records sleep-related data from the electroencephalogram measuring device described above.

[0073] The step count recording unit 406 is linked to a pedometer and allows automatic input or manual input by the subject. More preferably, automatic input is preferred in order to reduce the burden of recording on the subject.

[0074] The exercise recording unit 407 manually inputs whether or not muscle training or resistance exercise has been performed.

[0075] The pre-disease visualization unit 408 displays a pre-disease avatar. Various other data may also be visualized.

[0076] The external linking unit 409 has a function of transmitting the above-mentioned measurement data to a family doctor terminal or a hospital terminal for data sharing, or has a data conversion function and a data conversion or data transfer function for linking with other health management apps.

[0077] The health management dashboard unit 401 controls the overall health condition data, such as trend display of health management data, display of various charts, etc. It also outputs reports of the health management data.

[0078] The above-mentioned health management application 400 records the subject's subjective symptoms. For example, sleepiness upon waking up is evaluated on a three-level scale and entered. This is to obtain data from the subject that cannot be obtained from measurement data and to use it to determine whether the subject is healthy or not. For example, sleepiness may be "refreshed," "normal," "sleepy," etc. Other subjective symptom parameters may be set as subjective symptom parameters.

[0079] In this specification, pre-illness refers to a state in which there are no subjective symptoms but tests show abnormalities, and a state in which there are subjective symptoms but tests show no abnormalities. Health refers to a state in which there are no subjective symptoms but tests show no abnormalities. Disease refers to a cross-section of a state in which there are subjective symptoms but tests show abnormalities.

[0080] FIG. 27 is a flow chart illustrating a health monitoring method according to an embodiment of the present invention.

[0081] The health monitoring method of this embodiment comprises a biometric information acquisition step 501 of acquiring the biometric information of the subject using at least a sphygmomanometer, a thermometer, and a weight scale, a behavioral information acquisition step 502 of acquiring behavioral information, which is physical activity information, from a body-wearable device, a health checkup result information acquisition step 503 of acquiring health checkup result information including at least a brain image and an in-vivo endoscopic image, an analysis step 504 of analyzing the acquired biometric information, behavioral information, and health checkup result information of the subject, and a health condition estimation step 505 of estimating the subject's future health condition using the results of the above analysis and the biometric information, behavioral information, and health checkup result information of the subject.

[0082] At least blood pressure data, body temperature data, and weight data are acquired in the biological information acquisition step 501. Blood glucose data may be acquired as other biological information.

[0083] In a behavioral information acquisition step 502, physical activity information (step count data, muscle training data, etc.) is acquired.

[0084] In the health examination result information acquisition step 503, in-vivo information of the subject's brain image and in-vivo endoscopic image is acquired and used in the next analysis step.

[0085] In the analysis step 504, the acquired biological information, behavioral information, and health examination result information of the subject are analyzed. Genetic tests and the like may be added to the analysis data. By creating a health condition model using the health examination big data and using AI analysis technology, prediction accuracy can be improved.

[0086] In a health condition estimation step 505, the results of the above analysis, the subject's biological information, behavioral information, and health examination result information are used to estimate the subject's future health condition, predict whether the subject is healthy or not, and predict areas that will deteriorate in the future.

[0087] FIG. 28 is a flow chart illustrating a health monitoring method according to another embodiment of the present invention.

[0088] The health monitoring method of another embodiment includes an electroencephalogram measuring step 601, a biological information acquiring step 602, a behavioral information acquiring step 603, a medical checkup result information acquiring step 604, an analysis step 605, and a health condition estimating step 606. Here, the biological information acquiring step 602, the behavioral information acquiring step 603, the medical checkup result information acquiring step 604, the analysis step 605, and the health condition estimating step 606 are similar to the biological information acquiring step 501, the behavioral information acquiring step 502, the medical checkup result information acquiring step 503, the analysis step 504, and the health condition estimating step 505, respectively, so that the description will be omitted and only the electroencephalogram measuring step 601 will be described.

[0089] In the electroencephalogram measuring step 601, an electroencephalogram is measured of the sleep state of the subject at home. In the electroencephalogram measuring step 601, a sleep test equivalent to a polysomnogram test is performed. The electroencephalogram measuring device used is that shown in FIG. 5. Here, by performing the sleep measurement, the influence of the sleep of the subject who progresses to a lifestyle-related disease can be taken into account, thereby improving the accuracy of prediction of the subject's health state.

[0090] FIG. 29 is a schematic block diagram of an integrated data analysis service system to which the present invention is applied.

[0091] As shown in FIG. 29, the integrated data analysis service system 700 integrates a sleep analysis service 701, a brain image analysis service 702, a health check analysis service 703, and a pre-disease prediction service 704, and provides them as a solution package to provide diagnostic support for hospitals and clinics. Current analysis services are each provided as a single analysis service, so there is a problem that comprehensive judgment cannot be made. The service is provided as one of the means to solve the problem. As the sleep analysis service 701, for example, the sleep measurement service "InSomnograf" provided by S'UIMIN Co., Ltd. can be used. As a brain measurement device, for example, the device disclosed in JP Patent Publication No. 2022-40919 (Patent Document 2) can be used. As the brain image analysis service 702, for example, the brain analysis service disclosed in International Patent Publication No. 2023-190880 can be used. This brain analysis service is effective because it analyzes the entire brain image, and is desirable because it can perform brain image analysis that is not affected by the resolution of the brain dog image.

[0092] FIG. 30 is a schematic block diagram of a biometric device verification service system to which the present invention is applied.

[0093] As shown in FIG. 30, the biometric device verification service system 800 is composed of a biometric device verification unit 801, biometric device measurement big data 802, and an AI biometric device proposal unit 803. Since biometric devices vary from company to company and have different measurement accuracy, there is a risk that the prediction results obtained will differ. The biometric device is verified using the measurement big data, and an AI proposal is made for a biometric device that guarantees prediction accuracy. This has the effect of maintaining a constant prediction accuracy of the AI ​​analysis results.

[0094] Thus, according to the embodiments of the present invention, it is possible to realize a health monitoring system and health monitoring method that enables constant daily health monitoring with relatively little burden on the subject, helps to prevent and improve lifestyle-related diseases while maintaining sleep quality, and leads to a long and healthy life.

[0095] Furthermore, according to the embodiments of the present invention, it is possible to realize a health monitoring system and a health monitoring method that enable highly accurate monitoring of health and pre-illness while maintaining the quality of sleep.

[0096] Furthermore, according to the embodiment of the present invention, it is possible to realize a health monitoring method that can visualize the health monitoring results, encourage the subject to change his / her behavior, and realize a healthy longevity. By using the health monitoring method of the present embodiment, it is possible to predict the current health condition and the parts of the body that will deteriorate in the future. [Explanation of symbols]

[0097] 1. Biometric devices 2. In vivo CA measurement section 3 Measurement result synthesis section 4 Visualization section 5. Brainwave measuring device 6. Electroencephalography 6a, 6b, 6c: Electrode 7a, 7b electrode 8, 9 Flat cable 10 Connectors 20 Device body 21 Control section 22 Connector part 23 Memory section 24 Control section 25 Display section 26 Battery 30 Capsule Endoscopy 31 Tip cover 32a, 32b, 32c, 32d LED lighting 34 Objective Lens 40 Helical Device 41 Biometric Sensors 42 Ring Device 43, 44, 45 Biometric sensors 46 Stent-type devices 47, 48, 49 Biometric sensors 50 Mobile communication devices 51 CPU 52 ROM 53 RAM 54 Display 55 Biometric authentication memory unit 56 ID / Password Authentication Section 57 Touch input section 58 Camera 59 Speaker 60. Mike 61 Communication Interface 62 Network 63 Cloud Server 70 Mobile communication devices 71 Mobile Screen 72 Health Monitoring Apps 73 Camera 74 Display 75 Computer Screen 76 Biometric authentication department 80 Online Collaboration System 81 Online Collaboration Server 82a, 82b Subject terminal 83 Network 84a Family doctor terminal 84b Hospital terminal 85 Administrator terminal 100a, 100b Health monitoring system 101 In vivo CA measurement steps 102 Time-space internal environment measurement steps 103 Measurement result recording step 104 Measurement result transmission step 105 Measurement result synthesis step 106 Visualization Steps 201 Biometric Steps 202 Measurement result recording step 203 Measurement result transmission step 204 Recording to a mobile communication terminal step 301 Physical Activity Measurement Steps 302 Measurement result recording step 303 Measurement result transmission step 304 Recording step to a mobile communication terminal 400 Health Management Apps 401 Blood Pressure Recording Unit 402 Weight Recording Section 403 Body temperature recorder 404 Body-worn device recorder 405 Sleep Recording Department 406 Step count recorder 407 Sports Record Section 408 Mibyo Visualization Department 409 External Collaboration Department 410 Health Management Dashboard Section 501, 602 Biometric information acquisition step 502, 603 Behavioral information acquisition step 503, 604 Steps for obtaining health examination result information 504, 605 Analysis steps 505, 606 Health status estimation step 601 EEG measurement steps 700 Integrated Data Analysis Service System 701 Sleep analysis service 702 Brain image analysis service 703 Health checkup analysis service 704 Future Prediction Service 800 Biometric Device Verification Department 801 Biometric device measurement big data 803 AI Biometric Device Proposal Department

Claims

1. A health monitoring system comprising: a non-invasive biometric device for measuring the biometrics of a subject; measurement means for remotely controlling the device from outside to grasp the internal conditions of the subject's organs, digestive system, etc., and measuring spatiotemporal internal environment information using an in-vivo cybernetic avatar; and visualization means for visualizing the spatiotemporal internal environment information measured by the measurement means, wherein the visualization means synthesizes and displays the measurement results by the biometric device and the measurement results of the spatiotemporal internal environment information by the in-vivo cybernetic avatar, the visualization means has a body display area in which the subject's daily biometric data is displayed, an in-vivo cybernetic avatar display area in which the time-space internal environment information of the subject's body is displayed, and a sleep state display area in which the subject's sleep state throughout the night on a particular day is displayed, and performs display using the body display area, the in-vivo cybernetic avatar display area, and the sleep state display area, and does not display the time-space internal environment information measured by the measurement means as is, but links the type of the in-vivo cybernetic avatar with the part of the human body in which the in-vivo cybernetic avatar is placed, and displays an avatar image showing a healthy state and a pre-disease state; Furthermore, when the in-vivo cybernetic avatar is placed in the brain, heart, stomach or intestines, the visualization means changes the display form of the avatar images of the brain, heart, stomach and intestines depending on whether the avatar is in a healthy state or a pre-disease state, and displays at least disease avatar display patterns of "cancer", "cerebral infarction" and "heart disease". In the case of "cancer", an avatar image of the cancer cell attacking is displayed in the healthy state, and an avatar image of the cancer cell gaining momentum is displayed in the pre-disease state. In the case of cerebral infarction, an avatar image of red blood cells swimming smoothly through the blood vessels is displayed in the healthy state, and an avatar image of red blood cells having difficulty swimming due to arteriosclerosis in the blood vessels is displayed in the pre-disease state. In the case of heart disease, an avatar image of the heart with a smile is displayed in the healthy state, and an avatar image of the heart in pain is displayed in the pre-disease state. In the above sleep state display area, the sleep state is divided into three stages: light sleep, medium sleep, and deep sleep, and health and pre-illness are displayed. A health monitoring system comprising:

2. 2. The health monitoring system according to claim 1, further comprising an electroencephalogram measuring device for measuring sleep at home, the electroencephalogram measuring device being composed of an electroencephalogram measuring unit attached to the forehead of the subject and a device main body for recording and storing the measurement results, the electroencephalogram measuring unit comprising a plurality of forehead electrodes integrally provided on a horizontal sheet-like portion, a vertically elongated flat cable extending vertically from the horizontal sheet-like portion, and a left arm portion and a right arm portion having left ear electrodes and right ear electrodes provided at the tips of the flat cable branching off to the left and right from the vertically elongated flat cable, the plurality of forehead electrodes being attached to the center of the subject's forehead, and the left ear electrodes and right ear electrodes being attached behind the left and right ears of the subject, to perform a sleep test of the subject's sleep state throughout the night on a specific day.

3. 3. The health monitoring system according to claim 1 or 2, wherein the in vivo cybernetic avatar is a capsule-type device, a helical ring-type device, a stent-type device, or a combination thereof.

4. 3. The health monitoring system according to claim 1, further comprising a body-wearable device for measuring the amount of exercise of the subject by using the body-wearable device.

Images