Biometric data measurement system
The biometric data measurement system addresses the issues of invasiveness and hydrostatic pressure inaccuracy by using an annular biosensor and image recognition to stabilize contact pressure and correct for height variations, enabling precise and portable blood pressure measurements.
Patent Information
- Application Number
- JP2023517218
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-04-30
- Filing Date
- 2022-03-31
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2042-03-31
AI Technical Summary
Existing blood pressure measurement devices are invasive, bulky, and prone to inaccuracies due to hydrostatic pressure variations caused by differing heights relative to the heart, making them unsuitable for portable and accurate measurements.
A biometric data measurement system comprising an annular biosensor attached to the finger or wrist and a portable control unit that uses image recognition to stabilize contact pressure and determine the sensor's position relative to the heart, allowing for non-invasive and accurate blood pressure measurement.
The system provides highly portable and precise blood pressure measurements by stabilizing contact pressure and correcting for hydrostatic pressure effects, ensuring accurate readings regardless of the measurement site's height relative to the heart.
Smart Images

Figure 0007589808000001 
Figure 0007589808000002 
Figure 0007589808000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a biological data measurement system. [Background technology]
[0002] If the blood pressure measurement site is located higher than the heart, the measured blood pressure will be lower by the hydrostatic pressure difference in the blood vessels due to gravity. Conversely, if the blood pressure measurement site is located lower than the heart, the measured blood pressure will be higher by the hydrostatic pressure difference in the blood vessels. More specifically, if the blood pressure measurement site is moved up or down by 1 cm from the heart, the blood pressure (measured value) will change by approximately 0.7 mmHg.
[0003] Here, Patent Document 1 discloses an electronic blood pressure monitor including a camera having a predetermined imaging range, performing imaging operation during blood pressure measurement and outputting image data, a face and cuff detection unit detecting whether or not a captured image indicated by the image data includes a face image and a cuff image based on the image data, a position information calculation unit calculating position information of the face image and the cuff image in the captured image, an irregularity determination unit performing a process of determining whether or not the use state of the electronic blood pressure monitor is appropriate based on the relative positional relationship indicated by the calculated positional information of the face image and the cuff image, and an output unit outputting the result of the determination by the irregularity determination unit. According to this electronic blood pressure monitor, whether or not the use state of the electronic blood pressure monitor is appropriate is determined based on the relative positional relationship between the face image and the cuff image in the captured image during blood pressure measurement, so that it is possible to detect whether or not the use mode of the electronic blood pressure monitor is appropriate (in terms of measurement accuracy).
[0004] Patent Document 2 also proposes a device that includes a blood pressure sensor that acquires a blood pressure measurement value from a user holding the device in his / her hand, and a control unit that determines the angle of the device with respect to the direction of gravity, identifies one or more positions of the user holding the device in his / her hand relative to a displayed predetermined position range in a display image of the user, determines the height of the blood pressure sensor relative to the height of the user's heart based on the angle of the device with respect to the direction of gravity and the one or more positions of the user in the image relative to the predetermined position range, and controls based on the height of the blood pressure sensor relative to the height of the user's heart. According to this device, the device can be controlled to measure blood pressure based on the height of the blood pressure sensor relative to the height of the user's heart. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2009-247733 A [Patent Document 2] Special Publication No. 2020-500052 Summary of the Invention [Problem to be solved by the invention]
[0006] However, the electronic blood pressure monitor disclosed in Patent Document 1 is invasive because it uses a cuff to tighten the upper arm when measuring blood pressure. In addition, the use of a cuff makes the device (electronic blood pressure monitor) large in size and unsuitable for portability. Therefore, for example, it cannot be used (to measure blood pressure) when away from home.
[0007] On the other hand, in the device disclosed in Patent Document 2, the device is held in the hand and the fingers of the hand are brought into contact with the blood pressure sensor to measure blood pressure, making it difficult to keep the contact pressure constant. If the contact pressure changes, the blood pressure at the contacting measuring part will fluctuate (this may occur between measurements, but contact pressure fluctuations are particularly likely to occur during measurement), which may make it difficult to stably measure blood pressure.
[0008] The present invention has been made to solve the above-mentioned problems, and aims to provide a biometric data measurement system that is highly portable and capable of more accurately and non-invasively measuring biometric data, including blood pressure, whose measured values are affected by the difference between the height of the measurement site and the height of the heart (i.e., affected by hydrostatic pressure). [Means for solving the problem]
[0009] The biometric data measurement system of the present invention is a biometric data measurement system comprising a ring-shaped biometric sensor and a portable control unit configured to be able to communicate with each other, wherein the ring-shaped biometric sensor has a main body portion formed in a ring shape so as to be wearable on a finger or wrist, and a sensor portion provided on the main body portion for measuring at least blood pressure, and the portable control unit has an imaging portion for capturing images, a display portion for presenting an image of the user's face and the other hand wearing the ring-shaped biometric sensor to a user holding the portable control unit in one hand, and for displaying the image captured by the imaging portion, and a control portion for determining from the image whether the other hand wearing the ring-shaped biometric sensor is at chest height, and for controlling the biometric data measurement system based on the result of the determination.
[0010] According to the biometric data measurement system of the present invention, the annular biosensor having a sensor unit formed in a ring shape is attached to the finger or wrist, so that the contact pressure (pressure) with the measurement site is stable, and biometric data including blood pressure can be measured accurately. In addition, from an image of the user's face and the other hand on which the annular biosensor is attached, it is determined whether the hand on which the annular biosensor is attached is at chest (heart) height or not, and based on the determination result, the biometric data measurement system is controlled (biometric data including blood pressure is measured), so that biometric data including blood pressure can be measured more accurately. Furthermore, since no cuff is used, it is highly portable and can measure biometric data including blood pressure non-invasively. Effect of the Invention
[0011] The present invention is highly portable and enables more accurate and non-invasive measurement of biological data including blood pressure, whose measured value is affected by the difference between the height of the measurement site and the height of the heart (i.e., affected by hydrostatic pressure). [Brief description of the drawings]
[0012] [Figure 1] 1 is a diagram showing an overall configuration of a biological data measurement system according to an embodiment; [Diagram 2] 1 is a block diagram showing a functional configuration of a biological data measurement system according to an embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of a light state varying member (light scattering portion) of the annular biosensor. [Figure 4] 4 is a diagram showing the directivity angles of a light-emitting section (light-emitting element) and a light-receiving section (light-receiving element) of the photoplethysmographic sensor. FIG. [Diagram 5] 1A and 1B are diagrams illustrating examples of captured images of a user, in which (a) is an example of an image captured from above, (b) is an example of an image captured from the front, and (c) is an example of an image captured from below. [Figure 6] FIG. 13 is a diagram for explaining a method for estimating chest (heart) height. [Figure 7] FIG. 13A is a diagram showing an example image in which only the trunk is tilted to the right, and FIG. 13B is a diagram showing an example image in which the trunk and the portable control unit are tilted to the right in the same manner. [Figure 8] FIG. 13 is a diagram for explaining how the ratio of hand width to total head height in an image changes depending on the orientation of the imaging unit (camera). [Figure 9] 5 is a flowchart showing a processing procedure of a blood pressure measurement process using the annular biosensor constituting the biodata measurement system according to the embodiment. [Figure 10] 5 is a flowchart showing a processing procedure of a blood pressure measurement process, etc., performed by a portable control unit constituting the biological data measurement system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. In the drawings, the same reference numerals will be used for the same or corresponding parts. In each drawing, the same reference numerals will be used for the same elements, and duplicated explanations will be omitted.
[0014] First, the configuration of a biological data measurement system 1 according to an embodiment will be described with reference to Figs. 1 to 4. Fig. 1 is a diagram showing the overall configuration of the biological data measurement system 1. Fig. 2 is a block diagram showing the functional configuration of the biological data measurement system 1. Fig. 3 is a diagram showing an example of a light state variable member (light scattering section) 211 of the annular biological sensor 2. Fig. 4 is a diagram showing the directivity angles of the light emitting section (light emitting element) 221 and the light receiving section (light receiving element) 222 of the photoplethysmographic sensor 2.
[0015] The biological data measurement system 1 is mainly composed of an annular biological sensor 2 connected to each other via wireless communication so as to be able to communicate with each other, and a portable control unit 3. In particular, the biological data measurement system 1 has excellent portability and a function of more accurately and non-invasively measuring biological data including blood pressure, whose measured value is affected by the difference between the height of the measurement site and the height of the heart (i.e., affected by hydrostatic pressure).
[0016] The annular biosensor 2 mainly comprises a main body 21 formed in a ring shape (ring-shaped or wristband-shaped) so as to be wearable on a finger or wrist, a sensor unit 22 provided on the inner surface of the main body 21 and for measuring (detecting) at least blood pressure, a sensor-side communication unit 23 for transmitting and receiving data (measurement data, control data, etc.) to and from the portable control unit 3, a determination unit 24 for determining whether the annular biosensor 2 is worn, and an acceleration sensor 25 for detecting body movement. In addition, the annular biosensor 2 preferably comprises a temperature sensor for detecting body surface temperature.
[0017] The portable control unit 3 mainly includes an imaging unit 31 that captures an image (still image or moving image), a display unit 32 that presents (displays) the user's face and the other hand wearing the annular biosensor 2 to the user holding the portable control unit 3 in one hand and displays the image captured by the imaging unit 31, a unit side communication unit 33 that transmits and receives data (control data, measurement data, etc.) between the annular biosensor 2, a control unit 34 that determines from the image whether the other hand wearing the annular biosensor 2 is at chest height or not, and controls the imaging unit 31, the display unit 32, the unit side communication unit 33, and the annular biosensor 2 based on the result of the determination to obtain biodata (biological information) including blood pressure, and an inclination sensor (or acceleration sensor) 35 that detects the inclination of the portable control unit 3 with respect to the vertical direction. For example, a mobile terminal such as a smartphone can be suitably used as the portable control unit 3 that is a control terminal. In this embodiment, a smartphone is used as the portable control unit 3. Each component will be described below.
[0018] The main body 21 of the annular biosensor 2 is formed in a ring shape (ring type) so that it can be attached to a finger of the hand. Alternatively, the main body 21 is formed in a ring shape (wristband type) so that it can be attached to a wrist. In this embodiment, the annular biosensor 2 is described as an example of a ring-shaped biosensor attached to a finger of the hand. The annular biosensor 2 is attached to, for example, the index finger of one hand (the left hand in the example of Figs. 5 and 6). However, the finger on which the annular biosensor 2 is attached may be the middle finger, ring finger, little finger, or thumb. The portable control unit 3 is held by the hand opposite to the hand on which the annular biosensor 2 is attached (the other hand, the right hand in the example of Figs. 5 and 6).
[0019] The main body 21 is preferably formed in a shape (contour) that is recognizable in an image (still image or moving image) captured by the imaging section 31 of the portable control unit 3. In this way, the control section 34 of the portable control unit 3 can automatically recognize (determine) the position of the annular biosensor 2 in the image by recognizing the shape (contour) of the main body 21 from the image. Furthermore, a method of forming the housing shape into a recognizable shape can reduce the impact on design (i.e., the design is not significantly impaired) compared to a method of displaying a two-dimensional code or the like.
[0020] Instead of or in addition to forming the shape of the main body 21 in a recognizable manner, a light state variable member 211 that reflects, scatters, or absorbs light may be provided on the surface of the main body 21 so as to be recognizable in an image. In this case, the control unit 34 of the portable control unit 3 can automatically recognize (determine) the position of the annular biosensor 2 in the image captured by the imaging unit 31 of the portable control unit 3 by recognizing the light state variable member 211 from the image. In addition, in this case, for example, since this can be realized by making only a part of the mirror-finished housing surface into a light scattering part, the impact on the design can be kept small (i.e., the design is not significantly impaired) compared to a method of displaying a two-dimensional code or the like.
[0021] In particular, when light scattering is used, the reflected light does not have to be in a specific direction to be captured, as in the case of reflection, and the degree of freedom in direction is high. Since the direction of the annular biosensor 2 and the angle at which the light hits it vary, the accuracy of image recognition can be improved by preventing a large change in how it appears in the image.
[0022] 3(a) to (c) show an example in which the light state variable member (light scattering section) 211 is formed on the surface of the main body section 21. As shown in Fig. 3(a) to (c), even when the light state variable member (light scattering section) 211 faces upward or to the side, there is no significant change in the appearance of the light state variable member (light scattering section) 211 in the image, even though the angle at which the light hits it changes. This improves the accuracy of image recognition.
[0023] In addition, in the case of reflection on a mirror surface, the reflected light only travels in a fixed direction, so it may look bright or dark depending on how the light hits it. However, if it is configured with a curved surface such as a hemispherical shape, even if light hits it from various angles, the reflected light reflected at any place on the curved surface travels toward the imaging unit 31, making it easy to recognize the image. For example, if multiple hemispherical protrusions are arranged in a row, the arrangement of the multiple protrusions can be confirmed in the image even if the way the light hits it changes. In the method using light absorption, the entire surface or part of the main body 21 is made to have a high light absorption rate (low light reflectance), such as matte black. Since the light absorption rate is high, the reflected light is not reflected by the imaging unit 31 regardless of the angle from which the light hits it, making it easy to recognize the image. Furthermore, the following method may be combined to reduce erroneous recognition.
[0024] For example, the portable control unit 3 may have a unit-side light-emitting section (which in this embodiment is also the display section 32) that emits light in a predetermined pattern that can be recognized in an image (moving image), and the control section 34 of the portable control unit 3 may recognize (determine) the position of the annular biosensor 2 in the image by recognizing the annular biosensor 2 that reflects or scatters the light emitted in the predetermined pattern from the image. In this way, the position of the annular biosensor 2 can be automatically recognized (determined) even in a dark place. Furthermore, even if there are objects in the surrounding area that reflect illumination light or emit light, they can be distinguished from the annular biosensor 2 as long as they do not scatter or reflect light in synchronization with the light emission pattern from the portable control unit 3.
[0025] More specifically, the portable control unit 3 has a unit side light emitting section (display section 32), which emits light in a light emitting pattern (light amount change pattern, hue change pattern) that can be recognized in a moving image captured by the imaging section 31, and the control section 34 recognizes the shape of the annular biosensor 2 or the light state variable member (light scattering section) 211 that reflects / scatters the light emitting pattern from the captured moving image, and determines the position of the annular biosensor 2 in the moving image. Here, the hue change refers to a color change, for example, from blue to red. The hue change also includes white (superimposition of multiple wavelength bands), and therefore includes a change in the wavelength of light and an increase or decrease in the wavelength band of light.
[0026] The display unit 32 (display) of the portable control unit 3 displays the captured moving image, but for example, for about 0.1 sec, the captured moving image is switched from a full blue display to a full red display, and the control unit 34 extracts the position in the captured moving image where the blue component increases and then the red component increases, and identifies the part that matches the shape of the ring-shaped biosensor 2 (main body unit 21) and the light scattering unit 211, and recognizes (determines) the position of the ring-shaped biosensor 2. It is difficult to determine the ring-shaped biosensor 2 in a dark place, but this method makes it easier to determine the position of the ring-shaped biosensor 2 even in a dark place. Even if there are objects that reflect illumination light or emit light in the surrounding area, it can be determined that the object is not the ring-shaped biosensor 2 unless it scatters or reflects light in synchronization with the light emission pattern from the portable control unit 3. A separate unit side light emitting unit may be provided separately from the display unit 32.
[0027] Note that the surface of the main body 21 of the annular biosensor 2 may be configured to display characters, symbols, one-dimensional codes (e.g., barcodes), and / or two-dimensional codes (e.g., QR Code (registered trademark)) that are recognizable in an image captured by the imaging unit 31 of the portable control unit 3. Even in this manner, the control unit 34 of the portable control unit 3 can automatically recognize (determine) the position of the annular biosensor 2 in the image by recognizing the characters, symbols, one-dimensional codes, and / or two-dimensional codes from the image.
[0028] Alternatively to the above-mentioned method, the annular biosensor 2 may have a sensor-side light-emitting section (in this embodiment, the light-emitting element 221 of the sensor section 22 doubles as this) that emits light in a predetermined pattern that can be recognized in an image (moving image), and the control section 34 of the portable control unit 3 may automatically recognize (determine) the position of the annular biosensor 2 in the image by recognizing the light-emitting element 221 (sensor-side light-emitting section) that emits light in a predetermined pattern from the image. In this way, the position of the annular biosensor 2 can be automatically determined even in a dark place. Also, even if there are objects in the surrounding area that reflect illumination light or emit light, they can be distinguished from the annular biosensor 2 if they do not emit light in the predetermined light-emitting pattern.
[0029] In this case, it is preferable that the sensor unit 22 of the annular biosensor 2 is a photoplethysmographic sensor (described in detail below) including a light-emitting element (light-emitting unit) 221 and a light-receiving element (light-receiving unit) 222, and the sensor-side light-emitting unit that emits light in a predetermined pattern is the light-emitting element (light-emitting unit) 221 that constitutes the photoplethysmographic sensor 22. In this case, as shown in FIG. 4, it is preferable to make the directivity angle of the light-emitting element 221 of the photoplethysmographic sensor 22 larger than the directivity angle of the light-receiving element 222 of the photoplethysmographic sensor 22. By making the directivity angle of the light-emitting element (light-emitting unit) 221 larger, the light emitted from the light-emitting element (light-emitting unit) 221 is more likely to leak outside the annular biosensor 2, and is more likely to be recognized by the imaging unit 31 (image). On the other hand, by making the directivity angle of the light-receiving element (light-receiving unit) 222 smaller, it is possible to suppress the incidence of disturbance light. Note that a configuration may be adopted in which an independent sensor-side light-emitting unit is provided separately from the light-emitting element (light-emitting unit) 221 of the photoplethysmographic sensor 22. In this case, arranging the sensor side light emitting section on the top surface (outer surface) of the annular biosensor 2 makes recognition (determination) by the imaging section 31 easier, but this has a large impact on the design of the annular biosensor 2.
[0030] More specifically, for example, when a measurement preparation command (described in detail later) is sent from the portable control unit 3, the annular biosensor 2 (light-emitting element (light-emitting section) 221 of the photoplethysmographic sensor 22) starts emitting light in a predetermined pattern so that it can be recognized in the moving image captured by the imaging section 31 of the portable control unit 3. An LED or laser is used as the light source of the light-emitting section of the photoplethysmographic sensor 22, and the wavelengths that are often used are green, which has a high biological absorbance, near infrared, and red, which is used in pulse oximeters. However, the imaging section 31 (camera) usually uses an optical filter that matches the visual sensitivity of humans, and therefore cannot receive near infrared light. In addition, since the light-emitting element (light-emitting section) 221 of the photoplethysmographic sensor 22 is located on the skin side of the finger when worn, the green light, which has a high biological absorbance, does not penetrate the finger. Therefore, red light is suitable when using the light-emitting element (light-emitting section) 221 of the photoplethysmographic sensor 22 (for both purposes).
[0031] Also, it is preferable that the light from the light emitting element (light emitting unit) 221 easily leaks outside the finger so that the light from the light emitting element (light emitting unit) 221 can be easily recognized by the imaging unit 31 (image). The angle at which the intensity of the light emitted from the light emitting element (light emitting unit) 221 is half of the maximum (usually the center) is generally called the directivity angle. The angle at which the sensitivity of the light incident on the light receiving element (light receiving unit) 222 is half of the maximum (usually the center) is also the directivity angle. Increasing the directivity angle of the light emitting element (light emitting unit) 221 makes it easier for light to leak outside the finger. However, increasing the directivity angle of the light receiving element (light receiving unit) 222 makes it easier for ambient light (illumination light, sunlight, etc.) to enter the light receiving unit, increasing noise in the photoplethysmographic waveform. Therefore, it is preferable to make the directivity angle of the light emitting element (light emitting unit) 221 of the photoplethysmographic sensor 22 larger than the directivity angle of the light receiving element (light receiving unit) 222 of the photoplethysmographic sensor 22 (see FIG. 4).
[0032] On the other hand, when a separate sensor-side light-emitting unit is provided, the wavelength only needs to be visible light. Light-emitting patterns include light quantity change patterns, hue change patterns, and mixed patterns of these. A hue change is a color change, for example from blue to red, but it also includes not only a change in wavelength of light, but also a change from white (superimposition of multiple wavelength bands) to red (increase or decrease in the wavelength band of light). In practice, this is achieved by sequentially switching multiple LEDs with different wavelengths to emit light. As mentioned above, when using the light-emitting unit (light-emitting element) 221 of the photoplethysmographic sensor 22, only red is suitable, so a hue change pattern is not suitable.
[0033] The light quantity change pattern changes the quantity of emitted light over time. The light quantity may be changed as in a sine wave, but a pulse wave is suitable. Since it is necessary to capture the frame rate of the imaging unit 31, the frequency should be at least a few Hz. In addition, a fixed cycle may cause misrecognition if the light emission cycle of another device happens to be the same, so it is desirable to use a special light emission blinking pattern. For example, misrecognition can be avoided by changing the pulse interval from 0.25 seconds to 0.50 seconds to 0.75 seconds to 0.25 seconds to 0.50 seconds to 0.75 seconds. The ring-shaped biosensor 2 (light-emitting element (light-emitting unit) 221 of the photoplethysmography sensor 22) continues to emit light until the portable control unit 3 recognizes the ring-shaped biosensor 2 and sends a measurement (start) command.
[0034] As described above, sensor unit 22 is, for example, a photoelectric pulse wave sensor including a light-emitting element (light-emitting unit) 221 and a light-receiving element (light-receiving unit) 222, and detecting a photoelectric pulse wave signal. A photoelectric pulse wave sensor optically measures pulse rate and the like by utilizing the light absorption characteristics of hemoglobin in blood. Hereinafter, sensor unit 22 may also be referred to as photoelectric pulse wave sensor 22. Note that, as described above, in this embodiment, light-emitting element (light-emitting unit) 221 also serves as a sensor-side light-emitting unit. Sensor unit (photoelectric pulse wave sensor) 22 is provided on the inner surface of main body unit 21. This is because a pulse wave sensor including photoelectric pulse wave sensor 22 can more easily obtain a biological signal from the pad side of a finger than from the dorsal side of the finger.
[0035] The sensor unit 22 measures (detects) at least blood pressure. In this embodiment, a blood pressure sensor that estimates blood pressure from a photoelectric pulse waveform will be described as an example. A known method (see, for example, JP 2016-16295 A) can be used to estimate blood pressure from a photoelectric pulse waveform. That is, the annular biosensor 2 is a so-called cuffless sphygmomanometer that does not use a cuff. Note that other blood pressure estimation techniques (methods) using pulse wave transit time, etc. may also be used.
[0036] However, in either method, the blood pressure measurement obtained may be inaccurate due to the influence of hydrostatic pressure. To avoid the influence of hydrostatic pressure, blood pressure measurement needs to be performed at or near the height of the user's heart. If blood pressure measurement is performed above the height of the heart, the measurement result will be too low, and if blood pressure measurement is performed below the height of the heart, the measurement result will be too high. If the difference between the blood pressure measurement position and the height of the heart is 10 cm, 7 to 8 mmHg will be erroneously introduced into the blood pressure measurement. In other words, if blood pressure is measured with a finger while the arm is hanging down, a difference in height of about 50 cm will occur, resulting in an error of 35 to 40 mmHg. When blood pressure is measured by a general user who is not trained, such as a medical professional, the blood pressure measurement is often performed at a height significantly different from the height of the user's heart, causing an error in the blood pressure measurement. Even in the method of estimating blood pressure from a photoelectric pulse waveform measured with a finger, it is necessary to minimize or eliminate the influence of static pressure in order to perform an accurate blood pressure measurement.
[0037] Also, a known method (see, for example, Patent Application No. 2017-506158) can be used to estimate the blood glucose level from the photoelectric pulse waveform. However, the photoelectric pulse waveform is also affected by the blood pressure value at that time, and therefore also affects the estimated blood glucose level. Therefore, even with a blood glucose sensor, it is necessary to take an appropriate measurement posture to limit the influence of blood pressure. In addition, blood pressure may increase when the abdomen is compressed, such as leaning forward, but pulse and respiration may also change depending on the posture, so it may be necessary to take an appropriate measurement posture. The photoelectric pulse waveform also contains information on vascular resistance. When determining vascular resistance, since the photoelectric pulse waveform is also affected by blood pressure, variability can be reduced by measuring at the height of the heart. Although vascular resistance has been given as an example, the same applies when estimating blood flow rate, blood glucose level, and arteriosclerosis from the waveform. In addition, since the measurement posture affects the pulse rate, blood flow rate, body surface temperature, and respiration itself, measurement variability can be reduced by performing the measurement in a fixed posture. Here, the measured biological data (biological information) may include, in addition to blood pressure, for example, pulse wave, pulse rate, oxygen saturation, blood glucose level, body surface temperature, activity level, vascular resistance, blood flow rate, arteriosclerosis level, respiration, etc. In this way, by simultaneously measuring multiple biological data (information), it becomes possible to estimate the state of physical condition, signs of illness, etc.
[0038] The sensor side communication unit 23 transmits and receives data (measurement data, control data, etc.) to and from the portable control unit 3. In this embodiment, Bluetooth (registered trademark) is used as the wireless communication standard. That is, the sensor side communication unit 23 has a transmission function and a reception function based on Bluetooth (registered trademark). The wireless communication standard used is not limited to Bluetooth (registered trademark), and other standards may be used. More specifically, the sensor side communication unit 23 determines whether or not it is connected to the portable control unit 3. In addition, the sensor side communication unit 23 transmits mounting state information (details will be described later) of the annular biosensor 2 to the portable control unit 3. On the other hand, the sensor side communication unit 23 receives a measurement preparation command and a measurement (start) command transmitted from the portable control unit 3. Then, the sensor side communication unit 23 transmits the acquired biodata such as blood pressure to the portable control unit 3 (at a predetermined timing (or period)).
[0039] The determination unit 24 determines whether the annular biosensor 2 is attached to a finger (or wrist). If posture determination (described in detail later) is performed when the annular biosensor 2 is not attached, there is a risk of erroneously determining that a posture is appropriate when it is not, but such a problem can be avoided by performing posture determination only when the annular biosensor 2 is attached.
[0040] Here, as a method for determining whether the annular biosensor 2 is worn, it is preferable to determine whether a pulse wave is detected by the photoelectric pulse wave sensor 22. This is because there is a low possibility of erroneously determining that the annular biosensor 2 is worn even though it is not worn on the finger. However, since it is necessary to measure two or more beats in order to determine that it is a pulse wave, it may take more than three seconds. Therefore, it may be determined whether the amount of light received by the photoelectric pulse wave sensor 22 exceeds a threshold value. If the photoelectric pulse wave sensor 22 is a reflective type, the amount of light received will be low if the sensor is not worn, so it is considered that the sensor is not worn if it falls below the threshold value. If the photoelectric pulse wave sensor 22 is a transmissive type, the amount of light received will be high if the sensor is not worn, so it is considered that the sensor is not worn if it exceeds the threshold value. This method allows for a determination in a short time. However, there is a risk that any object that blocks light will be determined to be worn (i.e., erroneously determined) even if it is inserted into the annular biosensor 2. Therefore, the configuration for determining whether or not the annular biosensor 2 is attached to a finger may be combined with a method for determining that the annular biosensor 2 is not attached when no movement is detected by the acceleration sensor 25, gyro sensor, etc., or a method for providing a temperature sensor for detecting body surface temperature and determining that the annular biosensor 2 is not attached when the detected temperature is below a predetermined value.
[0041] The result of the determination by the determination unit 24 is sent from the sensor-side communication unit 23 to the portable control unit 3. Furthermore, the sensor-side communication unit 23 of the annular biosensor 2 transmits the result of the determination as to whether or not the annular biosensor 2 is attached to a finger or wrist to the portable control unit 3. If the annular biosensor 2 is not attached to a finger or wrist, the control unit 34 of the portable control unit 3 prohibits the determination of the inclination of the user's trunk (posture determination, details of which will be described later).
[0042] The acceleration sensor 25 detects the acceleration of the annular biosensor 2, i.e., the body movement of the user wearing the annular biosensor 2. The detection result by the acceleration sensor 25 is also sent from the sensor side communication section 23 to the portable control unit 3.
[0043] On the other hand, the imaging section (camera) 31 of the portable control unit 3 captures an image (still image or moving image). The imaging section 31 is provided on the surface of the portable control unit 3 on the display section 32 side. As shown in Figs. 5 and 6, for example, the imaging section 31 captures an image of a user's face and the hand placed against the chest when the user places one hand (e.g., the left hand) on which the annular biosensor 2 is attached against the chest (to cover the nipple) and holds the portable control unit 3 with the other (opposite) hand (e.g., the right hand).
[0044] The display unit 32 is, for example, an LCD display, etc. The display unit 32 displays (notifies), for example, the following images and information (1) to (7). (1) The display unit 32 displays (notifies) a message to a user who is holding the portable control unit 3 in one hand to place the hand with the annular biosensor 2 attached against his / her chest. (2) The display unit 32 displays (presents) to the user an image of the user's face and the other hand on which the annular biometric sensor 2 is attached, so that they are captured within the frame. (3) The display unit 32 displays images (still images or moving images) captured by the imaging unit 31 in real time. The display unit 32 also graphically displays (presents) the recommended range of the face display position and face display size. More specifically, the display unit 32 superimposes a figure such as an approximate ellipse or rectangle representing the appropriate face position and size. In this way, by graphically displaying the appropriate range of the face display position and face display size on the display unit 32 (display), the user can easily recognize the appropriate range. Therefore, the user can easily correct the position and size of the displayed face by himself / herself. (4) When the control unit 34 of the portable control unit 3 recognizes the user's face in the image, the display unit 32 notifies (displays) whether the display position and size of the face are within the recommended range. In this way, both the actual face position and size in the image and the face position and size within an appropriate range are displayed, making it easy for the user to make corrections. Note that, although it is preferable to set the standard for the face height at eye height, the accuracy of estimating the relative positions of the face and the heart can be improved if the eye position is also automatically determined during automatic face determination. (5) The display unit 32 displays (notifies) the user that the trunk should be vertical, and prompts the user to make adjustments. More specifically, the display unit 32 presents (displays) whether the relative position between the portable control unit 3 and the user's trunk, and the inclination of the user's trunk with respect to the vertical direction, are within a predetermined range. In this way, the user is notified of whether the relative position between the portable control unit 3 and the trunk, and whether the inclination of the trunk is within an appropriate range, so the user knows whether it is outside the range and can easily correct it. (6) The display unit 32 displays (notifies) the user that the hand wearing the annular biosensor 2 should be at chest height, prompting the user to make an adjustment. (7) As described above, the display unit 32 may also function as the unit side light emitting unit. Note that, as described above, when the display unit 32 also functions as the unit side light emitting unit, a detailed description will not be given here.
[0045] The unit side communication unit 33 transmits and receives data (control data (commands) and measurement data, etc.) between the annular biosensor 2 (sensor side communication unit 23). More specifically, the unit side communication unit 33 determines whether or not it is connected to the sensor side communication unit 23 via Bluetooth (registered trademark). The unit side communication unit 33 also transmits a measurement preparation command and a measurement (start) command to the sensor side communication unit 23. Meanwhile, the unit side communication unit 33 receives attachment status information transmitted from the annular biosensor 2. The unit side communication unit 33 also receives biodata such as blood pressure transmitted from the annular biosensor 2.
[0046] The control unit 34 estimates the difference in height between the hand and the heart in the following steps (1) to (4). The details of each step will be described later. (1) The relative position of the portable control unit 3 and the trunk is obtained from the size ratio of the face and the hands in the image. (2) The inclination of the trunk is calculated from the inclination of the portable control unit 3 and the relative position of the portable control unit 3 and the trunk calculated in (1). (3) The difference in height between the face and the heart is statistically determined, and the height of the heart in the image is determined in combination with the relative position of the portable control unit 3 and the trunk determined in (1) and the inclination of the trunk determined in (2). (4) Measure the height difference between the hand and the heart (5) Furthermore, the position of the annular biosensor 2 is determined to improve the accuracy of the difference in height between the hand and the heart calculated in (4).
[0047] The control unit 34 judges whether the other hand on which the annular biosensor 2 is attached is at chest height from an image (still image or moving image), and based on the result of the judgment, controls the imaging unit 31, the display unit 32, the unit side communication unit 33, and the annular biosensor 2 to acquire biodata (biological information) including blood pressure. For this reason, the control unit 34 is mainly configured to have a microprocessor that performs calculations, an EEPROM that stores programs and the like for causing the microprocessor to execute each process, a RAM that temporarily stores data, an external interface (I / F), and the like. Each function of the control unit 34 is realized by the microprocessor executing a program stored in the EEPROM or the like.
[0048] The control unit 34 estimates the relative position of the face and the chest (heart) from the size of the face in the image. More specifically, the control unit 34 automatically recognizes the user's face in the image, and estimates the position of the user's chest (heart) in the image based on the display position and display size of the face. In this way, since the distance between the face and the heart can be estimated from the size of the face, it is possible to improve the accuracy of determining whether the annular biosensor 2 is at chest height.
[0049] At that time, the control unit 34 statistically estimates the relative positions of the face and the heart from physical information such as height. That is, the control unit 34 acquires the user's pre-stored physical information and estimates the position of the user's chest (heart) by taking into account (referring to) the physical information. For example, since the size of the face and the distance between the face and the heart can be estimated from the height (and weight), it is possible to improve the accuracy of determining whether the annular biosensor 2 is at chest height or not.
[0050] However, since the relative positions are shifted when the trunk is bent significantly, such as when leaning forward, it is assumed here that the trunk is not tilted in a sitting position. For example, since there is no data on the height of the heart in the "AIST Human Body Dimension Database 1991-1992", in this embodiment, data on the nipple height is used instead. The difference in height between the face and the heart can be statistically obtained by substituting B2 medial canthus height - B6 nipple height. The control unit 34 estimates, for example, the difference between the eyes (medial canthus height) and the nipples (nipple height) from statistical data based on the size of the face in the image (total head height). Instead of the total head height, A2 head width, A3 inter-tragus width, and A4 inter-auricular width may be used. This is because the top of the head may extend outside the frame or the top of the head may be difficult to recognize due to the hairstyle. In this case, the estimation accuracy can be improved by using the user's height information. If there is no user's height information, the estimation is performed using the ratio of the average values of each statistical quantity. The user's physical information (height, etc.) may be read from a memory or server that has been previously entered by the user into the portable control unit 3, or data such as health check data stored on the server may be read.
[0051] Lengths used to indicate hand size include hand length, finger dorsal length, and hand width (see "AIST Japanese Hand Measurement Data"). It is also possible to use finger width, etc., but because this is easily affected by body fat percentage, it is expected that the accuracy of the estimation will be poor when estimating hand size from height alone. Of the above, there is concern that the accuracy of the estimation of hand length will decrease if the wrist is hidden by the sleeve. Also, the accuracy of the estimation of finger dorsal length is expected to decrease if the fingers are bent. Among the finger dorsal lengths, the thumb (first finger), which is difficult to bend, is the most suitable. Hand width is a suitable length to use as an indication of hand size.
[0052] As mentioned above, blood pressure varies depending on the difference between the height of the measurement site and the heart. If the height from the heart increases by 10 cm, the blood pressure value will be 7 to 8 mmHg lower. Therefore, it is important to measure at a measurement site at the same height as the heart. If the difference between the height of the annular biosensor 2 and the heart increases, the blood pressure value will deviate from the true value, so by making this judgment, it can be determined whether the measured blood pressure value deviates from the true value. The inclination of the trunk from the vertical direction is a factor that causes the estimated value of the height of the face and the heart to deviate. By determining whether the inclination is outside a specified range, it can be determined whether the measured blood pressure value deviates from the true value.
[0053] The left-right inclination of the user's trunk can be estimated from the left-right inclination of the face in the image and the left-right inclination of the portable control unit 3. If the left-right inclination exceeds a predetermined range, the user is notified via the display unit 32 or the like. Fig. 7(a) shows an example image in which only the trunk is inclined to the right. Fig. 7(b) shows an example image in which the trunk and the portable control unit 3 are inclined to the right in the same manner.
[0054] The portable control unit 3 has an inclination sensor (or acceleration sensor) 35 that detects the inclination of the portable control unit 3 with respect to the vertical direction. Based on the inclination of the portable control unit 3 with respect to the vertical direction detected by the inclination sensor 35, the control unit 34 determines whether or not the inclination of the user's trunk with respect to the vertical direction and the left-right direction is within a predetermined range.
[0055] The control unit 34 also estimates the inclination of the user's trunk in the front-rear direction from the display size (size) of the face and the display size (size) of the hand in the image. The control unit 34 statistically estimates the ratio of the size of the face to the size of the hand from the height information of the user, etc. More specifically, the control unit 34 estimates the size of the face and the size of the hand based on the height information, etc., and calculates the ratio (called the actual ratio). The control unit 34 also obtains the size of the face and the size of the hand in the image, and calculates the ratio (called the intra-image ratio). The control unit 34 then estimates the relative position of the portable control unit 3 and the trunk based on whether the intra-image ratio is within a predetermined range with respect to the actual ratio, and determines whether the relative position of the portable control unit 3 and the trunk is within a predetermined range. In this case, the size of the face and the size of the hand can be statistically estimated from the height (and weight), so that the relative position of the portable control unit 3 and the trunk can be estimated by automatically distinguishing the face and the hand in the image and calculating the ratio of their respective sizes in the image.
[0056] Here, in the example of FIG. 5, an example of an image captured by moving the portable control unit 3 (imaging unit 31) up and down is shown, and from the left side of the drawing, the images are (a) from above, (b) from the front, and (c) from below. As shown in FIG. 5, the hand width differs when the face size is kept constant. When the hand width / total head height is estimated from the image, it is 0.22 from above, 0.30 from the front, and 0.54 from the bottom. When the hand width / total head height is calculated based on the average of young adult males in the statistical data, it is 0.35, which is close to the value when photographed from the front. When all data in the database is assumed to be normally distributed and the position of the user's height in the normal distribution is assumed to be the same for other items, the hand width / total head height becomes 0.34, which is a closer value.
[0057] The average value of the statistics is μ and the standard deviation is σ. The user's height is expressed in terms of the height statistics μ and σ as shown in the following equation (1). The user's total head height and hand width are estimated from the obtained coefficient a and the total head height and hand width statistics. User measurement value = μi + a × σi (1) Therefore, by determining the hand width and total head height by image recognition, it is possible to estimate the relative position of the trunk and the portable control unit 3. Then, the user is notified to adjust the height of the portable control unit 3 so that the portable control unit 3 is approximately parallel to the trunk (taking an image from the front). In addition, the estimation accuracy can be improved by using the user's height information.
[0058] Next, the control unit 34 estimates whether the trunk is tilted forward or backward from the tilt of the portable control unit 3. As described above, since the relative position between the portable control unit 3 and the trunk has already been determined (the portable control unit 3 and the trunk are parallel), if the tilt of the portable control unit 3 is measured by the tilt sensor 35 built into the portable control unit 3, the tilt of the trunk in the forward and backward directions can be estimated. Therefore, the control unit 34 recognizes the user's face and the hand on which the annular biosensor 2 is attached from the image, estimates the relative position between the portable control unit 3 and the user's trunk from the display size of the user's face and the display size of the hand, and determines whether the tilt of the user's trunk in the vertical direction and the forward and backward directions is within a predetermined range based on the tilt of the portable control unit 3 detected by the tilt sensor (or acceleration sensor) 35 and the relative position between the portable control unit 3 and the user's trunk. Incidentally, even if the relative position of the portable control unit 3 and the trunk is within a predetermined range, if the inclination of the trunk from the vertical direction is large, the accuracy of chest height determination decreases. In this case, the inclination of the portable control unit 3 indicates whether the inclination of the trunk from the vertical direction is within a predetermined range, and therefore the accuracy of chest height determination can be determined.
[0059] If the user is leaning forward or leaning back (leaning backward) during measurement, the relative positional relationship between the face and the heart will be shifted, causing the heart height to be estimated lower than the actual heart height, reducing the accuracy of the blood pressure value. In addition, a posture that puts pressure on the abdomen, such as leaning forward, can cause blood pressure to rise. However, such leaning forward or leaning back is difficult for the user to notice. By determining the inclination of the trunk from the vertical direction, the user can be notified that they are leaning forward or leaning back, and can correct the position themselves.
[0060] Instead of (or in addition to) notifying the user to adjust the height of the portable control unit 3 so that the portable control unit 3 is approximately parallel to the trunk (taking an image from the front) after estimating the relative position of the trunk and the portable control unit 3 by determining the hand width and total head height through image recognition, the relative inclination of the portable control unit 3 and the trunk from the vertical direction may be estimated from the ratio of the hand width and total head height within the image, and the inclination of the trunk from the vertical direction may be obtained by combining this with the inclination of the portable control unit 3 from the vertical direction. By determining whether the inclination of the trunk from the vertical direction is outside a predetermined range, it is possible to know whether the measured blood pressure value deviates from the true value.
[0061] In this way, the control unit 34 recognizes the user's face and the hand on which the annular biosensor 2 is attached from an image (still image or moving image), estimates the relative position between the portable control unit 3 and the user's trunk from the display size of the user's face and the display size of the hand, and determines whether the inclination of the user's trunk with respect to the vertical direction is within a predetermined range based on the estimation result (relative position with respect to the user's trunk) and the inclination of the portable control unit 3 detected by the inclination sensor 35, and controls the annular biosensor 2 using the result of the determination. Since the size of the face and the size of the hand can be statistically estimated from the height (and weight), the face and the hand in the image can be automatically distinguished to estimate the relative position (inclination) of the portable control unit 3 and the trunk. By combining the inclination of the portable control unit 3 with the inclination of the portable control unit 3, the inclination of the trunk with respect to the vertical direction can be estimated, and by determining whether the inclination of the trunk is outside the predetermined range, it is possible to know whether the measured blood pressure value deviates from the true value.
[0062] Here, with reference to Fig. 8, a model will be used to explain how the ratio of hand width to total head height in an image changes depending on the orientation of the imaging unit 31. Fig. 8(a) shows a case where the imaging unit 31 is oriented perpendicular to the straight line on which α (face) and β (hand) are placed, and Fig. 8(b) shows a case where the imaging unit 31 is tilted by an angle φ from the state in Fig. 8(a). In Fig. 8, the total head height and hand width are plotted on the same straight line as the length L α Line α with length L βThe distance between the imaging unit 31 and α and the distance between the imaging unit 31 and β are d. The depth is omitted for simplicity. When the imaging unit 31 is oriented perpendicular to the line on which α and β are located, and α and β are captured at the same vertical position in the image, the distance between the imaging unit 31 and α and the distance between the imaging unit 31 and β are d. α1 , d β1 The angles from the direction in which the image capturing unit 31 faces are respectively θ0 and -θ0. Half of the angle range in which α and β are captured by the image capturing unit 31 is respectively θ α1 , θ β1 In this case, d α1 =d β1 =d0 (2) From Fig. 8(a), the following equations (3) and (4) hold. d α1 tan(θ α1 )=L α cos(θ0) (3) d β1 tan(θ β1 )=L β cos(θ0) (4) Therefore, the following equation (5) holds. L β / L α =d β1 / d α1 ×(tan(θ β1 ) / tan(θ α1 )) = tan(θ β1 ) / tan(θ α1 ) ···(5) Here, L β / L α is the real ratio, tan(θ β1 ) / tan(θ α1 ) is the intra-image ratio, and in this case, the two are the same.
[0063] Next, Fig. 8(b) shows the case where the imaging unit 31 is tilted upward by an angle φ. Here, the positions (θ0, -θ0) of α and β in the image do not change. The angle is within a range that satisfies the relationship of the following equation (6). 0°<θ0<90°, 0°<θ0+φ<90°, 0°<θ0-φ<90° (6) From FIG. 8(b), the following equations (7)-(9) hold. d α2 tan(θ α2 ) = L α cos(θ0 + φ) ···(7) d β2 tan(θ β2 ) = L β cos(θ0 - φ) ···(8) d α2 cos(θ0 + φ) = d β2 cos(θ0 - φ) ···(9) Therefore, the following equation (10) holds. d β2 / d α2 = cos(θ0 + φ) / cos(θ0 - φ) ···(10)
[0064] Similar to the previous case, find L β / L α . L β / L α = d β2 tan(θ β2 ) / cos(θ0 - φ) / (d α2 tan(θ α2 ) / cos(θ0 + φ)) = tan(θ β2 ) / tan(θ α2 ) × (d β2 / d α2 ) × (cos(θ0 + φ) / cos(θ0 - φ)) = tan(θ β2 ) / tan(θ α2 ) × (cos(θ0 + φ) / cos(θ0 - φ))^2 ···(11) Therefore,[[]] tan(θ β2 ) / tan(θ α2 ) = L β / L α × (cos(θ0 - φ) / cos(θ0 + φ))^2 ···(12) Here, tan(θ β2 ) / tan(θ α2 ) is the in-image ratio and changes from the actual ratio L β / L α by (cos(θ0 - φ) / cos(θ0 + φ))^2. Assuming φ > 0°, 0°<θ0-φ<θ0+φ<90° (13) That is, cos(θ0-φ)>cos(θ0+φ) ···(14) Therefore, the ratio in the image is larger than the actual ratio.
[0065] When φ<0° (when the imaging unit 31 is tilted downward), 0°<θ0+φ<θ0-φ<90° (15) That is, cos(θ0-φ) <cos(θ0+φ) ···(16) Therefore, the ratio in the image is smaller than the actual ratio.
[0066] Actual ratio L β / L α is estimated from statistics, and (cos(θ0-φ) / cos(θ0+φ))^2 is calculated from the ratio with the intra-image ratio to estimate the angle φ. The relative inclination of the imaging unit 31 (portable control unit 3) and the trunk can be determined from this angle φ. The inclination of the imaging unit 31 (portable control unit 3) from the vertical direction can be obtained by using the built-in inclination sensor 35 to obtain the inclination of the trunk from the vertical direction. By determining whether the inclination of the trunk from the vertical direction is outside a specified range, it can be determined whether the measured blood pressure value deviates from the true value.
[0067] After the relative positions of the portable control unit 3 and the trunk and the inclination of the portable control unit 3 are determined, the control unit 34 estimates the heart height. For example, the nipple height can be used as the heart height. The height of the heart from the eyes in the image is estimated from the value of "medial canthus height" - "nipple height" in the database. In the image of FIG. 6, the position of the middle finger can be estimated. When the nipple is covered with the palm of the hand, the middle finger tends to be close to the nipple height, so the estimation can be made with high accuracy. Note that the estimation was made from publicly available human body dimension data, but the estimation may be made based on separately obtained human body dimension data, or the estimation may be made by obtaining the user's own data and inputting the measured values.
[0068] In this manner, it can be determined that the user is in an appropriate posture for measurement (not leaning forward or leaning back) and that the hand wearing the annular biosensor 2 is at nipple height. Therefore, if the position of the annular biosensor 2 within the image can be determined, the difference in height between the annular biosensor 2 and the heart can be estimated. Note that the method for determining the position of the annular biosensor 2 within the image is as described above, and therefore a detailed description will be omitted here.
[0069] As described above, it is important to measure blood pressure at heart height while at rest, so accurate blood pressure values cannot be measured unless the measurement is performed in an appropriate posture. On the other hand, measuring at heart height limits the user's measurement posture, which can be difficult when continuous or regular data is required. Therefore, it is important to calculate the reliability of the measurement value and to correct it so that it is approximately equal to the blood pressure value in the case of an appropriate measurement posture. Since the blood pressure value becomes more inaccurate the more the posture deviates from the appropriate posture, by calculating the reliability of the measurement value according to the deviation from the appropriate posture, the user can handle the measurement value while taking into consideration the risk that the blood pressure measurement value deviates from the true value.
[0070] Therefore, the control unit 34 calculates the reliability of the biological data including the (measured) blood pressure based on the determination result of the inclination of the user's trunk (posture determination result). Since it is important to measure blood pressure at heart height while at rest, accurate blood pressure values cannot be measured unless the measurement is performed in an appropriate posture. The more the posture deviates from the appropriate posture, the more inaccurate the blood pressure value becomes, but by calculating the reliability, the measurement value can be handled while taking into account the risk that the blood pressure measurement value deviates from the true value.
[0071] Moreover, by correcting the measured blood pressure value so that it is approximately equal to the blood pressure value in an appropriate measurement posture, it becomes even more convenient for the user. If the absolute position of the face and the portable control unit 3 can be estimated, the height difference between the annular biosensor 2 and the heart can be estimated, and the blood pressure value can be corrected to correspond to the height difference. Furthermore, the control unit 34 may correct biometric data such as blood pressure based on the determination result of the inclination of the user's trunk (posture determination result). For example, since blood pressure may be high when leaning forward, in the case of leaning forward, the estimated value may be corrected lower based on the trunk inclination and blood pressure value data acquired in advance.
[0072] Although blood pressure value correction is possible if the difference between the height of the annular biosensor 2 and the chest can be estimated, the accuracy of blood pressure estimation is improved by measuring with the annular biosensor 2 at the (vertical) height of the chest. In other words, measuring at the height of the heart every time provides more stable blood pressure accuracy than measuring at a position lower or higher than the heart. However, measuring at the height of the heart limits the user's measurement posture, which may be difficult when continuous or regular data is required (there is a risk of causing pain to the user). Therefore, by correcting the measured blood pressure value so that it is approximately equivalent to the blood pressure value in the appropriate measurement posture, it becomes possible to obtain continuous or regular data.
[0073] Next, the operation of the biological data measurement system 1 will be described with reference to Fig. 9 and Fig. 10. Fig. 9 is a flowchart showing the procedure of blood pressure measurement processing by the annular biological sensor 2 constituting the biological data measurement system 1. Fig. 10 is a flowchart showing the procedure of blood pressure measurement processing by the portable control unit 3 constituting the biological data measurement system 1. The process shown in Fig. 9 is repeatedly executed at a predetermined timing mainly by the annular biosensor 2. The process shown in Fig. 10 is repeatedly executed at a predetermined timing mainly by the portable control unit 3.
[0074] First, the operation of the annular biosensor 2 (blood pressure measurement process) will be described with reference to Fig. 9. In step S100, it is determined whether or not the portable control unit 3 is connected by Bluetooth (registered trademark). If the portable control unit 3 is not connected, the process is temporarily terminated. On the other hand, if the portable control unit 3 is connected, the process proceeds to step S102.
[0075] In step S102, a photoelectric pulse wave signal is acquired. Then, in step S104, it is determined whether or not the annular biosensor 2 is attached to a finger based on the photoelectric pulse wave signal acquired in step S102. If the annular biosensor 2 is not attached to a finger, the process proceeds to step S102, and the above-mentioned steps S102 to S104 are repeatedly executed until the annular biosensor 2 is attached to a finger. On the other hand, if the annular biosensor 2 is attached to a finger, the process proceeds to step S106.
[0076] In step S106, information indicating that the annular biosensor 2 is attached to a finger (attachment state information) is transmitted to the portable control unit 3.
[0077] In the next step S108, it is determined whether or not a measurement preparation command has been received from the portable control unit 3. If the measurement preparation command has not been received, the process proceeds to step S106, and the above-mentioned steps S106 to S108 are repeatedly executed until the measurement preparation command is received. On the other hand, if the measurement preparation command has been received, the process proceeds to step S110.
[0078] In step S110, the light emitting element (light emitting section) 221 of the photoelectric pulse wave sensor 22 starts emitting light in a predetermined pattern.
[0079] Next, in step S112, acceleration data (body movement data) is acquired. Then, in step S114, the acquired acceleration data (body movement data) is transmitted to the portable control unit 3.
[0080] Next, in step S116, it is determined whether or not a measurement (start) command has been received from the portable control unit 3. If the measurement (start) command has not been received, the process proceeds to step S110, and the above-mentioned steps S110 to S116 are repeatedly executed until the measurement (start) command is received. On the other hand, if the measurement (start) command has been received, the process proceeds to step S118.
[0081] In step S118, photoelectric pulse wave data (blood pressure data) and acceleration data (body movement data) are acquired. Then, in step S120, the photoelectric pulse wave data (blood pressure data) and acceleration data (body movement data) acquired in step S118 are transmitted to the portable control unit 3. Thereafter, the process temporarily exits.
[0082] Next, the operation of the portable control unit 3 (blood pressure, etc. measurement process) will be described with reference to Fig. 10. In step S200, it is determined whether or not the ring-shaped biosensor 2 is connected via Bluetooth (registered trademark). If the ring-shaped biosensor 2 is not connected, in step S202, a connection with the ring-shaped biosensor 2 is established (paired) via Bluetooth (registered trademark), and then the process proceeds to step S204. On the other hand, if the ring-shaped biosensor 2 is connected, the process proceeds to step S204.
[0083] In step S204, it is determined whether or not information (wearing status information) indicating that the annular biosensor 2 is worn on a finger has been received from the annular biosensor 2. If the wearing status information has not been received, in step S206, information encouraging the user to wear the annular biosensor 2 is displayed (notified), and then the process proceeds to step S204, where it is determined again whether or not the wearing status information has been received. On the other hand, if the wearing status information has been received, the process proceeds to step S208.
[0084] In step S208, it is determined whether the mounting preparation switch has been pressed. If the mounting preparation switch has not been pressed, this process is repeated until the mounting preparation switch is pressed. On the other hand, if the mounting preparation switch has been pressed, the process proceeds to step S210.
[0085] In step S210, an image captured by the imaging unit (camera) 31 is displayed, and information urging the user to take a picture of himself is displayed (notified).
[0086] Next, in step S212, the image is analyzed, and the inclination of the portable control unit 3 relative to the vertical direction is acquired. Next, in step 214, it is determined whether the position / size of the face in the image, the position / size of the hand to which the annular biosensor 2 is attached, the inclination of the portable control unit 3 relative to the vertical direction, and the inclination of the user's trunk relative to the vertical direction are each within a predetermined range. Here, if each value is not within the predetermined range, information is displayed (notified) to the user in step S216 to prompt the user to bring each value within the predetermined range, and then the process proceeds to step S228. On the other hand, if each value is within the predetermined range, the process proceeds to step S218. Note that the methods for recognizing (determining) the position / size of the face in the image, the position / size of the hand on which the annular biosensor 2 is worn, the inclination of the portable control unit 3 relative to the vertical direction, and the inclination of the user's torso relative to the vertical direction are as described above, so detailed explanations will be omitted here.
[0087] In step S218, it is determined whether the annular biosensor 2 emitting light in a predetermined light emission pattern has been recognized from the captured image. If the annular biosensor 2 has not been recognized, then in step S216, information is displayed (notified) to the user to prompt the user to place the annular biosensor 2 (the light emitting element (light emitting section) 221 of the photoplethysmographic sensor 22) in the image, and the process proceeds to step S228. On the other hand, if the annular biosensor 2 has been recognized, the process proceeds to step S220.
[0088] In step S220, the acceleration data (body movement data) transmitted from the annular biosensor 2 is received (acquired). Then, in step S222, it is determined whether the measurement posture is within an appropriate range (whether the annular biosensor 2 is at chest height) and whether the body movement is within an appropriate range. If the measurement posture and body movement are not within the appropriate range, in step S216, information is displayed (notified) to the user to prompt the user to bring the measurement posture and body movement into the appropriate range, and then the process proceeds to step S228. On the other hand, if the measurement posture and body movement are within the appropriate range, the process proceeds to step S224. Note that the method of recognizing (determining) whether the measurement posture is within the appropriate range (whether the annular biosensor 2 is at chest height) is as described above, and will not be described in detail here.
[0089] In step S224, a measurement (start) command instructing the start of measurement is transmitted to the annular biosensor 2. Then, in step S226, the photoelectric pulse wave data (blood pressure data) and acceleration data (body movement data) transmitted from the annular biosensor 2 are received (acquired). Here, blood pressure, blood glucose level, pulse rate, oxygen saturation, and respiration are acquired from the photoelectric pulse wave data. The amount of activity and the tilt of the annular biosensor 2 are acquired from the acceleration data. Furthermore, if a temperature sensor is provided, the body surface temperature is acquired from the temperature data. Thereafter, the process proceeds to step S228.
[0090] In step S228, a determination is made as to whether or not to disconnect the connection with the annular biosensor 2 via Bluetooth (registered trademark). If the connection is to be disconnected, the process temporarily exits after the connection with the annular biosensor 2 via Bluetooth (registered trademark) is disconnected. On the other hand, if the connection is not to be disconnected, the process proceeds to step S210, and the above-mentioned processes of steps S210 to S228 are repeatedly executed.
[0091] As described above in detail, according to this embodiment, the annular biosensor 2 formed in a ring shape and provided with the sensor unit 22 is worn on the finger or wrist, so that the contact pressure (pressure) with the measurement site is stable, and biodata including blood pressure can be measured with high accuracy. In addition, from an image of the user's face and the other hand on which the annular biosensor 2 is worn, it is determined whether the hand on which the annular biosensor 2 is worn is at chest (heart) height or not, and based on the determination result, the annular biosensor 2 is controlled (biological data including blood pressure is measured), so that biodata including blood pressure can be measured with high accuracy. Furthermore, since no cuff is used, it is highly portable and can measure biodata including blood pressure non-invasively. As a result, according to this embodiment, it is highly portable and it is possible to measure biodata including blood pressure, the measurement value of which is affected by the difference between the height of the measurement site and the height of the heart (i.e., affected by hydrostatic pressure), with high accuracy and non-invasively.
[0092] In this case, according to the present embodiment, the user's face in the image is automatically recognized, and the position of the user's chest (heart) in the image is estimated based on the display position and display size of the face. In this way, the distance between the face and the heart can be estimated from the size of the face, so that it is possible to improve the accuracy of determining whether the annular biosensor 2 is at chest height or not.
[0093] Although the embodiment of the present invention has been described above, the present invention is not limited to the above embodiment and various modifications are possible. For example, in the above embodiment, the measured data (measurement data) such as blood pressure is sequentially transmitted to the portable control unit 3. The configuration may be such that the data is stored in an EEPROM or RAM of the annular biosensor 2 and is read out later (after measurement).
[0094] In the above embodiment, a photoplethysmographic sensor is used as the annular biosensor 2 (sensor section 22), but the annular biosensor 2 (sensor section 22) is not limited to a photoplethysmographic sensor.
[0095] In the above embodiment, Bluetooth (registered trademark) was adopted as the wireless communication standard connecting the annular biosensor 2 and the portable control unit 3, but instead of Bluetooth (registered trademark), for example, BLE (Bluetooth (registered trademark) Low Energy) may be adopted. [Explanation of symbols]
[0096] 1. Biometric data measurement system 2. Ring-shaped biosensor 21 Main body 211 Light state variable member 22 Sensor unit (photoplethysmography sensor) 221 Light emitting element (sensor side light emitting part) 222 Photodetector 23 Sensor side communication unit 24 Judgment section 25 Acceleration Sensor 3 Portable Control Unit 31 Imaging unit 32 Display unit (unit side light emitting unit) 33 Unit side communication section 34 Control section 35 Inclination sensor (acceleration sensor)
Claims
1. A biometric data measurement system including an annular biometric sensor and a portable control unit configured to be able to communicate with each other, The annular biosensor includes: A main body portion formed in a ring shape so as to be wearable on a finger or a wrist; a sensor unit provided in the main body unit and configured to measure biological data including blood pressure; The portable control unit includes: An imaging unit that captures an image; a display unit that presents an image of the user's face and the other hand on which the annular biosensor is attached to the user holding the portable control unit in one hand, and displays the image captured by the imaging unit; a control unit that determines whether the other hand on which the annular biosensor is attached is at chest height from the image, and controls the biodata measurement system based on the result of the determination to acquire biodata including blood pressure; A light state variable member that reflects or scatters light is provided on a surface of the main body of the annular biosensor, the controller of the portable control unit recognizes the position of the annular biosensor in the image by recognizing the light state variable member from the image; the portable control unit has a unit-side light-emitting part that emits light in a predetermined pattern; The control unit of the portable control unit recognizes the position of the annular biosensor in the image by recognizing the annular biosensor that reflects or scatters light emitted in the predetermined pattern from the image. A biological data measuring system comprising:
2. A biometric data measurement system including an annular biometric sensor and a portable control unit configured to be able to communicate with each other, The annular biosensor includes: A main body portion formed in a ring shape so as to be wearable on a finger or a wrist; a sensor unit provided in the main body unit and configured to measure biological data including blood pressure; The portable control unit includes: An imaging unit that captures an image; a display unit that presents an image of the user's face and the other hand on which the annular biosensor is attached to the user holding the portable control unit in one hand, and displays the image captured by the imaging unit; a control unit that determines whether the other hand on which the annular biosensor is attached is at chest height from the image, and controls the biodata measurement system based on the result of the determination to acquire biodata including blood pressure; The annular biosensor has a sensor-side light-emitting unit that emits light in a predetermined pattern, The control unit of the portable control unit recognizes the position of the annular biosensor in the image by recognizing the sensor-side light-emitting unit that emits light in the predetermined pattern from the image. A biological data measuring system comprising:
3. The sensor unit of the annular biosensor is a photoplethysmographic sensor including a light emitting element and a light receiving element, the sensor-side light-emitting unit that emits light in the predetermined pattern is the light-emitting element that constitutes the photoplethysmographic sensor, 3. The biological data measuring system according to claim 2, wherein a directional angle of the light-emitting element of the photoplethysmographic sensor is larger than a directional angle of the light-receiving element of the photoplethysmographic sensor.
4. The biometric data measurement system of any one of claims 1 to 3, characterized in that the control unit of the portable control unit recognizes the user's face in the image and estimates the position of the user's chest in the image based on the display position and display size of the face.
5. The biometric data measurement system according to claim 4, characterized in that the control unit of the portable control unit acquires pre-stored physical information of the user and estimates the position of the user's chest taking into account the physical information.
6. The biometric data measurement system of claim 4 or 5, characterized in that the control unit of the portable control unit recognizes the user's face and the hand on which the annular biometric sensor is attached from the image, estimates the relative position between the portable control unit and the user's torso from the ratio between the display size of the user's face and the display size of the hand, and determines whether the relative position is within a predetermined range.
7. the portable control unit has an inclination sensor that detects an inclination of the portable control unit with respect to a vertical direction; The biometric data measurement system of claim 6, characterized in that the control unit of the portable control unit determines whether the vertical and left-right tilt of the user's torso is within a predetermined range based on the vertical tilt of the portable control unit detected by an inclination sensor.
8. The biometric data measurement system of claim 7, wherein the control unit of the portable control unit recognizes the user's face and the hand on which the annular biometric sensor is attached from the image, estimates the relative position between the portable control unit and the user's trunk from the display size of the user's face and the display size of the hand, and determines whether the tilt of the user's trunk in the vertical direction and the front-to-back direction is within a predetermined range based on the tilt of the portable control unit detected by the tilt sensor and the relative position of the portable control unit and the user's trunk.
9. The biometric data measurement system described in claim 7 or 8, characterized in that the control unit of the portable control unit recognizes the user's face and the hand on which the annular biometric sensor is attached from the image, estimates the relative position between the portable control unit and the user's torso from the display size of the user's face and the display size of the hand, determines whether the inclination of the user's torso with respect to the vertical direction is within a predetermined range based on the estimation result and the inclination of the portable control unit detected by the inclination sensor, and controls the annular biometric sensor using the result of the determination.
10. The biometric data measurement system according to any one of claims 1 to 8, characterized in that the display unit of the portable control unit graphically displays the recommended range of face display position and face display size.
11. The controller of the portable control unit recognizes a face of the user in the image; 11. The biological data measurement system according to claim 10, wherein the display unit of the portable control unit notifies whether the face display position and face display size are within a recommended range.
12. The biometric data measurement system of any one of claims 7 to 9, characterized in that the display unit of the portable control unit presents the relative position between the portable control unit and the user's trunk, and whether or not the inclination of the user's trunk is within a predetermined range.
13. The annular biosensor includes a determination unit that determines whether the annular biosensor is attached to a finger or a wrist; a sensor side communication unit that transmits and receives data to and from the portable control unit, The sensor side communication unit of the annular biosensor transmits a determination result of whether or not the annular biosensor is attached to a finger or a wrist to the portable control unit; The biometric data measurement system of any one of claims 7 to 9, characterized in that the control unit of the portable control unit prohibits determination of the inclination of the user's trunk when the annular biometric sensor is not worn on a finger or wrist.
14. The biological data measurement system according to any one of claims 1 to 13, characterized in that the biological data includes, in addition to blood pressure, at least one of blood glucose level, pulse rate, respiration, pulse wave, oxygen saturation, body surface temperature, and activity level.
15. The biometric data measurement system of any one of claims 7 to 9, characterized in that the control unit of the portable control unit calculates the reliability of the acquired biometric data, including blood pressure, based on the result of determining the inclination of the user's trunk relative to the vertical direction.
16. The biometric data measurement system of any one of claims 7 to 9, characterized in that the control unit of the portable control unit corrects biometric data including blood pressure based on the determination result of the inclination of the user's torso relative to the vertical direction.
Citation Information
Patent Citations
Electronic sphygmomanometer
JP2009247733A
Personal authentication device and method
JP2010277611A
Support information provision device, support information provision system, support information provision method, and support information provision program
JP2017221350A
Device with blood pressure sensor and method for controlling the device
JP2020500052A
Method and apparatus for central venous pressure measurement - Patents.com
JP2020503087A
