Biological information estimation device and biological information estimation method

Abstract

Provided is a biological information estimation device and a biological information estimation method that can improve the accuracy of estimated biological information and can shorten the time required to estimate biological information of a living being. The biological information estimation device includes a detection unit that detects a pulse wave from a living being; a change unit that determines whether there is an interference with the pulse wave and changes the length of a measurement period based on the determination result of whether there is the interference; and an estimation unit that estimates biological information from the pulse wave detected during the measurement period.

Description

Technical Field

[0001] This disclosure relates to a bioinformatics estimation device and a bioinformatics estimation method. Background Technology

[0002] In a cuff-type electronic blood pressure monitor, pressure changes within the cuff. Additionally, the cuff itself acts as a sensor, detecting pulse waves. Blood pressure is then estimated based on the detected pulse waves.

[0003] Japanese Patent Application Publication No. 2015-16188 discloses a bioinformatics processing device.

[0004] In this bioinformatics processing device, biological signals including pulse wave components and body motion noise components are detected. Furthermore, the pulse wave components and body motion noise components are separated. The separated pulse wave components are then identified as a pulse wave signal (summary). Summary of the Invention

[0005] In cuff-type electronic blood pressure monitors, the accuracy of blood pressure estimation decreases when the organism whose blood pressure is being estimated performs an action or makes a sound.

[0006] In the bio-information processing device disclosed in Japanese Patent Application Publication No. 2015-16188, because it takes time to change the pressure inside the cuff, the time to detect biosignals may exceed the required time, sometimes resulting in unnecessary waiting time.

[0007] The present invention addresses this problem. One aspect of this disclosure aims to provide a bioinformatics estimation apparatus and method, which, for example, can improve the accuracy of bioinformatics estimation and shorten the time required to estimate the bioinformatics of organisms.

[0008] A bioinformatics estimation apparatus according to one aspect of this disclosure includes: a detection unit for detecting pulse waves from bio-information; a modification unit for determining whether there is interference with the pulse waves and modifying the length of a measurement period based on the determination result of whether there is interference; and an estimation unit for estimating bioinformatics based on the pulse waves detected during the measurement period.

[0009] Another aspect of the bioinformatics estimation method disclosed herein includes: a. a step of detecting a bio-detection pulse; b. a step of determining whether there is interference with the pulse and changing the length of a measurement period based on the determination of whether there is interference; and c. a step of estimating bioinformatics based on the pulses detected during the measurement period. Attached Figure Description

[0010] Figure 1 This is a block diagram of the bioinformatics estimation device according to the first embodiment.

[0011] Figure 2 This diagram illustrates an example of how the change unit of the bioinformatics estimation device according to the first embodiment determines whether there is interference.

[0012] Figure 3 This is a block diagram of the image processing unit included in the bioinformatics estimation device of the first embodiment.

[0013] Figure 4 This is a flowchart illustrating the processing flow performed by the modification unit of the bioinformatics estimation device in the first embodiment.

[0014] Figure 5 This is a graph illustrating an example of the time during which the change unit of the bioinformatics estimation device of the first embodiment ends the measurement when there is no interference with the pulse wave.

[0015] Figure 6 This is a graph illustrating an example of the time when the measurement period ends for the change unit of the bioinformatics estimation device in the first embodiment, under conditions where there is interference with the pulse wave.

[0016] Figure 7 This is a graph showing a first example of the selection of a maximum point by the modification unit provided in the bioinformatics estimation device of the first embodiment.

[0017] Figure 8 This is a graph representing a first example of minimum point selection performed by the modification unit of the bioinformatics estimation device of the first embodiment.

[0018] Figure 9 This is a graph representing a second example of the selection of a maximum point by the modification unit provided in the bioinformatics estimation device of the first embodiment.

[0019] Figure 10 This is a graph showing a second example of the selection of a minimum point by the modification unit provided in the bioinformatics estimation device of the first embodiment.

[0020] Figure 11 This is a graph showing an example of the waveform of a pulse with a modified portion provided by the bioinformatics estimation device of the first embodiment.

[0021] Figure 12 It is a graph representing an example of the first derivative of the waveform of a pulse with a changed portion provided by the bioinformatics estimation device of the first embodiment.

[0022] Figure 13 It is a graph showing an example of the second-order derivative of the waveform of the pulse with altered separation provided by the bioinformatics estimation device of the first embodiment.

[0023] Figure 14 This is a flowchart illustrating the process by which the modification unit of the bioinformatics estimation device of the first embodiment performs a process based on the pulse wave itself to determine whether there is interference.

[0024] Figure 15 This is a flowchart illustrating the process of image-based determination of interference by the modification unit of the bioinformatics estimation device of the first embodiment.

[0025] Figure 16 This is a flowchart illustrating the process of determining whether there is interference based on sound by the modification unit of the bioinformatics estimation device of the first embodiment.

[0026] Figure 17 This is a flowchart illustrating the process by which the modification unit of the bioinformatics estimation device of the first embodiment performs a process to determine whether there is interference based on acceleration or angular velocity. Detailed Implementation

[0027] The present embodiment will be described below with reference to the accompanying drawings. Furthermore, the same or equivalent elements will be given the same reference numerals in the drawings, and repeated descriptions will be omitted.

[0028] 1. First Embodiment 1.1 Bioinformatics Estimation Device

[0029] Figure 1 This is a block diagram of the bioinformatics estimation device according to the first embodiment.

[0030] Figure 1 The bioinformation estimation device 1 shown estimates bioinformation 12 of organism 11. The organism 11 whose bioinformation 12 is being estimated is a human. Organism 11 can also be an animal other than a human. The estimated bioinformation 12 represents the state of organism 11. Bioinformation 12 includes blood pressure 21 and pulse rate 22. Bioinformation 12 may also include bioinformation other than blood pressure 21 and pulse rate 22. Furthermore, in this disclosure, pulse rate and heart rate have the same meaning.

[0031] like Figure 1 As shown, the bioinformatics estimation device 1 includes a detection unit 31, a camera unit 32, a microphone 33, a motion sensor 34, a change unit 35, an estimation unit 36, and an output unit 37.

[0032] The detection department 31 detects pulse waves 41 from biological 11.

[0033] The imaging unit 32 captures images of the organism 11 to obtain images 42. The imaging unit 32 is composed of an RGB camera, etc.

[0034] Microphone 33 detects sound 43.

[0035] The motion sensor 34 detects the acceleration 44, angular velocity 45, or orientation 46 of the detection unit 31. The motion sensor 34 includes an acceleration sensor that detects the acceleration 44 when the acceleration 44 is detected. The motion sensor 34 includes a gyroscope sensor that detects the angular velocity 45 when the angular velocity 45 is detected. The motion sensor 34 includes an orientation sensor that detects the orientation 46 when the orientation 46 is detected.

[0036] The modification unit 35 determines whether interference exists in the pulse 41 and changes the length of the measurement period based on the determination result. This allows the measurement period to be adjusted to suit the presence or absence of interference. The interference determined to be present or absent is interference that reduces the periodicity or regularity of the pulse 41. Interference can be either external interference caused by phenomena outside the system generating the pulse 41 or internal interference caused by phenomena inside the system. The modification unit 35 can determine whether interference exists in the pulse 41 based on the pulse 41 itself, or based on factors other than the pulse 41. Factors other than the pulse 41 include image 42, sound 43, acceleration 44, angular velocity 45, orientation 46, etc. If the modification unit 35 determines that interference exists in the pulse 41, it extends the length of the measurement period. Therefore, if the estimation accuracy of the bioinformation 12 cannot be improved without extending the measurement period due to interference in the pulse 41, the measurement accuracy of the bioinformation 12 can be improved by extending the measurement period. Furthermore, even if the measurement period is shortened due to the absence of interference with pulse 41, the accuracy of bioinformation 12 can still be improved by shortening the measurement period and the time required to estimate bioinformation 12. For example, this time can be reduced to less than 10 seconds.

[0037] The estimation unit 36 ​​infers bio-information 12 based on the pulse wave 41 detected during the measurement period. The estimation unit 36 ​​does not use the pulse wave 41 detected during periods of interference, which are periods within the measurement period deemed to interfere with the pulse wave 41, for estimating the bio-information 12. On the other hand, the estimation unit 36 ​​uses the pulse wave 41 detected during periods of no interference, which are periods within the measurement period deemed not to interfere with the pulse wave 41, for estimating the bio-information 12.

[0038] The output unit 37 outputs the estimated biological information 12. The output unit 37 consists of a display showing a picture representing the biological information 12, a speaker emitting a sound representing the biological information 12, and a transmission circuit that transmits a signal representing the biological information 12.

[0039] 1.2 Examples of Interference

[0040] Figure 2This diagram illustrates an example of how the change unit of the bioinformatics estimation device according to the first embodiment determines whether there is interference.

[0041] like Figure 2 As shown, the interference 51 that the modification unit 35 determines to exist or not interferes with the pulse wave 41 includes interference caused by the action 61 of the organism 11. Therefore, the pulse wave 41 detected during the period when it is determined that the action 61 of the organism 11 does not interfere with the pulse wave 41 can be used in the estimation of biological information 12. Thus, the reduction in the estimation accuracy of biological information 12 caused by the action 61 of the organism 11 can be suppressed.

[0042] like Figure 2 As shown, the actions 61 of organism 11 include mouth actions 71 caused by speaking, eye actions 72 caused by blinking, mouth actions 73 caused by chewing, etc.

[0043] The modification unit 35 detects feature points 81 of the mouth, and based on the detected feature points 81, detects mouth movements 71 caused by speaking, mouth movements 73 caused by chewing, etc. Additionally, the modification unit 35 detects feature points 82 of the eyes, and based on the detected feature points 82 of the eyes, detects eye movements 72 caused by blinking, etc. Furthermore, as movements 61 of the organism 11, the modification unit 35 also detects eye movements, mouth movements, eyebrow movements, and cheek movements (not shown) based on emotional changes.

[0044] 1.3 Testing Department

[0045] The detection unit 31 detects pulse waves 41 from locations included in the biological entity 11. The locations for detecting pulse waves 41 include fingertips, palms, soles, cheeks, forehead, nose, or jaw. These locations can also be locations other than fingertips, palms, soles, cheeks, forehead, nose, and jaw. The detection unit 31 can detect pulse waves 41 from one location or simultaneously from multiple locations. Multiple locations can be the fingertips of the left and right hands, or two or more locations selected from the face, including cheeks, forehead, and nose, or even the fingertips and the face. Preferably, the detection unit 31 detects pulse waves 41 in real time.

[0046] In the first case of pulse wave 41 detection, the detection unit 31 is equipped with a contact sensor.

[0047] The contact sensor makes contact with the fingertip of bio11 and detects pulse wave 41 from the contacting fingertip.

[0048] Contact sensors have a light-emitting part and a light-receiving part.

[0049] The light-emitting part emits light. The emitted light can be either visible or invisible light. Visible light includes red light, green light, etc. Invisible light includes infrared light, etc. The light-emitting part is composed of light-emitting diodes (LEDs), etc.

[0050] The light-receiving section receives light generated by the diffuse reflection of light emitted by the light-emitting section from the fingertip in contact with the detection section 31, and outputs a signal corresponding to the amount of light received. The time variation of the magnitude of the output signal is the detected pulse wave 41. This light amount reflects the amount of blood flowing in the blood vessels within the fingertip. Therefore, the detected pulse wave 41 reflects the time variation of this blood volume. The light-receiving section is composed of a photodiode or the like.

[0051] The detection unit 31 may also include a signal processing unit that performs signal processing on the detected pulse 41 to remove noise components from the pulse 41. The signal processing may include removing low-frequency noise components with long periods or removing high-frequency noise components with short periods. The former may involve high-pass filtering or detrending, while the latter may involve low-pass filtering. The processing can be either analog signal processing performed by electronic circuits or digital signal processing performed by a processor.

[0052] In the second example of pulse wave 41 detection, the detection unit 31 includes a camera unit and an image processing unit.

[0053] The imaging unit captures images of the organism 11 to obtain images. The imaging unit consists of an RGB camera, etc. An RGB camera can also be used as both the imaging unit and the imaging unit 32 of the detection unit 31.

[0054] The image processing unit determines whether a living being 11 is captured in the acquired image. If it determines that a living being 11 is captured in the image, it outputs the pixel value of the pixel containing the living being 11. The temporal change of the output pixel value is the detected pulse 41. The image processing unit is composed of a central processing unit (CPU) or the like that that executes the program. All or part of the processing performed by the image processing unit can also be performed by dedicated electronic circuitry.

[0055] When simultaneously detecting pulse wave 41 from the fingertips of both the left and right hands, the detection unit 31 includes a contact sensor for the left fingertips and a contact sensor for the right fingertips. The contact sensor for the left fingertips contacts the fingertips of the left hand, detecting pulse wave 41 from the contacting fingertips. The contact sensor for the right fingertips contacts the fingertips of the right hand, detecting pulse wave 41 from the contacting fingertips.

[0056] When the detection unit 31 simultaneously detects pulse waves 41 from two or more areas included in the face, the imaging unit captures an image of the face of the organism 11. Furthermore, the image processing unit calculates the pulse waves 41 based on the pixel values ​​of the pixels in each of the captured areas.

[0057] When the detection unit 31 detects the pulse wave 41 simultaneously from the fingertip and face, the contact sensor contacts the fingertip of the living organism 11 and detects the pulse wave 41 from the contacting fingertip. Furthermore, the imaging unit captures an image of the living organism 11's face. Additionally, the image processing unit calculates the pulse wave 41 based on the pixel values ​​of the pixels depicting the face.

[0058] 1.4 Example of an image processing unit

[0059] Figure 3 This is a block diagram of the image processing unit included in the bioinformatics estimation device of the first embodiment.

[0060] like Figure 3 As shown, the image processing unit 91 of the detection unit 31 includes a transformation unit 101 and a filter unit 102.

[0061] The transformation unit 101 converts the brightness information 111 within the region of interest (ROI) in the image obtained by the camera unit included in the detection unit 31 into a preprocessing pulse 112. The ROI is the area such as the cheek of the organism 11 being photographed. The brightness information 111 is the temporal variation of the red, green, and blue brightness values ​​within the ROI. The preprocessing pulse 112 is the temporal variation of a value representing the state of the organism 11. The transformation unit 101 transforms the red, green, and blue brightness values ​​into this value according to the transformation formula.

[0062] The filter unit 102 performs bandpass filtering on the unprocessed pulse 112 and outputs the processed pulse 113. The bandpass filtering process includes removing high-frequency components such as flickering components from the unprocessed pulse 112 and removing low-frequency components such as body movement components caused by slow body movements, including breathing.

[0063] 1.5 Change Department

[0064] The modification unit 35 determines whether there is interference with each pulse in the pulse wave 41 detected after the start of the measurement period. If the number of pulses in the pulse wave 41 detected after the start of the measurement period that are determined to be interference-free is a set number, the measurement period ends. The modification unit 35 is composed of a CPU or the like that that executes the program. All or part of the processing performed by the modification unit 35 can also be performed by dedicated electronic circuitry.

[0065] The detected pulse wave 41 represents the temporal variation of the detected quantity from organism 11. The temporal variation of pulse wave 41 includes periodic temporal variations associated with the periodic beating of the heart of organism 11. The pulse contained in pulse wave 41 represents the temporal variation of the detected quantity during the period required for one beat of the heart of organism 11, extracted from pulse wave 41. The two ends of the pulse can be either a minimum point where the detected quantity is minimal or a maximum point where the detected quantity is maximal. Therefore, the two ends of the pulse can be either a trough or a peak of the waveform of pulse wave 41.

[0066] Even if the number of pulses in the pulse wave 41 detected during the measurement period that are determined to be interference-free 51 is only one, the estimation unit 36 ​​can estimate the bio-information 12 from a single pulse. Therefore, the set number can also be 1. However, the larger the number of pulses, the more accurate the estimation unit 36 ​​can be in estimating the bio-information 12. Therefore, the set number is preferably 2 or more, and more preferably 5 or more.

[0067] 1.6 Processing by the Change Department

[0068] Figure 4 This is a flowchart illustrating the process performed by the modification unit included in the bioinformatics estimation device of the first embodiment.

[0069] Change Department 35 Execution Figure 4 Steps S101 to S106 are shown.

[0070] In step S101, the changing unit 35 separates the multiple pulses contained in the pulse wave 41.

[0071] In the next step S102, the change unit 35 selects one pulse from the multiple pulses that has not been selected so far.

[0072] In the next step S103, the modification unit 35 determines whether interference 51 exists in the selected pulse. If interference 51 is determined to exist, step S102 is executed again. If interference 51 is determined not to exist, step S104 is executed.

[0073] In step S104, the change unit 35 increases the number of counted pulses.

[0074] From steps S101 to S104, if the modification unit 35 determines that there is interference 51 to the selected pulse, it maintains the counted number of pulses; if it determines that there is no interference 51 to the selected pulse, it increments the counted number of pulses. Therefore, the number of pulses counted by the modification unit 35 becomes the number of pulses for which interference 51 is determined to be absent.

[0075] In the next step S105, the change unit 35 determines whether the number of pulses being counted is the set number. If it is determined that the number of pulses is the set number, step S106 is executed. If it is determined that the number of pulses is not the set number, step S102 is executed again.

[0076] In step S106, the change unit 35 terminates the measurement period.

[0077] From step S101 to S106, the change unit 35 determines whether there is interference 51 in each pulse contained in the pulse wave 41. If the number of pulses contained in the pulse wave 41 that are determined to be without interference 51 is the set number, the measurement period ends.

[0078] 1.7 Determination of whether interference causes changes in length during the measurement period Figure 5 This is a graph illustrating an example of the time when the measurement period ends for the change unit of the bioinformation estimation device in the first embodiment when the pulse of an organism is slow. Figure 6 This is a graph illustrating an example of the time when the measurement period ends for the change unit of the bioinformatics estimation device in the first embodiment, under conditions where there is interference with the pulse wave.

[0079] exist Figure 5 and Figure 6 In the diagram, time is taken as the horizontal axis. Additionally, the detection amount from organism 11 is taken as the vertical axis.

[0080] exist Figure 5 as well as Figure 6 In the example shown, the modification unit 35 determines whether interference 51 exists in each pulse 121 contained in the pulse wave 41 detected after the measurement period begins at time 0. If the number of pulses 122 contained in the pulse wave 41 that are determined to be free of interference 51 is 5, the measurement period ends. Therefore, as... Figure 5 As shown, in the absence of interference 51 to pulse 41, the alteration unit 35 causes the measurement period to end at a relatively early time ta. On the other hand, as... Figure 6 As shown, when interference 51 exists in the pulse 41, the alteration unit 35 causes the measurement period to end at a relatively late time tp. Figure 5 As shown, when there is no interference 51 to the pulse 41, the estimation unit 36 ​​will use the five pulses 122 that are determined to be free of interference 51 for estimating the bio-information 12. On the other hand, as Figure 6 As shown, when there is interference 51 in the pulse wave 41, the estimation unit 36 ​​excludes more than one pulse 123 that is judged to have interference 51, does not use pulse 123 to estimate biological information 12, and instead uses five pulses 122 that are judged not to have interference 51 to estimate biological information 12.

[0081] The modification unit 35 separates multiple pulses 121 contained in the pulse wave 41 by performing signal processing on the pulse wave 41. The signal processing performed includes peak detection, etc.

[0082] 1.6 Separating Multiple Pulses via Peak Detection

[0083] When separating multiple pulses 51 by peak detection of pulse 41, the modification unit 35 extracts the maxima from pulse 41 and takes the portion of pulse 41 located between adjacent maxima as a single pulse 121. Alternatively, the modification unit 35 extracts the minima from pulse 41 and takes the portion of pulse 41 located between adjacent minima as a single pulse 121.

[0084] Figure 7 This is a graph showing a first example of the selection of a maximum point by the modification unit provided in the bioinformatics estimation device of the first embodiment. Figure 8 This is a graph showing a first example of the selection of a minimum point by the modification unit provided in the bioinformatics estimation device of the first embodiment.

[0085] exist Figure 7 and Figure 8 In the figure, time is taken as the horizontal axis. In addition, the detection amount detected from organism 11 is taken as the vertical axis.

[0086] In the first case, such as Figure 7 As shown, the modification unit 35 selects multiple maxima 131 from the pulse wave 41 detected after the start of the measurement period, in descending order of height, so that the time interval T1 between adjacent maxima 131 is within a set range, and the portion of the pulse wave 41 located between adjacent maxima 131 is taken as a pulse 121. The range is set based on a typical pulse rate. A typical pulse rate is 50 to 90 beats per minute. Thus, it is possible to select global maxima 131 suitable as a segment of two adjacent pulses 121. In addition, it is possible to suppress the selection of local maxima 132 that are not suitable as a segment. Or, as Figure 8 As shown, the modification unit 35 selects multiple minima 141 from the pulse wave 41 detected after the start of the measurement period, in descending order of depth, such that the portion of the pulse wave 41 located between adjacent minima 141 constitutes a pulse 121, so that the time interval T2 between adjacent minima 141 is within a set range. The range is set based on a typical pulse rate. A typical pulse rate is 50 to 90 beats per minute. Therefore, it is possible to select a global minima 141 suitable as a segment between two adjacent pulses 121. Furthermore, it is possible to suppress the selection of local minima 142 that are unsuitable as that segment.

[0087] Figure 9This is a graph representing a second example of the selection of a maximum point by the modification unit provided in the bioinformatics estimation device of the first embodiment. Figure 10 This is a diagram showing a second example of the selection of a minimum point by the modification unit provided in the bioinformatics estimation device of the first embodiment.

[0088] exist Figure 9 and Figure 10 In the diagram, time is taken as the horizontal axis. Additionally, the detection amount from organism 11 is taken as the vertical axis.

[0089] In the second example, such as Figure 9 As shown, the modification unit 35 selects a plurality of maxima 152 with a height of 151 or higher from the pulse 41 detected after the start of the measurement period, and takes a portion of the pulse 41 located between adjacent maxima 152 as a pulse 121. The height 151 is set based on the amplitude of the pulse 41. Thus, it is possible to select global maxima 152 suitable as segments of two adjacent pulses 121. Furthermore, it is possible to suppress the selection of local maxima 153 unsuitable as segments. Alternatively, as... Figure 10 As shown, the modification unit 35 selects a plurality of minima 162 with a depth of at least a set depth 161 from the pulse 41 detected after the start of the measurement period, and treats the portion of the pulse 41 located between adjacent minima 162 as a pulse 121. The depth 161 is set according to the amplitude of the pulse 41. Thus, it is possible to select global minima 162 suitable as segments of two adjacent pulses 121. Furthermore, it is possible to suppress the selection of local minima 163 that are unsuitable as segments.

[0090] In addition, there are methods that use SSF (Slope Sum Function) filters to enhance waveforms to select maxima or minima.

[0091] 1.9 Estimation Department

[0092] The estimation unit 36 ​​estimates blood pressure 21 based on the waveform and / or frequency dependence of the pulse wave 41 detected during an interference-free period determined to be free of interference 51 during the measurement period. When the detection unit 31 detects the pulse wave 41 simultaneously from two or more sites, the estimation unit 36 ​​can also estimate blood pressure 21 based on the correlation between the pulse waves 41 detected simultaneously from two or more sites. Therefore, the bioinformation estimation device 1 can estimate bioinformation 12 without using a cuff.

[0093] Figure 11 This is a graph showing an example of the waveform of a pulse with a modified portion provided by the bioinformatics estimation device of the first embodiment. Figure 12It is a graph representing an example of the first derivative of the waveform of a pulse with a changed portion provided by the bioinformatics estimation device of the first embodiment. Figure 13 It is a graph showing an example of the second-order derivative of the waveform of the pulse with altered separation provided by the bioinformatics estimation device of the first embodiment.

[0094] exist Figure 11 , Figure 12 and Figure 13 In the diagram, time is used as the horizontal axis. Additionally, the amount detected from organism 11 is used as the vertical axis.

[0095] The estimation unit 36 ​​can also measure blood pressure 21 from pulses 121 that are determined to be undisturbed 51 and contained in pulse waves 41 detected during the undisturbed period of the measurement. In this case, the estimation unit 36 ​​measures blood pressure 21 based on... Figure 11 The waveform of pulse 121 shown Figure 12 The first-order differential shown Figure 13 The second-order differential and other calculated characteristic quantities are shown, and blood pressure is estimated based on the calculated characteristic quantities 21. The calculated characteristic quantities are the average value, maximum value, minimum value, extreme value, minimum value, pulse length 121, the value of the detected quantity at the start or end of pulse 121, the relationship between these values ​​and the threshold, the number of extreme values, the number of minimum values, etc.

[0096] Furthermore, the estimation unit 36 ​​estimates the pulse count 22 based on the number of pulses 122 determined to be interference-free 51 contained in the pulse wave 41 detected during the interference-free period within the measurement period. For example, the estimation unit 36 ​​estimates the pulse count 22 by dividing the number of pulses 122 by the length of the interference-free period.

[0097] The speculation unit 36 ​​is a CPU or similar device that executes programs. All or part of the processing performed by the modification unit 35 can also be performed by dedicated electronic circuitry.

[0098] 1.10 Errors in pulse wave determination due to inherent interference.

[0099] Figure 14 This is a flowchart illustrating the process by which the modification unit of the bioinformatics estimation device of the first embodiment performs a process based on the pulse wave itself to determine whether there is interference.

[0100] If the modification unit 35 determines whether there is interference 51 to the pulse 121 that is the object of determination based on the pulse 41 itself, it performs the following: Figure 14 Steps S111 to S115 are shown.

[0101] In step S111, the modification unit 35 determines whether the pulse 121 can be used to estimate biometric information 12. For example, if the estimation unit 36 ​​calculates a characteristic quantity from each pulse 121 and estimates blood pressure 21 based on the calculated characteristic quantity, the modification unit 35 determines that the pulse 121 cannot be used to estimate biometric information 12 if it cannot calculate the characteristic quantity required to estimate blood pressure 21 from the pulse 121. For example, if the estimation unit 36 ​​can calculate the characteristic quantity required to estimate blood pressure 21 from each pulse 121, the modification unit 35 determines that the pulse 121 cannot be used to estimate biometric information 12. Figure 12 When the number of maxima extracted from the first-order derivative is less than that of the benchmark, it is possible to extract from... Figure 12 When the number of local minima extracted from the first-order derivative is less than that of the baseline, it is possible to extract from... Figure 13 When the number of maxima extracted from the second-order derivative shown is less than that of the benchmark, it is possible to extract from... Figure 13 If the number of minima extracted from the second-order derivative is within a certain range, it is determined that pulse 121 cannot be used to estimate biological information 12. If it is determined that pulse 121 can be used to estimate biological information 12, step S112 is executed. If it is determined that pulse 121 cannot be used to estimate biological information 12, step S115 is executed.

[0102] In step S112, the modification unit 35 determines whether the intensity of a frequency component outside a set range included in the pulse 121 is stronger than a set intensity. The modification unit 35 performs frequency analysis on the pulse 121 and determines whether the intensity of the component is stronger than a set intensity. If it is determined that the intensity is stronger than the set intensity, step S115 is executed. If it is determined that the intensity is not stronger than the set intensity, step S113 is executed.

[0103] In step S113, the modification unit 35 determines whether the difference between the pulse width of pulse 121 and the pulse width of adjacent pulse 121 is greater than or equal to a set difference (threshold). For example, if the pulse width of the former is less than 0.9 times the pulse width of the latter, or if the pulse width of the former is more than 1.1 times the pulse width of the latter, the modification unit 35 determines that the difference between the pulse width of the former and the pulse width of the latter is greater than or equal to the set difference. If it is determined that the difference is greater than or equal to the set difference, step 115 is executed. If it is determined that the difference is not greater than or equal to the set difference, step S114 is executed again. Alternatively, the threshold for comparing the difference between the pulse width of pulse 121 and the pulse width of adjacent pulse 121 can be adjusted according to the estimated pulse count. This is because the fluctuation width of the pulse interval will increase or decrease depending on the pulse count.

[0104] In step S114, the modification unit 35 determines that there is no interference 51 to pulse 121.

[0105] In step S115, the modification unit 35 determines that there is interference 51 to the pulse 121.

[0106] If, from step S111 to S115, the modification unit 35 is unable to use the pulse 121, which is the object of determination, to estimate the biological information 12, it determines that there is interference 51 with the pulse 121, which is the object of determination.

[0107] Furthermore, if the intensity of a component with a frequency outside the set range contained in the pulse 121 that is the object of determination is stronger than the set intensity, the modification unit 35 determines that there is interference 51 to the pulse 121 that is the object of determination.

[0108] Furthermore, if the difference between the pulse width of the pulse 121 being judged and the pulse width of the pulse 121 adjacent to the pulse 121 being judged is greater than or equal to a set difference, the modification unit 35 determines that there is interference 51 with the pulse 121 being judged. Therefore, if the regularity or periodicity of the pulse wave 41 decreases due to arrhythmia of the heart of the organism 11, i.e., the heart rate rhythm is disordered, the modification unit 35 determines that there is interference 51 with the pulse 121 being judged. Additionally, if the regularity or periodicity of the pulse wave 41 decreases due to false detection of the pulse 121, the modification unit 35 determines that there is interference 51 with the pulse 121 being judged.

[0109] 1.11 Determining the presence or absence of interference based on images

[0110] Figure 15 This is a flowchart illustrating the process of image-based determination of interference by the modification unit of the bioinformatics estimation device of the first embodiment.

[0111] If the modification unit 35 determines, based on the image 42, whether there is interference 51 on the pulse 121 that is the object of determination, it performs the following: Figure 15 Steps S121 to S124 are shown.

[0112] In step S121, the change unit 35 determines whether a brightness time change that meets certain conditions is detected in the image 42 during the period when pulse 121 is detected. The conditions to be met include conditions such as the overall brightness change of the image 42 per unit time being above a threshold. If it is determined that such a time change is detected in the image 42, step S123 is executed. If it is determined that such a time change is not detected in the image 42, step S122 is executed.

[0113] In step S122, during the period when pulse 121 is detected, the modification unit 35 determines whether mouth movement 71 caused by speaking, eye movement 72 caused by blinking, or mouth movement 73 caused by chewing is detected in the image 42. If it is determined that mouth movement 71 caused by speaking, eye movement 72 caused by blinking, or mouth movement 73 caused by chewing is detected in the image 42, step S123 is executed. If it is determined that no mouth movement 71 caused by speaking, eye movement 72 caused by blinking, or mouth movement 73 caused by chewing is detected in the image 42, step S124 is executed.

[0114] In step S123, the modification unit 35 determines that there is interference 51 to the pulse 121.

[0115] In step S124, the modification unit 35 determines that there is no interference 51 to the pulse 121.

[0116] From step S121 to S124, if a time change in brightness that meets the conditions is detected in the image 42 during the period when the pulse 121 that is to be determined is detected, the modification unit 35 determines that there is interference 51 to the pulse 121 that is to be determined.

[0117] Furthermore, if, during the period when the pulse 121 that is the target of judgment is detected, a mouth movement 71 caused by speaking, an eye movement 72 caused by blinking, or a mouth movement 73 caused by chewing is detected, the alteration unit 35 determines that there is a disturbance 51 to the pulse 121 that is the target of judgment. In other words, during the period when the pulse 121 is detected, it determines whether a time change in brightness that meets the conditions is detected in the image 42, and can detect interference from unexpected motion from the biological side as the subject and / or interference from motion from the camera unit 32 as the shooting side.

[0118] 1.12 Determining the presence of interference based on sound

[0119] Figure 16 This is a flowchart illustrating the process of determining whether there is interference based on sound by the modification unit of the bioinformatics estimation device of the first embodiment.

[0120] If the sound 43 determines whether it interferes with the pulse 121, which is the object of the determination, the modification unit 35 executes the following: Figure 16 Steps S131 to S134 are shown.

[0121] In step S131, the modification unit 35 determines whether a sound 43 with a volume above a set volume is detected by the microphone 33 during the period when the pulse 121 is detected. If the sound 43 is detected, step S133 is executed. If the sound 43 is not detected, step S132 is executed.

[0122] In step S132, the modification unit 35 determines whether a sound 43 with a volume above a set volume is detected by the microphone 33 during the period when the pulse 121 is detected. The modification unit 35 detects the sound 43 using a voice recognition function. If the sound 43 is detected, step S133 is executed. If the sound 43 is not detected, step S134 is executed.

[0123] In step S133, the modification unit 35 determines that there is interference 51 to pulse 121.

[0124] In step S134, the modification unit 35 determines that there is no interference with pulse 121.

[0125] From steps S131 to S134, if the microphone 33 detects a sound 43 with a volume above a set volume during the detection of the pulse 121 that is to be determined, the modification unit 35 determines that there is interference 51 with the pulse 121 that is to be determined. Additionally, if the microphone 33 detects the sound of a living being 11 speaking during the detection of the pulse 121 that is to be determined, the modification unit 35 determines that there is interference 51 with respect to the pulse 121 that is to be determined.

[0126] 1.13 Determining the presence or absence of interference based on acceleration or angular velocity

[0127] Figure 17 This is a flowchart illustrating the process by which the modification unit of the bioinformatics estimation device of the first embodiment performs a process to determine whether there is interference based on acceleration or angular velocity.

[0128] If the modification unit 35 determines whether there is interference 51 to the pulse 121 that is the object of determination based on acceleration 44 or angular velocity 45, it performs the following: Figure 17 Steps S141 to S143 are shown.

[0129] In step S141, the modification unit 35 determines whether an acceleration 44 or angular velocity 45 meeting certain conditions is detected by the motion sensor 34 during the detection of pulse 121. The conditions to be met include conditions such as having an acceleration 44 or angular velocity 45 at or above a set value. If it is determined that an acceleration 44 or angular velocity 45 meeting certain conditions has been detected, step S142 is executed. If it is determined that no acceleration 44 or angular velocity 45 meeting certain conditions has been detected, step S143 is executed.

[0130] In step S142, the modification unit 35 determines that there is interference 51 to the pulse 121.

[0131] In step S143, the modification unit 35 determines that there is no interference 51 to pulse 121.

[0132] From steps S141 to S143, if the motion sensor 34 detects an acceleration 44 or angular velocity 45 that meets the conditions during the detection of the pulse 121 that is the object of determination, the modification unit 35 determines that there is interference 51 to the pulse 121 that is the object of determination. Therefore, if the operation of the detection unit 31 is large, the modification unit 35 determines that there is interference 51 to the pulse 121 that is the object of determination.

[0133] The same applies when the orientation 46 is detected by the motion sensor 34 (not shown).

[0134] The motion sensor 34, attached to the detection unit 31, can detect disturbances caused by movement on the detection side. However, it is not limited to this; it can also be attached to a living organism as the subject by being equipped with accessories or ornaments such as rings, necklaces, hats, or glasses. When the motion sensor 34 is attached to a living organism, it can also notify the detection unit via wired or wireless means when it detects movement above a predetermined threshold, thereby causing the detection unit 31 to determine that "interference exists" (not shown).

[0135] The present invention is not limited to the above embodiments, and can be replaced by a structure that is substantially the same as the structure shown in the above embodiments, a structure that achieves the same effect, or a structure that can achieve the same purpose.

Claims

1. A bioinformatics estimation device, characterized in that, include: The detection department identifies pulse waves from biological detection. The modification unit determines whether there is interference with the pulse, and changes the length of the measurement period based on the determination result of whether there is interference; The estimation unit estimates biological information based on the pulses detected during the measurement period; and The camera unit, which captures images of the creature, The modification unit determines whether there is interference among the pulses included in the pulse wave detected after the start of the measurement period. If the number of pulses in the pulse wave detected after the start of the measurement period that are determined to be interference-free is a set number, the measurement period is terminated. If, during the period when a pulse that is to be determined is detected, a time change in brightness that meets certain conditions is detected in the image, the change unit determines that there is interference with the pulse that is to be determined.

2. A bioinformatics estimation device, characterized in that, include: The detection department identifies pulse waves from biological detection. The modification unit determines whether there is interference with the pulse, and changes the length of the measurement period based on the determination result of whether there is interference; The estimation unit estimates biological information based on the pulses detected during the measurement period; and The camera unit, which captures images of the creature, The modification unit determines whether there is interference among the pulses included in the pulse wave detected after the start of the measurement period. If the number of pulses in the pulse wave detected after the start of the measurement period that are determined to be interference-free is a set number, the measurement period is terminated. If, during the detection of a pulse that is to be determined, an action caused by the speech of the organism is detected in the image, the modification unit determines that there is interference with the pulse that is to be determined.

3. A bioinformatics estimation device, characterized in that, include: The detection department identifies pulse waves from biological detection. The modification unit determines whether interference exists with the pulse wave, and modifies the length of the measurement period based on the determination result of whether interference exists; and The estimation unit estimates biological information based on the pulses detected during the measurement period. The modification unit determines whether there is interference among the pulses included in the pulse wave detected after the start of the measurement period. If the number of pulses in the pulse wave detected after the start of the measurement period that are determined to be interference-free is a set number, the measurement period is terminated. If the difference between the pulse width of the pulse to be determined and the pulse width of the pulse adjacent to the pulse to be determined is greater than or equal to a set difference, the modification unit determines that the interference exists only for the pulse to be determined.

4. The bioinformatics estimation device according to any one of claims 1 to 3, characterized in that, The modification unit extends the length if it determines that the interference exists.

5. The bioinformatics estimation device according to any one of claims 1 to 3, characterized in that, The interference includes interference caused by the organism's actions.

6. The bioinformatics estimation device according to any one of claims 1 to 3, characterized in that, The interference includes interference caused by the organism's actions and / or interference caused by the actions of the organism information estimation device.

7. The bioinformatics estimation device according to any one of claims 1 to 3, characterized in that, If the pulse that is the object of determination cannot be used to estimate the biological information, the modification unit determines that there is interference with the pulse that is the object of determination.

8. The bioinformatics estimation device according to any one of claims 1 to 3, characterized in that, If the intensity of a component with a frequency outside a set range contained in the pulse that is the object of determination is stronger than the set intensity, the alteration unit determines that there is interference with the pulse that is the object of determination.

9. The bioinformatics estimation device according to any one of claims 1 to 3, characterized in that, The biometric information includes blood pressure.

10. The bioinformatics estimation device according to any one of claims 1 to 3, characterized in that, The biometric information includes pulse count.

11. A bioinformatics estimation method, characterized in that, include: From the process of biological pulse detection; The process of determining whether interference exists with the pulse wave, and adjusting the length of the measurement period based on the determination result of whether interference exists; The process of estimating biological information based on pulses detected during the measurement period; and The process of photographing the organism to obtain an image. In the process of changing the length of the measurement period, it is determined whether there is interference in each pulse contained in the pulse detected after the start of the measurement period. If the number of pulses in the pulse detected after the start of the measurement period that are determined to be interference-free is a set number, the measurement period is ended. If, during the period when a pulse that is to be determined is detected, a time change in brightness that meets certain conditions is detected in the image, it is determined that there is interference with the pulse that is to be determined.

12. A bioinformatics estimation method, characterized in that, include: From the process of biological pulse detection; The process of determining whether interference exists with the pulse wave, and adjusting the length of the measurement period based on the determination result of whether interference exists; The process of estimating biological information based on pulses detected during the measurement period; and The process of photographing the organism to obtain an image. In the process of changing the length of the measurement period, it is determined whether there is interference in each pulse contained in the pulse detected after the start of the measurement period. If the number of pulses in the pulse detected after the start of the measurement period that are determined to be interference-free is a set number, the measurement period is ended. If, during the detection of a pulse that is to be determined, an action caused by the speech of the organism is detected in the image, it is determined that there is interference with the pulse that is to be determined.

13. A bioinformatics estimation method, characterized in that, include: From the process of biological pulse detection; The process of determining whether interference exists with the pulse wave, and changing the length of the measurement period based on the determination of whether interference exists; and The process of estimating biological information based on pulses detected during the measurement period In the process of changing the length of the measurement period, it is determined whether there is interference in each pulse contained in the pulse detected after the start of the measurement period. If the number of pulses in the pulse detected after the start of the measurement period that are determined to be interference-free is a set number, the measurement period is ended. If the difference between the pulse width of the pulse to be determined and the pulse width of the pulse adjacent to the pulse to be determined is greater than or equal to a set difference, it is determined that the interference exists only for the pulse to be determined.

Images