Biological information detection system and biological information detection method
Patent Information
- Application Number
- JP2023142718
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-04
- Publication Date
- 2025-03-14
Smart Images
Figure 2025035588000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a biological information detection system and a biological information detection method. [Background technology]
[0002] When we look at modern labor, with the various ways of working, the loss of labor due to the deterioration of workers' health is an issue. As one measure to prevent this, a system for constantly managing the health of workers is necessary. One method for realizing constant health management is the use of wearable devices that can be worn on the body. Recent wearable devices are equipped with optical sensors and have the ability to constantly monitor blood flow and output and transmit various vital information (biological information). Some models also have the ability to notify designated contacts in the event of an abnormality that requires emergency action, such as cardiac arrest.
[0003] However, wearable devices must be worn by workers at all times, and wearing the device itself can be a burden for workers, and depending on the type of activity, workers may not be able to carry out the activity while wearing the device. Due to these issues, it would be desirable to be able to measure vital information without wearing a wearable device. Furthermore, when monitoring vital information at the workplace, the measurement time is important. The time that can be allotted for monitoring is limited, and it is desirable to measure within a time that does not bother the user.
[0004] As a background technique for these techniques, there is Japanese Patent No. 6828619 (Patent Document 1). This publication describes "a heart rate correction program that causes a computer to execute the following process: acquiring heart rate data related to the state of the heart rate from a first sensor that measures the heart rate of a subject, acquiring motion data from a second sensor that measures the motion of the subject, identifying a motion section in a measurement section from the motion data, setting a correction target section including the motion section and a predetermined section after the motion section, identifying a lower heart rate among the heart rates at the start and end of the correction target section based on the heart rate data, replacing the heart rate data in the correction target section with correction data corrected to the identified heart rate, and detecting a specific behavior by the subject based on the correction data in the correction target section and the heart rate data in the measurement section other than the correction target section" (see claims). [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Patent No. 6828619 Summary of the Invention [Problem to be solved by the invention]
[0006] However, the technique disclosed in Patent Document 1 leaves room for improvement in terms of reducing manufacturing costs and measurement time. Therefore, an object of the present invention is to provide a biological information detection system and a biological information detection method that can reduce manufacturing costs and measurement time. [Means for solving the problem]
[0007] In order to solve the above problems, the present invention comprises an image data acquisition unit that acquires image data related to a human body, a pulse wave calculation unit that calculates a pulse wave of the human body from image data acquired by the image data acquisition unit, a biometric information calculation unit that calculates biometric information of the human body from the pulse wave calculated by the pulse wave calculation unit, a pulse wave determination unit that determines a shape of the pulse wave calculated by the pulse wave calculation unit, and an output unit that outputs the biometric information calculated by the biometric information calculation unit, and is characterized in that the biometric information calculation unit calculates the biometric information based on the determination made by the pulse wave determination unit. Effect of the Invention
[0008] According to the present invention, it is possible to provide a biological information detection system and a biological information detection method that can reduce manufacturing costs and measurement time. Problems, configurations and effects other than those described above will become apparent from the following description of the embodiments. [Brief description of the drawings]
[0009] [Figure 1] 1 is a block diagram illustrating an example of a hardware configuration of a biological information detection system according to a first embodiment. [Diagram 2] 10 is a block diagram showing another example of the hardware configuration of the biological information detection system according to the first embodiment. FIG. [Diagram 3] 1 is a functional block diagram illustrating a process executed by the biological information detection system according to a first embodiment. [Figure 4] 4 is a flowchart illustrating the contents of a process executed by the biological information detection system according to the first embodiment. [Diagram 5] FIG. 1 is a waveform diagram showing various pulse waveforms. [Figure 6] FIG. 11 is a functional block diagram of a biological information detection system according to a second embodiment. [Figure 7] 10 is a flowchart illustrating a process executed by a biological information detection system according to a second embodiment. [Figure 8] FIG. 4 is a waveform diagram showing an example of a pulse wave. [Figure 9]FIG. 11 is a functional block diagram of a biological information detection system according to a third embodiment. [Figure 10] 11 is a flowchart illustrating a process executed by a biological information detection system according to a third embodiment. [Figure 11] FIG. 11 is a functional block diagram of a biological information detection system according to a fourth embodiment. [Figure 12] 13 is a flowchart illustrating a process executed by a biological information detection system according to a fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, examples (embodiments) of the present invention will be described with reference to the drawings. EXAMPLES
[0011] 1 is a block diagram showing an example of a hardware configuration of a biological information detection system according to the first embodiment. The biological information detection system 101 is an example of a smartphone. In the biological information detection system 101, a processor 111 that performs various calculations and centrally controls each unit, and a main storage device 112 such as a RAM (Random Access Memory) that serves as a working area for the processor 111 are connected via a bus 113.
[0012] An external storage device 114 such as a semiconductor memory and a communication control device 115 that performs wireless communication with a mobile communication network and the Internet (neither shown) via the mobile communication network are connected to the bus 113 via a predetermined interface. Similarly, a display device 116 such as an LCD (Liquid Crystal Display) or an organic EL (organic Electro-Luminescence) with a touch panel formed thereon, and a group of operation buttons 117 that enable various operations are connected to the bus 113. Similarly, a speaker 118 for receiving calls, a microphone 119 for transmitting calls, a camera 120 such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device), and the like are connected to the bus 113.
[0013] A program 121 is set up in the external storage device 114. This program 121 is, for example, downloaded from the Internet or the like via the communication control device 115 and set up in the external storage device 114. The program 121 is application software or the like that runs on a predetermined OS (Operating System).
[0014] 2 is a block diagram showing another example of the hardware configuration of the biological information detection system according to the first embodiment. The biological information detection system 201 is an example of a notebook computer. In the biological information detection system 201, a processor 211 that performs various calculations and centrally controls each unit, and a main storage device 212 such as a RAM that serves as a working area for the processor 211 are connected via a bus 213.
[0015] To the bus 213, an external storage device 214 such as an SSD (Solid State Drive) or HDD (Hard Disk Drive), a display device 215 such as an LCD or an organic EL display, an input device 216 such as a mouse, a keyboard or a tablet, and a speaker 217 are connected via respective predetermined interfaces. Similarly, to the bus 213, a communication control device 218 that communicates with the Internet, a storage medium reading device 219 such as an optical disk device that reads a storage medium 231 such as a DVD (Digital Versatile Disc) or a Blu-ray Disc (registered trademark), a camera 220 such as a CMOS image sensor or a CCD, and the like are connected.
[0016] A program 221 is set up in the external storage device 214. This program 221 is, for example, downloaded from the Internet or the like via the communication control device 218 and set up in the external storage device 214. Alternatively, the program 221 is read from the storage medium 231 by the storage medium reading device 219 and set up in the external storage device 214. The program 221 is application software or the like that runs on a predetermined OS.
[0017] As described above, examples of a smartphone (biometric information detection system 101) and a notebook computer (biometric information detection system 201) have been described as examples of the hardware configuration of the biometric information detection system according to the first embodiment. However, in addition to these, various types of computers such as tablets and desktop computers can be used as the hardware of the biometric information detection system. In other words, various computer systems can be used as long as they are computers capable of running the program 121 and the program 221. However, from the viewpoint of portability of the device, it is preferable to use a smartphone, tablet, notebook computer, or the like.
[0018] However, the technology of Patent Document 1 requires two sensors, a first sensor and a second sensor, and therefore the technology of Patent Document 1 requires two sensors, which increases manufacturing costs, leaving room for improvement. In addition, the technology of Patent Document 1 converts heart rate data into correction data. The accuracy of the measurement is improved by taking a sufficient number of data sections for the correction. However, the technology of Patent Document 1 requires a long time for measurement, so there is room for improvement.
[0019] Therefore, how the biological information detection systems 101 and 201 of the first embodiment improve such problems and reduce manufacturing costs and measurement time will be shown by explaining the specific processing contents.
[0020] Fig. 3 is a functional block diagram for explaining the processing executed by the biological information detection system of the present embodiment 1. That is, in the biological information detection systems 101, 201, the processors 111, 211 execute various calculations and controls based on the programs 121, 221 using the main memories 112, 212 as working areas, thereby realizing the functions of the functional units shown in Fig. 3.
[0021] As shown in Fig. 3, the bioinformation detection system 101, 201 includes an image data acquisition unit 10 that realizes an image data acquisition step of acquiring image data related to a human body. The bioinformation detection system 101, 201 also includes a pulse wave calculation unit 20 that realizes a pulse wave calculation step of calculating a pulse wave of the human body from image data acquired by the image data acquisition unit 10 (image data acquisition step). The bioinformation detection system 101, 201 also includes a bioinformation calculation unit 30 that realizes a bioinformation calculation step of calculating bioinformation of the human body from the pulse wave calculated by the pulse wave calculation unit 20 (pulse wave calculation step). The bioinformation detection system 101, 201 also includes an output unit 40 that realizes an output step of outputting the bioinformation calculated by the bioinformation calculation unit 30 (biological information calculation step).
[0022] The biological information calculation unit 30 (biological information calculation step) has a pulse wave determination unit 31 that realizes a pulse wave determination step of determining the shape of the pulse wave calculated by the pulse wave calculation unit 20 (pulse wave calculation step). The biological information calculation unit 30 (biological information calculation step) calculates biological information based on the determination by the pulse wave determination unit 31 (pulse wave determination step).
[0023] In addition, the biometric information calculation unit 30 (biometric information calculation process) is equipped with a speed-up unit 32 that selects pulse waves that can be used based on the judgment results in the pulse wave judgment unit 31 (pulse wave judgment process) and realizes a speed-up process that speeds up the calculation of biometric information in the biometric information calculation unit 30 (biometric information calculation process).
[0024] The processing contents executed by each of these functional block diagrams will be described in more detail. The biological information detection systems 101 and 201 are systems that analyze image data obtained by capturing an external image of a human body, calculate a pulse wave of the human body, and thereby detect biological information of the human body. The pulse wave is a vascular conduction wave (pulse pressure wave) that occurs due to changes in internal pressure in the arteries (blood vessels) when the heart pumps blood.
[0025] FIG. 4 is a flow chart for explaining the contents of the process executed by the biological information detection system 101, 201. First, the image data acquisition unit 10 acquires image data related to a human body (step S1). That is, the image data acquisition unit 10 controls the camera 120, 220 to capture an image of the skin of the human body, thereby acquiring image data of the skin of the human body. This imaging can be performed without contacting (non-invasively) the human body. The image of the skin of the human body captured here is generally an image of the face of the human body, but may be an image of an arm or the like. The image data acquisition unit 10 may also acquire image data of the human body already stored in the external storage device 114, 214, etc., or image data of the human body received from the Internet, etc.
[0026] Next, the pulse wave calculation unit 20 calculates the pulse wave of the human body from the image data acquired by the image data acquisition unit 10 (FIG. 4, step S2). The pulse wave calculation unit 20 extracts a signal corresponding to the pulse wave of the human body from the image data. That is, in the human body, blood flows through subcutaneous capillaries, arteries, and veins, and this flow causes a change in color to appear through the surface of the skin. This change is acquired from the image data acquired by the image data acquisition unit 10, and the color information is separated to estimate and extract the increase and decrease in the pulse wave. In the human body, the more blood flow there is, the more red reflected light there is and the less green reflected light there is. Therefore, the increase and decrease in red and green are detected from the image data (moving image data) and these signals are calculated to obtain the pulse wave.
[0027] Based on the pulse wave information output by pulse wave calculation section 20, biological information calculation section 30 calculates the heart rate and LF / HF (Low Frequency / Hi Frequency) which is a stress index as biological information (FIG. 4, step S5).
[0028] First, the time interval of the pulse wave calculated by pulse wave calculation section 20 is measured, and the heart rate can be calculated by calculating how many times the pulse beats in 60 seconds.
[0029] In addition, by recording the time between pulse waves and analyzing the frequency of the fluctuations, it is possible to measure the stress index LF / HF. LF / HF is determined by the balance of tension between the sympathetic and parasympathetic nervous systems, and the magnitude of the HF and LF fluctuation waves that appear in heart rate fluctuations changes accordingly, so this is used to estimate the balance of the autonomic nervous system from pulse rate fluctuations.
[0030] As a method for calculating LF / HF, a method of calculating the power spectrum by frequency analysis of the pulse wave will be described. For example, discrete Fourier transform can be used for frequency analysis. That is, if the time interval of the pulse wave at time x is represented by function f(x) and N pieces of data are sampled, F(t) for frequency t obtained by discrete Fourier transform of function f(x) can be obtained by the following formula. i is the imaginary unit.
number
[0031] The square of this is the power spectrum, which is an index representing the intensity of the frequency t component of the function f(x), and allows us to obtain a distribution related to frequency t. This distribution is the power spectrum. Hereafter, it will be simply called the spectrum.
[0032] LF / HF is calculated as LF / HF, which is the ratio of the sum of the spectrum of the low frequency component LF below 0.15 Hz to the sum of the spectrum of the high frequency component HF between 0.15 and 0.4 Hz. By using this index, it is possible to determine whether the sympathetic or parasympathetic nervous system is dominant in the human body.
[0033] The biological information calculation section 30 includes a pulse wave determination section 31 and a speed-up section 32. Note that the pulse wave determination section 31 and the speed-up section 32 do not need to be provided within the biological information calculation section 30, and may be provided independently from the biological information calculation section 30. The same applies to the pulse wave correction section 33, the measurement stability determination section 34, and the feedback section 35 described below.
[0034] Pulse wave determination unit 31 analyzes the shape of the pulse wave signal output by pulse wave calculation unit 20 (FIG. 4, step S3), detects feature points of the shape, and determines the type of pulse wave shape. Feature points of the pulse wave shape include the signal values and times of the crests and crests of the waveform, as well as the amount and rate of change in the way the wave rises before the crest and the way the wave falls thereafter, relative to the crest. Although the description has been given for one pulse wave shape, feature points are also detected for multiple consecutive pulse wave shapes and stored in main memory device 112, 212, etc.
[0035] Examples of pulse waveform types include a pulse wave that is symmetrical with respect to the peak of the wave crest, a pulse wave whose peak is biased toward either the front or back of the time, a pulse wave with a low peak, a pulse wave with a high peak, a pulse wave whose peak has an undulating slope (the slope of the peak is not linear), etc. The pulse wave determining unit 31 determines these types based on the pulse waveform, and assigns information on the determined attributes to the pulse wave (determines the type of pulse waveform and links the pulse wave to the information on its attributes).
[0036] The speed-up unit 32 selects necessary and unnecessary pulse waves based on the type of pulse wave shape classified by the pulse wave judgment unit 31 (FIG. 4, step S4), and performs filtering so that if a wave with a similar crest height is received, it is ignored, but if a wave with a low crest is received, the relevant wave is not used. This can be done by setting a threshold value for the height of each wave crest and not using waves with crests below this threshold. For example, if the crest height of a normal wave is 1, the threshold value can be set at a height of about 0.2.
[0037] Fig. 5 is a waveform diagram showing various pulse wave shapes. In Fig. 5, if the pulse wave has a well-balanced shape like wave crest 62, there is no problem. However, in Fig. 5, wave crest 63 is too high, wave crest 64 has a cliff-like apex biased toward the rear of the time axis, wave crest 65 is too low, and wave crest 66 does not have a crest shape, so all of these pulse wave shapes have problems.
[0038] Abnormalities in the waveform shape of the wave crests 64, 66 can be determined by comparing each wave crest with a predetermined threshold value and determining whether the peak of the crest is near the center of the wave width, etc. Since the shape of a normal pulse wave is known from past experience, an appropriate threshold value can be set based on that.
[0039] By such a determination, only the peaks of the pulse wave having a normal waveform are used for the calculation of the biological information by the biological information calculation unit 30. On the other hand, if the height of the peaks is determined to be low, for example, and the height is extremely low, it is considered that the pulse wave was not measured correctly. If such pulse wave information is used for the calculation of the biological information, it will cause an error in the biological information.
[0040] Here, the error removal by time averaging, which is one of the processes performed by the bioinformation calculation unit 30, will be described. For example, assume a situation in which the pulse rate is calculated from the interval between the peaks before and after the pulse wave. Even if the pulse wave contains an error and cannot be measured correctly, the human body's pulse wave is continuously beating, and this is detected, so that the pulse data can be obtained repeatedly and continuously. In other words, when trying to measure the pulse rate from this data, even if there is a problem such as an error in the pulse wave causing the interval between the peaks of the pulse wave to vary, by measuring and averaging the data of many peaks of the wave, the pulse rate during the averaged time period can be measured relatively accurately. This generally plays a role like a low-pass filter that can remove sudden noise. The bioinformation calculation unit 30 calculates bioinformation such as the pulse rate by such averaging processing.
[0041] However, even when implementing such error reduction processing, in order to obtain sufficient accuracy in biometric information, a large amount of wave crest data is required, which results in the problem that data collection and processing takes a long time.
[0042] Therefore, if only pulse wave information of normal wave crest shapes (determined to be correct by the pulse wave determination unit 31) is used among the pulse waves classified by the pulse wave determination unit 31, the bioinformation calculation unit 30 can obtain highly accurate bioinformation even if the averaging process is performed on only a small number of wave crests, assuming that there is little error in the wave crest data that is the basis of the calculation. In other words, if wave crest data of a continuous valid shape is obtained, the number of wave crests to be subjected to the time averaging process can be small. For example, it is possible to perform the time averaging process on the basis of the measurement of only four wave crests and use them as the measured value. In this way, the speed-up unit 32 enables the bioinformation calculation unit 30 to calculate the bioinformation in a short time.
[0043] Here, if the speed-up unit 32 did not exist, it would be necessary to observe multiple consecutive wave crests, and when the pulse wave determination unit 31 determines that the data of a certain wave crest among them is not of a correct waveform, it would be necessary to repeat the measurement and start over from acquiring the data of the first wave crest. Alternatively, in order to obtain the desired accuracy, it would be necessary to detect many wave crest data over a longer period of time and perform noise removal processing such as the time averaging process described above. In addition, if wave crest data containing noise is used, errors will be mixed into the calculation results of the biological information, and it will take a long time to remove the noise. In order to prevent such an increase in measurement time, the speed-up unit 32 is provided.
[0044] The output unit 40 outputs the bioinformation such as pulse rate, LF / HF, etc. calculated by the bioinformation calculation unit 30 (FIG. 4, step S6). That is, the bioinformation is displayed on the display device 116, 215, notified by voice, or output to a printer. Alternatively, the bioinformation may be output to a device such as a database server, where the data is stored.
[0045] According to the biological information detection systems 101 and 201 according to the first embodiment described above, the only sensor required for measurement is the camera 120 or the camera 220. There is no need for two sensors as in the above-mentioned Patent Document 1. Therefore, the manufacturing cost of the system can be reduced.
[0046] As described above, by providing pulse wave determination section 31 and further providing speed-up section 32, it is possible to speed up the processing as described above, compared to the technique of Patent Document 1. EXAMPLES
[0047] In the following description of each embodiment, the same reference numerals are used for the components, processing units, processing steps, etc. that are common to the previous embodiments, and detailed descriptions thereof will be omitted. In addition, the hardware configuration of each of the following embodiments is the same as that of the first embodiment.
[0048] Fig. 6 is a functional block diagram of a biological information detection system according to a second embodiment. Fig. 7 is a flowchart for explaining a process executed by the biological information detection system. The biological information detection systems 101 and 201 of the second embodiment have a pulse wave correction unit 33 added to the configuration of the first embodiment. The pulse wave correction unit 33 corrects a wave that is determined by the pulse wave determination unit 31 as being unable to be used as a pulse wave, to make it a usable wave (step S6).
[0049] That is, in embodiment 1, the speed-up unit 32 removes wave crests with poor waveforms, thereby enabling the measurement accuracy to be improved even when the averaging process is performed on only a small number of wave crests, thereby speeding up the measurement time.
[0050] However, this can only speed up the processing when the number of wave crests with poor waveforms among the wave crests observed in succession is small. In other words, when many wave crests with poor waveforms occur in succession, even if the problematic wave crests are not used, it will take time to gather a certain number of normal wave crests. Therefore, in this case, even if the speed-up unit 32 is present, it is not possible to speed up the measurement speed in the biological information detection system 101, 201.
[0051] Therefore, in this case, specifically, the following process is carried out by the pulse wave correction unit 33. That is, while the speed-up unit 32 discards wave peaks with poor waveforms, the pulse wave correction unit 33 corrects the wave peaks discarded by the speed-up unit 32 and utilizes them as wave peaks with an appropriate waveform.
[0052] Fig. 8 is a waveform diagram showing an example of a pulse wave. In Fig. 8, the waveform of pulse wave 51 shown by a solid line is the observed waveform. The figure shows a case in which pulse wave 51 is detected, and the first and second wave crests 52 and 53 are reliably detected as pulse waves, but the third wave crest 54 is too low to obtain a correct waveform, and the fourth wave crest 55 is obtained correctly. The third wave crest 54 is crushed by an error, but the third wave crest 54 is known in advance by pulse wave determination unit 31 to be an unreliable pulse wave.
[0053] Therefore, wave crest 56 is inserted between second wave crest 53 and fourth wave crest 55 as shown by a dashed line as if there were a third pulse wave, and processing continues. Specifically, as wave crest 56, any of the nearby wave crests 52, 53, 55 (which may be the average value of these multiple normal value wave crests) can be inserted at the position of wave crest 54 as wave crest 56. In this example, by adding wave crest 56, the data for the four wave crests is completed, so that the time averaging process can be performed, and biological information can be obtained quickly while maintaining the desired accuracy.
[0054] Also, in this case, it is determined whether wave crest 54 is worth correcting to make it a correct wave crest, and only when it is determined that it is worth making it a correct wave crest, wave crest 54 is corrected to wave crest 66. That is, the height of wave crest 54 is compared with a predetermined threshold, and only when it is determined that there is at least a wave crest, even if it is low, a correction is made to add wave crest 56. That is, if there is not even a small crest at the position of wave crest 54, no correction is made.
[0055] Therefore, according to this embodiment 2, even when wave crests with incorrect waveforms frequently appear, these incorrect wave crests can be used in measurement as wave crests with correct shapes corrected by the pulse wave correction unit 33, and biological information can be obtained quickly.
[0056] It is also possible to use both the speed-up section 32 and the pulse wave correction section 33, and if the occurrence of incorrect wave crests is low, the speed-up section 32 removes the incorrect wave crests, and if the incorrect wave crests occur frequently, the pulse wave correction section 33 corrects the incorrect wave crests to correct them. Alternatively, the speed-up section 32 may not be provided (step S4 may be omitted), and most of the incorrect wave crests may be corrected by the pulse wave correction section 33 regardless of the frequency of the incorrect wave crests, and used for measurement. EXAMPLES
[0057] Fig. 9 is a functional block diagram of a biological information detection system according to a third embodiment. Fig. 10 is a flowchart for explaining a process executed by the biological information detection system. The biological information detection systems 101 and 201 of the third embodiment have a measurement stability determination unit 34 added to the configuration of the first or second embodiment (Fig. 9 is an example in which the measurement stability determination unit 34 is provided in the second embodiment).
[0058] The measurement stability determination section 34 performs a stability determination step of determining the stability of the calculation of the biological information by the biological information calculation section 30 (biological information calculation step) based on the determination by the pulse wave determination section 31 (pulse wave determination step) (step S8). Then, the output section 40 performs an output step of outputting the result of the determination of the stability calculated by the measurement stability determination section 34 (stability determination step) (step S6).
[0059] In other words, if the pulse wave determination unit 31 judges that there are successive crests of a bad waveform, the human body being measured by the biometric information detection system 101, 201 may be moving and the measurement may not be going well, so in this case it is necessary to issue a warning to the user.
[0060] Therefore, the measurement stability determination unit 34 uses the information on the waveform classified by the pulse wave determination unit 31 to record and determine the number and detection order of wave crests that are likely to be measured correctly and wave crests that are thought to have a large error, thereby determining the stability of the measurement in the current biological information detection system 101, 201. For example, if the correctly measured wave crests continue for more than a certain threshold X, it is determined that the measurement in the biological information detection system 101, 201 is stable, and the measurement is continued as is. On the other hand, if the biological information detection system 101, 201 obtains a wave crest that exceeds a certain threshold Y and has a large error and cannot be used as it is, it is determined that the pulse wave has not been measured correctly, and a warning to that effect is issued to the user by the output unit 40. The warning issued by the output unit 40 is similar to that in the first embodiment. Various values can be set as the thresholds X and Y, but generally the threshold Y is a value larger than the threshold X.
[0061] In this way, it is possible to prompt the user to decide whether to continue the measurement, or to interrupt the measurement and perform a remeasurement, by determining the stability of the measurement in the biological information detection system 101, 201. With this function, it is possible to support the user in quickly completing the correct measurement by the biological information detection system 101, 201. EXAMPLES
[0062] Fig. 11 is a functional block diagram of a biological information detection system according to a fourth embodiment. Fig. 12 is a flowchart for explaining a process executed by the biological information detection system. The biological information detection systems 101 and 201 of the fourth embodiment have a feedback unit 35 added to the configuration of the third embodiment.
[0063] Feedback section 35 performs a feedback step of feeding back the result of determination made by measurement stability determination section 34 (stability determination step) and changing the determination method of pulse wave determination section 31 (pulse wave determination step) (step S9).
[0064] Furthermore, the feedback section 35 performs a feedback step of feeding back the result of the determination made by the measurement stability determination section 34 (stability determination step) and changing the correction method used by the pulse wave correction section 33 (pulse wave correction step) (step S9).
[0065] Such feedback from measurement stability determination section 34 may be given to only one of pulse wave determination section 31 and pulse wave correction section 33. Also, either speed-up section 32 or pulse wave correction section 33 may be omitted.
[0066] First, when the pulse rate is stable for a certain period of time, the biometric information calculation unit 30 records the pulse rate at that time as an approximate base pulse rate. This allows the subject to know the approximate pulse rate. However, due to human circumstances, the measurement may result in a pulse rate that is significantly higher than the base pulse rate. For example, it is normally impossible for the base pulse rate to suddenly rise to 120 when the base pulse rate was 60. If this were to happen, it is thought that errors have suddenly started to occur because the image data of the human body is captured and acquired by the cameras 120 and 220.
[0067] In such a case, the measurement stability determination unit 34 determines that the pulse wave is not measured correctly. In this case, the threshold value used in the pulse wave determination unit 31 and the speed-up unit 32 is adjusted (e.g., the threshold value is lowered) so that even wave crests with problematic shapes can be used for measurement by relieving them as much as possible. That is, in the first embodiment, the pulse wave determination unit 31 determines whether the waveform shape of the wave crest is appropriate by comparing the wave with the threshold value, and this threshold value is lowered so that even wave crests with some problem can be used for measurement. In the second embodiment, the pulse wave correction unit 33 compares the waveform with the threshold value at the position where the wave crest should be, and corrects the waveform of an appropriate crest at the position where it is thought that there is even a slight wave crest, and does not correct the appropriate wave crest at the position where it is judged that there is no even a slight crest. However, in the fourth embodiment, the threshold value is lowered to expand the range in which it is judged that even an extremely small crest exists.
[0068] In this way, even if the measurement results of the biological information detection systems 101 and 201 vary due to errors or the like, it is possible to perform proper measurement even from measurement values that include errors, thereby maintaining the stability of the measurement.
[0069] The present invention is not limited to the above-mentioned embodiment, but includes various modified examples. For example, the above-mentioned embodiment has been described in detail to clearly explain the present invention, and is not necessarily limited to those including all of the configurations described. It is also possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. It is also possible to add, delete, or replace a part of the configuration of each embodiment with another configuration.
[0070] In addition, the above-mentioned configurations, functions, processing units, processing steps, etc. may be realized in part or in whole by hardware, for example, by designing them as integrated circuits. In addition, the above-mentioned configurations, functions, etc. may be realized in software by a processor interpreting and executing a program that realizes each function. Information such as the program, table, file, etc. that realizes each function can be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD.
[0071] In addition, the control lines and information lines shown are those that are considered necessary for the explanation, and not all control lines and information lines in the product are shown. In reality, it can be considered that almost all components are connected to each other. [Explanation of symbols]
[0072] 10 Image data acquisition section 20 Pulse wave calculation unit 30 Biometric information calculation unit 31 Pulse wave determination unit 32 High speed section 33 Pulse wave correction unit 34 Measurement stability determination section 35 Feedback section 40 Output section 101,201 Biometric information detection system
Claims
1. an image data acquisition unit for acquiring image data relating to a human body; a pulse wave calculation unit that calculates a pulse wave of the human body from the image data acquired by the image data acquisition unit; a biometric information calculation unit that calculates biometric information of the human body from the pulse wave calculated by the pulse wave calculation unit; a pulse wave determination unit that determines the shape of the pulse wave calculated by the pulse wave calculation unit; an output unit that outputs the biometric information calculated by the biometric information calculation unit; Equipped with The biological information detection system according to claim 1, wherein the biological information calculation unit calculates the biological information based on the determination by the pulse wave determination unit.
2. 2. The biometric information detection system according to claim 1, further comprising a speed-up unit that selects the pulse wave that can be utilized based on a judgment result in the pulse wave judgment unit, and speeds up the calculation of the biometric information in the biometric information calculation unit.
3. The biological information detection system according to claim 1, further comprising a pulse wave correction unit which corrects a wave determined by the pulse wave determination unit not to be usable as a pulse wave, to make it usable.
4. a measurement stability determination unit that determines the stability of the calculation of the biological information by the biological information calculation unit based on the determination by the pulse wave determination unit, 2. The biological information detection system according to claim 1, wherein the output unit outputs the determination of the stability calculated by the measurement stability determination unit.
5. 5. The biological information detection system according to claim 4, further comprising a feedback section for feeding back a result of the determination made by said measurement stability determining section to change a determination method of said pulse wave determining section.
6. a pulse wave correction unit that corrects the wave determined by the pulse wave determination unit to be unusable as a pulse wave to make it usable; a feedback section which changes a correction method in the pulse wave correction section by feeding back a result of the determination in the measurement stability determination section; 5. The biological information detection system according to claim 4, further comprising:
7. 2. The biological information detection system according to claim 1, wherein the biological information calculation unit calculates LF / HF as the biological information.
8. 2. The biological information detection system according to claim 1, wherein the image data acquisition unit acquires image data of the skin of the human body in a non-contact manner using an imaging element.
9. an image data acquisition step of acquiring image data relating to a human body; a pulse wave calculation step of calculating a pulse wave of the human body from the image data acquired in the image data acquisition step; a biometric information calculation step of calculating biometric information of the human body from the pulse wave calculated in the pulse wave calculation step; a pulse wave determination step of determining the shape of the pulse wave calculated in the pulse wave calculation step; an output step of outputting the biometric information calculated in the biometric information calculation step; Including, The biological information detecting method, wherein the biological information calculating step calculates the biological information based on the determination made in the pulse wave determining step.
10. 10. The method for detecting vital signs according to claim 9, further comprising a speed-up step of selecting the pulse wave that can be utilized based on a result of the determination in the pulse wave determination step, thereby speeding up the calculation of the vital signs in the vital signs calculation step.
11. The biological information detection method according to claim 9, further comprising a pulse wave correction step of correcting a wave determined in the pulse wave determination step to be unusable as a pulse wave, to make it usable.
12. a stability determination step of determining the stability of the calculation of the biological information in the biological information calculation step based on the determination in the pulse wave determination step, 10. The biological information detection method according to claim 9, wherein the output step outputs the determination of the stability calculated in the stability determination step.
13. 13. The biological information detection method according to claim 12, further comprising a feedback step of feeding back a result of the determination in the stability determining step to change a determination method in the pulse wave determining step.
14. a pulse wave correction step of correcting the wave determined in the pulse wave determination step to be unusable as a pulse wave so as to make it usable; a feedback step of changing a correction method in the pulse wave correction step by feeding back a result of the determination in the stability determination step; The biological information detection method according to claim 12, further comprising:
15. 10. The biological information detection method according to claim 9, wherein the biological information calculation step calculates LF / HF as the biological information.
Citation Information
Patent Citations
Heart rate correction program, heart rate correction method, and heart rate correction system
JP6828619B2