Biometric measurement device and biometric measurement method
The bioinstrumentation device combines light sources with different wavelengths to change the perceived color from red to non-red, addressing the psychological impact and ensuring accurate biological measurement.
Patent Information
- Application Number
- PCT/JP2024/015696
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-04-05
- Filing Date
- 2024-04-22
- Publication Date
- 2024-11-28
AI Technical Summary
Biometric devices that use red light for biological measurements can have a negative psychological impact on living organisms, and existing technologies do not effectively address this issue by providing alternative color options for the irradiation light.
A bioinstrumentation device that uses a combination of light sources, including a first light source emitting light with a wavelength of 650 nm or more and a second light source emitting light with a wavelength of 590 nm or less, to create a perceived color other than red, thereby reducing the negative psychological effects while acquiring biological information.
The device effectively brings the perceived color of the irradiation light closer to non-red colors, reducing psychological discomfort and allowing for accurate biological information acquisition without interfering with the measurement process.
Smart Images

Figure JP2024015696_28112024_PF_FP_ABST
Abstract
Description
Biometric measurement device and biometric measurement method
[0001] The present disclosure relates to a biometric device and a biometric method.
[0002] There are technologies for acquiring biological information based on reflected light generated by irradiating a living body with light. For example, Patent Document 1 discloses a device for acquiring blood flow information of the face or scalp of a living body and cerebral blood flow information from reflected light pulses obtained by irradiating a living body with light pulses. Patent Document 2 discloses a device for detecting the pulse wave of a living body from an image acquired using a camera.
[0003] Patent No. 6399373 International Publication No. 2016 / 006027 Specification JP 4-189349 JP 11-164826
[0004] Depending on the wavelength of the light used to acquire biometric information, the light may appear red. Red may have a negative psychological effect on the living body.
[0005] The present disclosure provides a bioinstrumentation device that can make the color of the irradiated light perceived by a living body closer to a color other than red by using irradiated light that includes not only light that appears red but also light of other colors.
[0006] A biomeasurement device according to one aspect of the present disclosure comprises a light-emitting device including a first light source that emits first light having a wavelength longer than 650 nm and a second light source that emits second light including light with a wavelength of 590 nm or less, a photodetector that detects first reflected light from a living organism caused by the first light, and a processing circuit that generates biometric information of the living organism based on the first reflected light, wherein at least a portion of a first light spot formed by the first light and at least a portion of a second light spot formed by the second light overlap on the light emission surface of the light-emitting device that is visible to the living organism.
[0007] A general or specific aspect of the present disclosure may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable recording disk, or as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. The computer-readable recording medium may include a non-volatile recording medium such as a CD-ROM (Compact Disc-Read Only Memory). An apparatus may be composed of one or more devices. When an apparatus is composed of two or more devices, the two or more devices may be located in a single device or may be located separately in two or more separate devices. In this specification and claims, the term "apparatus" may refer not only to a single device but also to a system consisting of multiple devices.
[0008] According to the technology of the present disclosure, by using irradiation light that includes not only light that appears red but also light of other colors, it is possible to realize a biomeasurement device that can make the color of irradiation light perceived by a living body closer to a color other than red.
[0009] FIG. 1 is a diagram schematically illustrating a measurement apparatus according to an exemplary embodiment of the present disclosure. FIG. 2 is a diagram illustrating an example of the configuration of a photodetector. FIG. 3A is a diagram schematically illustrating an example of temporal changes in surface reflection components and internal scattering components contained in a reflected light pulse when the light pulse has an impulse waveform. FIG. 3B is a diagram schematically illustrating an example of temporal changes in surface reflection components and internal scattering components contained in a reflected light pulse when the light pulse has a rectangular waveform. FIG. 4 is a flowchart schematically illustrating an operation of a control circuit controlling a first light source, a third light source, and a photodetector. FIG. 5 is a diagram schematically illustrating a state in which light diffused by a diffuser plate is incident on a measured portion. FIG. 6A is a diagram schematically illustrating an example of two light spots formed in one region of a diffuser plate. FIG. 6B is a diagram schematically illustrating another example of two light spots formed in one region of a diffuser plate. FIG. 7 is a flowchart schematically illustrating an example of an operation of a control circuit controlling a second light source. FIG. 8 is a diagram for explaining the relationship between temporal changes in a first reflected light pulse and a second reflected light pulse and an exposure period. Fig. 9 is a flowchart that schematically shows the operation of the control circuit to control the first light source, the second light source, and the photodetector when the first light is a light pulse and the second light is a light pulse. Fig. 10 is a diagram that schematically shows an example of the emission periods of the first light and the second light. Fig. 11 is a diagram that schematically shows an example in which the measurement device according to this embodiment is installed in the passenger compartment of an automobile.
[0010] The embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component arrangement and connection configurations, steps, and step orders shown in the following embodiments are merely examples and are not intended to limit the technology of the present disclosure. Among the components in the following embodiments, components that are not described in the independent claims that represent the highest concepts are described as optional components. Each figure is a schematic diagram and is not necessarily an exact illustration. Furthermore, in each figure, substantially identical or similar components are assigned the same reference numerals. Duplicate descriptions may be omitted or simplified.
[0011] In the present disclosure, all or part of a circuit, unit, device, component, or part, or all or part of a functional block in a block diagram, may be implemented by one or more electronic circuits, including, for example, a semiconductor device, a semiconductor integrated circuit (IC), or an LSI (large scale integration). The LSI or IC may be integrated on a single chip or may be configured by combining multiple chips. For example, functional blocks other than memory elements may be integrated on a single chip. While the terms LSI and IC are used here, the term may be changed depending on the degree of integration, and may be referred to as a system LSI, a VLSI (very large scale integration), or an ULSI (ultra large scale integration). A Field Programmable Gate Array (FPGA), which is programmed after the LSI is manufactured, or a reconfigurable logic device, which can reconfigure the connection relationships within the LSI or set up circuit sections within the LSI, can also be used for the same purpose.
[0012] Furthermore, all or part of the functions or operations of a circuit, unit, device, component, or section can be implemented by software processing. In this case, the software is recorded on one or more non-transitory recording media such as ROMs, optical disks, hard disk drives, etc., and when the software is executed by a processor, the functions specified in the software are executed by the processor and peripheral devices. A system or device may include one or more non-transitory recording media on which the software is recorded, a processor, and required hardware devices, such as interfaces.
[0013] In this disclosure, the term "light" is not limited to visible light (wavelength of about 400 nm to about 700 nm) but also refers to invisible light. Invisible light refers to electromagnetic waves within the wavelength range of ultraviolet light (wavelength of about 10 nm to about 400 nm), infrared light (wavelength of about 700 nm to about 1 mm), or radio waves (wavelength of about 1 mm to about 1 m). The optical lenses in this disclosure can be used not only for visible light but also for invisible light such as ultraviolet light, infrared light, or radio waves.
[0014] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.
[0015] (Embodiment) [Configuration of bioinstrumentation device] An example configuration of a bioinstrumentation device according to an exemplary embodiment of the present disclosure will be described below with reference to Fig. 1. In this specification, the bioinstrumentation device may also be simply referred to as a "measurement device."
[0016] FIG. 1 is a schematic diagram illustrating a measurement device according to an exemplary embodiment of the present disclosure. The measurement device 100 shown in FIG. 1 acquires biometric information of a measurement target 12 of a living body 10 in a non-contact manner by irradiating the measurement target 12 with light and detecting the reflected light. The living body 10 may be, for example, a human. The measurement target 12 may be, for example, an exposed part of the human head, including the forehead and face, particularly the forehead. The biometric information may be, for example, at least one of pulse information, blood pressure information, facial or scalp blood flow information, and cerebral blood flow information. In the following description, unless otherwise specified, the measurement target 12 is assumed to be the human forehead.
[0017] 1, the measurement device 100 includes a light emitting device 20, a photodetector 30, and a processing circuit 40. The processing circuit 40 includes a signal processing circuit 50 and a control circuit 60. The light emitting device 20 emits a first light I for irradiating the living body 10. a and a first light source 20a that emits a second light I for irradiating the living body 10. b and a second light source 20b that emits the first light I. a The wavelength of the second light I may be, for example, 650 nm or more. bmay include light with a wavelength of 590 nm or less, for example. The photodetector 30 detects the light reflected from the living body 10 and outputs a signal indicating its intensity. The signal processing circuit 50 processes the signal output from the photodetector 30 to generate and output a signal indicating biological information of the measured area 12. The control circuit 60 controls the emission operation of the light emitting device 20, the detection operation of the photodetector 30, and the processing operation of the signal processing circuit 50.
[0018] In the measurement device 100, in a configuration in which the second light source 20b is removed from the light emitting device 20, the first light I a The living body 10 is irradiated with the irradiation light having a wavelength of 650 nm or more. Depending on the wavelength, the irradiation light may appear red to the living body 10. The color red may have a negative psychological effect on the living body 10.
[0019] In contrast, in the measurement device 100 according to this embodiment, the first light I, which appears red, a as well as the second light I, which is light of another color. b Therefore, the color of the irradiated light perceived by the living body 10 can be made closer to a color other than red, and the adverse psychological effects of red on the living body 10 can be reduced.
[0020] First Light I a The reflected light from the living body 10 due to the b The light reflected from the living body 10 due to the above is regarded as the second reflected light, and the light detector 30 detects the first reflected light without mixing with the second reflected light. b The signal processing circuit 50 generates biometric information of the living body 10 based on the first reflected light.
[0021] Each component of the measuring device 100 will be described in detail below.
[0022] <Light-emitting device 20> As described above, the light-emitting device 20 includes the first light source 20a and the second light source 20b. The first light I emitted from the first light source 20a a , and the second light I emitted from the second light source 20b. b The details are as follows:
[0023] First Light Ia More specifically, the wavelength of the first light I can be, for example, 650 nm or more and 900 nm or less. The wavelength range of 650 nm or more and 900 nm or less is suitable for biological measurement as described later. a is used to acquire biometric information. a may appear red to the living body 10 depending on the wavelength.
[0024] Second Light I b More specifically, the second light I may include light having a wavelength of 300 nm or more and 590 nm or less. The light may be, for example, violet light, indigo light, blue light, green light, or yellow light. b is the first light I a is used to prevent the living body 10 from seeing the image alone.
[0025] The light emitting device 20 emits a first light I a and the second light I b The light emitting surface has a light emitting surface that emits irradiation light including the first light I. a and at least a portion of the first light spot by the second light I b The color of the overlapping portion of the first light spot and the second light spot appears to the living body 10 as a color other than red. The first light spot on the light exit surface is formed by the first light I on the light exit surface. a Of the light, the intensity is at its maximum intensity e -2 The color of the second light spot on the light emitting surface is defined by the range above, where e is the base of the natural logarithm. The same applies to the second light spot on the light emitting surface. In this specification, the color of the portion where the two overlap on the light emitting surface of the light emitting device 20 is also referred to as the "color of the irradiated light."
[0026] In addition, if the first and second light spots partially or entirely overlap at a location of the light-emitting device 20 that is visible to the living body 10, the location corresponds to the light exit surface. If the light-emitting device 20 further includes optical members such as a lens, a screen member, or a diffusion plate, the first light I a and the second light I b The surface where the light partially or entirely overlaps with the light is the light exit surface.
[0027] The color of the irradiated light is the second light I b It depends on the color of the second light I. b For example, if the second light I is green, the color of the irradiated light will be yellow. b If the second light I is yellow, the color of the irradiated light will be orange. b For example, if the second light I is cyan light, the color of the irradiated light will be white. The spectrum of the cyan light may have a single peak across the green and blue wavelength ranges. Alternatively, the spectrum of the cyan light may have a peak in the green wavelength range and another peak in the blue wavelength range. b is, for example, white light, the second light I b The intensity of the first light I a The higher the intensity, the closer the color of the irradiated light can be to white.
[0028] However, in order to make the color of the irradiated light closer to a color other than red, the first light I a luminous flux Φ 1 and the second light I b luminous flux Φ 2 The magnitude relationship between Φ is also taken into consideration. 2 ≧Φ 1 is satisfied, the color of the emitted light can be effectively made to approach a color other than red.
[0029] Luminous flux is the brightness perceived by humans. The spectral radiant flux, which represents the radiant flux for each wavelength, is Φ e (λ), and the luminosity factor, which represents the brightness of each wavelength perceived by humans, is K(λ), then the luminous flux is ∫Φ e (λ)K(λ)dλ. The integration range is 0≦λ≦∞. Alternatively, K(λ) can be expressed as the maximum visibility K m The luminous flux is calculated by dividing the relative luminous efficiency V(λ) by K m ∫Φ e (λ)V(λ)dλ. Most people have the maximum visibility K at wavelength λ = 555 nm. m The maximum visibility is K m = 680 lm / W. a luminous flux Φ 1 is the first light I a Spectral radiant flux Φ e1It can be said that the second light I is determined based on the relative luminosity V(λ). b luminous flux Φ 2 is the second light I b Spectral radiant flux Φ e2 It can be said that the luminosity is determined based on the luminous efficiency V(λ) and the relative luminosity V(λ).
[0030] If the irradiated light is too dazzling, it will cause discomfort to the living body 10. The Unified Glare Rating (UGR), which is used as an evaluation index for glare, is defined by the following formula (1).
[0031] Here, L b is the background luminance, L is the luminance of the light source emitted by the observer, ω is the solid angle of the light source emitted by the observer, and P is the position index of the light source. b [cd / m 2 ] is the indirect illuminance E at the position of the observer's eye. i Based on [lx], L b = E i / π. The position index P is determined based on the following T, H, and R, with reference to an existing table that defines Guth's position index. T is the horizontal displacement from the observer's line of sight. H is the vertical displacement from the observer's line of sight. R is the value of the distance between the observer's eye and the light source projected onto the line of sight. If the distance between the observer's eye and the light source is r, then T 2 +H 2 +R 2 =r 2 The projected area of the light emitting part of the light source is A p Then, ω = A p / r 2 The projected area of the light emitting part of the light source is calculated by dividing the radius of the light emitting part by r 0 Then, A p = πr 0 2 When there are multiple light sources, L, ω, and P are calculated for each light source, and the sum of the values for each light source is calculated to calculate UGR as shown in equation (1).
[0032] E i =1lx, r=0.6m, R=0.5m, T=0m, H=0.33m, r0 = 0.002 m, and assume that there is one light source. b corresponds to the background luminance of a dark room, and T, H, and R are assumed to be measured when a seated person is measured with the measurement device 100 placed on a table in front of the person. Generally, when the UGR exceeds 25, the living body 10 feels uncomfortable with the glare, so the light source can be designed to satisfy UGR≦25. When UGR=25, the above luminance L is 27697 cd / m 2 This value is 30,000 cd / m 2 Therefore, if the luminance of the irradiated light is 30,000 cd / m 2 If the design is such that: the living body 10 does not feel discomfort from the glare of the irradiated light.
[0033] 1, the number of first light sources 20a is one, but it may be multiple. The same applies to the number of second light sources 20b. By providing multiple light sources that emit light of the same wavelength, the intensity of the irradiated light can be increased.
[0034] The first light source 20a includes a first light-emitting element 22a that emits light with an intensity corresponding to an injected first current and a first adjustment circuit 24a that adjusts the first current. Similarly, the second light source 20b includes a second light-emitting element 22b that emits light with an intensity corresponding to an injected second current and a second adjustment circuit 24b that adjusts the second current.
[0035] The first light-emitting element 22a may include, for example, a laser diode (LD) that emits laser light or a light-emitting diode (LED) that emits incoherent light. The same applies to the second light-emitting element 22b. When the first light-emitting element 22a includes an LD, biometric information can be acquired with high accuracy. b Since the second light-emitting element 22b is not used to acquire biological information, the second light-emitting element 22b may include an LED, which is less expensive than an LD.
[0036] The first adjustment circuit 24a may include, for example, a field effect transistor (GaNFET) including a gallium nitride (GaN) semiconductor having high electrical response. The same is true for the second adjustment circuit 24b.
[0037] The first light source 20a emits a first light I a The first light I may be emitted at all times, or a The first light I may be emitted as a light pulse. a When the first light I is constantly emitted, pulse information and / or blood pressure information of the living body 10 can be obtained. a When the light pulse is an optical pulse, in addition to pulse information and / or blood pressure information of the living body 10, blood flow information of the face or scalp and / or cerebral blood flow information can be obtained, as will be described later.
[0038] When acquiring pulse information and / or blood pressure information, the first light I a The first light I may be, for example, a constantly emitted laser beam or an incoherent light. a may be a light pulse of laser light or a light pulse of incoherent light.
[0039] First Light I a is a light pulse of laser light, the first light I a The spectrum of may have, for example, the following peaks. That is, the peak wavelength may be, for example, 650 nm or more and 900 nm or less. The peak width, more specifically, the full width at half maximum may be, for example, 10 nm or less. Light of wavelengths other than the peak wavelength is detected as noise, and this light reduces measurement accuracy. With the above peak width, it is possible to suppress the reduction in measurement accuracy.
[0040] First Light I a is a light pulse of laser light, in consideration of eye safety in biometric measurement, the first light I a The radiant flux of the light source may be, for example, 6.65 mW or less. In this case, it is possible to perform accurate biometric measurements while maintaining eye safety. The radiant flux is the radiant energy per unit time, and the above-mentioned spectral radiant flux Φ e Using (λ), ∫Φ e (λ)dλ.
[0041] First Light I a The radiant flux of 6.65 mW is required to satisfy Class 1 of the safety standard for laser products in JIS C 6802. 6.65 mW corresponds to the upper limit of the radiant flux of Class 1.
[0042] First Light I a The radiant flux of the light source 10 can be, for example, 0.3 mW or more. If the radiant flux is 0.3 mW or more, an excessive decrease in the S / N ratio can be suppressed in biological measurement.
[0043] It should be noted that the first light source 20a itself does not need to satisfy Class 1. For example, Class 1 of the safety standards for laser products may be satisfied by installing a diffusion plate or an ND filter in front of the first light source 20a to diffuse or attenuate the light.
[0044] The second light source 20b emits the second light I during biometric measurement. b The second light I may be emitted at all times. b The second light I may be emitted as a light pulse. b When the second light source 20b is constantly emitting the second light I, the control operation of the second light source 20b becomes easy. b is constantly emitted, the first light I a If the first light I is also constantly emitted, a and the second light I b The time-dependent change in the hue of the irradiated light containing the second light I can be suppressed. b is constantly emitted, the first light I a The second light I may be a light pulse. b When the first light I is a light pulse, heat generation of the second light emitting element 22b can be suppressed. a is also a light pulse, a and the second light I b may be emitted at the same timing or at different timings.
[0045] Second Light I b The second light I may be, for example, a constantly emitted laser beam or an incoherent light. b The second light I may be a light pulse of laser light or a light pulse of incoherent light. b When the second light I is incoherent light, an LED, which is less expensive than an LD, can be used as the second light source 20b. b is an incoherent light that is constantly emitted, the second light I bThe spectrum of the light pulse may have, for example, the following peaks: That is, the peak wavelength may be, for example, 300 nm or more and 590 nm or less. The peak width of the light pulse, more specifically, the full width at half maximum may be, for example, 250 nm or less.
[0046] First Light I a By making the time for irradiating the living body 10 with the first light I as long as possible, the amount of the first reflected light detected by the photodetector 30 can be increased. a and the emission period of the second light I b When the emission periods of the first light I a During the period when the second light I is not emitted, b Compared with the case where the first light I a As a result, the amount of light detected can be increased, thereby improving the signal-to-noise ratio.
[0047] In the following, the first light I a is the light pulse I p The case where the light pulse I p The rising portion of the light pulse I p The falling part is the part of the optical pulse I from when its intensity starts to increase until when it stops increasing. p This is the portion of the signal that begins to decrease in intensity and ends when the decrease is complete.
[0048] The light pulse I that has reached the measurement target 12 p A part of the reflected light is a surface reflection component I reflected on the surface of the measurement target 12 as shown in FIG. 1 The other part is an internally scattered component I that is reflected or scattered once or multiple times inside the measurement target 12 as shown in FIG. 2 The surface reflection component I 1includes three components: a direct reflection component, a diffuse reflection component, and a scattered reflection component. The direct reflection component is a reflection component whose angle of incidence and reflection angle are equal. The diffuse reflection component is a component that is diffused and reflected by the uneven shape of the surface. The scattered reflection component is a component that is scattered and reflected by internal tissue near the surface. When the measurement target 12 is the forehead of the user, the scattered reflection component is a component that is scattered and reflected inside the epidermis. In the following, the surface reflection component I that is reflected on the surface of the measurement target 12 is referred to as 1 The following explanation will be given assuming that the internal scattering component I 2 is explained as not including the component scattered and reflected by the internal tissue near the surface. 1 and the internal scattering component I 2 The surface reflection component I is reflected or scattered, and the direction of travel of these components changes, and some of them reach the photodetector 30 as a reflected light pulse. 1 may include surface information of the living body 10, for example, blood flow information of the face or scalp. 2 may include internal information of the living body 10, for example, cerebral blood flow information. Therefore, the surface reflection component I 1 By detecting the internal scattering component I, surface information of the living body 10, for example, blood flow information of the face or scalp, can be obtained. 2 By detecting this, internal information of the living body 10, for example, cerebral blood flow information, can be obtained.
[0049] Light Pulse I p The peak wavelength of the light may be any wavelength within the wavelength range of, for example, 650 nm to 950 nm. This wavelength range is included in the red to near-infrared wavelength range. This wavelength range is known as the "biological window" and has the property of being relatively difficult to absorb by water and skin in living organisms. When detecting a living organism, using light within this wavelength range can increase detection sensitivity.
[0050] When detecting blood flow information on the face or scalp of a living body, and cerebral blood flow information, the light used is mainly oxygenated hemoglobin (HbO 2It is believed that light is absorbed by oxygenated hemoglobin (Hb) and deoxygenated hemoglobin (Hb). Generally, when blood flow changes, the concentrations of oxygenated hemoglobin and deoxygenated hemoglobin change. This change also changes the degree of light absorption. Therefore, when blood flow changes, the amount of light detected also changes over time.
[0051] Oxygenated hemoglobin and deoxygenated hemoglobin have different wavelength dependences of optical absorption. When the wavelength is 650 nm or more and shorter than 805 nm, the optical absorption coefficient of deoxygenated hemoglobin is larger than that of oxygenated hemoglobin. At a wavelength of 805 nm, the optical absorption coefficients of deoxygenated hemoglobin and oxygenated hemoglobin are approximately the same. When the wavelength is longer than 805 nm and shorter than 950 nm, the optical absorption coefficient of oxygenated hemoglobin is larger than that of deoxygenated hemoglobin.
[0052] For this reason, two light pulses with different wavelengths may be used to obtain more detailed internal information of the measurement target portion 12. That is, in the measurement device 100, the light emitting device 20 emits a third light I for irradiating the measurement target portion 12. c The third light source may further include a third light source that emits the third light I. c The wavelength of the first light I a The wavelength of the third light source is longer than the wavelength of the third light source, for example, 650 nm or more, and more specifically, 650 nm or more and 900 nm or less. The third light source includes a third light-emitting element that emits light with an intensity according to the injected third current, and a third adjustment circuit that adjusts the third current. The emission operation of the third light source is controlled by the control circuit 60.
[0053] In the measurement device 100 in which the light emitting device 20 includes a third light source in addition to the first light source 20a, the first light I emitted from the first light source 20a a Light pulse I p1 and the third light I emitted from the third light source c Light pulse I p2 Light pulse I p1 The peak wavelength of the light pulse I is set to a value equal to or greater than 650 nm and less than 805 nm. p2The peak wavelength of the light pulse I can be set to a value between 805 nm and 950 nm. p1 and light pulse I p2 By irradiating the measurement part 12 with this light, it is possible to obtain information about the concentrations of oxygenated hemoglobin and deoxygenated hemoglobin contained in the blood inside the measurement part 12, as will be described later.
[0054] <Photodetector 30> The photodetector 30 detects the first reflected light so that the second reflected light is not mixed in. Therefore, the second light I b However, detection of the second reflected light to the extent that it does not affect the acquisition of biometric information is permitted.
[0055] The photodetector 30 may be configured to detect the first reflected light but not detect the second reflected light, for example. To prevent the second reflected light from being detected, the photodetector 30 may further include a first bandpass filter that transmits the first reflected light and suppresses the transmission of the second reflected light, for example. The transmittance of the first bandpass filter for the first reflected light may be, for example, 60% or more, 80% or more, 90% or more, or 95% or more. The transmittance of the first bandpass filter for the second reflected light may be, for example, 20% or less, 10% or less, or 5% or less. The first bandpass filter also helps reduce the influence of external disturbances such as ambient light.
[0056] Alternatively, the photodetector 30 may have a first portion that detects the first reflected light and a second portion that detects the second reflected light. A first band-pass filter that transmits the first reflected light and suppresses transmission of the second reflected light is disposed in the first portion. A second band-pass filter that transmits the second reflected light and suppresses transmission of the first reflected light is disposed in the second portion. The transmittance of the second band-pass filter for the second reflected light may be, for example, 60% or more, 80% or more, 90% or more, or 95% or more. The transmittance of the second band-pass filter for the first reflected light may be, for example, 20% or less, 10% or less, or 5% or less.
[0057] The first and second bandpass filters may be configured, for example, by multilayer filters or absorption filters. Taking into consideration the wavelength change of the emitted light due to temperature changes of the light source and the band shift due to oblique incidence on the filter, the width of the band that transmits one of the first and second reflected lights in these bandpass filters may be approximately 20 nm to 100 nm. The same applies to the width of the band that suppresses transmission of the other of the first and second reflected lights.
[0058] First Light I a is laser light, the first band-pass filter is configured to filter the first light I from the wavelength range to which the photodetector 30 is sensitive. a The first light I may have high transmittance in a narrow band including the wavelengths of the first light I and the transmittance in the remaining wavelength range is approximately zero. a The narrow band including the wavelength of the first light I a The first light I means a wavelength range in which the intensity is 1 / 10 or more of the peak intensity in the spectrum of the first light I. a Since light of wavelengths other than the wavelength of the reference wavelength is detected as noise, the bandpass filter can suppress a decrease in measurement accuracy. The high transmittance can be, for example, 60% or more, 80% or more, 90% or more, or 95% or more. The nearly zero transmittance can be, for example, 1% or less.
[0059] In the measurement device 100 in which the light emitting device 20 includes the third light source described above in addition to the first light source 20a, the first light I a is the laser light, and the third light I c is laser light, the first band-pass filter may be designed as follows: That is, the first band-pass filter is designed to filter out the first light I a and the third light I c The third light I may have high transmittance in a narrow band including the wavelengths of the third light I and the transmittance in the remaining wavelength range is nearly zero. c The narrow band including the wavelength of the third light I c In the spectrum, the wavelength range in which the intensity is 1 / 10 or more of the peak intensity.
[0060] In the above example, a band-pass filter is used, but the first light Ia is the light pulse, and the second light I b is an optical pulse, it is possible to cause the photodetector 30 to detect the first reflected light but not the second reflected light without using a band-pass filter. This method will be described later.
[0061] Next, the operation of the photodetector 30 to detect the first reflected light and output a signal will be described. a is constantly emitted, the photodetector 30 detects the first light I a The reflected light from the measurement target 12 due to the above is detected, and a time-series signal corresponding to the intensity of the reflected light is output.
[0062] First Light I a is the light pulse I p , the photodetector 30 detects the light pulse I p The photodetector 30 detects at least a portion of the component of the reflected light pulse generated when the reflected light pulse is reflected by the measured portion 12, and outputs a signal corresponding to the intensity of the component. When the photodetector 30 detects at least a portion of the component of the falling edge of the reflected light pulse, it can obtain information about the blood flow inside the measured portion 12. On the other hand, when the photodetector 30 detects at least a portion of the component of the rising edge of the reflected light pulse, it can obtain information about the blood flow on the surface of the measured portion 12. The above operation of the photodetector 30 is controlled by the control circuit 60.
[0063] In the measurement device 100 in which the light emitting device 20 includes the third light source described above in addition to the first light source 20a, the first light I a is the light pulse I p1 and the third light I c is the light pulse I p2 The photodetector 30 detects the light pulse I p1 The photodetector 30 detects at least a part of the component of the reflected light pulse generated when the light pulse I is reflected by the measurement target 12, and outputs a first signal corresponding to the intensity of the component. p2The photodetector 30 detects at least a portion of the components of the reflected light pulses generated when the two reflected light pulses are reflected by the measured part 12, and outputs a second signal corresponding to the intensity of the components. When the photodetector 30 detects at least a portion of the components of the falling period of each of the two reflected light pulses, it is possible to obtain information about the blood flow inside the measured part 12. On the other hand, when the photodetector 30 detects at least a portion of the components of the rising period of each of the two reflected light pulses, it is possible to obtain information about the blood flow on the surface of the measured part 12.
[0064] When the light emitting device 20 includes the third light source described above in addition to the first light source 20a, the measurement device 100 may include two photodetectors 30. One of the photodetectors 30 detects the light pulse I p1 The other photodetector 30 detects at least a part of the component of the falling edge of the reflected light pulse due to the light pulse I and outputs a first signal. p2 The photodetector 30 detects at least a part of the component of the falling period of the reflected light pulse caused by the above-mentioned and outputs a second signal. In this way, the number of photodetectors 30 is not limited to one, but may be two or more.
[0065] As shown in FIG. 1 , the photodetector 30 includes at least one photoelectric conversion element 32 and at least one charge accumulation section 34. The photodetector 30 may include multiple photoelectric conversion elements 32 and multiple charge accumulation sections 34. Specifically, the photodetector 30 may include multiple photodetection elements arranged two-dimensionally. Each photodetection element may include a photoelectric conversion element 32, such as a photodiode, and one or multiple charge accumulation sections 34. Such a photodetector 30 can simultaneously acquire two-dimensional information of the measurement section 12. The photodetector 30 may be any imaging element, such as a CCD image sensor or a CMOS image sensor. In this specification, the photodetection elements are also referred to as "pixels."
[0066] When the photodetector 30 includes a plurality of pixels arranged two-dimensionally, all of the plurality of pixels may detect the first reflected light, for example. Alternatively, among the plurality of pixels, a portion of two or more pixels may correspond to the first portion described above that detects the first reflected light, and the other two or more pixels may correspond to the second portion described above that detects the second reflected light. The portion of two or more pixels and the other two or more pixels may be arranged in a checkerboard pattern, for example.
[0067] The photodetector 30 may include an electronic shutter. The electronic shutter is a circuit that controls the timing of imaging. The electronic shutter controls the period of one signal accumulation in which received light is converted into an effective electrical signal and accumulated, and the period in which signal accumulation is stopped. The signal accumulation period is also referred to as the "exposure period." In the following description, the width of the exposure period is also referred to as the "shutter width." The time from the end of one exposure period to the start of the next exposure period is also referred to as the "non-exposure period."
[0068] The photodetector 30 can adjust the exposure period and non-exposure period to subnanoseconds, for example, in the range of 30 ps to 1 ns, using an electronic shutter. A TOF (Time of Flight) camera, whose purpose is to measure distance, detects all light emitted from the first light source 20a and reflected by the subject. Therefore, in a TOF camera, the shutter width must be larger than the pulse width of the light. In contrast, in the measurement device 100 of this embodiment, the shutter width does not need to be larger than the pulse width. The shutter width can be set to a value of, for example, 1 ns or more and 30 ns or less. According to the measurement device 100 of this embodiment, the shutter width can be reduced, thereby reducing the influence of dark current contained in the detection signal.
[0069] FIG. 2 is a diagram illustrating an example of the configuration of the photodetector 30. In FIG. 2, the area surrounded by a two-dot chain line frame corresponds to one pixel 201. The pixel 201 includes one photodiode (not shown). While FIG. 2 illustrates four pixels arranged in two rows and two columns, in practice, many more pixels may be arranged. The pixel 201 includes a first floating diffusion layer 204, a second floating diffusion layer 205, a third floating diffusion layer 206, and a fourth floating diffusion layer 207. Signals accumulated in the first floating diffusion layer 204 to the fourth floating diffusion layer 207 are treated as if they were four pixel signals in a typical CMOS image sensor and output from the photodetector 30. In the example illustrated in FIG. 2, the pixel 201 includes four floating diffusion layers, but depending on the application, the number of floating diffusion layers may be three or less, or five or more. The number of floating diffusion layers included in the pixel 201 depends on the number of signals to be accumulated simultaneously.
[0070] Each pixel 201 has four signal detection circuits. Each signal detection circuit includes a source follower transistor 309, a row selection transistor 308, and a reset transistor 310. Each transistor is, for example, but not limited to, a field-effect transistor formed on a semiconductor substrate. As shown in the figure, one of the input terminal and output terminal of the source follower transistor 309 is connected to one of the input terminal and output terminal of the row selection transistor 308. The one of the input terminal and output terminal of the source follower transistor 309 is typically the source. The one of the input terminal and output terminal of the row selection transistor 308 is typically the drain. The gate, which is the control terminal of the source follower transistor 309, is connected to the photodiode. Signal charges of holes or electrons generated by the photodiode are accumulated in a floating diffusion layer, which is a charge accumulation portion between the photodiode and the source follower transistor 309.
[0071] 2 , the first floating diffusion layer 204 to the fourth floating diffusion layer 207 are connected to a photodiode. A switch may be provided between the photodiode and each of the first floating diffusion layer 204 to the fourth floating diffusion layer 207. This switch switches the conduction state between the photodiode and each of the first floating diffusion layer 204 to the fourth floating diffusion layer 207 in response to a signal accumulation pulse from the control circuit 60. This controls the start and stop of accumulation of signal charge in each of the first floating diffusion layer 204 to the fourth floating diffusion layer 207. The electronic shutter in this embodiment has a mechanism for such exposure control.
[0072] The signal charges accumulated in the first floating diffusion layer 204 to the fourth floating diffusion layer 207 are read out when the row selection circuit 302 turns on the gate of the row selection transistor 308. At this time, the current flowing from the source follower power supply 305 to the source follower transistor 309 and the source follower load 306 is amplified in accordance with the signal potential of the first floating diffusion layer 204 to the fourth floating diffusion layer 207. An analog signal resulting from this current read out from the vertical signal line 304 is converted into digital signal data by an analog-to-digital (AD) conversion circuit 307 connected to each column. This digital signal data is read out for each column by the column selection circuit 303 and output from the photodetector 30. After reading out one row, the row selection circuit 302 and the column selection circuit 303 read out the signal charges in the floating diffusion layers of all rows in the same manner. After reading out all the signal charges, the control circuit 60 resets all the floating diffusion layers by turning on the gate of the reset transistor 310. This completes the imaging of one frame. By repeating the same high-speed imaging of frames, the photodetector 30 completes the imaging of a series of frames.
[0073] In this embodiment, an example of a CMOS-type photodetector 30 has been described, but the photodetector 30 may be another type of imaging element. The photodetector 30 may be, for example, a CCD-type, a single-photon counting element, or an amplification-type image sensor such as an EMCCD or ICCD. When a single-pixel sensor is used, the measurement point is one, but high-speed detection is possible.
[0074] <Processing Circuit 40 > The signal processing circuit 50 included in the processing circuit 40 is a circuit that processes the signal output from the photodetector 30 .
[0075] First Light I a When the first light I is constantly emitted, the signal processing circuit 50 generates and outputs a signal indicating pulse information and / or blood pressure information of the living body based on the time-series signal output from the photodetector 30. The pulse rate can be determined from the time-series signal whose intensity oscillates over time. Furthermore, the pulse wave velocity can be obtained from the time-series signal, and the blood pressure can be calculated based on the pulse wave velocity. a Even if the light is a light pulse, a time series signal can be obtained by repeatedly emitting the light pulse.
[0076] In the measurement device 100 in which the light emitting device 20 includes the third light source described above in addition to the first light source 20a, the first light I a is the light pulse I p1 and the third light I c is the light pulse I p2 If the light pulse I p1 and light pulse I p2 The signal processing circuit 50 generates and outputs a signal indicating the internal state of the measured portion 12 based on the first and second signals output from the photodetector 30. Here, the optical pulse I p1 The peak wavelength of the light pulse I is equal to or greater than 650 nm and less than 805 nm. p2 The peak wavelength of the first signal is set to be equal to or greater than 805 nm and equal to or less than 900 nm. The first signal and the second signal are used to solve a predetermined simultaneous equation, thereby determining the HbO concentration in the blood. 2The amount of change from the initial value of each of the concentrations of Hb and Hg can be calculated. The simultaneous equations are expressed by, for example, the following equations (2) and (3).
[0077] ΔHbO 2 and ΔHb are the HbO in the blood, respectively. 2 and the change in Hb concentration from the initial value. 750 OXY and ε 750 deOXY and HbO at a wavelength of 750 nm, respectively. 2 and the molar extinction coefficient of Hb. 850 OXY and ε 850 deOXY and HbO at a wavelength of 850 nm, respectively. 2 and the molar extinction coefficient of Hb. 750 ini and I 750 now and I represent the detected intensities at the initial time point and the measurement time point for a wavelength of 750 nm, respectively. 850 ini and I 850 now represent the detected intensities at the initial time point and the measurement time point for a wavelength of 850 nm, respectively.
[0078] As described above, light having wavelengths other than the peak wavelength is detected as noise, and this light reduces the measurement accuracy. p1 When the full width at half maximum of the light pulse I is 10 nm or less, the deterioration of the measurement accuracy can be suppressed. p2 The same applies to the full width at half maximum of the
[0079] The signal processing circuit 50 can be realized, for example, by a digital signal processor (DSP), a programmable logic device (PLD) such as a field programmable gate array (FPGA), or a combination of a central processing unit (CPU) or a graphics processing unit (GPU) and a computer program.
[0080] The control circuit 60 included in the processing circuit 40 controls the first adjustment circuit 24a to emit a light pulse I from the first light-emitting element 22a. p1 The control circuit 60 controls the first light source 20a to emit the light pulse I p1 and the shutter timing of the photodetector 30. When the light emitting device 20 includes the third light source in addition to the first light source 20a, the control circuit 60 further controls the third adjustment circuit to adjust the time difference between the emission timing of the light pulse I from the third light emitting element. p2 The control circuit 60 further controls the third light source to emit a light pulse I p2 and the shutter timing of the photodetector 30.
[0081] In this specification, this time difference is also referred to as a "phase difference." The "emission timing" of the first light source 20a is determined by the time when the light pulse I is emitted from the first light source 20a. p1 The "emission timing" of the third light source is the timing at which the light pulse I emitted from the third light source starts to rise. p2 is the timing at which the rise of the light beam begins. "Shutter timing" is the timing at which exposure starts. The control circuit 60 may adjust the phase difference by changing the emission timing, or may adjust the phase difference by changing the shutter timing.
[0082] The control circuit 60 may be configured to remove an offset component from the signal detected by each pixel of the photodetector 30. The offset component is a signal component due to ambient light such as sunlight or fluorescent light, or disturbance light. The offset component due to ambient light or disturbance light can be estimated by detecting a signal using the photodetector 30 in a state in which all light sources are turned off and no light is emitted.
[0083] The control circuit 60 may be, for example, a combination of a processor and a memory, or an integrated circuit such as a microcontroller having a built-in processor and memory. The control circuit 60 adjusts, for example, the emission timing and the shutter timing, and causes the signal processing circuit 50 to process signals, for example, by the processor executing a program recorded in the memory.
[0084] The signal processing circuit 50 and the control circuit 60 may be integrated into a single circuit or may be separate individual circuits. The signal processing circuit 50 may be a component of an external device, such as a server, located in a remote location. In this case, the external device, such as the server, transmits and receives data to and from the first light source 20 a, the second light source 20 b, the photodetector 30, and the control circuit 60 via wireless or wired communication.
[0085] The control operations performed by the control circuit 60 and the processing operations performed by the signal processing circuit 50 may be treated as operations of the processing circuit 40 .
[0086] <Others> The measurement device 100 may further include an imaging optical system that forms a two-dimensional image of the measurement portion 12 on the light-receiving surface of the photodetector 30. The optical axis of the imaging optical system is approximately perpendicular to the light-receiving surface of the photodetector 30. The imaging optical system may include a zoom lens. When the position of the zoom lens changes, the magnification ratio of the two-dimensional image of the measurement portion 12 changes, and the resolution of the two-dimensional image on the photodetector 30 changes. Therefore, even if the distance to the measurement portion 12 is long, it is possible to enlarge and observe the desired measurement area in detail.
[0087] The measurement device 100 may further include a polarizing plate arranged between the measurement target 12 and the first light source 20a, and a polarizing plate arranged between the measurement target 12 and the photodetector 30. In this case, the polarization directions of the polarizing plate arranged on the first light source 20a side and the polarizing plate arranged on the photodetector 30 side may be in a crossed Nicol relationship. The arrangement of these two polarizing plates allows the surface reflection component I of the measurement target 12 to be 1 , i.e., the component having the same angle of reflection as the incident angle, can be prevented from reaching the photodetector 30. 1 This can reduce the amount of light that reaches the photodetector 30.
[0088] When the light-emitting device 20 includes the third light source described above in addition to the first light source 20a, the measurement device 100 may further include a polarizing plate disposed between the measurement target 12 and the third light source. In this case, the polarization directions of the polarizing plate disposed on the third light source side and the polarizing plate disposed on the photodetector 30 side may be in a crossed Nicol relationship.
[0089] [Example of Biosignal Detection Operation] Next, an example of a biosignal detection operation will be described with reference to Figs. 3A to 4. Here, the internal scattering component I 2 A specific example of a method for detecting the light pulse emitted from the first light source 20a will be described below. However, if the light-emitting device 20 includes the above-mentioned third light source in addition to the first light source 20a, the same can be said for the light pulse emitted from the third light source.
[0090] FIG. 3A shows the light pulse I p When the surface reflection component I is included in the reflected light pulse, 1 and the internal scattering component I 2 3B is a diagram showing an example of the change over time of the light pulse I. p When the waveform of the reflected light pulse is rectangular, the surface reflection component I 1 and the internal scattering component I 2 In each figure, the left side of the figure shows the change over time of the light pulse I emitted from the first light source 20a. p The right figure shows an example of the waveform of the surface reflection component I 1 and the internal scattering component I 2 The internal scattering component I 2 is actually weak, but in FIGS. 3A and 3B, the internal scattering component I 2 The intensity of the light is exaggerated.
[0091] As shown in FIG. 3A, a light pulse I p has an impulse waveform, the surface reflection component I 1 is the light pulse I p and the internal scattering component I 2 is the surface reflection component I 1This means that the internal scattering component I 2 This is because the light beams passing through various paths within the measurement target 12 correspond to a combination of the light beams.
[0092] As shown in FIG. 3B, a light pulse I p If has a rectangular waveform, the surface reflection component I 1 is the light pulse I p and the internal scattering component I 2 has a waveform in which a plurality of impulse response waveforms are superimposed. The inventors have found that the optical pulse I p has an impulse waveform, the internal scattering component I detected by the photodetector 30 2 By starting the electronic shutter at the falling edge of the reflected light pulse, the internal scattering component I 2 can be effectively detected. The area surrounded by the dashed line in the diagram on the right side of FIG. 3B represents an example of a shutter open period during which the electronic shutter of the photodetector 30 is open. Compared to using a femtosecond laser with a pulse width on the order of femtoseconds (fs) or a picosecond laser with a pulse width on the order of picoseconds (ps), if the pulse width of the rectangular pulse is on the order of 1 ns to 10 ns, the first light source 20a can be driven at a lower voltage. This allows the measurement device 100 to be made smaller and at a lower cost.
[0093] Conventionally, a streak camera has been used to distinguish and detect information such as the light absorption coefficient or light scattering coefficient at different locations in the depth direction inside a living body. For example, Patent Document 3 discloses an example of such a streak camera. In the streak camera, an ultrashort light pulse with a pulse width of femtoseconds or picoseconds is used to perform measurements with a desired spatial resolution. In contrast, in this embodiment, the surface reflection component I 1 and the internal scattering component I 2 Therefore, the light pulse emitted from the first light source 20a does not need to be an ultrashort light pulse, and the pulse width can be selected arbitrarily.
[0094] When irradiating a person's head with light to obtain cerebral blood flow information, the internal scattering component I 2 The amount of light is the surface reflection component I 1 Furthermore, when safety standards for laser products are taken into consideration, the amount of light that can be irradiated becomes extremely small. Therefore, the internal scattering component I 2 Even in this case, it becomes very difficult to detect the light pulse I p If the output is a time-delayed internal scattering component I 2 This increases the amount of detected light and improves the S / N ratio.
[0095] The first light source 20a emits a light pulse I having a pulse width of, for example, 3 ns or more. p Alternatively, the first light source 20a can emit a light pulse I having a pulse width of 5 ns or more, or even 10 ns or more. p On the other hand, if the pulse width is too large, the amount of unused light increases and is wasted, so the first light source 20a may emit a light pulse I having a pulse width of, for example, 50 ns or less. p Alternatively, the first light source 20a may be controlled to emit a light pulse I having a pulse width of 30 ns or less, or even 20 ns or less. p If the pulse width of the rectangular pulse is several nanoseconds to several tens of nanoseconds, the first light source 20a can be driven at a low voltage. Therefore, the measurement device 100 can be made smaller and less expensive.
[0096] The irradiation pattern of the first light source 20a may be, for example, a pattern with a uniform intensity distribution within the irradiation area. In this respect, the measurement device 100 in this embodiment differs from the conventional device disclosed in, for example, Patent Document 4. In the device disclosed in Patent Document 4, the detector and the light source are separated by about 3 cm, and the surface reflection component is spatially separated from the internal scattering component. For this reason, discrete light irradiation is unavoidable. In contrast, in this embodiment, the surface reflection component I 1 The internal scattering component I 2Therefore, the first light source 20a can be used to provide an illumination pattern with a uniform intensity distribution. The illumination pattern with a uniform intensity distribution can be formed by diffusing the light emitted from the first light source 20a with a diffusion plate.
[0097] In this embodiment, unlike the conventional technology, the internal scattering component I 2 By irradiating the measurement target portion 12 with light over a wide spatial range, the measurement resolution can be increased.
[0098] 4 is a flowchart that schematically illustrates the operation of the control circuit 60 to control the first light source 20a, the third light source, and the photodetector 30 when the light-emitting device 20 includes the third light source described above in addition to the first light source 20a. a is the light pulse I p1 and the third light I c is the light pulse I p2 The control circuit 60 performs the operation shown in FIG. p1 and the reflected light pulse due to light pulse I p2 The photodetector 30 detects at least a portion of the falling edge component of each reflected light pulse caused by the
[0099] The control circuit 60 controls the second light source 20b to emit the second light I during the biometric measurement. b Even in this case, the photodetector 30 detects the second light I b If a band-pass filter that suppresses the transmission of reflected light due to the light pulse I is provided, the band-pass filter can prevent the reflected light from entering the photodetector 30. As a result, the photodetector 30 does not detect the reflected light. p1 and light pulse I p2 As will be described later, the first light I is emitted at different times, so the irradiated light is a and the second light I b or the third light I c and the second light I b Includes:
[0100] The control circuit 60 executes the operations of steps S101 to S108 shown in FIG.
[0101] <Step S101> The control circuit 60 outputs a light pulse I to the first light source 20a for a predetermined time. p1 At this time, the electronic shutter of the photodetector 30 stops exposure. p1 Among the reflected light pulses due to 1 The electronic shutter stops exposure until the period during which the light reaches the photodetector 30 is completed.
[0102] <Step S102> The control circuit 60 receives the light pulse I p1 Among the reflected light pulses caused by 2 When the light reaches the photodetector 30, the electronic shutter starts exposure.
[0103] <Step S103> After a predetermined time has elapsed, the control circuit 60 causes the electronic shutter to stop exposure.
[0104] By steps S102 and S103, signal charges are accumulated in one of the first to fourth floating diffusion layers 204 to 207 shown in Fig. 2. These signal charges are referred to as "first signal charges."
[0105] <Step S104> The control circuit 60 outputs a light pulse I to the third light source for a predetermined time. p2 At this time, the electronic shutter of the photodetector 30 stops exposure. p2 Among the reflected light pulses due to 1 The electronic shutter stops exposure until the period during which the light reaches the photodetector 30 is completed.
[0106] <Step S105> The control circuit 60 receives the light pulse I p2 Among the reflected light pulses caused by 2 When the light reaches the photodetector 30, the electronic shutter starts exposure.
[0107] <Step S106> After a predetermined time has elapsed, the control circuit 60 causes the electronic shutter to stop exposure.
[0108] Through steps S105 and S106, signal charges are accumulated in another floating diffusion layer among the first floating diffusion layer 204 to the fourth floating diffusion layer 207 shown in Fig. 2. This signal charge is referred to as a "second signal charge."
[0109] <Step S107> The control circuit 60 determines whether the number of times the signal accumulation has been performed has reached a predetermined number. If the determination in step S107 is No, steps S101 to S106 are repeated until a determination is made as Yes. If the determination in step S107 is Yes, the process proceeds to step S108.
[0110] <Step S108> The control circuit 60 causes the photodetector 30 to generate and output a first signal and a second signal based on the first signal charge and the second signal charge, respectively.
[0111] In this way, the control circuit 60 outputs the light pulse I p1 and the light detector 30 detects the light pulse I p1 The control circuit 60 executes a first operation of detecting at least a part of a component of the falling period of the reflected light pulse caused by the third light source. p2 and the light detector 30 detects the light pulse I p2 The control circuit 60 performs a second operation to detect at least a portion of a component of the falling period of the reflected light pulse caused by the first operation. The control circuit 60 repeats a series of operations including the first operation and the second operation a predetermined number of times. Alternatively, the control circuit 60 may repeat the first operation a predetermined number of times, and then repeat the second operation a predetermined number of times. The order of the first operation and the second operation may also be reversed.
[0112] By the operation shown in FIG. 4, the internal scattering component I 2 It can detect with high sensitivity. When irradiating a human head with light to obtain information such as cerebral blood flow, the attenuation rate of light inside is very large. For example, the outgoing light may be attenuated to about one millionth of the incoming light. For this reason, the internal scattering component I 2In some cases, the amount of light emitted by a single pulse is insufficient to detect the laser beam. The amount of light emitted is particularly weak in Class 1 laser product safety standards. Therefore, in the example of FIG. 4, the first light source 20a emits multiple light pulses, and the photodetector 30 is exposed multiple times by the electronic shutter accordingly. This operation allows the detection signal to be integrated, improving sensitivity. Note that multiple light emission and exposure are not essential and are performed as needed.
[0113] In the example of FIG. 4, the internal scattering component I 2 is detected, but the surface reflection component I 1 In addition, the surface reflection component I 1 and the internal scattering component I 2 In the case where both are detected, a light pulse I is detected between steps S101 and S102. p1 The surface reflection component I of the reflected light pulse due to 1 and a step of accumulating a signal charge based on the light pulse I is added between steps S104 and S105. p2 The surface reflection component I of the reflected light pulse due to 1 These signal charges are accumulated in the remaining two floating diffusion layers among the first floating diffusion layer 204 to the fourth floating diffusion layer 207 shown in FIG. 2. The surface reflection component I 1 By detecting this, it is possible to obtain information indicating, for example, the appearance of the face or the state of scalp blood flow.
[0114] In the above example, two light sources emitting light of different wavelengths are used, but multiple light sources emitting light of the same wavelength may also be used. If the light output of each light source is small, the lack of light output can be compensated for by providing multiple light sources emitting light of the same wavelength. Here, "the same wavelength" does not have to be strictly the same, and the wavelengths may be slightly different.
[0115] To summarize the above, the following can be said about the measurement device 100 according to this embodiment.
[0116] ・First light I appears red a as well as the second light I, which is light of another color.b By using irradiation light including red, the color of the irradiation light perceived by the living body 10 can be made closer to a color other than red. As a result, it is possible to reduce the adverse psychological effects of red on the living body 10.
[0117] The photodetector 30 detects the first reflected light so that the second reflected light is not mixed in. Therefore, the second light I b does not affect the acquisition of biometric information.
[0118] The signal processing circuit 50 generates biometric information of the living body 10 based on the first reflected light. The biometric information may be, for example, at least one of pulse information, blood pressure information, facial or scalp blood flow information, and cerebral blood flow information.
[0119] In the measurement device 100 in which the light-emitting device 20 includes the third light source described above in addition to the first light source 20a, more detailed internal information of the living body 10 can be obtained.
[0120] (Modifications) Modifications of the measuring device 100 according to this embodiment will be described below.
[0121] [Measurement Device Further Including Diffuser Plate] The first light I diffused by the diffuser plate a and the second light I b 5 is a diagram schematically showing how light diffused by a diffuser plate 70 enters the measurement portion 12.
[0122] The light emitting device 20 may further include a diffuser plate 70 as shown in Fig. 5. The diffuser plate 70 diffuses the first light I emitted from the first light source 20a as shown in Fig. 5. a , and the second light I emitted from the second light source 20b b As a result, the diffused first light I a and the second light I b This allows the measurement area 12 to be uniformly irradiated with light, making it possible to evaluate biological information using the same standard in any part of the measurement area 12. The any part of the measurement area 12 may be, for example, the left or right part of the forehead.
[0123] As shown in FIG. 5, the living body 10 visually recognizes the diffuser plate 70. The first light I aand the second light I b Since the light emitting device 20 emits irradiation light including the first light I a and the second light I b It can be said that this spreads
[0124] When LDs are used for the first light source 20a and the second light source 20b, the first light I a and the second light I b The first light I spreads as it travels. a and the second light I b Each of the light spots of the first light I may have, for example, an elliptical shape. Unless otherwise specified, the long axis direction of the elliptical light spot is perpendicular to the paper surface of FIG. 5, and the short axis direction is horizontal to the paper surface of FIG. 5. a and the second light I b When LDs are used for the first light source 20a and the second light source 20b, the first light source 20a and the second light source 20b may be mounted in a so-called CAN package or on the same substrate.
[0125] As shown in FIG. 5, the diffuser 70 has a plurality of recesses or protrusions on its surface, which randomly diffuses incident light rays in various directions. Therefore, the diffuser 70 has the function of eliminating uneven illuminance on the measurement target 12. The diffuser 70 may be formed, for example, by a minute lens array. In the example shown in FIG. 5, a diffuser 70 that refracts and transmits light inside is used, but this is not limiting. A diffuser that reflects and diffuses light may also be used. A reflective diffuser also has minute recesses and protrusions on the reflective surface, which diffuses reflected light in random directions. When a reflective diffuser is used, the first light I that has been reflected and diffused is a and the second light I b The first light source 20a, the second light source 20b, and a reflective type diffusion plate are disposed at appropriate positions so that the measurement target portion 12 is illuminated with light having a wavelength of 1000 nm.
[0126] 5, the light emitting device 20 may further include collimator lenses 25 between the first light source 20a and the diffuser plate 70 and between the second light source 20b and the diffuser plate 70. When the light exit surface of the first light source 20a and the light exit surface of the second light source 20b are located near the focal point of the collimator lens 25, the collimator lens 25 collimates the first light I, which travels while diverging. a and the second light I b The first light I is collimated and emitted. a and the second light I b The optical axis of each of the first light I is parallel to the optical axis of the collimator lens 25. a and the second light I b Each optical axis of the first light I a and the second light I b When each of the collimated first light I is a light beam, the central axis of the light beam is the central axis of the collimated first light I. a and the second light I b Each of the light spots has an elliptical shape. In this specification, "collimate" refers not only to making light completely parallel, but also to reducing the spread of light. Instead of the collimator lens 25, an optical system including one or more mirrors and / or one or more collimator lenses may be used.
[0127] 6A is a diagram schematically illustrating an example of a light spot formed in one region of the diffuser plate 70. The first light I shown in FIG. a and the second light I b The light spots of the first light I a and the second light I b is projected onto the diffuser 70. In FIG. 6A, the first light I a The intensity distribution of the light spot of the second light I b The intensity distribution of the light spot is also shown.
[0128] In the example shown in Figure 6A, the sizes of the two light spots are the same, but they may be different. b The light spot of the first light I a Alternatively, the size of the first light I may be large enough to include all of the light spots of the first light I. aThe light spot of the second light I b 6A, the two elliptical light spots are aligned in the minor axis direction, but this is not limiting. The two elliptical light spots may be aligned in the major axis direction by rotating each light spot by 90° around its center as the rotation axis.
[0129] As shown in FIG. 6A, the first light I a The light spot of the second light I b The first light spot I at least partially overlaps with the light spot of the first light I. These two light spots may partially overlap or may completely overlap. a and the second light I b The color of the overlapping area of the light spots approaches a color other than red. The wider this overlapping area, the less red the illuminated light appears.
[0130] 6B is a diagram schematically illustrating another example of a light spot formed in one region of the diffuser plate 70. As shown in FIG. 6B, the second light I b The light spot of the first light I a The first light I has a size large enough to include all the light spots of the first light I. a The light spot of the second light I b Therefore, among the light spots of the irradiated light formed on the diffuser plate 70, the first light I a The color of the area where the light spot is located can be made closer to a color other than red.
[0131] First Light I a and the optical axis of the second light I b When the first light source 20a and the second light source 20b are arranged so that the optical axes of the first light I intersect, a The light spot of the second light I b It is easier to fit the object inside the light spot of the first light I. a and the optical axis of the second light I b When the optical axes of the first light I and the second light I intersect on the diffuser plate 70, as shown in FIG. a The center of the light spot of the second light Ib overlaps with the center of the light spot.
[0132] In the example shown in FIGS. 6A and 6B, the diffuser 70 diffuses the first light I a and the second light I b A light-shielding film may be provided to suppress transmission of the first light I at a portion where the first light I and the second light I do not overlap. a The transmittance of the light-shielding film with respect to the second light I may be, for example, 20% or less, 10%, 5% or less, or 1%. b The same applies to the transmittance of the light-shielding film with respect to the light-shielding film. The light-shielding film can reduce the possibility that the living body 10 will be able to see the portion where the two do not overlap.
[0133] Examples of the arrangement of the optical system including one or more mirrors and / or one or more collimator lenses, and the diffuser plate 70 are disclosed in, for example, WO 2021 / 256165, the entire disclosure of which is incorporated by reference.
[0134] [Example of Control Operation of Second Light Source 20b] Next, with reference to Fig. 7, an example of operation in which the control circuit 60 controls the second light source 20b to make the color of the irradiated light perceived by the living body 10 closer to the color of the ambient light will be described. The ambient light may be, for example, indoor lighting, outdoor lighting, or sunlight. Alternatively, the ambient light may be, for example, indoor lighting or light obtained by mixing sunlight with indoor lighting.
[0135] When the color of the irradiated light is different from the color of the ambient light, for example, when the color of the ambient light is warm and the color of the irradiated light is cool, the user feels uncomfortable with the irradiated light. By making the color of the irradiated light closer to the color of the ambient light, the user's discomfort with the irradiated light can be reduced.
[0136] 7 is a flowchart showing an example of the operation of the control circuit 60 to control the second light source 20b. The control circuit 60 executes steps S201 to S207 shown in FIG. 7 before and during biometric measurement. However, these operations may be omitted before biometric measurement.
[0137] <Step S201> The control circuit 60 causes the photodetector 30 to detect light from the living body 10 illuminated by ambient light. Here, the photodetector 30 is an imaging element that includes pixels capable of detecting red (R), green (G), and blue (B) light in addition to pixels capable of detecting the first reflected light from the living body 10 due to the first light Ia, and generates an RGB color image. Alternatively, another RGB color camera may be used instead of the photodetector 30.
[0138] <Step S202> The control circuit 60 acquires the color image output from the photodetector 30. The color image includes information about the living body 10 in the wavelength band of visible light.
[0139] <Step S203> The control circuit 60 estimates the color of the ambient light based on the acquired color image. This operation can be performed, for example, by a machine learning model in which the color image is used as an input image and an ambient light image showing the distribution of the colors of the ambient light in the color image is used as an output image. As the machine learning model, a convolutional neural network that estimates the ambient light image based on the color image is trained using a dataset including the color image and a ground truth of the ambient light image in the color image.
[0140] An example of such a machine learning model is described in "Deep Specialized Network for Illuminant Estimation" W. Shi et al., Computer Vision -ECCV 2016 pp 371-387. The method disclosed in this document improves estimation accuracy by combining a HyperNet that estimates two ambient light images as hypotheses based on a color image and a SelNet that selects the ambient light image that is most likely to be closer to the correct image from the two ambient light images. However, the machine learning model is not limited to this method.
[0141] In a machine learning model, when a color image showing a living organism 10 and a background is input as an input image, an ambient light image showing the distribution of ambient light colors is output as an output image. For example, the average of the ambient light colors in the ambient light image may be used as the estimated ambient light color. Alternatively, if the distribution of ambient light colors in the ambient light image is divided into multiple segments, the color of the segment with the largest number of pixels may be used as the estimated ambient light color.
[0142] <Step S204> The control circuit 60 converts the current color of the illumination light emitted from the light-emitting device 20 and the estimated color of the ambient light into coordinate information on a chromaticity diagram. The current color of the illumination light is the color of the illumination light that is set to be emitted from the light-emitting device 20 at the time the color of the ambient light is estimated.
[0143] As described above, in steps S203 and S204, the control circuit 60 estimates the color of the ambient light based on the color image and generates first color information related to the estimated color of the ambient light. In the above example, the color information is information related to chromaticity, but this is not limited to this example. Instead of chromaticity, for example, color temperature or a combination of red light intensity, green light intensity, and blue light intensity may be used.
[0144] <Step S205> The control circuit 60 determines whether there is a color mismatch between the current color of the irradiated light and the estimated color of the ambient light. A possible cause of the color mismatch is a change in the ambient light. Examples of changes in the ambient light include changing the color of the indoor illumination light (the ambient light) from one of cool and warm colors to the other, moving the measuring device 100 to another room, or changing the amount of sunlight contained in the ambient light depending on the time of day, such as morning, noon, or night. Another possible cause of the color mismatch is that the color of the irradiated light at the initial setting is different from the color of the ambient light.
[0145] The determination of color shift can be performed, for example, as follows: If, on the chromaticity diagram, the plot of the current color of the irradiated light is located outside the color discrimination ellipse whose center is the plot of the estimated color of the ambient light, the control circuit 60 determines "Yes," and if not, the control circuit 60 determines "No." The color discrimination ellipse is the range of color differences on the chromaticity diagram that cannot be distinguished by the naked eye.
[0146] Alternatively, if the distance between the plot of the current color of the irradiated light and the plot of the estimated color of the ambient light on the chromaticity diagram exceeds a predetermined threshold, the control circuit 60 may determine "Yes," and if not, the control circuit 60 may determine "No." The predetermined threshold may be, for example, any value equal to or greater than the minor axis and equal to or less than the major axis of the above-mentioned color discrimination ellipse. Examples of the any value include the minor axis, the major axis, or an average thereof of the above-mentioned color discrimination ellipse.
[0147] If the determination is Yes, the process proceeds to step S206, whereas if the determination is No, the control operation ends.
[0148] <Step S206> The control circuit 60 determines the wavelength and / or intensity of the second light source 20b by referring to the following table. The table indicates the correspondence between color information regarding the color of the irradiated light and the wavelength and / or intensity of the second light source 20b when emitting irradiated light having that color. The table is created and stored in memory before executing the operation of step S201.
[0149] The above table can be created, for example, as follows: The control circuit 60 outputs the first light I a The second light source 20b emits the second light I while the wavelength and / or intensity of the second light I are fixed. b The control circuit 60 changes the wavelength and / or intensity of the second light I in small increments and acquires color information of the irradiated light each time. b The wavelength and / or intensity of the light is then correlated.
[0150] The color information of the irradiated light may include, for example, the intensity r of red light, the intensity g of green light, and the intensity b of blue light. 1 A light emitting element that emits light of wavelength λ2 a light emitting element that emits light of wavelength λ 3 The wavelength λ is a peak wavelength. 1 The light intensity of P 1 and the wavelength λ 2 The light intensity of P 2 and the wavelength λ 3 The light intensity of P 3 Let's say.
[0151] In that case, the table would be, for example, (r, g, b) and (P 1 , P 2 , P 3 Alternatively, the table may contain a correspondence between (r, g, b) and (λ 1 , λ 2 , λ 3 ), or the correspondence between (r, g, b) and (λ 1 , λ 2 , λ 3 , P 1 , P 2 , P 3 ) may also include a correspondence relationship with
[0152] When the estimated color information of the ambient light includes a red light intensity r, a green light intensity g, and a blue light intensity b, similar to the color information of the irradiated light, the control circuit 60 selects the wavelength and / or intensity of the second light source 20b corresponding to the closest color information of the irradiated light by performing a neighboring point search to search for color information of the irradiated light that is closest to the estimated color information of the ambient light. Alternatively, the control circuit 60 may calculate the wavelength and / or intensity of the second light source 20b by performing interpolation based on the wavelengths and / or intensities of the second light source 20b corresponding to the color information of the irradiated light that is first and second closest to the estimated color information of the ambient light.
[0153] As described above, in steps S205 and S206, the control circuit 60 controls the second light I emitted from the second light source 20b based on the first color information and the second color information related to the current color of the irradiated light. b The controller 10 determines whether to control the second light source 20b so as to change the color of the light source 20b.
[0154] <Step S207> The control circuit 60 controls the second light source 20b to emit the second light Ib The control circuit 60 changes the wavelength and / or intensity of the second light I to the wavelength and / or intensity determined in step S206. As a result, the color of the irradiated light approaches the color of the estimated ambient light. b When it is determined that the second light source 20b should be controlled to change the color of the irradiated light, the control circuit 60 controls the second light source 20b so that the color of the irradiated light approaches the color of the estimated ambient light. At this time, the control circuit 60 does not control the first light source 20a.
[0155] As described above, the second light source 20b may include a plurality of light-emitting elements that emit light of different wavelengths. When some of the plurality of light-emitting elements are driven and the remaining elements are stopped, the second light source 20b may be controlled by stopping the driven light-emitting elements and driving the stopped light-emitting elements. Alternatively, when all of the plurality of light-emitting elements are driven, the second light source 20b may be controlled by changing the intensity of light emitted from each light-emitting element.
[0156] In this specification, "the color of the illuminating light approaches the color of the estimated ambient light" means one of the following three cases. In the first case, the plot of the color of the illuminating light on the chromaticity diagram completely matches the plot of the color of the estimated ambient light. In the second case, the plot of the color of the illuminating light on the chromaticity diagram is included in a color discrimination ellipse centered on the plot of the color of the estimated ambient light. In the third case, the distance between the plot of the color of the illuminating light and the plot of the color of the estimated ambient light on the chromaticity diagram is equal to or less than a predetermined threshold.
[0157] The above control operation allows the color of the irradiated light perceived by the living body 10 to be closer to the color of the ambient light, thereby reducing the discomfort felt by the user from the irradiated light.
[0158] [Another Example of Biosignal Detection Operation] Hereinafter, with reference to FIG. 8, a is the first light pulse, and the second light I b is the second light pulse, the photodetector 30 detects the first light I a while detecting the first reflected light pulse due to the second light I bAn example of a detection operation of a biological signal in which the second reflected light pulse due to the above is not detected will be described. In this example, the photodetector 30 does not need to include the band-pass filter described above.
[0159] 8 is a diagram illustrating the relationship between the time change of the first reflected light pulse and the second reflected light pulse and the exposure period. a and the second light I b are emitted from the first light source 20a and the second light source 20b at different timings. Figures 8(a) and 8(b) show examples of the waveforms of the first reflected light pulse and the second reflected light pulse, respectively, that reach the light detection elements included in the light detector 30. Figure 8(c) shows an example of an exposure period during which the shutters of the light detection elements are open.
[0160] First Light I a and the second light I b are emitted from the first light source 20a and the second light source 20b at different timings, the first reflected light pulse and the second reflected light pulse arrive at the photodetector element at different timings, as shown in (a) and (b) of Figure 8. The intensity of each reflected light pulse during its falling edge gradually decreases due to the superposition of the impulse response waveforms, as described above. The slower the shutter timing, the greater the internal scattering component I contained in the entire acquired signal. 2 The proportion of the internal scattering component I 2 is scalp blood flow component I, which contains a lot of information about scalp blood flow in the superficial part of the forehead. 2―1 and cerebral blood flow component I, which contains a lot of information about cerebral blood flow in the deep forehead. 2―2 It mainly includes:
[0161] As shown in FIG. 8(c), the first reflected light pulse is reflected by the cerebral blood flow component I 2―2 The exposure is performed during a period that includes a large amount of the first reflected light pulse. In contrast, the exposure is stopped during a period in which the second reflected light pulse reaches the light detection element. If the exposure period is between the emission timing of the first light source 20a and the emission timing of the second light source 20b, the light detection element will not detect the second reflected light pulse. The "emission timing" of the first light source 20a or the second light source 20b is the timing at which the light pulse emitted from the first light source 20a or the second light source 20b starts to rise.
[0162] FIG. 9 shows the first light I a is the first light pulse, and the second light I b is the second light pulse. By performing the operation generally shown in Fig. 9, the control circuit 60 causes the photodetector 30 to detect at least a part of the component of the falling period of the first reflected light pulse, but not the second reflected light pulse.
[0163] The control circuit 60 executes the operations of steps S301 to S306 shown in FIG.
[0164] <Step S301> The control circuit 60 controls the first light source 20a to emit the first light pulse for a predetermined time. At this time, the electronic shutter of the photodetector 30 stops exposure. The control circuit 60 controls the surface reflection component I 1 The electronic shutter stops exposure until the period during which the light reaches the photodetector 30 is completed.
[0165] <Step S302> The control circuit 60 extracts the internal scattering component I from the first reflected light pulse. 2 When the light reaches the photodetector 30, the electronic shutter starts exposure.
[0166] <Step S303> After a predetermined time has elapsed, the control circuit 60 causes the electronic shutter to stop exposure.
[0167] By steps S302 and S303, signal charges are accumulated in one of the first to fourth floating diffusion layers 204 to 207 shown in FIG.
[0168] <Step S304> The control circuit 60 causes the second light source 20b to emit the second light pulse for a predetermined period of time. At this time, the electronic shutter of the photodetector 30 stops exposure. Furthermore, the control circuit 60 causes the electronic shutter of the photodetector 30 to stop exposure until the period in which the second reflected light pulse reaches the photodetector 30 is completed.
[0169] <Step S305> The control circuit 60 determines whether the number of times the signal accumulation has been performed has reached a predetermined number. If the determination in step S305 is No, steps S301 to S304 are repeated until a determination is made as Yes. If the determination in step S305 is Yes, the process proceeds to step S306.
[0170] <Step S306> The control circuit 60 causes the photodetector 30 to generate and output a signal based on the signal charge.
[0171] To summarize the above, it can be said that the control circuit 60 performs the following two operations.
[0172] The first light source 20a and the second light source 20b are caused to emit the first light pulse and the second light pulse, respectively, so that the living body 10 is irradiated with the first light pulse and the second light pulse at different times.
[0173] The photodetector 30 is exposed to light for at least a portion of the time period during which the first reflected light pulse reaches the photodetector, and is not exposed to light for the time period during which the second reflected light pulse reaches the photodetector.
[0174] These operations performed by the control circuit 60 cause the photodetector 30 to detect the first reflected light pulse but not the second reflected light pulse, so that the second light pulse does not affect the acquisition of biological information.
[0175] [First Light I a and the second light I b Example of Emission Period of First Light I a and the second light I b FIG. 10 shows an example of the emission period of the first light I a and the second light I b 10 is a diagram showing an example of an emission period of the first light I. a The lower diagram of FIG. 10 shows the relationship between the intensity and time of the second light I b 10 shows the relationship between the intensity of the second light I and the time. b During the period when the first light I aIn this case, the first light I for each light pulse is emitted one or more times. a The start and end timings of the emission period of the second light I b In other words, the first light I a The start timing of the emission period of the second light I b The timing of the emission period of the first light I for each light pulse is later than the timing of the emission period of the first light I for each light pulse. a The end timing of the emission period of the second light I b This is earlier than the end of the extraction period.
[0176] The first light I for each light pulse a The start timing and end timing of the emission period of the first light I a The timings are when the intensity of the second light I exceeds and falls below 1 / 10 of the maximum intensity. b The start and end timings of the emission period of the second light I b The timings are when the intensity exceeds and falls below 1 / 10 of the maximum intensity.
[0177] The first light I as shown in FIG. a and the second light I b Due to the relationship between the emission periods of the first light I and the second light I, the living body 10 a In a state where the red color of the first light I is not visible, a As a result, the amount of detected first reflected light obtained by many optical pulses can be averaged, thereby improving the signal-to-noise ratio.
[0178] (Application Example) An application example of the measurement device 100 according to this embodiment will be described below. FIG. 11 is a diagram schematically illustrating an example in which the measurement device 100 according to this embodiment is installed inside the cabin of an automobile. In the example shown in FIG. 11, the measurement device 100 is installed above the windshield, but it may also be installed behind the steering wheel. In the example shown in FIG. 11, the living body 10 is the driver, but it may also be a passenger sitting in the passenger seat or back seat. In the example shown in FIG. 11, the measured part 12 is the face, but it may also be the neck or arm.
[0179] 11 , the light-emitting surface of the light-emitting device 20 included in the measurement device 100 is within the driver's field of view. The driver is irradiated with the light emitted from the light-emitting device 20. The processing circuit 40 generates biometric information of the driver based on the first reflected light from the driver's head. In this way, the measurement device 100 according to this embodiment, which is installed inside the vehicle cabin, can acquire biometric information of the driver while suppressing the inclusion of red, a dangerous color, in the colors perceived by the driver.
[0180] Processing circuitry 40 may further estimate the driver's state based on the acquired biological information and provide advice to the driver based on the estimation result. For example, if it is estimated that the driver is in a stressed and / or excited state, processing circuitry 40 may urge the driver to take a deep breath via a display or voice.
[0181] Unlike the measurement device 100 according to this embodiment, in a configuration in which the second light source 20b is removed from the light-emitting device 20, the emitted light may appear red to the driver. The color red may have a negative psychological effect on the driver. In contrast, according to the measurement device 100 according to this embodiment, the color of the emitted light does not appear red to the driver, so the negative psychological effect of red on the driver can be reduced. As a result, it is easier to guide the driver to drive safely.
[0182] Furthermore, in a configuration in which the second light source 20b is omitted from the light-emitting device 20, the emitted light may appear red not only to the driver of the vehicle in which the measurement device 100 is installed, but also to the driver of a following vehicle. In this case, the driver of the following vehicle may mistake the emitted light for the brake lights of the vehicle ahead or a traffic light. To prevent such misidentification, it is not permitted by law to install a device that emits red-appearing light to the rear of a vehicle, excluding brake lights and turn signals.
[0183] In contrast, with the measuring device 100 according to this embodiment, the color of the emitted light is less likely to appear red to the driver, reducing the possibility that the driver of a following vehicle will mistake the emitted light for the brake lights of the vehicle ahead or a traffic light.
[0184] [Additional Notes] The above description of the embodiments discloses the following techniques.
[0185] (Technology 1) A biomeasurement device comprising: a light-emitting device including a first light source that emits first light having a wavelength longer than 650 nm, and a second light source that emits second light that includes light with a wavelength of 590 nm or less; a photodetector that detects first reflected light from a living organism that is caused by the first light; and a processing circuit that generates biometric information of the living organism based on the first reflected light, wherein at least a portion of a first light spot formed by the first light and at least a portion of a second light spot formed by the second light overlap on a light-emitting surface of the light-emitting device that is visible to the living organism.
[0186] In this bioinstrumentation device, by using irradiation light that includes not only light that appears red but also light of other colors, it is possible to make the color of the irradiation light perceived by the living body a color other than red.
[0187] (Technology 2) The bioinstrumentation device according to Technology 1, wherein the first light spot is located inside the second light spot.
[0188] In this bioinstrumentation device, the color of the portion of the light exit surface where the first light spot is located can be changed to a color other than red.
[0189] (Technology 3) The luminous flux of the first light is Φ 1 and the luminous flux of the second light is Φ 2 When this is done, Φ 2 ≧Φ 1 The bioinstrumentation device according to Technology 1 or 2, which satisfies the above.
[0190] In this bioinstrumentation device, the color of the irradiated light can be effectively changed to a color other than red.
[0191] (Technology 4) The bioinstrumentation device according to any one of Technologies 1 to 3, wherein the radiant flux of the first light is 6.65 mW or less.
[0192] This biometric measurement device can perform biometric measurements with high accuracy while maintaining eye safety.
[0193] (Technology 5) The luminance of the irradiation light including the first light and the second light is 30,000 cd / m2 The bioinstrumentation device according to any one of techniques 1 to 4, which is as follows:
[0194] In this bioinstrumentation device, the living body does not feel discomfort from the glare of the irradiated light.
[0195] (Technology 6) The bioinstrumentation device according to any one of Techniques 1 to 5, wherein an emission period of the first light and an emission period of the second light overlap.
[0196] In this bioinstrumentation device, the first light I a Since the time for irradiating the living body 10 is longer, the amount of the first reflected light detected by the photodetector 30 can be increased, thereby improving the S / N ratio.
[0197] (Technology 7) The biomeasurement device according to Technology 6, wherein a start timing of an emission period of the first light and an end timing of the emission period of the first light are included in an emission period of the second light.
[0198] In this biometric device, the first light I is emitted without allowing the living body to see the red color of the first light. a Since a large number of light pulses can be emitted as a result, it is possible to increase the amount of detected first reflected light and improve the S / N ratio.
[0199] (Technology 8) The bioinstrumentation device according to any one of Techniques 1 to 7, wherein the light emitting surface of the light emitting device diffuses the first light and the second light.
[0200] In this bioinstrumentation device, the living body can be uniformly irradiated with irradiation light including the diffused first and second lights.
[0201] (Technology 9) The bioinstrumentation device according to any one of Technologies 1 to 8, wherein the photodetector does not detect second reflected light from the living body caused by the second light.
[0202] This biometric measurement device can generate biometric information of the living body based on the first reflected light.
[0203] (Technology 10) The biological measurement device according to any one of Techniques 1 to 9, wherein the photodetector includes a band-pass filter that suppresses transmission of second reflected light from the living body due to the second light.
[0204] In this bioinstrumentation device, the photodetector has difficulty detecting the second reflected light.
[0205] (Technology 11) A biomeasurement device described in any of Technologies 1 to 10, wherein the first light is a first light pulse, the second light is a second light pulse, the first reflected light is a first reflected light pulse, and the second reflected light from the living body caused by the second light is a second reflected light pulse, and the processing circuit causes the first light source and the second light source to emit the first light pulse and the second light pulse, respectively, so that the living body is irradiated with the first light pulse and the second light pulse at different times, exposes the photodetector for at least a part of a period in which the first reflected light pulse reaches a photodetector element included in the photodetector, and stops exposure for a period in which the second reflected light pulse reaches the photodetector element.
[0206] In this bioinstrumentation device, it is possible to cause the photodetector to detect the first reflected light pulse, but not to detect the second reflected light pulse.
[0207] (Technology 12) The biomeasurement device according to any one of technologies 1 to 11, wherein the first light is an optical pulse of laser light, the spectrum of the first light has a peak, the peak has a peak wavelength of 650 nm or more and 900 nm or less, and the full width at half maximum of the peak is 10 nm or less.
[0208] In this biomeasuring device, it is possible to reduce the possibility that light of wavelengths other than the peak wavelength will be detected as noise, and to prevent a decrease in measurement accuracy.
[0209] (Technology 13) The bioinstrumentation device according to any one of techniques 1 to 12, wherein the spectrum of the second light has a peak, the peak has a peak wavelength of 300 nm or more and 590 nm or less, and the full width at half maximum of the peak is 250 nm or less.
[0210] In this bioinstrumentation device, an LED, which is less expensive than an LD, can be used as the second light source.
[0211] (Technology 14) The bioinstrumentation device according to any one of Techniques 1 to 13, wherein the second light is white light.
[0212] In this biomeasurement device, the color of the irradiated light can be made closer to white as the intensity of the second light is higher than the intensity of the first light.
[0213] (Technology 15) The biometric measurement device according to any one of technologies 1 to 14, wherein the living body is a driver driving a car, the light emitting surface of the light emitting device is within the field of view of the driver, and the processing circuit generates the biometric information based on the first reflected light from the driver's head.
[0214] This biometric measurement device can acquire biometric information of the driver while suppressing the inclusion of red, a dangerous color, in the colors perceived by the driver.
[0215] (Technology 16) A biomeasurement device described in any of Technologies 1 to 15, wherein the living body is illuminated with ambient light, and the processing circuit acquires a color image including information on a wavelength band of visible light for the living body, estimates a color of the ambient light based on the color image, and generates first color information regarding the estimated color of the ambient light, and determines whether to control the second light source to change the color of the second light based on the first color information and second color information regarding a current color of illuminated light including the first light and the second light.
[0216] This biometric device can determine whether there is a color shift between the current color of the irradiated light and the estimated color of the ambient light.
[0217] (Technology 17) The biomeasurement device according to Technology 16, wherein when the processing circuit determines to control the second light source to change the chromaticity of the second light, the processing circuit controls the second light source so that a color of the irradiated light approaches a color of the estimated ambient light.
[0218] In this biometric device, the color of the irradiated light is made closer to the color of the ambient light, thereby reducing the sense of discomfort felt by the user due to the irradiated light.
[0219] (Technology 18) A method executed by a computer, comprising: causing a first light source to emit first light having a wavelength longer than 650 nm; causing a second light source to emit second light including light with a wavelength of 590 nm or less; causing a photodetector to detect first reflected light from a living organism caused by the first light; and generating biometric information of the living organism based on the first reflected light, wherein at least a portion of a first light spot formed by the first light and at least a portion of a second light spot formed by the second light overlap on a light emitting surface of a light emitting device including the first light source and the second light source, the light emitting surface being visible to the living organism.
[0220] In this method, by using irradiated light that includes not only light that appears red but also light of other colors, it is possible to make the color of the irradiated light perceived by the living body a color other than red.
[0221] (Technology 19) A biomeasurement device comprising: a first light source that emits first light to irradiate a living organism; a second light source that emits second light to irradiate the living organism; a photodetector that detects first reflected light from the living organism caused by the first light; and a processing circuit that generates biometric information of the living organism based on the first reflected light, wherein the wavelength of the first light is longer than 650 nm, the second light includes light having a wavelength of 590 nm or less, and the photodetector does not detect the second reflected light from the living organism caused by the second light.
[0222] In this bioinstrumentation device, by using irradiation light that includes not only light that appears red but also light of other colors, it is possible to make the color of the irradiation light perceived by the living body a color other than red.
[0223] The bioinstrumentation device of the present disclosure is useful in a wide range of fields, such as non-contact cerebral blood flow measurement and vital sensing.
[0224] 10 Living organism 12 Measurement target portion 20 Light emitting device 20a First light source 20b Second light source 22a First light emitting element 22b Second light emitting element 24a First adjustment circuit 24b Second adjustment circuit 25 Collimator lens 30 Photodetector 32 Photoelectric conversion element 34 Charge accumulation unit 40 Processing circuit 50 Signal processing circuit 60 Control circuit 100 Measurement device 201 Pixel 204 First floating diffusion layer 205 Second floating diffusion layer 206 Third floating diffusion layer 207 Fourth floating diffusion layer 302 Row selection circuit 303 Column selection circuit 304 Vertical signal line 305 Source follower power supply 306 Source follower load 307 Conversion circuit 308 Row selection transistor 309 Source follower transistor 310 Reset transistor
Claims
1. A biomeasurement device comprising: a light-emitting device including a first light source that emits a first light having a wavelength longer than 650 nm, and a second light source that emits a second light including light with a wavelength of 590 nm or less; a photodetector that detects first reflected light from a living organism caused by the first light; and a processing circuit that generates biometric information of the living organism based on the first reflected light, wherein at least a portion of a first light spot formed by the first light and at least a portion of a second light spot formed by the second light overlap on the light emission surface of the light-emitting device that is visible to the living organism.
2. The bioinstrumentation device according to claim 1, wherein the first light spot is located inside the second light spot.
3. The luminous flux of the first light is Φ 1 and the luminous flux of the second light is Φ 2 Then, Φ 2 ≧Φ 1 The bioinstrumentation device according to claim 1 or 2, which satisfies the following:
4. The bioinstrumentation device according to claim 1 or 2, wherein the radiant flux of the first light is 6.65 mW or less.
5. The luminance of the irradiation light including the first light and the second light is 30000 cd / m 2 The bioinstrumentation device according to claim 1 or 2, wherein:
6. The bioinstrumentation device according to claim 1 or 2, wherein the emission period of the first light and the emission period of the second light overlap.
7. The bioinstrumentation device according to claim 6, wherein a start timing of the emission period of the first light and an end timing of the emission period of the first light are included in the emission period of the second light.
8. The bioinstrumentation device according to claim 1 or 2, wherein the light emitting surface of the light emitting device diffuses the first light and the second light.
9. The bioinstrumentation device according to claim 1 or 2, wherein the photodetector does not detect a second reflected light from the living body caused by the second light.
10. A bioinstrumentation device as described in claim 1 or 2, wherein the photodetector is provided with a bandpass filter that suppresses transmission of a second reflected light from the living body caused by the second light.
11. The biomeasurement device of claim 1 or 2, wherein the first light is a first light pulse, the second light is a second light pulse, the first reflected light is a first reflected light pulse, and the second reflected light from the living body due to the second light is a second reflected light pulse, and the processing circuit causes the first light source and the second light source to emit the first light pulse and the second light pulse, respectively, so that the living body is irradiated with the first light pulse and the second light pulse at different times, exposes the photodetector for at least a portion of a period in which the first reflected light pulse reaches a photodetector included in the photodetector, and stops exposure during a period in which the second reflected light pulse reaches the photodetector.
12. The biomeasurement device according to claim 1 or 2, wherein the first light is a light pulse of laser light, the spectrum of the first light has a peak, the peak has a peak wavelength of 650 nm or more and 900 nm or less, and the full width at half maximum of the peak is 10 nm or less.
13. The bioinstrumentation device according to claim 1 or 2, wherein the spectrum of the second light has a peak, the peak has a peak wavelength of 300 nm or more and 590 nm or less, and the full width at half maximum of the peak is 250 nm or less.
14. The bioinstrumentation device according to claim 1 or 2, wherein the second light is white light.
15. The biomeasurement device of claim 1 or 2, wherein the living body is a driver driving a car, the light emitting surface of the light emitting device is within the field of view of the driver, and the processing circuit generates the bioinformation based on the first reflected light from the driver's head.
16. A biomeasurement device as described in claim 1 or 2, wherein the living organism is illuminated with ambient light, and the processing circuit acquires a color image including information on a wavelength band of visible light for the living organism, estimates a color of the ambient light based on the color image, and generates first color information regarding the estimated color of the ambient light, and determines whether to control the second light source to change the color of the second light based on the first color information and second color information regarding a current color of the illuminated light including the first light and the second light.
17. The biomeasurement device of claim 16, wherein when the processing circuit determines to control the second light source to change the chromaticity of the second light, the processing circuit controls the second light source so that the color of the irradiated light approaches the estimated color of the ambient light.
18. A method executed by a computer, comprising: causing a first light source included in a light-emitting device to emit a first light having a wavelength longer than 650 nm; causing a second light source included in the light-emitting device to emit a second light including light with a wavelength of 590 nm or less; causing a photodetector to detect first reflected light from a living organism caused by the first light; and generating biometric information of the living organism based on the first reflected light, wherein at least a portion of a first light spot formed by the first light and at least a portion of a second light spot formed by the second light overlap on a light emission surface of the light-emitting device visible to the living organism.
Citation Information
Patent Citations
Pulse waveform detector
JP1999197126A
Portable terminal health condition examination device with camera
JP2015202208A
Pulse wave detection device
JP2017140202A
Pulse wave measurement device and pulse wave measurement method
JP2018069026A
Biological information detection device and biological information detection method
JP2018187161A
