MEASUREMENT DEVICE AND METHOD FOR CONTROLLING MEASUREMENT DEVICE - Patent application

Abstract

This measuring apparatus comprises: a light source; a sensor that includes a plurality of light detection cells including a first light detection cell and a second light detection cell; and an electronic circuit. The electronic circuit causes the light source to emit a light pulse; causes, during a first exposure period including at least a part of the period from when the strength of a reflected light pulse from an object generated due to the light pulse starts to increase to when said strength starts to decrease, the first light detection cell to detect the reflected light pulse so as to generate a first signal; and causes, during a second exposure period including at least a part of the falling period from when the strength of the reflected light pulse starts to decrease to when said strength stops decreasing, the second light detection cell to detect the reflected light pulse so as to generate a second signal. The electronic circuit generates first data exhibiting the surface state of the object on the basis of the first signal and outputs the same; and generates second data exhibiting the internal state of the object on the basis of the second signal and outputs the same.

Description

[Technical field]

[0001] The present disclosure relates to metrology instruments and methods for controlling metrology instruments. [Background technology]

[0002] Various methods for measuring biological signals resulting from brain activity of a subject have been developed. For example, Patent Document 1 discloses an example of an imaging device that acquires information showing changes in cerebral blood flow over time of a subject without contacting the subject. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-009584 A Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides a technique that makes it possible to obtain information on shallow and deep areas of a measurement target with higher time resolution than ever before. [Means for solving the problem]

[0005] A measurement device according to an embodiment of the present disclosure includes a light source that emits a first light pulse toward an object, a sensor including a plurality of light detection cells including a first light detection cell and a second light detection cell, and an electronic circuit that controls the light source and the sensor and processes a signal output from the sensor. The electronic circuit causes the light source to emit a first light pulse, causes the first light detection cell to detect the first reflected light pulse during a first exposure period including at least a portion of a period from when the intensity of a first reflected light pulse from the object caused by the first light pulse starts to increase to when it starts to decrease, thereby generating a first signal, causes the second light detection cell to detect the first reflected light pulse during a second exposure period including at least a portion of a falling period from when the intensity of the first reflected light pulse starts to decrease to when it stops decreasing, generates a second signal, generates and outputs first data indicating a surface state of the object based on the first signal, and generates and outputs second data indicating an internal state of the object based on the second signal.

[0006] A comprehensive or specific aspect of the present disclosure may be realized in a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable recording disk, or may be realized in any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. The computer-readable recording medium may include a non-volatile recording medium such as a CD-ROM (Compact Disc-Read Only Memory). An apparatus may be composed of one or more devices. When an apparatus is composed of two or more devices, the two or more devices may be arranged in one device, or may be arranged separately in two or more separate devices. In this specification and the claims, "apparatus" may mean not only one device, but also a system consisting of multiple devices. Effect of the Invention

[0007] According to the measurement device of the present disclosure, it is possible to obtain information on shallow and deep areas of a measurement target with a higher time resolution than ever before. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram showing a measurement device according to the first embodiment. [Figure 2A] FIG. 2A is a diagram showing an example in which a light emission pulse has an impulse waveform. [Figure 2B] FIG. 2B is a diagram showing an example in which the light emission pulse has a rectangular waveform. [Diagram 3] FIG. 3 is a diagram illustrating an example of the configuration of an image sensor. [Figure 4A] FIG. 4A is a diagram showing an example of an operation within one frame. [Figure 4B] FIG. 4B is a diagram showing another example of the detection operation using light of two different wavelengths. [Diagram 5] FIG. 5 is a schematic diagram for explaining the relationship between the timing of the light emission pulse and the reflected light pulse and each exposure period. [Figure 6A] FIG. 6A is a diagram showing an example of an arrangement pattern of two types of pixels having different exposure periods in an image sensor. [Figure 6B] FIG. 6B is a diagram showing another example of an arrangement pattern of two types of pixels having different exposure periods in an image sensor. [Figure 6C] FIG. 6C is a diagram showing yet another example of an arrangement pattern of two types of pixels having different exposure periods in an image sensor. [Figure 6D] FIG. 6D is a diagram showing yet another example of an arrangement pattern of two types of pixels having different exposure periods in an image sensor. [Figure 7] FIG. 7 is a flowchart showing an outline of the operation in the first embodiment. [Figure 8] FIG. 8 is a schematic diagram for explaining the relationship between the timing of the light emission pulse and the reflected light pulse and each exposure period in the first embodiment. [Figure 9A]FIG. 9A is a diagram showing an example of an arrangement pattern of three types of pixels having different exposure periods in an image sensor. [Figure 9B] FIG. 9B is a diagram showing another example of an arrangement pattern of three types of pixels having different exposure periods in an image sensor. [Figure 9C] FIG. 9C is a diagram showing still another example of an arrangement pattern of three types of pixels having different exposure periods in an image sensor. [Figure 9D] FIG. 9D is a diagram showing still another example of an arrangement pattern of three types of pixels having different exposure periods in an image sensor. [Figure 10] FIG. 10 is a flowchart showing an outline of the operation in the second embodiment. [Figure 11] FIG. 11 is a timing chart showing a modification of the second embodiment. [Figure 12] FIG. 12 is a timing chart showing another modified example of the second embodiment. [Figure 13] FIG. 13 is a diagram for explaining the principle of distance calculation. [Figure 14] FIG. 14 is a diagram showing yet another modified example. [Figure 15] FIG. 15 is a diagram showing an example of time-dependent changes in three types of images that are generated. [Figure 16] FIG. 16 is a diagram showing an example of a distance image. [Figure 17] FIG. 17 is a diagram showing a schematic flow of an operation for generating a correction value image used in the correction process. [Figure 18] FIG. 18 is a diagram illustrating a correction process using a correction value image. [Figure 19] FIG. 19 is a diagram showing a measurement operation according to still another modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, the arrangement and connection forms of the components, steps, and the order of steps shown in the following embodiments are examples and are not intended to limit the technology of the present disclosure. Among the components in the following embodiments, components that are not described in the independent claims showing the highest concept are described as optional components. Each figure is a schematic diagram and is not necessarily illustrated strictly. Furthermore, in each figure, substantially the same or similar components are given the same reference numerals. Duplicate descriptions may be omitted or simplified.

[0010] In the present disclosure, all or part of a circuit, unit, device, member or part, or all or part of a functional block in a block diagram may be implemented by one or more electronic circuits including, for example, a semiconductor device, a semiconductor integrated circuit (IC), or an LSI (large scale integration). The LSI or IC may be integrated into one chip, or may be configured by combining multiple chips. For example, functional blocks other than memory elements may be integrated into one chip. Here, although it is called an LSI or an IC, the name may change depending on the degree of integration, and it may be called a system LSI, a VLSI (very large scale integration), or an ULSI (ultra large scale integration). A Field Programmable Gate Array (FPGA), which is programmed after the manufacture of the LSI, or a reconfigurable logic device, which can reconfigure the junction relationship inside the LSI or set up the circuit partition inside the LSI, can also be used for the same purpose.

[0011] Furthermore, all or part of the functions or operations of a circuit, unit, device, member, or part can be executed by software processing. In this case, the software is recorded in one or more non-transitory recording media such as ROMs, optical disks, hard disk drives, etc., and when the software is executed by a processor, the functions specified in the software are executed by the processor and peripheral devices. The system or device may include one or more non-transitory recording media on which the software is recorded, a processor, and necessary hardware devices, such as interfaces.

[0012] First, an overview of the embodiment of the present disclosure will be described.

[0013] A measurement device according to an exemplary embodiment of the present disclosure includes a light source that emits a first light pulse toward an object, a sensor including a plurality of light detection cells including a first light detection cell and a second light detection cell, and an electronic circuit that controls the light source and the sensor and processes a signal output from the sensor. The electronic circuit performs the following operations (a) to (e): (a) The electronic circuit causes the light source to emit a first light pulse. (b) the electronic circuit generates a first signal by causing the first light detection cell to detect the first reflected light pulse during a first exposure period that includes at least a portion of a period from when an intensity of a first reflected light pulse from the object caused by the first light pulse starts to increase to when an intensity of the first reflected light pulse starts to decrease. (c) the electronic circuit causes the second photodetection cell to detect the first reflected light pulse during a second exposure period including at least a part of a falling period from when the intensity of the first reflected light pulse starts to decrease to when it stops decreasing, thereby generating a second signal. (d) The electronic circuit generates and outputs first data indicating a condition of the surface of the object based on the first signal. (e) The electronic circuit generates and outputs second data indicating an internal state of the object based on the second signal.

[0014] Here, the "object" may be a living body such as a human head. A light pulse from a light source may be emitted toward a human forehead, for example. When the light pulse is incident on the forehead, reflection or scattering occurs on the surface and inside thereof, generating a reflected light pulse. The reflected light pulse includes a surface reflection component reflected on the surface of the object and an internal scattering component scattered inside the object. The sensor receives the reflected light pulse with a first light detection cell in a first exposure period, and generates a first signal according to the amount of received light. The sensor also receives the reflected light pulse with a second light detection cell in a second exposure period, and generates a second signal according to the amount of received light. The first signal reflects the intensity of the component of light reflected or scattered near the surface of the object and returned. The second signal reflects the intensity of the component of light scattered by the deeper internal tissue of the object and returned. The electronic circuit generates first data reflecting the state of the surface of the object based on the first signal. In the following description, the first data may be referred to as "surface data". The electronic circuit also generates second data reflecting the internal state of the object based on the second signal. In the following description, the second data may be referred to as "deep data". The electronic circuit may output the first signal itself as the first data, or may output data newly generated by calculation using the first signal as the first data. Similarly, the electronic circuit may output the second signal itself as the second data, or may output a signal newly generated by calculation using the second signal as the second data. When the measurement target site is the human forehead, the second data depends on, for example, the state of human brain activity.

[0015] According to the above configuration, the sensor can detect the component of the reflected light pulse that returns relatively early with the first light detection cell, and detect the component that returns relatively late with the second light detection cell, thereby achieving higher time resolution than when these two components are detected with one light detection cell.

[0016] The second exposure period may start after the start of the falling period of the first reflected light pulse. With this configuration, information on a deeper part of an object can be obtained with higher accuracy.

[0017] The first exposure period may include at least a part of a rise period from when the intensity of the first reflected light pulse starts to increase to when the increase ends. With such a configuration, information on a surface layer of the object can be obtained with higher accuracy.

[0018] The first exposure period may end before the start of the falling period. With such a configuration, it is possible to reduce the overlap between the first exposure period and the second exposure period, so that information on the surface layer and information on the deep layer can be obtained with higher accuracy.

[0019] In this specification, the "rise period" of the light pulse refers to the period from when the intensity of the light pulse starts to increase to when it ends increasing at the position of the light receiving surface of the sensor. More precisely, the "rise period" is defined as the period from when the intensity of the light pulse exceeds a preset lower limit to when it reaches a preset upper limit. The lower limit may be set to, for example, 10% of the peak value of the intensity of the light pulse, and the upper limit may be set to, for example, 90% of the peak value. On the other hand, the "fall period" of the light pulse refers to the period from when the intensity of the light pulse starts to decrease to when it ends decreasing at the position of the light receiving surface of the sensor. More precisely, the "fall period" refers to the period from when the intensity of the light pulse falls below a preset upper limit to when it reaches a preset lower limit. For the fall period, the upper limit may be set to, for example, 90% of the peak value of the intensity of the light pulse, and the lower limit may be set to, for example, 10% of the peak value.

[0020] The plurality of photodetection cells may include a plurality of first photodetection cells including the first photodetection cell and a plurality of second photodetection cells including the second photodetection cell. In this case, the electronic circuit may perform the following operations. (b1) The electronic circuit causes each of the plurality of first photodetector cells to generate the first signal by detecting the first reflected light pulse during the first exposure period. (c1) The electronic circuit causes each of the plurality of second photodetector cells to detect the first reflected light pulse during the second exposure period to generate the second signal. (d1) The electronic circuit generates and outputs the first data based on a plurality of first signals including the first signal output from each of the plurality of first photodetection cells. (e1) The electronic circuit generates and outputs the second data based on a plurality of second signals including the second signal output from each of the plurality of second photodetection cells.

[0021] According to the above configuration, it is possible to obtain information on the surface layer and information on the deeper part of the object over a wider range.

[0022] The number of the plurality of first photodetection cells may be less than, greater than, or the same as the number of the plurality of second photodetection cells.

[0023] The sensor may be an image sensor. The plurality of photodetection cells may be arranged in a matrix. The electronic circuit may generate image data based on the plurality of first signals as the first data, and generate image data based on the plurality of second signals as the second data. With such a configuration, image data showing the state of the surface of the object and image data showing the state of the inside of the object can be output. By displaying images based on the image data on a display, the state of the surface and the inside of the object can be visualized.

[0024] The arrangement pattern of the plurality of photodetection cells arranged in a matrix may be in various forms. For example, the rows or columns of the plurality of first photodetection cells and the rows or columns of the plurality of second photodetection cells may be arranged alternately. Alternatively, the plurality of first photodetection cells and the plurality of second photodetection cells may be arranged in a checkerboard pattern.

[0025] When the object includes a human head, the first data may indicate a facial appearance in the head. The second data may indicate a state of cerebral blood flow in the head. With such a configuration, a face image and an image indicating the state of cerebral blood flow can be generated and displayed.

[0026] The plurality of light detection cells may further include a third light detection cell. The electronic circuit may further generate a third signal by causing the first light detection cell or the third light detection cell to detect the first reflected light pulse during a third exposure period different from the first exposure period and the second exposure period. The electronic circuit may further generate and output third data based on the third signal. The third data may indicate, for example, a state of scalp blood flow. According to such a configuration, it is possible to generate three types of data, for example, first data indicating the appearance of a face, second data indicating a state of cerebral blood flow, and third data indicating a state of scalp blood flow.

[0027] The electronic circuit may cause the first light detection cell to generate the third signal during the third exposure period, and generate and output data indicating a distance from the sensor to the object based on the first signal and the third signal. With such a configuration, it is possible to obtain not only surface and internal information of the object, but also distance information.

[0028] The light source may further emit a second pulse of light towards the object. The electronic circuit may further perform the following operations: (a2) The electronic circuit causes the light source to emit the first light pulse, and then causes the light source to emit the second light pulse. (b2) The electronic circuit generates a third signal by causing the first light detection cell to detect the second reflected light pulse during a third exposure period including at least a part of a falling period from when the intensity of the second reflected light pulse from the object caused by the second light pulse starts to decrease until when the decrease ends. Here, a length from the start of emission of the first light pulse to the start of the first exposure period may be different from a length from the start of emission of the second light pulse to the start of the third exposure period. (c2) The electronic circuit causes the second photodetection cell to detect the second reflected light pulse during a fourth exposure period that includes at least a portion of a falling period of the second reflected light pulse and is different from a third exposure period, thereby generating a fourth signal. (d2) The electronic circuit generates and outputs data indicating a distance from the sensor to the object based on the first signal and the third signal.

[0029] Here, the data indicating the distance may be generated as the above-mentioned "first data", or may be generated as data independent of the above-mentioned "first data".

[0030] When the object includes a human head, the electronic circuit may generate and output data indicating the psychological or physical state of the person based on the first signal and the second signal. The data may indicate, for example, the person's interest, emotion, drowsiness, concentration, or fatigue. For example, the person's psychological or physical state can be estimated by combining facial expression information indicated by the first signal and brain activity information indicated by the second signal.

[0031] When the sensor generates the third signal and the fourth signal, the electronic circuit may generate data indicating the person's psychological or physical state by using the third signal and the fourth signal in addition to the first signal and the second signal.For example, when the third signal indicates the state of scalp blood flow, the psychological or physical state can be estimated with higher accuracy by using information indicating the state of scalp blood flow in addition to information indicating the person's facial expression and cerebral blood flow.

[0032] The light source may further emit a second light pulse toward the object. The second light pulse may have a different wavelength than the first light pulse. The first exposure period may begin a first time after the start of emission of the first light pulse. The electronic circuit may further perform the following operations: (a3) The electronic circuit causes the light source to emit the first light pulse and the second light pulse during each of a first measurement period and a second measurement period. (b3) The electronic circuit generates the first signal by causing the first light detection cell to detect the first reflected light pulse during the first exposure period included in the first measurement period, and to detect a second reflected light pulse from the object caused by the second light pulse during a third exposure period that starts when a second time has elapsed from the start of emission of the second light pulse in the first measurement period. (c3) The electronic circuit causes the first photodetection cell to detect the first reflected light pulse in a fourth exposure period that starts when a third time has elapsed from the start of emission of the first light pulse in the second measurement period, and to detect the second reflected light pulse in a fifth exposure period that starts when a fourth time has elapsed from the start of emission of the second light pulse in the second measurement period, thereby generating a third signal. (d3) The electronic circuit generates data indicative of a distance from the sensor to the object based on the first signal and the third signal.

[0033] In this example, the third time may be different from the first time and the fourth time may be different from the second time.

[0034] By the above operation, data indicating the distance from the sensor to the object can be generated for every two consecutive measurement periods, as will be described later with reference to Fig. 19. If the sensor is an image sensor, the electronic circuit may repeatedly generate a distance image based on the first signal and the third signal, and an image based on the second signal. In this case, the first measurement period and the second measurement period may be referred to as a first frame period and a second frame period, respectively.

[0035] The electronic circuitry may perform the following operations: (a4) The electronic circuit causes the light source to emit one or more light pulses. (b4) The electronic circuit causes the first light detection cell in the sensor to generate a first signal by detecting a first component of one or more reflected light pulses from the living body caused by the one or more light pulses. (c4) the electronic circuit causes the second photodetector cell in the sensor to generate a second signal by detecting a second component of the one or more reflected light pulses. (d4) the electronic circuit causes the first light detection cell in the sensor to generate a third signal by detecting a third component of the one or more reflected light pulses. (e4) The electronic circuit generates first data indicating a distance from the sensor to the living body based on the first signal and the third signal. (f4) generating second data indicative of a state of blood flow in the living body based on the second signal;

[0036] Through such an operation, first data indicating distance and second data indicating the state of blood flow in the living body can be generated with high resolution.

[0037] The electronic circuit may correct the second data based on the first data. By performing such correction, blood flow information of the living body can be obtained with high accuracy even if the living body moves during measurement.

[0038] The electronic circuit may correct the second data based on data indicating a spatial distribution of illuminance of the one or more light pulses and the first data. The data indicating the spatial distribution of illuminance may be prepared in advance before measurement and stored in a storage medium. Details of a method for correcting the second data indicating a blood flow state of a living body based on the first data indicating a distance from the sensor to an object and the data indicating the spatial distribution of illuminance will be described later with reference to Figures 15 to 18.

[0039] A method according to one embodiment of the present disclosure is a method for controlling a measurement device including a light source and a sensor including a plurality of light detection cells including a first light detection cell and a second light detection cell, the method including: causing the light source to emit a light pulse; causing the first light detection cell to detect the reflected light pulse in a first exposure period including at least a portion of a period from when the intensity of a reflected light pulse from an object caused by the light pulse starts to increase to when it starts to decrease, thereby generating a first signal; causing the second light detection cell to detect the reflected light pulse in a second exposure period including at least a portion of a falling period from when the intensity of the reflected light pulse starts to decrease to when it stops decreasing, thereby generating a second signal; generating and outputting first data indicating a surface state of the object based on the first signal; and generating and outputting second data indicating an internal state of the object based on the second signal.

[0040] A method according to another aspect of the present disclosure is a method for controlling a measurement device including a light source and a sensor including a plurality of light detection cells including a first light detection cell and a second light detection cell, the method including: causing the light source to emit one or more light pulses; causing the first light detection cell to generate a first signal by detecting a first component of one or more reflected light pulses from a living body caused by the one or more light pulses; causing the second light detection cell to generate a second signal by detecting a second component of the one or more reflected light pulses; causing the first light detection cell to generate a third signal by detecting a third component of the one or more reflected light pulses; generating first data indicating a distance from the sensor to the living body based on the first signal and the third signal; and generating second data indicating a state of blood flow in the living body based on the second signal.

[0041] According to another embodiment of the present disclosure, an apparatus includes one or more processors and a storage medium storing a computer program executed by the one or more processors. The processor may execute the computer program to perform the functions of the electronic circuit in any of the above examples.

[0042] The present disclosure includes computer programs that define the functionality of the aforementioned electronic circuits, and control methods executed by the aforementioned electronic circuits.

[0043] Hereinafter, exemplary embodiments of the present disclosure will be described in more detail with reference to the drawings.

[0044] (Embodiment 1) [1. Measuring device 100] 1 is a schematic diagram showing a measurement device 100 according to a first exemplary embodiment of the present disclosure. The measurement device 100 includes a light source 110, an image sensor 120, and an electronic circuit 130. The image sensor 120 includes a plurality of photodetection cells. Each photodetection cell includes a photoelectric conversion unit 122 and one or more charge accumulation units 124. The electronic circuit 130 includes a control circuit 132, a signal processing circuit 134, and a storage medium such as a memory 136.

[0045] FIG. 1 also shows the head of a subject 50, which is the object of measurement by the measurement device 100. Note that the object is not limited to a human head. The object may be other types of living organisms, such as animals or plants other than humans. Depending on the application, the object may be an object other than a living organism. For example, the object may be a scattering object such as a liquid, gas, or food.

[0046] The measurement device 100 of this embodiment can obtain information indicating the state of scalp blood flow and cerebral blood flow of the subject 50 to be observed in a non-contact manner. The measurement device 100 may generate, for example, two-dimensional image data indicating the concentration distribution of at least one of oxygenated hemoglobin and deoxygenated hemoglobin in the brain of the subject 50. Alternatively, the measurement device 100 may generate other types of data that vary due to the brain activity of the subject 50.

[0047] The multiple photodetection cells in the image sensor 120 include a first photodetection cell and a second photodetection cell. In the following description, the photodetection cells may be referred to as "pixels", the first photodetection cell may be referred to as "first pixel P1", and the second photodetection cell may be referred to as "second pixel P2". The image sensor 120 can, for example, obtain information on the facial appearance or scalp blood flow of the subject 50 by the first photodetection cell, and obtain information on the cerebral blood flow by the second photodetection cell. The signal processing circuit 134 can execute a process with high time resolution to generate surface data indicating the facial appearance or scalp blood flow state of the subject 50 and deep data indicating the state of the cerebral blood flow.

[0048] Each component will be described in detail below.

[0049] [1-1.Light source 110] The light source 110 is disposed so as to emit light toward the head of the subject 50, for example, a target part including the forehead. The light emitted from the light source 110 and reaching the subject 50 is divided into a surface reflection component I1 reflected on the surface of the subject 50 and an internal scattering component I2 scattered inside the subject 50. The internal scattering component I2 is a component that is reflected or scattered once or multiple scattered inside the living body. When light is emitted toward the forehead of a person as in this embodiment, the internal scattering component I2 refers to a component that reaches a part about 8 mm to 16 mm deep from the surface of the forehead, for example, the brain, and returns to the measurement device 100 again. The surface reflection component I1 includes three components, a direct reflection component, a diffuse reflection component, and a diffuse reflection component. The direct reflection component is a reflection component whose incidence angle and reflection angle are equal. The diffuse reflection component is a component that is diffusely reflected due to the uneven shape of the surface. The diffuse reflection component is a component that is scattered and reflected by internal tissue near the surface. When light is emitted toward a person's head, the scattered reflection component is a component that is scattered and reflected inside the epidermis. The surface reflection component I1 may include these three components. The surface reflection component I1 and the internal scattering component I2 change their traveling direction due to reflection or scattering, and some of them reach the image sensor 120. The surface reflection component I1 includes surface information of the subject 50, for example, blood flow information of the face and scalp. The internal scattering component I2 includes internal information of the subject 50, for example, cerebral blood flow information.

[0050] In this embodiment, a surface reflection component I1 and an internal scattering component I2 are detected from the reflected light returning from the head of the subject 50. The surface reflection component I1 reflects the facial appearance or scalp blood flow state of the subject 50. Therefore, by analyzing the change over time of the surface reflection component I1, it is possible to estimate the change in the facial appearance or scalp blood flow state of the subject 50. On the other hand, the internal scattering component I2 fluctuates in intensity, reflecting the brain activity of the subject 50. Therefore, it is possible to estimate the state of the brain activity of the subject 50 by analyzing the change over time of the internal scattering component I2.

[0051] A method of acquiring the internal scattering component I2 will be described. The light source 110 repeatedly emits a light pulse multiple times at a predetermined time interval or at a predetermined timing according to an instruction from the control circuit 132. The light pulse emitted from the light source 110 may be, for example, a rectangular wave in which the length of the fall period, which is the period from the start to the end of the decrease in the intensity of the light pulse, is close to zero. In general, light incident on the head of the subject 50 propagates through the head through various paths and is emitted from the surface with a time difference. For this reason, the temporal rear end portion of the internal scattering component I2 of the light pulse has a temporal spread. When the subject is the forehead, the temporal spread of the rear end of the internal scattering component I2 is about 4 ns. Considering this, the length of the fall period, which is the period from the start to the end of the decrease in the intensity of the light pulse, may be set to, for example, 2 ns or less, which is half of the period. The fall period may be further half of the period, 1 ns or less. The length of the rise period of the light pulse emitted from the light source 110 is arbitrary. In this embodiment, the internal scattering component I2 is detected using the falling edge of the light pulse, where the intensity falls, and the rising edge of the light pulse, where the intensity rises, is not used. The rising edge of the light pulse is used to detect the surface reflection component I1.

[0052] The light source 110 may include, for example, a laser element such as a laser diode (LD). The light emitted from the laser element may be adjusted to have a steep time response characteristic in which the falling edge of the optical pulse is approximately perpendicular to the time axis. The light source 110 may include a drive circuit that controls the drive current of the LD. The drive circuit may include, for example, an enhancement mode power transistor such as a field effect transistor (GaN FET) including a gallium nitride (GaN) semiconductor. By using such a drive circuit, the falling edge of the optical pulse output from the LD can be made steep.

[0053] The wavelength of the light emitted from the light source 110 may be any wavelength within the wavelength range of, for example, 650 nm to 950 nm. This wavelength range is included in the wavelength range from red to near-infrared. The above wavelength range is called the "biological window" and has the property that light is relatively difficult to absorb by moisture and skin in a living body. When a living body is the detection target, the detection sensitivity can be increased by using light within the above wavelength range. When detecting changes in blood flow in the human brain as in this embodiment, the light used is considered to be absorbed mainly by oxygenated hemoglobin (HbO2) and deoxygenated hemoglobin (Hb). Oxygenated hemoglobin and deoxygenated hemoglobin have different wavelength dependences of light absorption. In general, when a change occurs in blood flow, the concentrations of oxygenated hemoglobin and deoxygenated hemoglobin change. The degree of light absorption also changes with this change. Therefore, when the blood flow changes, the amount of light detected also changes over time.

[0054] The light source 110 may emit light of a single wavelength included in the above wavelength range, or may emit light of two or more wavelengths. Light of multiple wavelengths may be emitted from multiple light sources, respectively.

[0055] In general, biological tissues have different absorption and scattering characteristics depending on the wavelength. Therefore, by detecting the wavelength dependency of the optical signal due to the internal scattering component I2, more detailed component analysis of the measurement target is possible. For example, in biological tissues, when the wavelength is 650 nm or more and less than 805 nm, the optical absorption coefficient of deoxygenated hemoglobin is greater than the optical absorption coefficient of oxygenated hemoglobin. When the wavelength is longer than 805 nm and less than 950 nm, the optical absorption coefficient of oxygenated hemoglobin is greater than the optical absorption coefficient of deoxygenated hemoglobin.

[0056] Therefore, the light source 110 may be configured to emit light having a wavelength of 650 nm or more and less than 805 nm (e.g., about 750 nm) and light having a wavelength longer than 805 nm and less than 950 nm (e.g., about 850 nm). In this case, the light intensity of the internal scattering component I2 due to light having a wavelength of, for example, about 750 nm and the light intensity of the internal scattering component I2 due to light having a wavelength of, for example, about 850 nm are measured. The light source 110 may include a first light-emitting element that emits light having a wavelength of 650 nm or more and less than 805 nm, and a second light-emitting element that emits light having a wavelength longer than 805 nm and less than 950 nm. The signal processing circuit 134 can calculate the change amount of each of the HbO2 and Hb concentrations in the blood from the initial value by solving a predetermined simultaneous equation based on the signal value of the light intensity input for each pixel.

[0057] In the measurement device 100 in this embodiment, the cerebral blood flow of the subject 50 is measured in a non-contact manner. For this reason, a light source 110 designed in consideration of the effect on the retina may be used. For example, a light source 110 that satisfies Class 1 of the laser safety standards established in various countries may be used. When Class 1 is satisfied, light with such low illuminance that the exposed emission limit (AEL) is below 1 mW is irradiated onto the subject 50. Note that the light source 110 itself does not have to satisfy Class 1. For example, Class 1 of the laser safety standards may be satisfied by disposing a diffusion plate or an ND filter between the light source 110 and the subject 50 to diffuse or attenuate the light.

[0058] Conventionally, streak cameras have been used to distinguish and detect information such as absorption coefficients or scattering coefficients at different locations in the depth direction inside a living body. For example, Japanese Patent Application Laid-Open No. 4-189349 discloses an example of such a streak camera. In these streak cameras, ultrashort light pulses with a pulse width of femtoseconds or picoseconds are used to measure with a desired spatial resolution.

[0059] In contrast, the measurement device 100 of this embodiment can distinguish and detect the surface reflection component I1 and the internal scattering component I2. Therefore, the light pulse emitted by the light source 110 does not need to be an ultrashort light pulse, and the pulse width can be selected arbitrarily.

[0060] When illuminating a human head with light to measure cerebral blood flow, the amount of light of the internal scattering component I2 can be an extremely small value, about one several thousandth to one several tens of thousandsth of the amount of light of the surface reflection component I1. Furthermore, considering the safety standards for lasers, the amount of light that can be irradiated is extremely small. Therefore, it is very difficult to detect the internal scattering component I2. Even in this case, if the light source 110 emits a light pulse with a relatively large pulse width, it is possible to increase the accumulated amount of the internal scattering component I2, which is accompanied by a time delay. This increases the amount of detected light and improves the signal-to-noise (SN) ratio.

[0061] 2A and 2B are diagrams showing examples of time-dependent changes in the intensity of the light emission pulse Ie, the surface reflection component I1, and the internal scattering component I2 in the reflected light pulse. FIG. 2A shows an example of each waveform when the light emission pulse Ie has an impulse waveform. FIG. 2B shows an example of each waveform when the light emission pulse Ie has a rectangular waveform. The internal scattering component I2 is actually weak, but in FIG. 2A and FIG. 2B, the intensity of the internal scattering component I2 is emphasized.

[0062] 2A, when the light emission pulse Ie has an impulse waveform, the surface reflection component I1 has an impulse waveform similar to that of the light pulse Ie, and the internal scattering component I2 has an impulse response waveform that is delayed compared to the surface reflection component I1. This is because the internal scattering component I2 corresponds to a combination of light rays that have passed through various paths inside the skin.

[0063] As shown in FIG. 2B, when the light pulse Ie has a rectangular waveform, the surface reflection component I1 has a rectangular waveform similar to that of the light pulse Ie, and the internal scattering component I2 has a waveform in which many impulse response waveforms are superimposed. The inventors confirmed that the amount of light of the internal scattering component I2 detected by the image sensor 120 can be amplified by superimposing many impulse response waveforms, compared to when the light pulse Ie has an impulse waveform. The internal scattering component I2 can be effectively detected by starting to open the electronic shutter after the timing when the intensity of the reflected light pulse starts to fall. The dashed frame in the graph on the right side of FIG. 2B represents an example of a shutter opening period in which the electronic shutter of the image sensor 120 is opened. This shutter opening period is also called an "exposure period". If the pulse width of the rectangular pulse is on the order of 1 ns to 10 ns, the light source 110 can be driven at a relatively low voltage, and the measurement device 100 can be made smaller and less expensive. In this embodiment, in order to effectively detect the internal scattering component I2, exposure is started after the timing at which the intensity of the surface reflection component I1 reaching the image sensor 120 starts to fall.

[0064] The light source 110 may include a light emitting element such as a general-purpose semiconductor laser. When a general-purpose semiconductor laser is driven at a low voltage, if the pulse width is too short, it becomes difficult to follow the driving of turning on and off the light. For this reason, the light emission waveform differs for each pulse emission, which is likely to exhibit unstable behavior and cause variation in distance measurement results. In order to obtain a stable waveform using a general-purpose semiconductor laser, the light source 110 may be controlled to emit a light pulse with a pulse width of, for example, 3 ns or more. Alternatively, for further stabilization, the light source 110 may emit a light pulse with a pulse width of 5 ns or more, or even 10 ns or more. On the other hand, if the pulse width is too large, the light outflow to the charge accumulation unit 124 at the time of shutter off, that is, parasitic light sensitivity (PLS), may increase, which may cause measurement errors. Therefore, the light source 110 may be controlled to generate a light pulse with a pulse width of, for example, 50 ns or less. Alternatively, the light source 110 may emit a light pulse with a pulse width of 30 ns or less, or even 20 ns or less.

[0065] For example, a pattern with a uniform intensity distribution in the irradiation area may be selected as the irradiation pattern of the light source 110. In this case, light can be irradiated to the subject 50 with spatially equal illuminance, and it is easy to keep the intensity of the detection signal within the dynamic range in any pixel of the image sensor 120.

[0066] [1-2.Image sensor 120] The image sensor 120 receives light emitted from the light source 110 and reflected from the subject 50. The image sensor 120 has a plurality of photodetection cells arranged two-dimensionally, and can acquire two-dimensional information of the subject 50 at once. The image sensor 120 can be any imaging element such as a CCD image sensor or a CMOS image sensor. The image sensor 120 is an example of a sensor in the present disclosure. The sensor in the present disclosure is not limited to a sensor having a plurality of photodetection cells arranged two-dimensionally, but may be a sensor having a plurality of photodetection cells arranged one-dimensionally, for example. In addition, in applications where it is sufficient to acquire information on only one point, a photodetector having a single photodetection element such as a photodetector may be used as the sensor. In that case, the technology of the present disclosure can be applied by using two adjacent photodetection elements as a "first photodetection cell" and a "second photodetection cell", respectively.

[0067] The image sensor 120 in this embodiment includes an electronic shutter. The electronic shutter is a circuit that controls the timing of exposure. The electronic shutter controls one signal accumulation period during which received light is converted into a valid electrical signal and accumulated, and a period during which signal accumulation is stopped. The signal accumulation period is called an "exposure period." The time from the end of one exposure period to the start of the next exposure period is called a "non-exposure period." Hereinafter, the exposed state may be expressed as "OPEN," and the stopped exposure state as "CLOSE."

[0068] The image sensor 120 can adjust the exposure period and non-exposure period with an accuracy of sub-nanoseconds, for example, 30 ps to 1 ns, by using an electronic shutter. Each exposure period can be set to a value of, for example, 1 ns or more and 30 ns or less.

[0069] When light is irradiated onto the forehead of the subject 50 to obtain information such as cerebral blood flow, the attenuation rate of light inside the living body is very large. For example, the outgoing light may attenuate to about one millionth of the incoming light. For this reason, the amount of light may be insufficient to detect the internal scattering component I2 with only one pulse of irradiation. The amount of light is particularly weak in the irradiation of Class 1 of the laser safety standard. In this case, the control circuit 132 causes the light source 110 to emit a light pulse multiple times, and in synchronization with this, exposes each photodetection cell of the image sensor 120 multiple times. This allows the signal to be accumulated multiple times, improving sensitivity.

[0070] An example of the configuration of the image sensor 120 will now be described.

[0071] The image sensor 120 includes a plurality of pixels arranged two-dimensionally on an imaging surface. Each pixel includes a photoelectric conversion element, such as a photodiode, and one or more charge storage units.

[0072] FIG. 3 is a diagram showing an example of the configuration of the image sensor 120. In FIG. 3, an area surrounded by a two-dot chain line frame corresponds to one pixel 201. The pixel 201 includes a photoelectric conversion element such as a photodiode (not shown). Although only eight pixels arranged in two rows and four columns are shown in FIG. 3, a larger number of pixels may be arranged in practice. Each pixel 201 includes a first floating diffusion layer 204 and a second floating diffusion layer 206 that are charge storage units. Here, the light source 110 emits a first light pulse having a wavelength of 650 nm or more and less than 805 nm, and a second light pulse having a wavelength of more than 805 nm and less than 950 nm. The first floating diffusion layer 204 accumulates charges generated by receiving a reflected light pulse by the first light pulse. The second floating diffusion layer 206 accumulates charges generated by receiving a reflected light pulse by the second light pulse. The signals accumulated in the first floating diffusion layer 204 and the second floating diffusion layer 206 are treated as if they were signals from two pixels of a general CMOS image sensor, and are output from the image sensor 120. In a configuration in which detection of a reflected light pulse by a first light pulse and detection of a reflected light pulse by a second light pulse are switched for each frame, each pixel 201 may include a single charge accumulation unit. Also, in a configuration in which the light source 110 emits light of a single wavelength, each pixel 201 may include a single charge accumulation unit. In this embodiment, one of two adjacent pixels 201 detects a surface reflection component I1 of a reflected light pulse, and the other detects an internal scattering component I2 of the reflected light pulse.

[0073] In the example shown in FIG. 3, each pixel 201 has two signal detection circuits. Each signal detection circuit includes a source follower transistor 309, a row selection transistor 308, and a reset transistor 310. Each transistor is, for example, but not limited to, a field effect transistor formed on a semiconductor substrate. As shown in the figure, one of the input terminal and the output terminal of the source follower transistor 309 is connected to one of the input terminal and the output terminal of the row selection transistor 308. The one of the input terminal and the output terminal of the source follower transistor 309 is typically a source. The one of the input terminal and the output terminal of the row selection transistor 308 is typically a drain. The gate, which is the control terminal of the source follower transistor 309, is connected to the photodiode. The signal charge by the holes or electrons generated by the photodiode is accumulated in a floating diffusion layer, which is a charge accumulation portion between the photodiode and the source follower transistor 309.

[0074] Although not shown in FIG. 3, the first floating diffusion layer 204 and the second floating diffusion layer 206 are connected to a photodiode (not shown). A switch may be provided between the photodiode and each of the first floating diffusion layer 204 and the second floating diffusion layer 206. This switch switches the conduction state between the photodiode and each of the first floating diffusion layer 204 and the second floating diffusion layer 206 in response to a control signal from the control circuit 132. This controls the start and stop of accumulation of signal charges in each of the first floating diffusion layer 204 and the second floating diffusion layer 206. The electronic shutter in this embodiment has a mechanism for such exposure control.

[0075] The signal charge accumulated in each floating diffusion layer is read out by turning on the gate of the row selection transistor 308 by the row selection circuit 302. At this time, the current flowing from the source follower power supply 305 to the source follower transistor 309 and the source follower load 306 is amplified according to the signal potential of the floating diffusion layer. An analog signal due to this current read out from the vertical signal line 304 is converted into digital signal data by an analog-digital (AD) conversion circuit 307 connected to each column. This digital signal data is read out for each column by the column selection circuit 303 and output from the image sensor 120. After reading out one row, the row selection circuit 302 and the column selection circuit 303 read out the next row, and so on in the same manner, reading out information on the signal charges of the floating diffusion layers of all rows. After reading out all the signal charges, the control circuit 132 resets all the floating diffusion layers by turning on the gate of the reset transistor 310. This completes the imaging of one frame. Similarly, high-speed imaging of frames is repeated thereafter, until imaging of a series of frames by the image sensor 120 is completed.

[0076] In this embodiment, an example of the CMOS type image sensor 120 has been described, but the image sensor 120 may be another type of imaging element. The image sensor 120 may be, for example, a CCD type, a single photon counting element, or an amplification type image sensor such as an EMCCD or ICCD. Also, instead of the image sensor 120 in which a plurality of photodetection cells are two-dimensionally arranged, a sensor in which a plurality of photodetection cells are one-dimensionally arranged may be used. Alternatively, a plurality of sensors each having a single photodetection cell may be used. When a single-pixel sensor is used, biomeasurement is possible only at one point, but high-speed measurement is possible.

[0077] 4A is a diagram showing an example of the operation within one frame. As shown in FIG. 4A, the emission of the first light pulse and the emission of the second light pulse may be alternately switched multiple times within one frame. In this way, the time difference between the acquisition timing of the detection images by the two types of wavelengths can be reduced, and even if the subject 50 is moving, it is possible to capture images by the first and second light pulses almost simultaneously.

[0078] FIG. 4B is a diagram showing another example of the detection operation using light of two kinds of wavelengths. As shown in FIG. 4B, the detection of the reflected light pulse by the first light pulse and the detection of the reflected light pulse by the second light pulse may be switched for each frame. Such an operation may be performed, for example, by switching the emission of the first light pulse and the emission of the second light pulse for each frame. In that case, each pixel 201 may have a single charge storage section. According to such a configuration, the number of charge storage sections in each pixel 201 can be reduced, so that the size of each pixel 201 can be increased and the sensitivity can be improved.

[0079] The light emitted from light source 110 may have only one wavelength. Even in this case, it is possible to estimate the approximate state of brain activity.

[0080] [1-3.Electronic circuit 130] The electronic circuit 130 includes a control circuit 132, a signal processing circuit 134, and a memory 136. The control circuit 132 adjusts the time difference between the emission timing of the light pulse from the light source 110 and the shutter timing of the image sensor 120. In this specification, the time difference is sometimes referred to as a "phase difference." The "emission timing" of the light source 110 refers to the timing at which the light pulse emitted from the light source 110 starts to rise. The "shutter timing" refers to the timing at which exposure starts.

[0081] The control circuit 132 may be configured to remove an offset component from a signal detected by each pixel of the image sensor 120. The offset component is a signal component due to ambient light such as sunlight or fluorescent light, or disturbance light. The offset component due to ambient light or disturbance light is estimated by detecting a signal by the image sensor 120 in a state in which the driving of the light source 110 is turned off and no light is emitted from the light source 110.

[0082] The control circuit 132 may be, for example, a processor such as a central processing unit (CPU), or an integrated circuit such as a microcontroller incorporating a processor and memory. The control circuit 132 adjusts the emission timing and the shutter timing, for example, by the processor executing a computer program recorded in the memory 136.

[0083] The signal processing circuit 134 is a circuit that processes the image signal output from the image sensor 120. The signal processing circuit 134 performs arithmetic processing such as image processing. The signal processing circuit 134 can be realized by, for example, a digital signal processor (DSP), a programmable logic device (PLD) such as a field programmable gate array (FPGA), a central processing unit (CPU), or an image processing arithmetic processor (GPU). The signal processing circuit 134 performs the processing described below by the processor executing a computer program stored in the memory 136.

[0084] The control circuit 132 and the signal processing circuit 134 may be integrated into one circuit, or may be separate individual circuits. The signal processing circuit 134 may be a component of an external device, such as a server installed in a remote location. In this case, the external device, such as a server, transmits and receives data to and from a measurement device including the light source 110, the image sensor 120, and the control circuit 132 by wireless or wired communication. The signal processing circuit 134 generates a superficial signal reflecting the surface reflection component I1 and a deep signal reflecting the internal scattering component I2 based on the signal output from the image sensor 120. Prior to this processing, the signal processing circuit 70 may estimate an offset component due to ambient light and remove the offset component.

[0085] [2. Example of operation] Next, an example of the operation of this embodiment will be described.

[0086] In this embodiment, the pixels in the image sensor 120 include a plurality of first pixels P1 and a plurality of second pixels P2. The control circuit 132 causes each of the first pixels P1 to detect a temporal leading end portion of the reflected light pulse in the first exposure period. The control circuit 132 also causes each of the second pixels P2 to detect a temporal trailing end portion of the reflected light pulse in the second exposure period. Here, "detecting the leading end portion" means detecting at least a part of the component of the reflected light pulse in the rising period. On the other hand, "detecting the trailing end portion" means detecting at least a part of the component of the reflected light pulse in the falling period. As a result, the first pixel P1 acquires information on a relatively shallow part of the head, and the second pixel P2 acquires information on a relatively deep part of the head. With this configuration, a biosignal can be generated with a higher time resolution than when information on the shallow part and information on the deep part are acquired with one pixel.

[0087] FIG. 5 is a schematic diagram for explaining the relationship between the timing of the light emission pulse and the reflected light pulse and the first exposure period and the second exposure period. Part (a) of FIG. 5 shows an example of the waveform of the light emission pulse from the light source 110. Part (b) of FIG. 5 shows an example of the waveform of the reflected light pulse that reaches the image sensor 120. Part (c) of FIG. 5 shows an example of the first exposure period during which the shutter of the first pixel P1 is opened. Part (d) of FIG. 5 shows an example of the second exposure period during which the shutter of the second pixel P2 is opened.

[0088] The timing at which the reflected light pulse starts rising is later than the timing at which the light emission pulse of the light source 110 starts rising. The timing at which the reflected light pulse starts rising varies depending on the distance between the subject 50 and the image sensor 120. The intensity during the falling period of the reflected light pulse gradually decreases due to the superposition of the impulse response waveform as described above. The later the shutter timing, the higher the proportion of the internal scattering component I2 contained in the entire acquired signal. The internal scattering component I2 mainly contains the scalp blood flow component I2-1 containing a lot of information on the scalp blood flow in the shallow part of the forehead and the cerebral blood flow component I2-2 containing a lot of information on the cerebral blood flow in the deep part of the forehead. In this embodiment, as shown in parts (c) and (d) of FIG. 5, the pixel P1 is exposed in a phase containing a lot of the scalp blood flow component I2-1, and the pixel P2 is exposed in a phase containing a lot of the cerebral blood flow component I2-2.

[0089] In this embodiment, after the first exposure period ends, the second exposure period starts. The first exposure period is set to include at least a part of the rising period of the reflected light pulse that reaches the image sensor 120 when the object is located at a preset distance from the measurement device 100. The first exposure period may be set to include the entire rising period of the reflected light pulse, or may be set to include only a part of the rising period. The first exposure period may be set to start, for example, before the end of the rising period of the reflected light pulse and to end before the start of the falling period. The second exposure period is set to include at least a part of the falling period of the reflected light pulse that reaches the image sensor 120 when the object is located at a preset distance from the measurement device 100. The second exposure period may be set to start, for example, after the start of the falling period of the reflected light pulse and before the end of the falling period. The first exposure period and the second exposure period may partially overlap.

[0090] 6A to 6D are diagrams showing examples of arrangement patterns of first pixels P1 and second pixels P2, which are two types of pixels having different exposure periods in the image sensor 120. By changing the arrangement pattern, it is possible to obtain optimal information depending on the purpose of the measurement.

[0091] FIG. 6A shows an example of an array pattern in which rows of first pixels P1 and rows of second pixels P2 are alternately arranged. In this case, the phase of the exposure period differs between the even-numbered rows and the odd-numbered rows. This array is useful when it is desired to capture abrupt changes in the lateral direction. For example, the array of FIG. 6A is effective when it is desired to compare the difference in signals between the left and right sides of the forehead, such as when it is desired to detect an event in which the left brain is activated but the right brain does not change.

[0092] FIG. 6B shows an example of an array pattern in which columns of first pixels P1 and columns of second pixels P2 are arranged alternately. In this case, the phase of the exposure period differs between the even-numbered columns and the odd-numbered columns. This array is useful when capturing steep changes in the vertical direction. For example, the array of FIG. 6B is effective when comparing the difference in signals above and below the forehead, such as when detecting an event in which the cerebral blood flow and the skin blood flow of a part of the face change in different trends.

[0093] 6C shows an example in which a plurality of first pixels P1 and a plurality of second pixels P2 are arranged in a checkerboard pattern, which allows signals from the entire forehead to be evaluated equally in both the up-down and left-right directions.

[0094] The arrangement pattern of the pixels P1 and P2 may be a repeating pattern in which a pixel block of N rows and M columns (N and M are any natural numbers) constitutes a constituent unit. For example, a repeating pattern in which pixels of 2 rows and 2 columns constitute a constituent unit as shown in FIG. 6D may be adopted. In the example of FIG. 6D, the number of second pixels P2 is three times the number of first pixels P1. As described above, the signal of the internal scattering component I2 is weak. For this reason, the number of second pixels P2 is made greater than the number of first pixels P1, and the signal value of the second pixels P2 is averaged to improve the signal-to-noise ratio.

[0095] 6D, the first pixel P1 and the second pixel P2 may be interchanged. In that case, the number of the first pixels P1 is greater than the number of the second pixels P2. The first pixels P1 contain a lot of surface information of the subject 50, such as the appearance of the face, and therefore can improve the accuracy of processing such as analysis of facial expression or gaze, or estimation of the magnitude or speed of body movement.

[0096] FIG. 7 is a flowchart showing an outline of the operation of the electronic circuit 130 in this embodiment. For simplicity, it is assumed that the light source 110 emits light of one wavelength. The control circuit 132 first causes the light source 110 to emit a light pulse for a predetermined time (step S101). The control circuit 132 causes the image sensor 120 to start charge accumulation in each of the first pixels P1 at a first timing (step S102). Next, the control circuit 132 causes the image sensor 120 to stop charge accumulation in each of the first pixels P1 at a second timing (step S103). The period from the first timing to the second timing is the first exposure period. By the operations of steps S102 and S103, charges corresponding to the intensity of the front end portion of the reflected light pulse are accumulated in each of the first pixels P1. Next, the control circuit 132 causes the image sensor 120 to start charge accumulation in each of the second pixels P2 at a third timing (step S104). Next, the control circuit 132 causes the image sensor 120 to stop accumulating charge in each of the second pixels P2 at the fourth timing (step S105). The period from the third timing to the fourth timing is the second exposure period. By the operations of steps S104 and S105, charge corresponding to the intensity of the trailing edge portion of the reflected light pulse is accumulated in each of the second pixels P2.

[0097] Next, the control circuit 132 judges whether the number of times the charge accumulation has been performed reaches a predetermined number (step S106). If this judgment is No, the operations of steps S101 to S105 are repeated until it is judged as Yes. If it is judged as Yes in step S106, the signal processing circuit 134 reads out the signal of the charge accumulated in each pixel of the image sensor 120. The signal processing circuit 134 generates and outputs a first intensity map based on the charges accumulated in the first pixels P1 and a second intensity map based on the charges accumulated in the second pixels P2 (step S107).

[0098] In step S107, the signal processing circuit 134 generates image data for each intensity map by extracting and integrating data of the same type of pixel from the image data acquired by the image sensor 120 based on the array patterns exemplified in FIGS. 6A to 6D. Specifically, the signal processing circuit 134 extracts only the data of the first pixel P1 from the acquired image data to generate the first intensity map, and extracts only the data of the second pixel P2 to generate the second intensity map. For example, in the example of FIG. 6A, the first intensity map is generated from the data of the first pixel P1 in the odd row, and the second intensity map is generated from the data of the second pixel P2 in the even row. At this time, pixels without data may be interpolated based on the data of the surrounding pixels. The first intensity map is an example of surface data, and may be, for example, image data showing the appearance of the face of the subject 50 or the distribution of scalp blood flow. The second intensity map is an example of deep data, and may be, for example, image data showing the distribution of cerebral blood flow of the subject 50. The signal processing circuit 134 may remove artifacts of scalp blood flow components by performing a calculation to separate the characteristics of the intensity map of the superficial layer from the characteristics of the intensity map of the deep layer. This processing allows information on the time-dependent changes in the cerebral blood flow of the subject 50 to be acquired with high accuracy and high time resolution.

[0099] An example of a calculation for separating the characteristics of the intensity map of the superficial layer from the characteristics of the intensity map of the deep layer will be described below. Here, an example will be described in which the charge accumulation operations of steps S101 to S106 are performed for each of a first light pulse having a wavelength of 650 nm or more and less than 805 nm, and a second light pulse having a wavelength of more than 805 nm and less than 950 nm. In this case, each pixel in each of the first intensity map and the second intensity map has a value of the reflected light intensity by the first light pulse (hereinafter referred to as the "first value") and a value of the reflected light intensity by the second light pulse (hereinafter referred to as the "second value"). The signal processing circuit 134 calculates the amount of change from the initial value of the concentration of oxygenated hemoglobin (HbO2) and deoxygenated hemoglobin (Hb) from each intensity map. Specifically, the signal processing circuit 134 calculates the change amount Δ[HbO2]_surface from the initial value of the HbO2 concentration in the superficial layer and the change amount Δ[Hb]_surface from the initial value of the Hb concentration in the superficial layer by solving a predetermined simultaneous equation using the first value and the second value of each pixel in the first intensity map. Similarly, the signal processing circuit 134 calculates the change amount Δ[HbO2]_deep from the initial value of the HbO2 concentration in the deep layer and the change amount Δ[Hb]_deep from the initial value of the Hb concentration in the deep layer by solving a predetermined simultaneous equation using the first value and the second value of each pixel in the second intensity map. The signal processing circuit 134 calculates the change amount Δ[HbO2]_cerebral blood flow and Δ[Hb]_cerebral blood flow of the respective concentrations of HbO2 and Hb in the cerebral blood flow from their initial values ​​by the following calculation formula. Δ[HbO2]_Cerebral blood flow = Δ[HbO2]_Deep - kΔ[HbO2]_Superficial Δ[Hb]_Cerebral blood flow = Δ[Hb]_Deep - kΔ[Hb]_Superficial Here, the coefficient k is a known value calculated in advance using a human model (phantom). The coefficient k is the ratio of the "magnitude of the deep scalp blood flow component" to the "magnitude of the superficial scalp blood flow component." In other words, k = (magnitude of the deep scalp blood flow component) / (magnitude of the superficial scalp blood flow component).

[0100] 7, two types of image data, one for the surface layer and one for the deep layer, can be generated for each frame. The electronic circuit 130 may generate moving image data by repeating this series of operations multiple times. Note that multiple light emission and charge accumulation are not essential and are performed as necessary.

[0101] The signal processing circuit 134 in this embodiment can generate moving image data showing a time-dependent change in cerebral blood flow and moving image data showing a time-dependent change in facial appearance based on image data output from the image sensor 120 for each frame. The signal processing circuit 134 is not limited to such moving image data, and may generate other information. For example, by synchronizing with other devices, biological information such as blood flow rate, blood pressure, blood oxygen saturation, or heart rate in the brain may be generated. In addition, biological information such as skin blood flow rate, heart rate, or sweat rate may be generated based on the surface reflection component I1 detected by each pixel included in the image sensor 120.

[0102] It is known that there is a close relationship between changes in blood components such as cerebral blood flow or hemoglobin and human neural activity. For example, changes in neural cell activity according to a person's interest level cause changes in cerebral blood flow or blood components. Therefore, if biological information such as cerebral blood flow or facial appearance information can be measured, the user's psychological state or physical state can be estimated. The user's psychological state can be, for example, mood, emotion, health state, or temperature sensation. The mood can include, for example, a pleasant or unpleasant mood. The emotion can include, for example, a feeling of relief, anxiety, sadness, or anger. The health state can include, for example, a state of vitality or fatigue. The temperature sensation can include, for example, a feeling of hot, cold, or muggy. Derived from these, indicators that represent the degree of brain activity, such as interest level, proficiency level, mastery level, and concentration level, can also be included in the psychological state. In addition, physical states such as fatigue level, drowsiness, or the degree of intoxication due to drinking are also included in the subject of estimation by the signal processing circuit 134. The signal processing circuit 134 can estimate the user's psychological or physical state based on at least one of changes in cerebral blood flow state, changes in scalp blood flow state, and changes in facial appearance, and output a signal indicating the estimation result.

[0103] (Embodiment 2) Next, a second exemplary embodiment of the present disclosure will be described. In this embodiment, the pixels of the image sensor 120 include three types of pixels, a first pixel P1, a second pixel P2, and a third pixel P3. Different exposure periods are set for the first pixel P1, the second pixel P2, and the third pixel P3. According to this embodiment, information on the appearance, scalp blood flow, and time-dependent changes in cerebral blood flow of the subject 50 can be obtained with high time resolution.

[0104] The following description will focus on the differences from the first embodiment, and overlapping points will not be described.

[0105] FIG. 8 is a schematic diagram for explaining the relationship between the timing of the light emission pulse and the reflected light pulse in this embodiment and the first to third exposure periods. Part (a) of FIG. 8 shows an example of the waveform of the light emission pulse from the light source 110. Part (b) of FIG. 8 shows an example of the waveform of the reflected light pulse reaching the image sensor 120. Part (c) of FIG. 8 shows an example of the first exposure period during which the shutter of the first pixel P1 is opened. Part (d) of FIG. 8 shows an example of the second exposure period during which the shutter of the second pixel P2 is opened. Part (e) of FIG. 8 shows an example of the third exposure period during which the shutter of the third pixel P3 is opened.

[0106] The first pixel P1 is exposed to a phase that contains a large surface reflection component I1, the second pixel P2 is exposed to a phase that contains a large cerebral blood flow component I2-2, and the third pixel P3 is exposed to a phase that contains a large scalp blood flow component I2-1.

[0107] 9A to 9D are diagrams showing examples of arrangement patterns of a first pixel P1, a second pixel P2, and a third pixel P3, which are three types of pixels having different exposure periods in the image sensor 120. In this embodiment as well, by changing the arrangement pattern, optimal information can be obtained depending on the purpose of the measurement.

[0108] 9A shows an example of an array pattern in which a row of a first pixel P1, a row of a second pixel P2, and a row of a third pixel P3 are repeated in sequence. This array is useful when it is desired to capture a steep change in the lateral direction. For example, the array of FIG. 9A is effective when it is desired to compare the difference between the left and right signals of the forehead, such as when it is desired to detect an event in which the left brain is activated but the right brain does not change.

[0109] FIG. 9B shows an example of an array pattern in which a row of first pixels P1, a row of second pixels P2, and a row of third pixels P3 are repeated in sequence. This array is useful when it is desired to capture a steep change in the vertical direction. For example, the array of FIG. 9B is effective when it is desired to compare the difference in signals above and below the forehead, such as when it is desired to detect an event in which the cerebral blood flow and the skin blood flow of a part of the face change in different trends.

[0110] 9C shows an example in which a plurality of first pixels P1, a plurality of second pixels P2, and a plurality of third pixels P3 are arranged in a checkerboard pattern, which allows the signals of the entire forehead to be evaluated equally in both the up-down and left-right directions.

[0111] As shown in FIG. 9D, the arrangement pattern of the first pixel P1, the second pixel P2, and the third pixel P3 may be a repeating pattern in which a pixel block of N rows by M columns (N and M are any natural numbers) is used as a constituent unit.

[0112] FIG. 10 is a flowchart showing an outline of the operation of the electronic circuit 130 in the second embodiment. For simplicity, an example in which one type of light wavelength is used will be described. The control circuit 132 first causes the light source 110 to emit a light pulse for a predetermined time (step S201). The control circuit 132 causes the image sensor 120 to start charge accumulation in each of the first pixels P1 (step S202). Next, the control circuit 132 causes the image sensor 120 to start charge accumulation in each of the third pixels P3 (step S203). When a time equivalent to the first exposure period has elapsed since step S202, the control circuit 132 causes the image sensor 120 to stop charge accumulation in each of the first pixels P1 (step S204). When a time equivalent to the third exposure period has elapsed since step S203, the control circuit 132 causes the image sensor 120 to stop charge accumulation in each of the third pixels P3 (step S205). After a predetermined time has elapsed since step S204, the control circuit 132 causes the image sensor 120 to start accumulating charges in each of the second pixels P2 (step S206). When a time equivalent to the second exposure period has elapsed since step S206, the control circuit 132 causes the image sensor 120 to stop accumulating charges in each of the second pixels P2 (step S207).

[0113] Next, the control circuit 132 judges whether the number of times the charge accumulation has been performed reaches a predetermined number (step S208). If this judgment is No, the operations of steps S201 to S207 are repeated until it is judged as Yes. If it is judged as Yes in step S208, the signal processing circuit 134 reads out the signal of the charge accumulated in each pixel of the image sensor 120. The signal processing circuit 134 generates and outputs a first intensity map based on the charges accumulated in the first pixels P1, a second intensity map based on the charges accumulated in the second pixels P2, and a third intensity map based on the charges accumulated in the third pixels P3 (step S209).

[0114] 10, three types of image data can be generated for each frame, each of which reflects the intensity distribution of the surface reflection component I1, the scalp blood flow component I2-1, and the cerebral blood flow component I2-2. The electronic circuit 130 may generate moving image data by repeating this series of operations multiple times. Note that, in this embodiment, multiple light emission and charge accumulation are not essential and are performed as necessary.

[0115] As described above, according to this embodiment, appearance information, scalp blood flow information, and cerebral blood flow information can be obtained with high time resolution.

[0116] In the examples of Figures 8 and 10, the third exposure period starts before the first exposure period ends. This is not limited to the example, and for example, the third exposure period may start after the first exposure period ends. In addition, the third exposure period and the second exposure period may partially overlap each other.

[0117] FIG. 11 is a timing chart showing a modified example of this embodiment. In this modified example, the third pixel P3 is not provided, and the first pixel P1 is exposed in the first exposure period and the third exposure period. For this reason, each first pixel P1 has a plurality of charge storage units, as in the example shown in FIG. 3. The first exposure period and the third exposure period are respectively assigned to the first charge storage unit and the second charge storage unit in each first pixel P1. This allows three types of biosignals to be acquired using two types of pixels. In this case, the arrangement of the first pixel P1 and the second pixel P2 may be, for example, any of the arrangements shown in FIG. 6A to FIG. 6D. Measurement can be performed with a higher spatial resolution than when three types of pixels are set.

[0118] FIG. 12 is a timing chart showing still another modification of the present embodiment. In this example, unlike the example of FIG. 11, the third exposure period starts immediately before the start of the falling period of the reflected light pulse. The first exposure period starts before the start of the rising period of the reflected light pulse and ends immediately after the end of the rising period, as in the example of FIG. 11. The signal processing circuit 134 in this example generates and outputs data indicating the distance from the image sensor 120 to the subject 50 based on a first signal based on the charge accumulated in the first charge accumulation unit of the first pixel P1 during the first exposure period and a third signal based on the charge accumulated in the second charge accumulation unit of the first pixel P1 during the third exposure period.

[0119] FIG. 13 is a diagram for explaining the principle of distance calculation. FIG. 13 illustrates a light emission pulse Ie, a reflected light pulse Ir, a first exposure period, a second exposure period, and a third exposure period. Let the time widths of the light emission pulse and the reflected light pulse be T0. Let the time from when the light source 110 starts emitting the light pulse until the end of the first exposure period be t1, and the time from when the light source 110 starts emitting the light pulse until the start of the third exposure period be t2. In this example, 0 < t2 - t1 < T0 holds. During the first exposure period, the charge generated by the exposure of the front end portion of the reflected light pulse is accumulated. On the other hand, during the third exposure period, the charge generated by the exposure of the rear end portion of the reflected light pulse is accumulated. Let the signal indicating the amount of charge accumulated during the first exposure period be S1, and the signal indicating the amount of charge accumulated during the third exposure period be S3. The intensities of the signals S1 and S3 each vary according to the distance z between the subject 50 and the image sensor 120. The distance z can be calculated using the following (Equation 1).

Equation

[0120] Based on (Equation 1), the signal processing circuit 134 can obtain the distance z from the signals S1 and S3.

[0121] FIG. 14 is a diagram showing yet another modified example. In this example, the control circuit 132 causes the light source 110 to emit a first light pulse 141 and then emits a second light pulse 142. For the first reflected light 143 caused by the first light pulse 141, charges are accumulated in the first charge accumulation section of each first pixel P1 during the first exposure period, and charges are accumulated in the charge accumulation section of each second pixel P2 during the second exposure period. As a result, a signal S1 is output from the first charge accumulation section of each first pixel P1, and a signal S2 is output from the charge accumulation section of each second pixel P2. For the second reflected light 144 caused by the second light pulse 142, charges are accumulated in the second charge accumulation section of each first pixel P1 during the third exposure period, and charges are accumulated in the charge accumulation section of each second pixel P2 during the fourth exposure period. As a result, a signal S3 is output from the second charge storage section of each first pixel P1, and a signal S2 is output from the charge storage section of each second pixel P2. Here, a length ta from the start of emission of the first light pulse 141 to the start of the first exposure period is shorter than a length tb from the start of emission of the second light pulse 142 to the start of the third exposure period. The signal processing circuit 134 generates and outputs data indicating a distance z from the image sensor 120 to the object from the signals S1 and S3 based on the above (Equation 1).

[0122] The method shown in FIG. 13 or FIG. 14 allows the distance from the image sensor 120 to the object to be calculated for each pixel. The electronic circuit 130 can generate moving image data showing the time-dependent changes in two-dimensional distance distribution and cerebral blood flow distribution by continuously repeating the operation of acquiring distance information and cerebral blood flow information for each pixel. The electronic circuit 130 can adjust the timing of the first to fourth exposure periods in the next measurement for each pixel based on the distance information for each pixel acquired by each measurement. Such adjustment allows the signal of cerebral blood flow to be acquired with higher accuracy.

[0123] The electronic circuit 130 may correct the cerebral blood flow information using the distance information acquired by the above method. The light emitted from the light source 110 has a unique illuminance distribution according to the characteristics of the light source 110. The level of the acquired cerebral blood flow signal varies depending on the position of the measurement point depending on the spatial illuminance distribution of the light emitted by the light source 110. In addition, if the subject 50 moves while the measurement device 100 is repeatedly acquiring the cerebral blood flow signal of the subject 50, the distance from the measurement device 100 to the measurement point varies, and the level of the acquired cerebral blood flow signal varies. In order to obtain good measurement results, it is important to suppress the influence of this variation. Therefore, the electronic circuit 130 can perform distance measurement in parallel with the cerebral blood flow measurement, and correct the cerebral blood flow signal at each measurement point based on the distance from the measurement device 100 to each measurement point measured.

[0124] The operation of correcting the cerebral blood flow signal based on the distance will be described below with reference to Figures 15 to 17. In this specification, the "cerebral blood flow signal" means a signal indicating the state of the subject's cerebral blood flow, and is a signal indicating the intensity of the internal scattering component of light from the measured area, or a signal generated by processing that signal.

[0125] FIG. 15 is a diagram showing an example of time changes of three types of images generated by the electronic circuit 130. In this example, the electronic circuit 130 repeats the operation of generating the three types of images shown in FIG. 15, a first image (a), a third image (b), and a second image (c), by executing the operation shown in FIG. 13 or FIG. 14. FIG. 15 shows three types of images in an initial frame and three types of images in a current frame. Over time, the subject 50 moves (i.e., moves his / her body) and the blood flow in the scalp and brain fluctuates, and these influences may cause fluctuations in the luminance distribution of each image.

[0126] In the example shown in FIG. 15, the control circuit 132 in the electronic circuit 130 causes two types of pixels (i.e., the first pixel P1 and the second pixel P2) in the image sensor 120 to perform exposure in three types of exposure periods shown in FIG. 13 or FIG. 14. The pixel arrangement may be, for example, any of those shown in FIG. 6A to FIG. 6D. The signal processing circuit 134 in the electronic circuit 130 extracts the signal of the first charge storage unit of each first pixel P1, the signal of the second charge storage unit of each first pixel P1, and the signal of the charge storage unit of each second pixel P2 from the signal acquired from the image sensor 120, and generates a first image (a), a third image (b), and a second image (c) based on those signals. The first charge storage unit of each first pixel P1 detects the front end portion of the reflected light pulse in the first exposure period and generates a first signal. The signal processing circuit 134 generates a first image (a) based on those first signals. The second charge accumulation unit of each first pixel P1 detects the components from immediately before the start of the falling period of the reflected light pulse to the end of the falling period during the third exposure period, and generates a third signal. The signal processing circuit 134 generates a third image (b) based on the third signals. The charge accumulation unit of each second pixel P2 detects the trailing end portion of the reflected light pulse during the second exposure period, and generates a second signal. The signal processing circuit 134 generates a second image (c) based on the second signals. The second image (c) shows a two-dimensional distribution of internally scattered components scattered in the brain blood of the subject 50.

[0127] The signal processing circuit 134 calculates the distance for each pixel by performing the calculation shown in (Equation 1) above from the first signal and the third signal for each pixel. The signal processing circuit 134 generates a distance image based on the calculated distance for each pixel. Furthermore, the signal processing circuit 134 corrects the second image (c) based on the distance image.

[0128] 16 is a diagram showing a schematic example of a distance image generated based on a first image (a) and a third image (b). The signal processing circuit 134 corrects the second image (c) based on such a distance image. More specifically, the signal processing circuit 134 generates a correction value image for correcting the second image (c) based on the distance image and data indicating the illuminance distribution of the light source 110 prepared in advance. The signal processing circuit 134 uses the correction value image to perform correction to remove the influence of body movement from the second image (c).

[0129] 17 is a diagram showing a schematic flow of an operation for generating a correction value image used in the correction process by the signal processing circuit 134. For the correction, information indicating the illuminance distribution of the light source 110 acquired in advance by calibration is used. The calibration is performed before measuring the subject 50. The information indicating the illuminance distribution represents the spatial illuminance distribution of the light emitted by the light source 110, and is given by the following (Equation 2).

number

[0130] The signal processing circuit 134 can generate a correction value image as shown in the lower right of FIG. 17 by inputting distance image information acquired from the subject 50 by the above-mentioned method into the function of (Equation 2).

[0131] 18 is a diagram showing a schematic diagram of a process of correcting the second image (c) using the correction value image. The signal processing circuit 134 corrects the second image (c) by dividing the value of each pixel of the second image (c) by the value of the corresponding pixel in the correction value image. This process can eliminate the influence of the luminance fluctuation of the second image (c) caused by the illuminance distribution of the light source 110. The above measurement and calculation process can suppress the influence of body movement even if the body movement occurs, and can clearly capture the region 52 where the cerebral blood flow changes.

[0132] As described above, by acquiring different information from multiple pixels within the same frame, the influence of brightness fluctuations caused by the body movements of the subject 50 can be suppressed, and the state of a person's cerebral blood flow can be acquired with high time resolution and high accuracy.

[0133] Next, still another modified example of the measurement operation by the measurement device 100 will be described.

[0134] FIG. 19 is a diagram showing a measurement operation according to another modified example. FIG. 19 is a timing chart showing the relationship between two types of light emission pulses and reflected light pulses with different wavelengths in this modified example and the respective exposure periods of the two charge accumulation units in each of the first pixel P1 and the second pixel P2. In this modified example, similar to the example shown in FIG. 4A, within the period of each frame, emission of a first light pulse having a first wavelength of 650 nm or more and less than 805 nm and emission of a second light pulse having a second wavelength of more than 805 nm and less than 950 nm are alternately repeated. The operations of the first frame and the second frame shown in FIG. 19 are alternately repeated at a predetermined frame rate. In this embodiment, the exposure periods of the two charge accumulation units in each first pixel P1 are different between the first frame and the second frame. In the first frame, the first charge accumulation unit and the second charge accumulation unit in each first pixel P1 are controlled to be exposed in the exposure period in which the front end portions of the reflected light pulses of the first wavelength and the second wavelength are detected, respectively. The exposure period starts before the start of the rising period of the reflected light pulse and ends immediately after the end of the rising period. On the other hand, in the second frame, the first charge storage unit and the second charge storage unit in each first pixel P1 are controlled to be exposed during the exposure period in which the components including the trailing end portions of the reflected light pulses of the first and second wavelengths are detected. The exposure period starts immediately before the start of the falling period of the reflected light pulse and ends during or after the falling period. In both frames, the first charge storage unit and the second charge storage unit in each second pixel P2 are controlled to be exposed during the exposure period in which the trailing end portions of the reflected light pulses of the first and second wavelengths are detected. The exposure period starts after the start of the falling period of the reflected light pulse and ends after the falling period.

[0135] In the example of FIG. 19, the period during which the measurement operation of the first frame is performed is referred to as the "first measurement period", and the period during which the measurement operation of the second frame is performed is referred to as the "second measurement period". In the first measurement period, the exposure period of the first charge storage unit of the first pixel P1 is referred to as the "first exposure period", and the exposure period of the second charge storage unit of the first pixel P1 is referred to as the "third exposure period". In the second measurement period, the exposure period of the first charge storage unit of the first pixel P1 is referred to as the "fourth exposure period", and the exposure period of the second charge storage unit of the first pixel P1 is referred to as the "fifth exposure period". In each measurement period, each exposure period of each charge storage unit of the second pixel is referred to as the "second exposure period". The first exposure period starts when a first time t1 has elapsed from the emission time of the first light pulse in the first measurement period. The third exposure period starts when a second time t2 has passed since the emission of the second light pulse in the first measurement period. The fourth exposure period starts when a third time t3 has passed since the emission of the first light pulse in the second measurement period. The fifth exposure period starts when a fourth time t4 has passed since the emission of the second light pulse in the second measurement period. The third time t3 is different from the first time t1, and the fourth time t4 is different from the second time t2. In the example of FIG. 19, the first time t1 and the second time t2 are equal, and the third time t3 and the fourth time t4 are equal. The first time t1 and the second time t2 may be different, and the third time t3 and the fourth time t4 may be different.

[0136] The signal processing circuit 134 can obtain the distance from the measuring device 100 to the measurement point corresponding to the pixel by performing the calculation based on the above (Equation 1) based on the signal of the first charge storage unit of each first pixel acquired in the first exposure period and the fourth exposure period, and / or the signal of the second charge storage unit of each first pixel acquired in the third exposure period and the fifth exposure period. Furthermore, the signal processing circuit 134 generates cerebral blood flow information indicating the state of cerebral blood flow based on the signal of the first charge storage unit and the second charge storage unit of each second pixel acquired in the second exposure period. The signal processing circuit 134 may correct the cerebral blood flow information based on the distance information by the above-mentioned method.

[0137] By performing measurements at the exposure timing of this modification, the time difference between the acquisition timing of the images at each wavelength is shortened, and information on two types of wavelengths can be acquired with high time resolution, making it possible to capture more subtle changes in cerebral blood flow. [Industrial Applicability]

[0138] The measuring device according to the present disclosure is capable of performing measurements non-contact and with high time resolution, and is therefore particularly useful for biosensing of humans. [Explanation of symbols]

[0139] 50 Target 100 Measuring Equipment 110 Light source 120 Image Sensor 122 Photoelectric conversion unit 124 Charge storage section 130 Electronic circuits 132 Control circuit 134 Signal Processing Circuit

Claims

1. a light source that emits a first light pulse toward an object; a sensor including a plurality of light detection cells including a first light detection cell and a second light detection cell; an electronic circuit for controlling the light source and the sensor and for processing a signal output by the sensor; Equipped with The electronic circuit includes: causing the light source to emit a first light pulse; generating a first signal by causing the first light detection cell to detect the first reflected light pulse during a first exposure period including at least a part of a period from when an intensity of a first reflected light pulse from the object caused by the first light pulse starts to increase to when an intensity of the first reflected light pulse starts to decrease; generating a second signal by causing the second photodetector cell to detect the first reflected light pulse during a second exposure period including at least a part of a falling period from when the intensity of the first reflected light pulse starts to decrease until when the intensity of the first reflected light pulse ends to decrease; generating and outputting first data indicative of a surface condition of the object based on the first signal; generating and outputting second data indicating an internal state of the object based on the second signal; Measuring equipment.

2. the plurality of photodetection cells include a plurality of first photodetection cells including the first photodetection cell and a plurality of second photodetection cells including the second photodetection cell; The electronic circuit includes: causing each of the plurality of first photodetection cells to detect the first reflected light pulse during the first exposure period to generate the first signal; causing each of the plurality of second photodetection cells to detect the first reflected light pulse during the second exposure period to generate the second signal; generating and outputting the first data based on a plurality of first signals including the first signal output from each of the plurality of first photodetection cells; generating and outputting the second data based on a plurality of second signals including the second signal output from each of the plurality of second photodetection cells; The measurement device according to claim 1 .

3. the sensor is an image sensor; The plurality of photodetection cells are arranged in a matrix, The electronic circuit includes: generating image data based on the plurality of first signals as the first data; generating image data based on the plurality of second signals as the second data; The measurement device according to claim 2 .

4. The plurality of photodetection cells are arranged in a matrix, The rows or columns of the first photodetection cells and the rows or columns of the second photodetection cells are arranged alternately. The measuring device according to claim 2 or 3.

5. the object includes a human head; the first data being indicative of a facial appearance on the head; The measuring device according to any one of claims 2 to 4.

6. the object includes a human head; The second data indicates a state of cerebral blood flow in the head. The measuring device according to any one of claims 1 to 5.

7. the plurality of photodetection cells further includes a third photodetection cell; the electronic circuit causes the first photodetection cell or the third photodetection cell to detect the first reflected light pulse during a third exposure period different from the first exposure period and the second exposure period, thereby generating a third signal; The measuring device according to any one of claims 1 to 6.

8. The electronic circuit includes: During the third exposure period, the first photodetector cell generates the third signal; generating and outputting data indicating a distance from the sensor to the object based on the first signal and the third signal; The measurement device according to claim 7.

9. The light source further emits a second light pulse toward the object; The electronic circuit includes: causing the light source to emit the first light pulse and then emit the second light pulse; generating a third signal by causing the first light detection cell to detect the second reflected light pulse during a third exposure period including at least a part of a falling period from when the intensity of the second reflected light pulse from the object caused by the second light pulse starts to decrease until when the decrease ends; generating a fourth signal by causing the second photodetector cell to detect the second reflected light pulse during a fourth exposure period that includes at least a part of the falling period of the second reflected light pulse and is different from a third exposure period; generating and outputting data indicating a distance from the sensor to the object based on the first signal and the third signal; The measuring device according to any one of claims 1 to 6.

10. the object includes a human head; The electronic circuit generates and outputs data indicative of the person's psychological or physical state based on the first signal and the second signal. The measuring device according to any one of claims 1 to 9.

11. The light source further emits a second light pulse toward the object; the wavelength of the second light pulse is different from the wavelength of the first light pulse; the first exposure period begins when a first time has elapsed from a time point when the first light pulse begins to be emitted, The electronic circuit includes: causing the light source to emit the first light pulse and the second light pulse during a first measurement period and a second measurement period, respectively; generating the first signal by causing the first light detection cell to detect the first reflected light pulse during the first exposure period included in the first measurement period, and to detect a second reflected light pulse from the object caused by the second light pulse during a third exposure period that starts when a second time has elapsed from a point in time when the second light pulse started to be emitted during the first measurement period; causing the first light detection cell to detect the first reflected light pulse in a fourth exposure period that starts when a third time has elapsed from a start point of emission of the first light pulse in the second measurement period, and to detect the second reflected light pulse in a fifth exposure period that starts when a fourth time has elapsed from a start point of emission of the second light pulse in the second measurement period, thereby generating a third signal; generating data indicative of a distance from the sensor to the object based on the first signal and the third signal; the third time period is different from the first time period; the fourth time is different from the second time; The measuring device according to any one of claims 1 to 6.

12. a light source that emits one or more light pulses toward the living body; a sensor including a plurality of light detection cells including a first light detection cell and a second light detection cell; An electronic circuit; Equipped with The electronic circuit includes: causing the light source to emit the one or more light pulses; generating a first signal by causing the first light detection cell to detect a first component of one or more reflected light pulses from the living body resulting from the one or more light pulses; causing the second photodetector cell to detect a second component of the one or more reflected light pulses to generate a second signal; causing the first photodetector cell to detect a third component of the one or more reflected light pulses to generate a third signal; generating first data indicating a distance from the sensor to the living body based on the first signal and the third signal; generating second data indicative of a state of blood flow in the living body based on the second signal; Measuring equipment.

13. The electronic circuit corrects the second data based on the first data. The measurement device according to claim 12.

14. the electronic circuit corrects the second data based on data indicative of a spatial distribution of irradiance of the one or more light pulses and the first data. The measuring device according to claim 12 or 13.

15. The data indicating the spatial distribution includes information on the distribution of the illuminance corresponding to a direction from the light source toward the living body. The measurement device according to claim 14.

16. The electronic circuit corrects the second data based on the first data corresponding to the same frame period as the second data. The measuring device according to any one of claims 12 to 15.

17. A method for controlling a measurement device including a light source and a sensor including a plurality of light detection cells including a first light detection cell and a second light detection cell, the method comprising: causing the light source to emit a light pulse; generating a first signal by causing the first light detection cell to detect the reflected light pulse during a first exposure period including at least a part of a period from when an intensity of the reflected light pulse from an object caused by the light pulse starts to increase to when an intensity of the reflected light pulse starts to decrease; generating a second signal by causing the second photodetector cell to detect the reflected light pulse during a second exposure period including at least a part of a falling period from when the intensity of the reflected light pulse starts to decrease until when the intensity of the reflected light pulse ends to decrease; generating and outputting first data indicative of a surface condition of the object based on the first signal; generating and outputting second data indicating an internal state of the object based on the second signal; The method includes:

18. A method for controlling a measurement device including a light source and a sensor including a plurality of light detection cells including a first light detection cell and a second light detection cell, the method comprising: causing the light source to emit one or more pulses of light; generating a first signal by causing the first light detection cell to detect a first component of one or more reflected light pulses from a living body resulting from the one or more light pulses; causing the second photodetector cell to detect a second component of the one or more reflected light pulses to generate a second signal; causing the first photodetector cell to detect a third component of the one or more reflected light pulses to generate a third signal; generating first data indicating a distance from the sensor to the living body based on the first signal and the third signal; generating second data indicative of a state of blood flow in the living body based on the second signal; The method includes:

Images