MEASURING APPARATUS, OPTICAL SENSOR, BIOLOGICAL DATA MEASURING SYSTEM, BIOLOGICAL INFORMATION ESTIMATION SYSTEM, MEASURING METHOD, AND PROGRAM

Abstract

This measurement device comprises: a measurement instruction output unit that outputs a measurement instruction to an optical sensor including a light receiving element array in which a plurality of light receiving elements are two-dimensionally arranged, wherein the measurement instruction includes a first measurement instruction for instructing first measurement corresponding to preliminary measurement and a second measurement instruction for instructing second measurement corresponding to main measurement; a received signal acquisition unit that acquires a signal received from at least one of the plurality of light receiving elements according to the measurement instruction; a biological data generation unit that generates biological data for each light receiving element using the acquired received signal; a calculation unit that calculates a deviation of the biological data for each light receiving element using the biological data generated using the received signal acquired according to the first measurement instruction; and a measurement region setting unit that sets, according to the deviation of the biological data for each light receiving element, a measurement region including a light receiving element used for the second measurement according to the second measurement instruction.

Description

[Technical field]

[0001] The present disclosure relates to a measurement device or the like that measures biological data using an optical sensor. [Background technology]

[0002] A measuring device has been developed that uses an optical sensor to measure biometric data such as arterial pulsation waveform (pulse waveform). Autonomic nerve activity is reflected in biometric data such as pulse rate. Therefore, a technology has been developed that uses biometric data to estimate the emotion of a subject. When estimating emotions, it is preferable to measure biometric data continuously.

[0003] Non-Patent Document 1 discloses a flexible imaging device in which a high-resolution array sensor is mounted on a flexible substrate. The device in Non-Patent Document 1 has a structure in which a polycrystalline silicon thin-film transistor readout circuit and an organic photodiode with high sensitivity in the near-infrared region are combined. By attaching the device in Non-Patent Document 1 to the skin of a subject, it is possible to obtain biometric information such as the subject's pulse and vein image at high resolution.

[0004] Patent Document 1 discloses a measuring device for measuring pulse waveforms. The device of Patent Document 1 includes a light source, a detection unit, and an analysis unit. The light source emits at least one type of measurement light belonging to a predetermined wavelength band to a measurement area consisting of at least a part of a living body. The detection unit has a plurality of sensors regularly arranged in a predetermined arrangement. The detection unit detects the measurement light emitted from the light source and transmitted through the living body with the plurality of sensors. The analysis unit performs an analysis process using the detection result detected by the detection unit to identify a measurement position for measuring information about pulsation associated with the activity of the living body based on the time change in the amount of the detected measurement light from within the measurement area.

[0005] Patent Document 2 discloses a pulse detection device that detects pulse. The device of Patent Document 2 includes a light-emitting element and a light-receiving element, and is equipped with a pulse detector having multiple sensors that detect pulse based on changes in the amount of light received by the light-receiving element, which receives light projected from the light-emitting element and reflected or transmitted by the subject. The device of Patent Document 2 detects the amplitude of the change in the amount of light received by the light-receiving element of each sensor in the pulse detector when the pulse is present. The device of Patent Document 2 compares the magnitude of the amplitude of the change in the amount of light received by multiple sensors, and identifies the sensor with the largest amplitude. The device of Patent Document 2 calculates the output signal of the sensor with the largest amplitude to determine the pulse rate. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2013-121420 A [Patent Document 2] Japanese Patent Application Publication No. 7-299043 [Non-patent literature]

[0007] [Non-Patent Document 1] T. Yokota, et al., “A conformable imager for biometric authentication and vital sign measurement”, Nature Electronics, volume 3, pp113-121(2020). Summary of the Invention [Problem to be solved by the invention]

[0008] As in Non-Patent Document 1, if a two-dimensional optical sensor is used, a wide range of biological data can be measured at one measurement timing. The more elements in the light receiving element array that constitutes the two-dimensional optical sensor, the more reliable the pulse waveform can be measured, but due to factors such as power consumption and communication speed, it is difficult to realize continuous measurement. On the other hand, if the number of elements in the light receiving element array is small, measurement may become impossible due to factors such as the shift of the measurement point due to body movement, and it is difficult to realize continuous measurement.

[0009] According to the method of Patent Document 1, the pulse waveform can be measured accurately by identifying the measurement position in the measurement area based on the time change of the light amount of the measurement light. Patent Document 1 discloses that the pulse waveform data in the target micro-area is calculated by focusing on the time change of the data in the micro-area. Patent Document 1 also discloses that the pulse waveform measured in advance is used to calculate the similarity between the pulse waveform measured in advance and the pulse waveform data in each micro-area. Due to factors such as drift and noise, it is not easy to calculate the similarity of the time series data of the pulse waveform data actually measured. Therefore, the method of Patent Document 1 cannot appropriately identify the measurement position in the measurement area, and it is difficult to constantly measure biological data.

[0010] In the method of Patent Document 2, the sensor with the largest amplitude of change in the amount of received light is selected, and the pulse rate is calculated using the output signal of the selected sensor. Therefore, the method of Patent Document 2 is not easily affected by factors such as drift and noise. In the method of Patent Document 2, when the number of light receiving elements is about several, the sensor with the largest amplitude of change in the amount of received light can be identified. However, in the method of Patent Document 2, when the number of light receiving elements reaches about 10,000 pixels, it becomes difficult to identify the sensor with the largest amplitude of change in the amount of received light, making it difficult to constantly measure biological data.

[0011] An object of the present disclosure is to provide a measurement device etc. that can realize continuous measurement of biological data using an optical sensor. [Means for solving the problem]

[0012] A measuring device according to one embodiment of the present disclosure includes a measurement instruction output unit that outputs measurement instructions to an optical sensor including a light receiving element array in which a plurality of light receiving elements are arranged two-dimensionally, the measurement instructions including a first measurement instruction instructing a first measurement equivalent to a preliminary measurement and a second measurement instruction instructing a second measurement equivalent to a main measurement, a received signal acquisition unit that acquires a received signal from at least any of the plurality of light receiving elements in response to the measurement instruction, a biometric data generation unit that generates biometric data for each light receiving element using the acquired received signal, a calculation unit that calculates the deviation of the biometric data for each light receiving element using the biometric data generated using the received signal acquired in response to the first measurement instruction, and a measurement area setting unit that sets a measurement area including a light receiving element to be used for a second measurement in response to the second measurement instruction in response to the deviation of the biometric data for each light receiving element.

[0013] In a measurement method of one embodiment of the present disclosure, a measurement instruction including a first measurement instruction instructing a first measurement equivalent to a preliminary measurement and a second measurement instruction instructing a second measurement equivalent to a main measurement is output to an optical sensor including a light receiving element array in which multiple light receiving elements are arranged in a two-dimensional manner, a received signal of at least any of the multiple light receiving elements is acquired in response to the measurement instruction, biometric data for each light receiving element is generated using the acquired received signal, a deviation of the biometric data for each light receiving element is calculated using the biometric data generated using the received signal acquired in response to the first measurement instruction, and a measurement area including the light receiving element to be used for the second measurement in response to the second measurement instruction is set in response to the deviation of the biometric data for each light receiving element.

[0014] A program of one embodiment of the present disclosure causes a computer to execute the following processes: outputting measurement instructions to an optical sensor including a light receiving element array in which multiple light receiving elements are arranged in a two-dimensional manner, the measurement instructions including a first measurement instruction instructing a first measurement equivalent to a preliminary measurement and a second measurement instruction instructing a second measurement equivalent to a main measurement; acquiring a received signal from at least any of the multiple light receiving elements in response to the measurement instructions; generating biometric data for each light receiving element using the acquired received signal; calculating a deviation of the biometric data for each light receiving element using the biometric data generated using the received signal acquired in response to the first measurement instruction; and setting a measurement area including a light receiving element to be used for a second measurement in response to the second measurement instruction in response to the deviation of the biometric data for each light receiving element. Effect of the Invention

[0015] According to the present disclosure, it is possible to provide a measurement device or the like that can realize continuous measurement of biological data using an optical sensor. [Brief description of the drawings]

[0016] [Figure 1] 1 is a block diagram showing an example of the configuration of a biological data measurement system according to a first embodiment. [Diagram 2] 2 is a conceptual diagram showing an example of a measurement surface of an optical sensor included in the biological data measurement system according to the first embodiment. FIG. [Diagram 3] 2 is a cross-sectional view showing an example of the configuration of an optical sensor included in the biological data measurement system according to the first embodiment. FIG. [Figure 4] 2 is a conceptual diagram for explaining an example of positions at which an optical signal is emitted and received by an optical sensor included in the biological data measurement system according to the first embodiment. FIG. [Diagram 5] 4 is a graph for explaining an example of reflected light received by a light receiving element array of an optical sensor included in the biological data measurement system according to the first embodiment. [Figure 6] 2 is a block diagram showing an example of the configuration of an optical sensor included in the biological data measurement system according to the first embodiment. FIG. [Figure 7] 1 is a block diagram showing an example of the configuration of a measurement device included in a biological data measurement system according to a first embodiment. [Figure 8] 4 is an example of time-series data of biological data measured for each light receiving element constituting a light receiving element array of an optical sensor included in the biological data measurement system according to the first embodiment. [Figure 9] FIG. 2 is a conceptual diagram for explaining a measurement channel setting process by a measurement device included in the biological data measurement system according to the first embodiment. [Figure 10] FIG. 2 is a conceptual diagram for explaining a measurement channel setting process by a measurement device included in the biological data measurement system according to the first embodiment. [Figure 11] This is a heat map in which the positions of light-receiving elements where the deviation calculated by the measurement device of the biological data measurement system of the first embodiment is larger than the standard deviation of the channel deviation for multiple light-receiving elements are mapped in correspondence with the light-receiving surface of the light-receiving element array. [Figure 12] FIG. 2 is a conceptual diagram for explaining an example of a measurement channel selected by a measurement device included in the biological data measurement system according to the first embodiment. [Figure 13] FIG. 2 is a conceptual diagram showing an example of how biological data (pulse rate) measured by a measuring device included in the biological data measurement system according to the first embodiment is displayed on a screen. [Figure 14] FIG. 2 is a conceptual diagram showing an example of displaying on a screen time-series data of biological data measured by a measuring device included in the biological data measurement system according to the first embodiment. [Figure 15] 4 is a flowchart for explaining an example of the operation of a measurement device included in the biological data measurement system according to the first embodiment. [Figure 16] 5 is a flowchart for explaining an example of a measurement channel setting process by a measurement device included in the biological data measurement system according to the first embodiment. [Figure 17]10 is a flowchart for explaining another example of the measurement channel setting process by the measurement device included in the biological data measurement system according to the first embodiment. [Figure 18] 4 is a flowchart for explaining an example of an operation of an optical sensor included in the biological data measurement system according to the first embodiment. [Figure 19] 4 is a flowchart for explaining an example of a first measurement process by an optical sensor included in the biological data measurement system according to the first embodiment. [Figure 20] 10 is a flowchart for explaining an example of a second measurement process by the optical sensor included in the biological data measurement system according to the first embodiment. [Figure 21] FIG. 11 is a block diagram showing an example of a configuration of an optical sensor according to a second embodiment. [Figure 22] 10 is a flowchart illustrating an example of an operation of the optical sensor according to the second embodiment. [Diagram 23] FIG. 13 is a block diagram showing an example of a configuration of a biological information estimating system according to a third embodiment. [Figure 24] FIG. 13 is a conceptual diagram for explaining an emotion estimated by an estimation device of a biological information estimation system according to a third embodiment, based on a pulse signal. [Diagram 25] FIG. 13 is a conceptual diagram for explaining an example of learning for generating an estimation model used for emotion estimation by an estimation device of a biological information estimation system according to a third embodiment. [Figure 26] FIG. 13 is a conceptual diagram for explaining an example of emotion estimation by an estimation device of a biological information estimation system according to a third embodiment. [Figure 27] FIG. 13 is a conceptual diagram showing an example in which information relating to a subject's emotion estimated by an estimation device of a biological information estimation system according to a third embodiment is displayed on a screen of a terminal device. [Figure 28] FIG. 13 is a block diagram showing an example of the configuration of a measurement apparatus according to a fourth embodiment. [Figure 29]FIG. 2 is a block diagram showing an example of a hardware configuration for implementing control and processing in each embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, the embodiments for carrying out the present invention will be described with reference to the drawings. However, the embodiments described below are limited in a manner that is technically preferable for carrying out the present invention, but the scope of the invention is not limited to the following. In addition, in all the drawings used to explain the following embodiments, the same reference numerals are used for similar parts unless otherwise specified. In addition, in the following embodiments, repeated explanations of similar configurations and operations may be omitted.

[0018] (First embodiment) First, a biological data measurement system according to a first embodiment will be described with reference to the drawings. The biological data measurement system of this embodiment measures arterial pulsation (pulse) according to a light receiving signal detected by an optical sensor attached to the skin of a subject. In the following, an example of measuring pulse as biological data will be described. The method of this embodiment can also be applied to measuring biological data other than pulse, so long as the measurement uses an optical sensor.

[0019] (composition) Fig. 1 is a block diagram showing an example of the configuration of a biological data measurement system 1 according to this embodiment. The biological data measurement system 1 includes an optical sensor 10 and a measurement device 16. The optical sensor 10 is attached to the body of a subject. The measurement device 16 is implemented in a mobile terminal (not shown) carried by the subject. The measurement device 16 may be built in a cloud or a server that can be connected via the mobile terminal carried by the subject.

[0020] The optical sensor 10 includes a light receiving element array in which a plurality of light receiving elements are arranged in an array. The optical sensor 10 irradiates light onto the skin of the subject and receives the reflected light. The measurement device 16 measures the pulsation (pulse) of the artery in response to the light receiving signal measured by the optical sensor 10 attached to the skin of the subject. The measurement device 16 measures the pulse of the subject in response to the change in intensity of the received reflected light. The optical sensor 10 and the measurement device 16 will be described separately below.

[0021] [Optical sensor] 2 and 3 are conceptual diagrams showing an example of the configuration of the optical sensor 10. Fig. 2 is a diagram of the optical sensor 10 as viewed from the measurement surface side. Fig. 3 is a cross-sectional view of the optical sensor 10 taken along the AA cutting line in Fig. 2. The optical sensor 10 has a plurality of light emitters 11, a light receiving element array 12, and a control unit 13.

[0022] The light emitters 11, the light receiving element array 12, and the control unit 13 are disposed on the surface of the substrate 110. The light emitters 11 and the light receiving element array 12 are formed on a first surface (also called a measurement surface) of the substrate 110. An adhesive layer 111 for attaching the optical sensor 10 to the skin of the subject is disposed around the light emitters 11 and the light receiving element array 12. The optical sensor 10 is attached to the skin of the subject so that light from outside does not enter the measurement surface side of the substrate 110 when attached to the skin of the subject. FIG. 3 shows an example in which the control unit 13 is disposed on the surface opposite the measurement surface. The position at which the control unit 13 is disposed is not limited to the surface opposite the measurement surface. For example, the control unit 13 may be disposed inside the substrate 110 or at a position away from the light emitters 11 and the light receiving element array 12.

[0023] The light emitter 11 has an emission surface that emits light used to measure the pulse. The light emitted by the light emitter 11 when measuring the pulse is also called an optical signal. The multiple light emitters 11 are arranged with their emission surfaces facing the same direction. The emission surfaces of the multiple light emitters 11 and the light receiving surface of the light receiving element array 12 are arranged to face the same direction. The emission surface of the light emitter 11 is directed toward the skin of the subject with the optical sensor 10 attached to the skin of the subject.

[0024] 2 shows an example in which twelve light emitters 11 are arranged along the four sides of the light receiving element array 12. The number of light emitters 11 is not limited to twelve. Furthermore, the positions at which the light emitters 11 are arranged do not have to be along the four sides of the light receiving element array 12. As long as the optical signal emitted from the light emitters 11 can be received by the light receiving element array 12, there is no limitation on the positions at which the light emitters 11 are arranged.

[0025] The light emitter 11 emits an optical signal in a wavelength band capable of measuring the pulse in response to the control of the control unit 13. For example, the light emitter 11 is realized by an LED (Light Emitting Diode). For example, the light emitter 11 emits an optical signal in a green wavelength band. For measuring the pulse, an optical signal in the green wavelength band is suitable. For example, the light emitter 11 emits an optical signal in a near-infrared wavelength band. For measuring the entire vein, near-infrared light of, for example, about 1.1 micrometers is suitable. For example, if the multiple light emitters 11 can emit a red wavelength band and an infrared wavelength band, the oxygen saturation in the arterial blood can be measured according to the difference in absorbance between them. The wavelength band of the optical signal emitted by the light emitter 11 is not particularly limited as long as it is a wavelength band capable of measuring biological data. The optical output of the multiple light emitters 11 may be the same or different. The optical output of the multiple light emitters 11 may be constant or adjustable. If the optical output of the multiple light emitters 11 is adjustable, the optical output can be adjusted for each light emitter 11.

[0026] The light receiving element array 12 has a light receiving surface that receives reflected light of the optical signal emitted from the light emitter 11. The reflected light is a light component of the optical signal emitted from the light emitter 11 that is reflected / scattered under the skin (inside the body) of the subject and reaches the light receiving surface of the light receiving element array 12. A plurality of light receiving elements are arranged in a two-dimensional array on the light receiving surface of the light receiving element array 12. For example, about 10,000 light receiving elements are arranged in a two-dimensional array on the light receiving surface of the light receiving element array 12. The light intensity of the reflected light received by each of the plurality of light receiving elements arranged in the two-dimensional array is measured in association with the position (address) of the light receiving element.

[0027] For example, the light receiving element array 12 can be realized by a sheet-type image sensor disclosed in Non-Patent Document 1 (Non-Patent Document 1: T. Yokota, et al., “A conformable imager for biometric authentication and vital sign measurement”, Nature Electronics, volume 3, pp113-121(2020)). The sheet-type image sensor in Non-Patent Document 1 is made of organic photoresist. The light emitter 11 has a configuration in which a light emitting diode, a thin film transistor, a CMOS (Complementary Metal-Oxide Semiconductor), and a photodetector are combined. However, as in the sheet-type image sensor of Non-Patent Document 1, the light emitter 11 and the light receiving element array 12 may be integrated together.

[0028] FIG. 4 is a conceptual diagram showing how an optical signal emitted from the light emitter 11 is reflected / scattered under the skin (inside the body) of a subject. The reflected light of the optical signal emitted from each of the multiple light emitters 11 passes through different paths and is received by the light receiving element array 12. The optical signals emitted from the multiple light emitters 11 change in light intensity depending on the light absorption characteristics and scattering characteristics of body tissues such as skin, blood vessels, muscles, fat, and bones. Therefore, the light intensity of the reflected light received by the light receiving element varies depending on the length of the path of the optical signal / reflected light, the environment under the skin, and the body movement of the subject. In this embodiment, an optical signal is emitted from the light emitter 11 from above the skin of the subject toward the body, and the pulse of the subject is measured according to the reflected light of the optical signal. For example, in this embodiment, the change in blood volume in the body due to pulsation is measured as a change in absorbance (also called a change in light intensity).

[0029] FIG. 5 is a graph for explaining an example of reflected light received by the light receiving element array 12. The reflected light includes a fluctuating component and a stationary component. The fluctuating component is also called an AC (Alternating Current) component. The AC component fluctuates due to pulsation. The stationary component is , also called a DC (Direct Current) component. The DC component hardly fluctuates due to pulsation. The pulse is measured based on the change in light intensity of the reflected light according to the fluctuation of the AC component. In this embodiment, the fluctuation of the AC component is measured as the pulsation.

[0030] The control unit 13 controls the multiple light emitters 11. For example, the control unit 13 is realized by a microcomputer (also called a microcomputer) or a microcontroller. For example, the control unit 13 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a R The control unit 13 has a Read Only Memory (OM), a flash memory, etc. The control unit 13 executes control and processing according to a program stored in advance. The control unit 13 executes control and processing according to the program in accordance with a preset schedule, an external instruction, etc.

[0031] 6 is a block diagram showing an example of a functional configuration of the optical sensor 10. The control unit 13 has a measurement instruction acquisition unit 131, a light emission control unit 132, a storage unit 133, a signal acquisition unit 134, and a signal output unit 135.

[0032] The measurement instruction acquisition unit 131 acquires a measurement instruction from the measurement device 16. The measurement instruction acquisition unit 131 acquires an instruction to perform preliminary measurement (also called a first measurement instruction) from the measurement device 16. The first measurement instruction is an instruction to perform preliminary measurement for a certain period of time with all light receiving elements of the light receiving element array 12. The measurement instruction acquisition unit 131 outputs the acquired first measurement instruction to the light emission control unit 132 and the signal acquisition unit 134. The measurement instruction acquisition unit 131 also acquires an instruction to perform measurement in a measurement channel (also called a second measurement instruction) from the measurement device 16, which will be described later. The second measurement instruction is an instruction to perform continuous main measurement in a measurement channel selected from the light receiving elements of the light receiving element array 12. The selected measurement channel forms a measurement area. The measurement instruction acquisition unit 131 outputs the acquired second measurement instruction to the light emission control unit 132 and the signal acquisition unit 134.

[0033] The light emission control unit 132 acquires a measurement instruction by the measuring device 16 from the measurement instruction acquisition unit 131. The light emission control unit 132 acquires a first measurement instruction to perform a preliminary measurement from the measurement instruction acquisition unit 131. The light emission control unit 132 controls the multiple light emitters 11 to emit light in response to the first measurement instruction. The light emission control unit 132 controls the multiple light emitters 11 with a control method corresponding to the first measurement instruction stored in the storage unit 133. The light emission control unit 132 also acquires a second measurement instruction to perform continuous measurement (main measurement) from the measurement instruction acquisition unit 131. The light emission control unit 132 controls the multiple light emitters 11 to emit light in response to the second measurement instruction. The light emission control unit 132 controls the multiple light emitters 11 with a control method corresponding to the second measurement instruction stored in the storage unit 133. For example, the light emission control unit 132 controls all of the multiple light emitters 11 in the same manner in response to the first measurement instruction and the second measurement instruction. For example, the light emission control unit 132 may control each of the multiple light emitters 11 in a different pattern in response to the first measurement instruction and the second measurement instruction. There are no particular limitations on the method of controlling the multiple light emitters 11 by the light emission control unit 132.

[0034] The storage unit 133 stores a control method for causing the multiple light emitters 11 to emit light. The control method stored in the storage unit 133 is referenced by the light emission control unit 132. The control method stored in the storage unit 133 is not particularly limited.

[0035] The signal acquiring unit 134 acquires a measurement instruction by the measuring device 16 from the measurement instruction acquiring unit 131. The signal acquiring unit 134 acquires a first measurement instruction to perform a preliminary measurement from the measurement instruction acquiring unit 131. In response to the first measurement instruction, the signal acquiring unit 134 acquires a light receiving signal corresponding to the reflected light received by all the light receiving elements constituting the light receiving element array 12. The signal acquiring unit 134 outputs the light receiving signals of all the light receiving elements to the signal output unit 135. In addition, the signal acquiring unit 134 acquires a second measurement instruction to perform continuous measurement (main measurement) from the measurement instruction acquiring unit 131. In response to the second measurement instruction, the signal acquiring unit 134 acquires a light receiving signal corresponding to the reflected light received by the light receiving element set to the measurement channel selected by the measuring device 16. The signal acquiring unit 134 outputs the light receiving signal of the light receiving element set to the measurement channel to the signal output unit 135.

[0036] The signal output unit 135 acquires the reception signal from the signal acquisition unit 134. The signal output unit 135 outputs the acquired reception signal to the measurement device 16. For example, the signal output unit 135 may store the reception signal acquired from the light receiving element array 12 in a storage device such as a flash memory, and transmit the reception signals for a predetermined period of time to the measurement device 16 all at once.

[0037] The substrate 110 is a bendable substrate. The substrate 110 has a bendable plate-like shape. For example, the substrate 110 has a structure in which a conductive layer such as copper foil is formed on the surface of a polyimide base layer, and the conductive layer is laminated with a covering layer of a plastic film. For example, the base layer and covering layer of the substrate 110 may mainly consist of urethane nonwoven fabric, polyvinyl chloride, elastic cotton cloth, sponge sheet, urethane film, or olefin film. The light emitter 11, the light receiving element array 12, and the control unit 13 mounted on the substrate 110 may be configured to deform in response to the deformation of the substrate 110, or may be configured not to deform.

[0038] A plurality of light emitters 11 and a light receiving element array 12 are arranged on the measurement surface (also called the first surface) of the substrate 110. An adhesive layer 111 is formed on the peripheral portion of the measurement surface of the substrate 110. The portion where the adhesive layer 111 is formed may be made of a different material or structure from the other portions. For example, if the portion where the adhesive layer 111 is formed has a mesh-like structure, the portion where the adhesive layer 111 is formed is less likely to become steamy, and the decrease in adhesive strength of the adhesive layer 111 caused by sweat or the like can be suppressed. A control unit 13 is arranged on a second surface facing the measurement surface of the substrate 110. The control unit 13 may be arranged inside the substrate 110. For example, the control unit 13 may be arranged inside the substrate 110 to improve waterproofing. For example, the control unit 13 may be covered with a waterproof film or the like to improve waterproofing. For example, when the optical sensor 10 is attached to the subject's body, the substrate 110 is deformed according to the shape of the portion to which it is attached. There are no particular limitations on the material, structure, or shape of the substrate 110.

[0039] The adhesive layer 111 is formed on the peripheral portion of the measurement surface of the substrate 110. The adhesive layer 111 includes an adhesive for attaching the optical sensor 10 to the body of the subject. For example, the adhesive layer 111 includes an acrylic adhesive, a rubber adhesive, or a silicone adhesive. The adhesive layer 111 preferably has a light-shielding property so that light from the outside does not reach the light emitter 11 or the light receiving element array 12. There is no particular limitation on the material of the adhesive layer 111. For example, it is preferable to use a material that is less irritating to the skin for the adhesive layer 111. For example, the adhesive layer 111 may contain a substance that reduces discomfort to the skin. For example, the adhesive layer 111 may contain menthol or the like. For example, the adhesive layer 111 may contain a substance that suppresses a decrease in adhesive strength due to absorption of moisture such as sweat. For example, the adhesive layer 111 may contain a polymer absorbent or the like. In this embodiment, an example is shown in which the optical sensor 10 is attached to the subject's body by the adhesive layer 111, but the optical sensor 10 may be attached to the subject's body by a band (not shown) or the like.

[0040] [Measuring equipment] Figure 71 is a block diagram showing an example of a functional configuration of the measurement device 16. The measurement device 16 has a measurement instruction output unit 161, a received signal acquisition unit 162, a biological data generation unit 163, a calculation unit 164, a measurement area setting unit 165, and a biological data output unit 166.

[0041] When the measuring device 16 is started, the measurement instruction output unit 161 outputs a first measurement instruction to the optical sensor 10 to perform a preliminary measurement prior to continuous main measurement. The first measurement instruction is an instruction to perform preliminary measurement for a certain period of time with all light receiving elements of the light receiving element array 12. The measurement instruction output unit 161 also acquires the address of the measurement channel selected by the measurement area setting unit 165. The measurement instruction output unit 161 outputs a second measurement instruction to the optical sensor 10 to perform measurement in the selected measurement channel. The second measurement instruction is an instruction to perform continuous main measurement in the selected measurement channel among the light receiving elements of the light receiving element array 12.

[0042] Furthermore, the measurement instruction output unit 161 outputs a first measurement instruction to the optical sensor 10 in order to update the measurement channel at a predetermined update timing. For example, the measurement instruction output unit 161 may output an instruction to perform a first measurement instruction to the optical sensor 10 for an area including the measurement channel under measurement. Furthermore, the measurement instruction output unit 161 may update the measurement channel in response to the value or fluctuation of the biological data while the main measurement is being performed.

[0043] The reception signal acquisition unit 162 acquires a reception signal corresponding to the measurement instruction from the measurement instruction output unit 161 from the optical sensor 10. The reception signal corresponding to the first measurement instruction is a signal from all the light receiving elements constituting the light receiving element array 12 of the optical sensor 10. The reception signal corresponding to the second measurement instruction is a signal from a light receiving element set to a measurement channel among the multiple light receiving elements constituting the light receiving element array 12 of the optical sensor 10. The reception signal acquisition unit 162 outputs the acquired reception signal to the biological data generation unit 163. For example, the reception signal acquisition unit 162 may store the reception signal acquired from the light receiving element array 12 in a flash memory (not shown).

[0044] The biometric data generating unit 163 acquires a reception signal corresponding to the measurement instruction from the measurement instruction output unit 161 from the reception signal acquiring unit 162. The biometric data generating unit 163 generates biometric data using the acquired reception signal. For example, the biometric data generating unit 163 generates pulse data using time series data of the acquired reception signal. There is no particular limitation on the biometric data generated by the biometric data generating unit 163.

[0045] The biometric data generating unit 163 outputs the biometric data generated using the reception signal corresponding to the first measurement instruction to the calculation unit 164. On the other hand, the biometric data generating unit 163 outputs the biometric data generated using the reception signal corresponding to the second measurement instruction to the biometric data output unit 166. For example, at a predetermined verification timing, the biometric data generating unit 163 may output the biometric data generated using the reception signal corresponding to the second measurement instruction to the calculation unit 164. The biometric data output to the calculation unit 164 at the verification timing is used to verify the selected measurement channel. For example, the biometric data generating unit 163 may store the generated biometric signal in a flash memory (not shown).

[0046] FIG. 8 is an example of time series data of biodata (beat) generated based on the measurement value (amplitude) for each channel. The time series data of biodata (beat) in FIG. 8 includes several beats. For example, the difference between the maximum value and the minimum value of each beat is the representative value of the channel. As shown in FIG. 8, biodata based on the measurement value for each channel includes drift and noise. Therefore, it is difficult to compare the measurement values ​​of multiple light receiving elements (channels) constituting the light receiving element array 12 with the average value for each channel. In this embodiment, the deviation of the measurement value for each channel is used to make it easier to compare the measurement values ​​of multiple light receiving elements (channels) constituting the light receiving element array 12. In addition, if biodata is measured without omission within the light receiving surface of the light receiving element array 12, the measurement values ​​of all the light receiving elements are required. For example, when the light receiving elements of the light receiving element array 12 are 120×160 pixels, it is difficult to use the measurement values ​​of all the light receiving elements due to restrictions such as communication speed. For example, when using biometric data for emotion estimation, a resolution of about 100 Hz (Hertz) is required, and it is difficult to collect biometric data of 10,000 pixels in real time. In this embodiment, the light receiving elements used to measure the biometric data are selected from among the light receiving elements constituting the light receiving element array 12, thereby reducing the load of calculation and communication.

[0047] The calculation unit 164 selects a channel for performing the main measurement using the biological data based on the reception signal received in response to the first measurement instruction. The calculation unit 164 calculates a representative value of the amplitude of the biological data for each channel for all of the multiple light receiving elements (channels) constituting the light receiving element array 12. For example, the calculation unit 164 calculates the maximum amplitude of the biological data as the representative value for each channel. The calculation unit 164 also calculates the average value of the representative values ​​of the multiple light receiving elements (channels) constituting the light receiving element array 12. The calculation unit 164 calculates the deviation (also called the channel deviation) for each channel by subtracting the average value of the representative values ​​of the multiple light receiving elements (channels) from the representative value for each light receiving element (channel). The calculation unit 164 outputs the channel deviation calculated for each channel to the measurement area setting unit 165.

[0048] For example, if the number of light receiving elements in the light receiving element array 12 is m, the calculation unit 164 calculates the channel deviation D of channel m using the following formula 1: m (m is a natural number). D m =M m -A···(1) In the above formula 1, M m is the maximum value of the biological data (amplitude) in channel m. A is the average value of the maximum values ​​of the biological data (amplitude) for a plurality of light receiving elements (channels).

[0049] FIG. 9 is a conceptual diagram for explaining an example of calculating a channel deviation obtained by subtracting an average value from a representative value for each light receiving element (channel Ch) constituting the light receiving element array 12. FIG. 9 is a pixel image 121 corresponding to the light receiving surface of the light receiving element array 12. The example of FIG. 9 shows a state in which a channel deviation is calculated for biological data based on a reception signal received by the upper left light receiving element (channel). The channel deviation may be calculated collectively for a plurality of light receiving elements (channels) constituting the light receiving element array 12. In the case of the example of FIG. 9, the calculation unit 164 calculates the channel deviation for all of the plurality of light receiving elements (channels). For example, the calculation unit 164 may calculate the channel deviation for a narrower range rather than for all light receiving elements (channels) constituting the light receiving element array 12.

[0050] The calculation unit 164 may calculate the deviation of the measurement values ​​by the multiple light receiving elements (channels) constituting the light receiving element array 12 for multiple channels, rather than for a single channel. For example, the control unit 13 may set an area (also called a calculation area) consisting of 2×2=4 channels, and calculate the deviation of the measurement values ​​for each calculation area. For example, the control unit 13 calculates the deviation of the calculation area (also called area deviation) by subtracting the average value of the representative values ​​of the multiple light receiving elements (channels) from the average value of the representative values ​​of the measurement values ​​by the light receiving elements (channels) included in the calculation area. The calculation unit 164 outputs the area deviation calculated for each calculation area to the measurement area setting unit 165.

[0051] The arrangement of the calculation region is not limited to 2×2 and can be set arbitrarily. For example, the number and arrangement of channels included in the calculation region are set in advance. The number and arrangement of channels included in the calculation region may be set automatically according to the selection status of channels included in the measurement candidate region described later. For example, the calculation unit 164 changes the number and arrangement of channels included in the calculation region according to the number of channels included in the measurement candidate region.

[0052] Figure 10 shows the calculation area R consisting of four light receiving elements in a 2 × 2 array. c For each test, the average value is calculated from the representative value. 10 is a conceptual diagram for explaining an example of calculating the subtracted area deviation. FIG. 10 is a pixel image 122 corresponding to the light receiving surface of the light receiving element array 12. The example of FIG. 10 is a calculation area R c A generated signal based on the received signals received by multiple light receiving elements (channels) included in The figure shows how to calculate the regional deviation for the body data. The regional deviation is calculated by dividing the region R by the region R set in the plurality of light receiving elements (channels) that constitute the light receiving element array 12. c Regarding In the example of FIG. 10, the calculation unit 164 may calculate the multiple calculation regions R c All of For example, the calculation unit 164 calculates the area deviation for a plurality of calculation areas R c Instead, narrow the scope The calculation unit 164 may calculate the area deviation by using the calculation area R c For example, multiple light receiving elements may be set. Children (channels) are multiple computational domains R c may be shared by

[0053] Furthermore, the calculation unit 164 calculates the standard deviation of the channel deviations calculated for the multiple light receiving elements (channels). The calculation unit 164 outputs the calculated standard deviation of the channel deviations for the multiple light receiving elements (channels) to the measurement area setting unit 165.

[0054] The measurement region setting unit 165 acquires the channel deviation calculated for each channel, the region deviation calculated for each calculation region, and the standard deviation of the channel deviations for multiple light receiving elements (channels) from the calculation unit 164. The measurement region setting unit 165 selects a channel (also called a measurement channel) to be used for the main measurement of the biological data based on the channel deviation and the region deviation. For example, the measurement region setting unit 165 sets the region of the channel in which the deviation of the channel deviation, the region deviation, etc. exceeds a predetermined threshold value as a measurement candidate region. For example, the measurement region setting unit 165 selects a measurement channel based on a comparison result between the deviation of the channel deviation, the region deviation, etc. and the standard deviation of the channel deviations for multiple light receiving elements (channels). For example, the measurement region setting unit 165 sets a light receiving element (channel) in which the deviation of the channel deviation, the region deviation, etc. is 1.5 times or more the standard deviation of the channel deviations for multiple light receiving elements (channels) as a measurement candidate region. The measurement region setting unit 165 selects a measurement channel from the light receiving elements (channels) set in the measurement candidate region. The measurement region setting unit 165 sets the selected measurement channel as the measurement region.

[0055] FIG. 11 is a heat map in which the positions of light receiving elements (channels) whose deviation calculated by the measurement device 16 is larger than the standard deviation of the channel deviations for a plurality of light receiving elements (channels) are mapped in association with the light receiving surface of the light receiving element array 12. FIG. 11 is a pixel image 123 corresponding to the light receiving surface of the light receiving element array 12. In the example of FIG. 11, hatching according to the magnitude of the deviation calculated by the measurement device 16 is shown. In practice, the magnitude of the deviation may be displayed in different colors. Region R1 is a region of a channel whose region deviation is 1.5 times the standard deviation or more. Region R1 is set as a measurement candidate region. Region R2 is a region of a channel whose region deviation is 0.5 times the standard deviation or more. Region R3 is a region of a channel whose region deviation of the calculation region is less than 0.5 times the standard deviation and whose sum of the amplitudes inside the calculation region is greater than 0. Region R3 corresponds to the range of the detected human body. For example, the outer edge of region R3 may be displayed with different hatching or color to clearly indicate the range of the detected human body. For example, the heat map in Fig. 11 may be displayed on the screen of a terminal device (not shown). For example, a subject wearing optical sensor 10 can adjust the position at which optical sensor 10 is worn by referring to the heat map displayed on the screen.

[0056] FIG. 12 shows a measurement region R selected from the region R1 set as the measurement candidate region. M As an example of FIG. 12 is a conceptual diagram for explaining the measurement of the light receiving area R. M is within the range of region R1 set as the measurement candidate region. As shown in Figure 12, the measurement area R M The number of measurement channels included in is significantly smaller than the total number of channels included in the pixel image 124. Therefore, according to this embodiment, the load on reception of a reception signal, communication of the reception signal, calculation of the biological data, and the like in measuring the biological data can be significantly reduced.

[0057] The biometric data output unit 166 acquires biometric data corresponding to the second measurement instruction from the biometric data generation unit 163. The biometric data output unit 166 outputs the acquired biometric data. For example, the biometric data output unit 166 outputs a representative value of the biometric data generated based on the light receiving signals received by a plurality of light receiving elements as the biometric data. For example, the biometric data output unit 166 outputs an average value of the biometric data generated based on the light receiving signals received by a plurality of light receiving elements as the biometric data. The biometric data output unit 166 may output the biometric data via a wired connection such as a cable, or may output the biometric data via wireless communication. For example, the biometric data output unit 166 is configured to output the biometric data via a wireless communication function (not shown) conforming to a standard such as Bluetooth (registered trademark) or WiFi (registered trademark). The communication function of the biometric data output unit 166 may conform to a standard other than Bluetooth (registered trademark) or WiFi (registered trademark). There is no particular limitation on the output destination or use of the biometric data. For example, the biometric data output unit 166 outputs the biometric data to a dedicated terminal device (not shown) having a screen. For example, the biometric data output unit 166 outputs the biometric data to a mobile terminal (not shown) such as a smartphone or tablet carried by the user. For example, the biometric data output unit 166 outputs the biometric data to an external system (not shown) built on a server or cloud.

[0058] FIG. 13 is an example of displaying the pulse rate measured according to the biological data output from the measuring device 16 on the screen of the terminal device 100. The pulse rate corresponds to the number of pulses per unit time. Here, the number of pulses per minute is defined as the pulse rate. A user who visually checks the pulse rate displayed on the screen can check the subject's pulse rate. For example, the subject's physical condition can be verified according to the pulse rate. The pulse is derived from the heart's beat (heartbeat). Therefore, the pulse rate corresponds to the heart rate. If the subject's pulse rate can be measured / displayed in real time, the subject's physical condition can be accurately monitored in real time. For example, the subject's perceived intensity of exercise can be quantified according to the values ​​of the heart rate during exercise and the heart rate at rest. The quantified perceived intensity of exercise and the degree of fatigue according to the perceived intensity of exercise may be displayed on the screen of the terminal device 100.

[0059] FIG. 10 is an example of displaying the waveform of time-series data of biometric data (pulse) output from the measuring device 16 on the screen of the terminal device 100. The measuring device 16 generates biometric data using a reception signal received by a measurement channel with a large area deviation. Therefore, the waveform of the time-series data of biometric data (pulse) output from the measuring device 16 is smooth with little drift or noise, as shown in FIG. 10. A user who visually checks the waveform displayed on the screen can check the state of the subject's pulse. For example, the state of the subject's body, health, mind, emotions, etc. can be verified based on the strength, interval, and time change of the pulse.

[0060] (operation) Next, the operation of the biological data measurement system 1 of this embodiment will be described with reference to the drawings. In the following, the optical sensor 10 and the measurement device 16 constituting the biological data measurement system 1 will be described individually.

[0061] [Measuring equipment] Fig. 15 is a flowchart for explaining an example of the operation of the measuring device 16. In the process according to the flowchart of Fig. 15, the measuring device 16 will be described as the subject of the operation.

[0062] In FIG. 15, first, the measuring device 16 outputs a first measurement instruction to the optical sensor 10 (step S11).

[0063] Next, the measurement device 16 executes a measurement channel setting process (step S12). The measurement channel setting process is a process for setting a channel to be used for the main measurement according to the value of the biological data based on the reception signal received in response to the first measurement instruction. The measurement channel setting process will be described later in detail.

[0064] Next, the measurement device 16 acquires a received light signal from the optical sensor 10 (step S13). The received signal acquired from the optical sensor 10 at this stage is a signal measured by main measurement in response to the second measurement instruction.

[0065] Next, the measuring device 16 generates biological data according to the acquired light receiving signal (step S14).

[0066] Next, the measuring device 16 outputs the generated biological data (step S15).

[0067] If it is time to update the measurement channel (Yes in step S16), the process returns to step S11. At the update timing, the measurement device 16 may output a first measurement instruction to the optical sensor 10 to execute the first measurement process by focusing on an area including the measurement channel.

[0068] If it is not time to update the measurement channel after step S15 (No in step S16), and measurement is to be continued (Yes in step S17), the process returns to step S13. On the other hand, if measurement is to be ended (No in step S17), the process according to the flowchart in Fig. 15 ends. The continuation / end of measurement may be determined according to a preset timing, the timing when the measurement value is no longer being measured, etc.

[0069] <Measurement channel setting process for each channel> Next, the measurement channel setting process for each channel by the measuring device 16 will be described with reference to the drawings. Fig. 16 is a flow chart for explaining the measurement channel setting process for each channel.

[0070] In FIG. 16, first, the measuring device 16 acquires biological data measured by the optical sensor 10 in response to the first measurement instruction (step S111).

[0071] Next, the measurement device 16 calculates a representative value of the biological data for each channel of the light receiving element array 12 (step S112). For example, the measurement device 16 calculates a maximum value of the biological data for each channel.

[0072] Next, the measurement device 16 calculates the average value of the representative values ​​of the biological data for all the channels of the light-receiving element array 12 (step S113).

[0073] Next, the measurement device 16 subtracts the average value of the representative values ​​of the biological data for all channels from the representative value of the biological data for each channel constituting the light receiving element array 12 to calculate the channel deviation for each channel (step S114).

[0074] Next, the measurement device 16 sets a measurement candidate region where the deviation exceeds a threshold value (step S115).

[0075] Next, the measuring device 16 selects at least one measurement channel from the channels included in the measurement candidate region (step S116). In other words, the measuring device 16 sets a measurement region within the range of the measurement candidate region.

[0076] Next, the measuring device 16 outputs a second measurement instruction using the selected measurement channel to the optical sensor 10 (step S117).

[0077] <Measurement channel setting process for each calculation domain> Next, the measurement channel setting process for each calculation region by the measuring device 16 will be described with reference to the drawings. Fig. 17 is a flowchart for explaining the measurement channel setting process for each calculation region.

[0078] In FIG. 17, first, the measuring device 16 acquires biological data measured by the optical sensor 10 in response to the first measurement instruction (step S121).

[0079] Next, the measurement device 16 calculates a representative value of the biological data for each calculation region of the light receiving element array 12 (step S122). For example, the measurement device 16 calculates a maximum value of the biological data for each calculation region.

[0080] Next, the measurement device 16 calculates the average value of the representative values ​​of the biological data for all calculation regions of the light-receiving element array 12 (step S123).

[0081] Next, the measuring device 16 calculates the standard deviation of the channel deviations for all the light receiving elements (step S124).

[0082] Next, the measurement device 16 subtracts the average value of the representative values ​​of the biological data for all calculation areas from the representative value of the biological data for each calculation area set in the light receiving element array 12 to calculate the regional deviation for each calculation area (step S125).

[0083] Next, the measurement device 16 sets a measurement candidate region according to the comparison result between the region deviation and the standard deviation (step S126). For example, the measurement device 16 selects a selected region in which the region deviation is 1.5 times or more the standard deviation as the measurement candidate region.

[0084] Next, the measuring device 16 selects at least one measurement channel from the channels included in the measurement candidate region (step S127). In other words, the measuring device 16 sets a measurement region within the range of the measurement candidate region.

[0085] Next, the measuring device 16 outputs a second measurement instruction using the selected measurement channel to the optical sensor 10 (step S128).

[0086] [Optical sensor] Fig. 18 is a flowchart for explaining an example of the operation of the optical sensor 10. In the process according to the flowchart of Fig. 18, the optical sensor 10 will be described as the subject of the operation.

[0087] 18, first, when the optical sensor 10 acquires a first measurement instruction (Yes in step S131), it executes a first measurement process (step S132). Details of the first measurement process will be described later. On the other hand, when the first measurement instruction has not been acquired (No in step S131), the optical sensor 10 waits until the first measurement instruction is acquired.

[0088] After step S132, when the second measurement instruction is acquired (Yes in step S133), the optical sensor 10 executes the second measurement process (step S134). Details of the second measurement process will be described later. On the other hand, when the second measurement instruction is not acquired (No in step S133), the optical sensor 10 waits until the second measurement instruction is acquired.

[0089] After step S134, if the first measurement instruction is acquired (Yes in step S135), the optical sensor 10 returns to step S132 and executes the first measurement process. On the other hand, if the first measurement instruction is not acquired (No in step S135), and if the measurement is to be continued (Yes in step S136), the optical sensor 10 returns to step S134 and continues the second measurement process. On the other hand, if the measurement is to be ended (No in step S136), the process according to the flowchart in Fig. 18 ends. The continuation / end of the measurement may be determined according to a preset timing, the timing when the measurement value is no longer being measured, or the like.

[0090] <First measurement process> Next, the first measurement process by the optical sensor 10 will be described with reference to the drawings. The first measurement process is executed in response to a first measurement instruction from the measuring device 16. Fig. 19 is a flowchart for explaining the first measurement process by the optical sensor 10.

[0091] In FIG. 19, the optical sensor 10 controls the light emitter 11 to emit an optical signal for a first measurement (step S141).

[0092] Next, the optical sensor 10 receives the reflected light of the optical signal emitted from the light emitter 11 through all channels of the light receiving element array 12 (step S142).

[0093] Next, the optical sensor 10 outputs the light receiving signals received by all the channels of the light receiving element array 12 to the measurement device 16 (step S143).

[0094] <Second measurement process> Next, the second measurement process by the optical sensor 10 will be described with reference to the drawings. The second measurement process is executed in response to a second measurement instruction from the measuring device 16. Fig. 20 is a flowchart for explaining the second measurement process by the optical sensor 10.

[0095] In FIG. 20, the optical sensor 10 controls the light emitter 11 to emit an optical signal for the second measurement (step S151).

[0096] Next, the optical sensor 10 receives the reflected light of the optical signal emitted from the light emitter 11 at a measurement channel selected from the light receiving element array 12 (step S152).

[0097] Next, the optical sensor 10 outputs the light receiving signal received by the measurement channel selected from the light receiving element array 12 to the measurement device 16 (step S153).

[0098] As described above, the biological data measurement system of this embodiment includes an optical sensor and a measurement device. The optical sensor has a plurality of light emitters, a light receiving element array, and a control unit. The plurality of light emitters are arranged on a measurement surface of a substrate that is attached to the skin of a subject whose biological data is to be measured. The plurality of light emitters emit optical signals toward the skin of the subject. The light receiving element array includes a plurality of light receiving elements arranged two-dimensionally. The light receiving element array is arranged on the measurement surface of the substrate. The light receiving element array receives reflected light of the optical signals emitted from the plurality of light emitters. The control unit causes the plurality of light emitters to emit optical signals in response to a measurement instruction from the measurement device. The control unit receives a reception signal for each light receiving element in response to the reflected light of the optical signal received by the plurality of light receiving elements constituting the light receiving element array. The control unit outputs the received reception signal for each light receiving element to the measurement device. The control unit outputs a reception signal by the light receiving element within the range of the measurement area set by the measurement device to the measurement device during a period of the second measurement in response to a second measurement instruction from the measurement device.

[0099] The measurement device of this embodiment includes a measurement instruction output unit, a reception signal acquisition unit, a biological data generation unit, a calculation unit, a measurement area setting unit, and a biological data output unit. The measurement instruction output unit outputs a measurement instruction including a first measurement instruction for instructing a first measurement corresponding to a preliminary measurement and a second measurement instruction for instructing a second measurement corresponding to a main measurement to an optical sensor including a light receiving element array in which a plurality of light receiving elements are arranged two-dimensionally. The reception signal acquisition unit acquires at least one reception signal of the plurality of light receiving elements in response to the measurement instruction. The biological data generation unit generates biological data for each light receiving element using the acquired reception signal. The calculation unit calculates the deviation of the biological data for each light receiving element using the biological data generated using the reception signal acquired in response to the first measurement instruction. The measurement area setting unit sets a measurement area including a light receiving element used in a second measurement in response to the second measurement instruction in response to the deviation of the biological data for each light receiving element. The biological data output unit outputs the biological data measured in the second measurement in response to the second measurement instruction.

[0100] In this embodiment, in the measurement of biological data using an optical sensor, a measurement area including a light receiving element used in a second measurement equivalent to the main measurement is set according to the deviation of the biological data for each light receiving element. According to this embodiment, in the second measurement equivalent to the main measurement, the load of measurement and communication by the optical sensor can be reduced. Therefore, according to this embodiment, it is possible to realize continuous measurement of biological data using an optical sensor.

[0101] In one aspect of this embodiment, the measurement instruction output unit outputs a first measurement instruction to the optical sensor, which instructs measurement using all of the multiple light receiving elements constituting the light receiving element array. Also, the measurement instruction output unit outputs a second measurement instruction to the optical sensor, which instructs measurement using light receiving elements within the range of the measurement area among the multiple light receiving elements constituting the light receiving element array. In this aspect, in the first measurement corresponding to the preliminary measurement, the deviation of the biological data for each light receiving element is verified for all of the multiple light receiving elements. Therefore, according to this aspect, the optimal measurement area can be set without omission on the light receiving surface of the light receiving element array. Also, according to this aspect, the load in the second measurement can be reduced by narrowing down the light receiving elements to be the target of the second measurement.

[0102] In one aspect of this embodiment, the calculation unit calculates the difference between the representative value of the biometric data for each light receiving element and the representative value of all the biometric data of the multiple light receiving elements as the deviation of the biometric data for each light receiving element. The measurement area setting unit sets a measurement candidate area according to the deviation of the biometric data for each light receiving element. The measurement area setting unit sets the measurement area within the range of the measurement candidate area. According to this aspect, the load in the second measurement can be reliably reduced by setting the measurement area within the range of the measurement candidate area set according to the deviation of the biometric data for each light receiving element.

[0103] In one aspect of the present embodiment, the measurement area setting unit sets an area consisting of light receiving elements in which the deviation of the biological data for each light receiving element exceeds a predetermined threshold as a measurement candidate area. According to this aspect, the measurement area can be clearly set according to the predetermined threshold.

[0104] In one aspect of this embodiment, the calculation unit calculates the standard deviation of the deviations of the biological data for all of the multiple light receiving elements. The measurement area setting unit sets an area consisting of light receiving elements whose deviation is a predetermined multiple or more of the standard deviation as the measurement candidate area. The calculation unit sets the measurement area within the range of the measurement candidate area. According to this aspect, the measurement area can be clearly set according to the value of the deviation relative to the standard deviation.

[0105] In one aspect of this embodiment, the calculation unit calculates the difference between the representative value of the biometric data for each of a plurality of calculation areas including a plurality of light receiving elements and the average value of the representative values ​​of the biometric data for all of the plurality of calculation areas as the area deviation of the biometric data for each calculation area. The measurement area setting unit sets the measurement candidate area according to the area deviation of the biometric data for each calculation area. According to this aspect, by setting the measurement area according to the area deviation of the biometric data for each calculation area, the load on setting the measurement area according to the first measurement can be reduced.

[0106] In one aspect of this embodiment, the measurement instruction output unit outputs the first measurement instruction to the optical sensor and updates the measurement area when a predetermined period has elapsed since the start of the second measurement according to the second measurement instruction. According to this aspect, by updating the measurement area in a timely manner, continuous measurement of biological data can be realized.

[0107] In one aspect of this embodiment, when the measurement value of the biological data falls below the reference value in the second measurement according to the second measurement instruction, the measurement instruction output unit outputs the first measurement instruction to the optical sensor and updates the measurement area. According to this aspect, continuous measurement of the biological data can be realized by updating the measurement area according to the measurement value of the biological data.

[0108] In one aspect of this embodiment, when updating the measurement area, the measurement instruction output unit outputs a first measurement instruction to the optical sensor, the first measurement instruction including an instruction to narrow down the measurement range to the surrounding area and the measurement area, to perform the first measurement. According to this aspect, by narrowing down the measurement range in the first measurement in updating the measurement area, the load on the first measurement can be reduced.

[0109] In one aspect of this embodiment, when the measurement value of the biological data is interrupted in the second measurement according to the second measurement instruction, the measurement area setting unit resets the area with a high deviation rank as the measurement area. The measurement instruction output unit outputs a second measurement instruction including an instruction to continue the measurement in the reset measurement area to the optical sensor. According to this aspect, in a situation where the measurement value of the biological data is interrupted, continuous measurement of the biological data can be realized by resetting the measurement area.

[0110] In one aspect of the present embodiment, the biometric data output unit outputs a heat map in which the measurement area is highlighted in association with the light receiving surface of the light receiving element array. According to this aspect, for example, by displaying the heat map on a screen, a person viewing the screen can confirm that an appropriate measurement area has been set.

[0111] Second embodiment Next, an optical sensor according to a second embodiment will be described with reference to the drawings. The optical sensor of this embodiment includes the functions of the measurement device of the first embodiment.

[0112] Fig. 21 is a block diagram showing an example of the configuration of the optical sensor 20 of this embodiment. The optical sensor 20 includes a plurality of light emitters 21, a light receiving element array 22, and a control unit 23. The plurality of light emitters 21, the light receiving element array 22, and the control unit 23 are arranged on a substrate, similar to the first embodiment (Figs. 2 to 3). The substrate is similar to the substrate 110 of the first embodiment, and therefore a detailed description thereof will be omitted. A description of an adhesive layer and the like for attaching the optical sensor 20 to the human body will be omitted.

[0113] The light emitter 21 has the same configuration as the light emitter 11 of the first embodiment. The light emitter 21 has an emission surface that emits light used to measure the pulse. The multiple light emitters 21 are arranged with their emission surfaces facing the same direction. The emission surfaces of the multiple light emitters 21 and the light receiving surface of the light receiving element array 22 are arranged facing the same direction. The emission surface of the light emitter 21 is directed toward the skin of the subject with the optical sensor 20 attached to the skin of the subject. The light emitter 21 emits an optical signal in a wavelength band capable of measuring the pulse according to the control of the control unit 23.

[0114] The light receiving element array 22 has a similar configuration to the light receiving element array 12 of the first embodiment. The light receiving element array 22 has a light receiving surface that receives reflected light of the optical signal emitted from the light emitter 21. The reflected light is a light component of the optical signal emitted from the light emitter 21 that is reflected / scattered under the skin (inside the body) of the subject and reaches the light receiving surface of the light receiving element array 22. A plurality of light receiving elements are arranged in a two-dimensional array on the light receiving surface of the light receiving element array 22. The light intensity of the reflected light received by each of the plurality of light receiving elements arranged in the two-dimensional array is measured in association with the position (address) of the light receiving element.

[0115] The control unit 23 has a configuration similar to that of the control unit 13 of the first embodiment. The control unit 23 differs from the control unit 13 of the first embodiment in that the control unit 23 includes the functions of the measuring device 16 of the first embodiment. The control unit 23 controls the multiple light emitters 21. For example, the control unit 23 is realized by a microcomputer (also called a microcontroller) or a microcontroller.

[0116] 21, the control unit 23 has a measurement instruction acquisition unit 231, a light emission control unit 232, a storage unit 233, a signal acquisition unit 234, a signal output unit 235, and a measurement unit 236. In the following, the functions of the measurement device 16 of the first embodiment will be described as being performed by the measurement unit 236. The functions of the measurement unit 236 may be divided into multiple components.

[0117] The measurement unit 236 has the same function as the measurement device 16 of the first embodiment. When the optical sensor 10 is activated, the measurement unit 236 outputs a first measurement instruction to the light emission control unit 232 to perform a preliminary measurement prior to continuous main measurement. The first measurement instruction is an instruction to perform preliminary measurement for a certain period of time with all light receiving elements of the light receiving element array 22. The measurement unit 236 also outputs a second measurement instruction to the optical sensor 20 to perform measurement in a selected measurement channel. The second measurement instruction is an instruction to perform continuous main measurement in a selected measurement channel among the light receiving elements of the light receiving element array 22.

[0118] Furthermore, the measuring section 236 outputs a first measurement instruction to the light emission control section 232 in order to update the measurement channel at a predetermined update timing. For example, the measuring section 236 may output an instruction to perform a first measurement instruction for an area including the measurement channel being measured to the light emission control section 232. Furthermore, the measuring section 236 may update the measurement channel in response to the value or fluctuation of the biological data while performing the main measurement.

[0119] The measurement unit 236 acquires the reception signal from the signal acquisition unit 234. The measurement unit 236 generates biometric data using the acquired reception signal. For example, the measurement unit 236 generates pulse data using time series data of the acquired reception signal. There are no particular limitations on the biometric data generated by the measurement unit 236.

[0120] The measurement unit 236 selects a channel for performing the main measurement using the biological data based on the reception signal received in response to the first measurement instruction. The measurement unit 236 calculates a representative value of the amplitude of the biological data for each channel of all of the multiple light receiving elements (channels) constituting the light receiving element array 22. The measurement unit 236 also calculates the average value of the representative values ​​of the multiple light receiving elements (channels) constituting the light receiving element array 22. The measurement unit 236 calculates the deviation (also called channel deviation) for each channel, obtained by subtracting the average value of the representative values ​​of the multiple light receiving elements (channels) from the representative value for each light receiving element (channel).

[0121] The measurement unit 236 may calculate the deviation of the measurement values ​​by the multiple light receiving elements (channels) constituting the light receiving element array 22 for multiple channels, rather than for a single channel. For example, the measurement unit 236 may set an area (also called a calculation area) consisting of multiple light receiving elements, and calculate the deviation of the measurement values ​​for each calculation area. For example, the measurement unit 236 calculates the deviation of the calculation area (also called an area deviation) by subtracting the average value of the representative values ​​of the multiple light receiving elements (channels) from the average value of the representative values ​​of the measurement values ​​by the light receiving elements (channels) included in the calculation area. In addition, the measurement unit 236 calculates the standard deviation of the channel deviations calculated for the multiple light receiving elements (channels).

[0122] The measurement unit 236 selects a channel (also called a measurement channel) to be used for the main measurement of the biological data based on the channel deviation calculated for each channel, the region deviation calculated for each calculation region, and the standard deviation of the channel deviations for the multiple light receiving elements (channels). For example, the measurement unit 236 sets the region of the channel in which the deviation of the channel deviation, the region deviation, etc. exceeds a predetermined threshold value as the measurement candidate region. For example, the measurement unit 236 selects the measurement channel according to the result of comparing the deviation of the channel deviation, the region deviation, etc. with the standard deviation of the channel deviation for the multiple light receiving elements (channels). The measurement unit 236 sets the light receiving element (channel) in which the deviation of the channel deviation, the region deviation, etc. is a predetermined multiple or more with respect to the standard deviation of the channel deviation for the multiple light receiving elements (channels) as the measurement candidate region. For example, the measurement unit 236 sets the light receiving element (channel) in which the deviation of the channel deviation, the region deviation, etc. is 1.5 times or more with respect to the standard deviation of the channel deviation for the multiple light receiving elements (channels) as the measurement candidate region. The measurement unit 236 selects the measurement channel from the light receiving elements (channels) set in the measurement candidate region. The measurement unit 236 sets the selected measurement channel in the measurement region.

[0123] The measurement unit 236 may store measurement channels with high ranks in channel deviation or region deviation among the channels included in the measurement candidate region. For example, when the measurement in the measurement channel selected according to the channel deviation or region deviation is interrupted, the measurement unit 236 reselects a measurement channel from a region with a high rank in channel deviation or region deviation. In other words, when the measurement in the measurement region is interrupted, the measurement unit 236 resets the region with a high rank in channel deviation or region deviation as the measurement region. In this way, even if the measurement in the measurement channel is suddenly interrupted, the measurement of biological data can be continued. Such processing can also be applied to the first embodiment.

[0124] The measurement instruction acquisition unit 231 has the same configuration as the measurement instruction acquisition unit 131 of the first embodiment. The measurement instruction acquisition unit 231 acquires a measurement instruction from the measurement unit 236. The measurement instruction acquisition unit 231 acquires an instruction to perform a preliminary measurement (also called a first measurement instruction) from the measurement unit 236. The measurement instruction acquisition unit 231 outputs the acquired first measurement instruction to the light emission control unit 232 and the signal acquisition unit 234. The measurement instruction acquisition unit 231 also acquires an instruction to perform a measurement in a measurement channel (also called a second measurement instruction) from the measurement unit 236. The measurement instruction acquisition unit 231 outputs the acquired second measurement instruction to the light emission control unit 232 and the signal acquisition unit 234. Note that the measurement instruction acquisition unit 231 may be omitted, and the measurement unit 236 may output the first measurement instruction and the second measurement instruction to the light emission control unit 232 and the signal acquisition unit 234.

[0125] The light emission control unit 232 has the same configuration as the light emission control unit 132 of the first embodiment. The light emission control unit 232 acquires a measurement instruction by the measurement unit 236 from the measurement instruction acquisition unit 231. The light emission control unit 232 acquires a first measurement instruction to perform a preliminary measurement (first measurement process) from the measurement instruction acquisition unit 231. The light emission control unit 232 controls the multiple light emitters 21 to emit light in response to the first measurement instruction. The light emission control unit 232 controls the multiple light emitters 21 with a control method according to the first measurement instruction stored in the storage unit 233. In addition, the light emission control unit 232 acquires a second measurement instruction to perform a continuous main measurement (second measurement process) from the measurement instruction acquisition unit 231. The light emission control unit 232 controls the multiple light emitters 21 to emit light in response to the second measurement instruction. The light emission control unit 232 controls the multiple light emitters 21 with a control method according to the second measurement instruction stored in the storage unit 233.

[0126] The storage unit 233 has the same configuration as the storage unit 133 of the first embodiment. The storage unit 233 stores a control method for causing the multiple light emitters 21 to emit light. The control method stored in the storage unit 233 is referenced by the light emission control unit 232. The control method stored in the storage unit 233 is not particularly limited.

[0127] The signal acquiring unit 234 has the same configuration as the signal acquiring unit 134 of the first embodiment. The signal acquiring unit 234 acquires a measurement instruction by the measuring unit 236 from the measurement instruction acquiring unit 231. The signal acquiring unit 234 acquires a first measurement instruction to perform a preliminary measurement (first measurement process) from the measurement instruction acquiring unit 231. The signal acquiring unit 234 acquires a light receiving signal received by all the light receiving elements constituting the light receiving element array 22 in response to the first measurement instruction. The signal acquiring unit 234 outputs the light receiving signal received by all the light receiving elements to the measuring unit 236. In addition, the signal acquiring unit 234 acquires a second measurement instruction to perform a continuous main measurement (second measurement process) from the measurement instruction acquiring unit 231. In response to the second measurement instruction, the signal acquiring unit 234 acquires a light receiving signal received by the light receiving element set to the measurement channel selected by the measuring unit 236. The signal acquiring unit 234 outputs to the measuring unit 236 a light receiving signal received by a light receiving element set in the measurement channel.

[0128] In response to the second measurement instruction, the measurement unit 236 generates biometric data using the light receiving signal acquired from the signal acquisition unit 234. The measurement unit 236 outputs the biometric data measured in response to the second measurement instruction to the signal output unit 235.

[0129] The signal output unit 235 acquires the biometric data measured in response to the second measurement instruction from the measurement unit 236. The signal output unit 235 outputs the acquired biometric data. The signal output unit 235 may output the biometric data via a wired connection such as a cable, or may output the biometric data via wireless communication. For example, the signal output unit 235 is configured to output the biometric data via a wireless communication function (not shown) conforming to standards such as Bluetooth (registered trademark) and WiFi (registered trademark). The communication function of the signal output unit 235 may conform to standards other than Bluetooth (registered trademark) and WiFi (registered trademark). There is no particular limitation on the output destination and use of the biometric data. For example, the signal output unit 235 outputs the biometric data to a dedicated terminal device (not shown) having a screen. For example, the signal output unit 235 outputs the biometric data to a mobile terminal (not shown) such as a smartphone or tablet carried by the user. For example, the signal output unit 235 outputs the biometric data to an external system (not shown) constructed on a server or cloud. For example, the signal output section 235 may store the biological data acquired from the measuring section 236 in a storage device such as a flash memory, and output the biological data measured during a predetermined period all at once.

[0130] (operation) Next, the operation of the optical sensor 20 of this embodiment will be described with reference to the drawings. Fig. 22 is a flowchart for explaining an example of the operation of the optical sensor 20. In the process according to the flowchart of Fig. 22, the optical sensor 20 will be described as the subject of the operation.

[0131] 22, first, when the optical sensor 20 is activated, it executes a first measurement process (step S21). Details of the first measurement process in step S21 are similar to those of the first measurement process in FIG.

[0132] Next, the optical sensor 20 executes a measurement channel setting process (step S22). The measurement channel setting process in step S22 is similar to the measurement channel setting process in FIG.

[0133] Next, the optical sensor 20 executes a second measurement process (step S23). The second measurement process in step S23 is similar to the second measurement process in FIG.

[0134] If it is time to update the measurement channel (Yes in step S24), the process returns to step S21. At the update timing, the optical sensor 20 may execute the first measurement process by focusing on an area including the measurement channel.

[0135] If it is not time to update the measurement channel after step S23 (No in step S24), and measurement is to be continued (Yes in step S25), the process returns to step S23. On the other hand, if measurement is to be ended (No in step S25), the process according to the flowchart in Fig. 22 ends. The continuation / end of measurement may be determined according to a preset timing, the timing when the measurement value is no longer being measured, etc.

[0136] As described above, the optical sensor of this embodiment has a plurality of light emitters, a light receiving element array, and a control unit. The plurality of light emitters are arranged on a measurement surface of a substrate that is attached to the skin of a subject whose biological data is to be measured. The plurality of light emitters emit optical signals toward the skin of the subject. The light receiving element array includes a plurality of light receiving elements arranged two-dimensionally. The light receiving element array is arranged on the measurement surface of the substrate. The light receiving element array receives reflected light of the optical signals emitted from the plurality of light emitters.

[0137] The control unit of this embodiment has a measurement instruction acquisition unit, a light emission control unit, a storage unit, a signal acquisition unit, a measurement unit, and a signal output unit. The measurement unit outputs a measurement instruction including a first measurement instruction instructing a first measurement corresponding to a preliminary measurement and a second measurement instruction instructing a second measurement corresponding to a main measurement. The measurement instruction acquisition unit acquires the measurement instruction by the measurement unit. The light emission control unit causes the multiple light emitters to emit optical signals in response to the measurement instruction from the measurement device. The signal acquisition unit acquires a reception signal for each light receiving element corresponding to the reflected light of the optical signal received by the multiple light receiving elements constituting the light receiving element array. The measurement unit acquires at least one reception signal from the multiple light receiving elements in response to the measurement instruction. The measurement unit generates biometric data for each light receiving element using the acquired reception signal. The measurement unit calculates the deviation of the biometric data for each light receiving element using the biometric data generated using the reception signal acquired in response to the first measurement instruction. The measurement unit sets a measurement area including the light receiving element used for the second measurement in response to the second measurement instruction in response to the deviation of the biometric data for each light receiving element. The signal output unit outputs biological data measured in a second measurement in response to the second measurement instruction.

[0138] In the optical sensor of this embodiment, in measuring biological data, a measurement area including a light receiving element used in a second measurement corresponding to a main measurement is set according to the deviation of the biological data for each light receiving element. According to this embodiment, the optical sensor can reduce the load of measurement and communication and can measure biological data continuously.

[0139] (Third embodiment) Next, a biological information estimation system according to a third embodiment will be described with reference to the drawings. The biological information estimation system of this embodiment estimates biological information of a subject based on biological data (pulse signal) output from the measurement device of the first and second embodiments.

[0140] (composition) FIG. 23 is a block diagram showing an example of the configuration of a biological information estimation system 3 according to this embodiment. The biological information estimation system 3 includes an optical sensor 30, a measuring device 36, and an estimation device 37. The optical sensor 30 is the optical sensor 10 of the first embodiment. The measuring device 36 is the measuring device 16 of the first embodiment. Details of the optical sensor 30 and the measuring device 36 will not be described. The biological information estimation system 3 may include the optical sensor 20 of the second embodiment. When the biological information estimation system 3 includes the optical sensor 20 of the second embodiment, the measuring device 36 can be omitted. The biological information estimation system 3 may be configured by the measuring device 36 and the estimation device 37.

[0141] The estimation device 37 acquires the pulse signal output from the optical sensor 30. The estimation device 37 estimates biological information of the subject based on the acquired pulse signal. The biological information of the subject includes the pulse, physical condition, emotion, and the like.

[0142] For example, the estimation device 37 estimates the subject's pulse based on the pulse signal. For example, the estimation device 37 estimates the pulse according to the interval between the maximum value and the minimum value appearing in the time series data of the pulse signal. For example, the estimation device 37 estimates the pulse according to the expression cycle of the feature amount extracted from the time series data of the pulse signal. The estimation device 37 outputs information related to the pulse, such as the estimated pulse interval and the intensity of the pulse signal.

[0143] For example, the estimation device 37 estimates the subject's physical condition based on the pulse signal. For example, the estimation device 37 estimates the subject's physical condition based on the time series data of the pulse signal. When the subject is at rest, the intensity of the pulse signal decreases and the pulse interval increases. When the subject is exercising, the intensity of the pulse signal increases and the pulse interval decreases. When the subject has arrhythmia, the pulse rhythm becomes irregular and the pulse is interrupted. The subject's physical condition also affects the baseline of the time series data of the pulse signal. When the subject's physical condition is stable, the baseline fluctuation is small. In contrast, when the subject's physical condition is unstable, the baseline fluctuation is large. For example, the baseline shows an upward or downward trend depending on the subject's physical condition. Also, when the subject has some kind of illness, characteristics specific to that illness may appear in the pulse signal. By using an estimation model that has previously learned the characteristics of a disease that appear in a pulse signal, it is possible to estimate the disease that a subject suffers from based on the subject's pulse signal. The estimation device 37 outputs information related to the estimated physical condition of the subject.

[0144] For example, the subject's physical state, such as stress, fatigue, or drowsiness, also affects the pulse signal. The estimation device 37 extracts features corresponding to the physical state, such as stress, fatigue, or drowsiness, from the time-series data of the pulse. For example, the estimation device 37 extracts features such as the average value, standard deviation, coefficient of variation, root-mean-square value, and frequency component of the time-series data of the pulse. The estimation device 37 estimates the subject's physical state according to the extracted features. The estimation device 37 outputs information related to the estimated physical state of the subject, recommendation information corresponding to the estimated physical state, and the like.

[0145] For example, the estimation device 37 estimates the subject's emotion based on the pulse signal. The subject's emotion can be estimated from the intensity and fluctuation of the pulse. For example, the estimation device 37 estimates the degree of emotion such as joy, anger, sadness, and happiness according to the fluctuation of the time series data of the pulse. For example, the estimation device 37 may estimate the subject's emotion according to the fluctuation of the baseline of the time series data regarding the pulse. For example, when the subject's "anger" gradually increases, the baseline shows an upward trend according to the increase in the subject's excitement (arousal level). For example, when the subject's "sadness" gradually increases, the baseline shows a downward trend according to the decrease in the subject's excitement (arousal level).

[0146] FIG. 24 is a conceptual diagram for explaining emotions that the estimation device 37 estimates based on a pulse signal. In the example of FIG. 24, emotions are estimated according to the relationship between valence (horizontal axis) and arousal level (vertical axis). The valence (horizontal axis) quantifies the comfort of the emotion. The valence (horizontal axis) indicates a more comfortable state toward the right and an unpleasant state toward the left. The arousal level (vertical axis) quantifies the excitement of the emotion. The arousal level (vertical axis) indicates a more excited state toward the top and a more calm state toward the bottom. In the example of FIG. 24, emotions of joy, anger, sadness, and pleasure are associated with each quadrant defined by the valence (horizontal axis) and arousal level (vertical axis). "Joy" is associated with the first quadrant. The higher the valence and the higher the arousal level, the higher the degree of "joy". "Anger" is associated with the second quadrant. The lower the valence and the higher the arousal level, the higher the degree of "anger". "Sadness" is associated with the third quadrant. The lower the emotional valence and the lower the arousal level, the higher the degree of "sadness." The fourth quadrant is associated with "happy." The higher the emotional valence and the lower the arousal level, the higher the degree of "happy." Note that the association of emotions with the graph in FIG. 24 is merely an example, and does not limit the criteria for emotion estimation by the bioinformation estimation system 3 of this embodiment. For example, the subject's emotions may be classified into more detailed emotional states rather than into four emotional states such as joy, anger, sadness, and happiness. The subject's emotions may be classified not only by the two-dimensional coordinate system as in FIG. 24, but also by any classification method for emotional states.

[0147] The heart rate fluctuates under the influence of autonomic nerve activity such as the sympathetic and parasympathetic nerves. Similarly, the pulse rate fluctuates under the influence of autonomic nerve activity such as the sympathetic and parasympathetic nerves. For example, low and high frequency components can be extracted by frequency analysis of the time series data of the pulse rate. The influence of the sympathetic and parasympathetic nerves is reflected in the low frequency components. The influence of the parasympathetic nerves is reflected in the high frequency components. Therefore, for example, the activity state of the autonomic nerve function can be estimated according to the ratio between the high frequency components and the low frequency components.

[0148] The sympathetic nerves tend to be active when the subject is excited. When the subject's sympathetic nerves are active, the pulse rate becomes faster. That is, the higher the pulse rate, the higher the level of arousal. The parasympathetic nerves tend to be active when the subject is relaxed. When the subject is relaxed, the pulse rate becomes slower. That is, the lower the pulse rate, the lower the level of arousal. In this way, the estimation device 37 can measure the level of arousal according to the pulse rate. For example, valence can be evaluated according to the fluctuation in the pulse interval. The more pleasant the emotional state, the more stable the emotion and the smaller the fluctuation in the pulse interval. That is, the smaller the fluctuation in the pulse interval, the higher the valence. On the other hand, the more unpleasant the emotional state, the more unstable the emotion and the larger the fluctuation in the pulse interval. That is, the larger the fluctuation in the pulse interval, the higher the valence. In this way, the estimation device 37 can measure valence according to the pulse interval. However, the method of measuring the arousal level and emotional valence is not limited to the methods and standards given here, as long as the pulse signal output from the optical sensor 30 is used.

[0149] The estimation device 37 estimates the arousal level and the valence level based on the time series data of the pulse signal. The estimation device 37 estimates the emotion according to the coordinates of the measured arousal level and the valence level in the coordinate system of the graph in FIG. 24. When the coordinates of the arousal level and the valence level measured for a certain subject are in the first quadrant, the estimation device 37 estimates that the emotional state of the subject is "joy". When the coordinates of the arousal level and the valence level measured for a certain subject are in the second quadrant, the estimation device 37 estimates that the emotional state of the subject is "anger". When the coordinates of the arousal level and the valence level measured for a certain subject are in the third quadrant, the estimation device 37 estimates that the emotional state of the subject is "sad". When the coordinates of the arousal level and the valence level measured for a certain subject are in the fourth quadrant, the estimation device 37 estimates that the emotional state of the subject is "happy". For example, when the valence level and the arousal level do not exceed the threshold value, the estimation device 37 determines that the emotional state of the subject is normal. For example, if the coordinates of the valence and arousal are inside the dashed circle shown in the center of the coordinate system in Fig. 24, the estimation device 37 judges that the emotional state of the subject is normal. The threshold value for judging that the emotional state of the subject is normal can be set arbitrarily. For example, such a threshold value may be different for each of the emotions of joy, anger, sadness, and pleasure.

[0150] The estimation device 37 may be configured to estimate emotions using a machine learning technique. FIG. 25 is a conceptual diagram showing an example of having the learning device 340 learn using a dataset of features (explanatory variables) extracted from a pulse signal and emotions (response variables) as teacher data. The teacher data is data in which a label of the emotional state at that time is added to a feature extracted from a pulse signal measured for a subject in any of the emotional states of joy, anger, sadness, and pleasure. The teacher data may be data in which a label of the emotional state at that time is added to a pulse signal measured for a subject in any of the emotional states of joy, anger, sadness, and pleasure. The learning device 340 generates an estimation model by supervised learning using the teacher data. For example, the estimation model 370 is generated in advance by having the learning device 340 learn teacher data related to multiple subjects. The estimation model 370 outputs an estimation result of the subject's emotion according to an input of features extracted from the pulse signal. There is no particular limitation on the specific machine learning technique.

[0151] Fig. 26 is a conceptual diagram for explaining an example in which the estimation device 37 estimates an emotion using the estimation model 370. In the example of Fig. 26, an estimation result of any one of emotions, joy, anger, sadness, and pleasure, is output from the estimation model 370 in response to an input of a pulse signal of a subject. For example, information related to the estimation result of the emotion output from the estimation model 370 is displayed on a screen of a terminal device or the like (not shown).

[0152] FIG. 27 is an example in which information on the subject's emotion estimated by the estimation device 37 in response to the pulse signal output from the optical sensor 30 is displayed on the screen of the terminal device 300. In the example of FIG. 27, recommendation information according to the subject's emotional state is also displayed on the screen of the terminal device 300. In the example of FIG. 27, the subject's emotional state is "anger". For example, emoticons or icons indicating the subject's emotional state may be displayed on the screen of the terminal device 300. The subject who visually recognizes the emotional state displayed on the screen can confirm his / her own emotional state. In addition, the subject who visually recognizes the recommendation information displayed on the screen can bring his / her own emotional state closer to a normal state by paying attention to the recommendation information. However, the recommendation information displayed on the screen does not necessarily bring about an expected change in the emotional state of the subject. For example, the estimated emotional state of the subject may be configured to be transmitted to a terminal device (not shown) owned by the subject's family or acquaintance. With this configuration, it may be possible to bring the subject's emotional state closer to normal based not on inorganic information displayed on a screen, but on the behavior of people who are close to the subject.

[0153] In the example of FIG. 27, an image of a flower is also displayed on the screen of the terminal device 300 in order to soften the emotional state of the subject toward a normal state. The image displayed on the screen may be any image as long as it has the potential to soften the emotional state of the subject. Not only images but also videos may be displayed on the screen of the terminal device 300. Music that softens the emotional state of the subject may be played from a speaker (not shown) of the terminal device 300. For example, if the emotional state of the subject is "sadness", content such as images, videos, and music that comfort the subject may be provided to the subject. For example, if the emotional state of the subject is "joy" or "pleasure", content that maintains these emotional states may be provided to the subject. It is preferable that the content provided to the subject is set for each emotion of the subject. For example, a function for inputting whether the provided information matches the emotion of the subject may be added. If the system is configured to learn the user's reaction to the provided information according to the estimated emotion and feed it back to subsequent emotion estimations, the emotion of the subject can be more accurately estimated.

[0154] For example, the optical sensor 30 may be attached to the driver of the vehicle, and recommendation information according to the driver's emotional state may be provided. For example, a safe driving environment can be provided by recommending the driver to take a break or notifying the driver of the estimated arrival time to the next parking area according to the estimation result of the driver's emotional state. For example, if the emotional state of the driver of the vehicle is "anger" or "sadness", music or a message that soothes or comforts the driver may be played. For example, if the emotional state of the driver of the vehicle is "comfortable", music or a message that encourages the driver to feel a little tense may be played. For example, if the emotional state of the driver of the vehicle is "joy", music or a message that makes it easy to maintain the emotional state may be played. For example, the system may be configured to provide recommendation information according to the driver's emotional state and driving time. For example, if the driving time becomes long and the driver's emotion shows a tendency to "anger", recommendation information such as "enter the next parking area, stand up and exercise" may be provided to the driver. For example, if the driver has been driving for a long time and the driver's emotions show a tendency toward "sadness," recommendation information such as "Put into the next parking area and take a nap" may be provided to the driver.

[0155] For example, the degree of distraction of a driver may be estimated based on the emotional state of the driver. The degree of distraction tends to be high when the emotional state is extreme. Therefore, for example, when the degree of arousal or the emotional valence is extremely high or extremely low, the degree of distraction is estimated to be high. A threshold value for the degree of distraction may be set for the degree of arousal or the emotional valence, and the degree of distraction of the driver may be estimated according to the relationship with the threshold value. For example, when the degree of distraction exceeds the threshold value, a notification sound may be generated to call attention.

[0156] For example, the optical sensor 30 may be attached to a user who is living a daily life, and recommendation information according to the subject's emotional state may be provided. For example, if the user's emotional state is "anger" or "sadness", recommendation information recommending exercise such as walking or running may be provided to distract the user. For example, if the user's emotional state is "anger" or "sadness", music or information that can easily shift the user's emotional state to "pleasure" or "joy" may be provided. For example, if the user's emotional state is "pleasure" or "joy", music or information that can enhance the emotional state may be provided. For example, if the user's emotional state is "pleasure" or "joy", intrusive information may not be provided so that the environment at that time is maintained.

[0157] As described above, the biological information estimation system of this embodiment includes an optical sensor, a measurement device, and an estimation device. The optical sensor is the optical sensor of the first or second embodiment. The measurement device is the measurement device of the first or second embodiment. The estimation device acquires biological data of the subject measured by the measurement device. The estimation device estimates the biological information of the subject based on the acquired biological data. According to this embodiment, the biological information of the subject can be estimated using the biological data measured by the measurement device.

[0158] In one aspect of this embodiment, the measurement device measures a pulse signal of a subject as biometric data. The estimation device estimates a pulse rate of the subject using the pulse signal of the subject. The estimation device outputs information corresponding to the estimated pulse rate. According to this aspect, for example, the pulse rate estimated using the biometric data measured by the measurement device is displayed on a screen, allowing a person viewing the screen to confirm the pulse rate of the subject.

[0159] In one aspect of the present embodiment, the estimation device estimates the emotional state of the subject using the pulse signal of the subject. The estimation device outputs information corresponding to the estimated emotional state. According to this aspect, for example, the emotional state estimated using biodata measured by the measurement device is displayed on a screen, so that a person viewing the screen can confirm the emotional state of the subject.

[0160] (Fourth embodiment) Next, a measurement device according to a fourth embodiment will be described with reference to the drawings. The measurement device according to this embodiment has a simplified configuration of the first to third measurement devices and measurement units. FIG. 28 is a block diagram showing an example of the configuration of a measurement device 46 according to this embodiment. The measurement device 46 includes a measurement instruction output unit 461, a received signal acquisition unit 462, a biological data generation unit 463, a calculation unit 464, and a measurement region setting unit 465.

[0161] The measurement instruction output unit 461 outputs a measurement instruction including a first measurement instruction for instructing a first measurement corresponding to a preliminary measurement and a second measurement instruction for instructing a second measurement corresponding to a main measurement to an optical sensor including a light receiving element array in which a plurality of light receiving elements are arranged two-dimensionally. The reception signal acquisition unit 462 acquires reception signals of at least one of the plurality of light receiving elements in response to the measurement instruction. The biometric data generation unit 463 generates biometric data for each light receiving element using the acquired reception signals. The calculation unit 464 calculates the deviation of the biometric data for each light receiving element using the reception signals acquired in response to the first measurement instruction. The measurement area setting unit 465 sets a measurement area including the light receiving element used for the second measurement in response to the second measurement instruction in response to the deviation of the biometric data for each light receiving element.

[0162] In this embodiment, in the measurement of biological data using an optical sensor, a measurement area including a light receiving element used in a second measurement equivalent to the main measurement is set according to the deviation of the biological data for each light receiving element. According to this embodiment, in the second measurement equivalent to the main measurement, the load of measurement and communication by the optical sensor can be reduced. Therefore, according to this embodiment, it is possible to realize continuous measurement of biological data using an optical sensor.

[0163] (Hardware) Here, a hardware configuration for executing the control and processing according to each embodiment of the present disclosure will be described using an information processing device 90 in Fig. 29 as an example. Note that the information processing device 90 in Fig. 29 is an example configuration for executing the control and processing according to each embodiment, and does not limit the scope of the present disclosure.

[0164] As shown in Fig. 29, an information processing device 90 includes a processor 91, a main memory device 92, an auxiliary memory device 93, an input / output interface 95, and a communication interface 96. In Fig. 29, the interface is abbreviated as I / F (Interface). The main memory device 92, the auxiliary memory device 93, the input / output interface 95, and the communication interface 96 are connected to each other via a bus 98 so as to be able to communicate data with each other. In addition, the processor 91, the main memory device 92, the auxiliary memory device 93, and the input / output interface 95 are connected to a network such as the Internet or an intranet via the communication interface 96.

[0165] The processor 91 loads a program stored in an auxiliary storage device 93 or the like into a main storage device 92. The processor 91 executes the program loaded into the main storage device 92. In this embodiment, a software program installed in the information processing device 90 may be used. The processor 91 executes control and processing according to each embodiment.

[0166] The main memory device 92 has an area in which a program is loaded. The processor 91 loads a program stored in the auxiliary memory device 93 or the like in the main memory device 92. The main memory device 92 is realized by a volatile memory such as a dynamic random access memory (DRAM). Furthermore, a non-volatile memory such as a magnetoresistive random access memory (MRAM) may be configured / added to the main memory device 92.

[0167] The auxiliary storage device 93 stores various data such as programs. The auxiliary storage device 93 is realized by a local disk such as a hard disk or a flash memory. Note that it is also possible to configure the main storage device 92 to store various data and omit the auxiliary storage device 93.

[0168] The input / output interface 95 is an interface for connecting the information processing device 90 to peripheral devices based on standards and specifications. The communication interface 96 is an interface for connecting to external systems and devices through a network such as the Internet or an intranet based on standards and specifications. The input / output interface 95 and the communication interface 96 may be a common interface for connecting to external devices.

[0169] Input devices such as a keyboard, a mouse, and a touch panel may be connected to the information processing device 90 as necessary. These input devices are used to input information and settings. When a touch panel is used as an input device, the display screen of the display device may also serve as an interface for the input device. Data communication between the processor 91 and the input devices may be mediated by an input / output interface 95.

[0170] The information processing device 90 may be equipped with a display device for displaying information. When the display device is equipped, the information processing device 90 is preferably equipped with a display control device (not shown) for controlling the display of the display device. The display device may be connected to the information processing device 90 via the input / output interface 95.

[0171] The information processing device 90 may also be provided with a drive device. The drive device mediates between the processor 91 and a recording medium (program recording medium) for reading data and programs from the recording medium, writing the processing results of the information processing device 90 to the recording medium, and the like. The drive device may be connected to the information processing device 90 via an input / output interface 95.

[0172] The above is an example of a hardware configuration for enabling the control and processing according to each embodiment of the present invention. Note that the hardware configuration in FIG. 29 is an example of a hardware configuration for executing the control and processing according to each embodiment, and does not limit the scope of the present invention. Also included in the scope of the present invention is a program for causing a computer to execute the control and processing according to each embodiment. Furthermore, also included in the scope of the present invention is a program recording medium on which the program according to each embodiment is recorded. The recording medium can be realized, for example, by an optical recording medium such as a CD (Compact Disc) or a DVD (Digital Versatile Disc). The recording medium can be realized, for example, by a USB (Universal Serial The program executed by the processor may be realized by a semiconductor recording medium such as a memory for storing programs and a secure digital (SD) card. The recording medium may also be realized by a magnetic recording medium such as a flexible disk, or other recording medium. When the program executed by the processor is recorded on a recording medium, the recording medium corresponds to a program recording medium.

[0173] The components of each embodiment may be combined in any manner. Furthermore, the components of each embodiment may be realized by software or by a circuit.

[0174] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above-mentioned embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

[0175] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) a measurement instruction output unit that outputs measurement instructions including a first measurement instruction for instructing a first measurement corresponding to a preliminary measurement and a second measurement instruction for instructing a second measurement corresponding to a main measurement to an optical sensor including a light receiving element array in which a plurality of light receiving elements are arranged two-dimensionally; a reception signal acquiring unit that acquires a reception signal from at least one of the plurality of light receiving elements in response to the measurement instruction; a biometric data generating unit that generates biometric data for each of the light receiving elements using the acquired reception signal; a calculation unit that calculates a deviation of the biological data for each of the light receiving elements by using the reception signal acquired in response to the first measurement instruction; a measurement area setting unit that sets a measurement area including the light receiving element used for a second measurement in response to the second measurement instruction in accordance with the deviation of the biological data for each light receiving element. (Appendix 2) The measurement instruction output unit is 2. The measuring device according to claim 1, wherein the first measurement instruction instructs measurement using all of the plurality of light receiving elements constituting the light receiving element array, and the second measurement instruction instructs measurement using the light receiving elements within the range of the measurement area among the plurality of light receiving elements constituting the light receiving element array, are output to the optical sensor. (Appendix 3) The calculation unit is Calculating a difference between the representative value of the biometric data for each of the light receiving elements and the representative value of all of the biometric data for the plurality of light receiving elements as the deviation of the biometric data for each of the light receiving elements; The measurement area setting unit is setting a measurement candidate region according to the deviation of the biological data for each of the light receiving elements; 3. The measurement device according to claim 1, wherein the measurement region is set within a range of the measurement candidate region. (Appendix 4) The measurement area setting unit is The measurement device according to claim 3, wherein a region consisting of the light receiving elements in which the deviation of the biological data for each light receiving element exceeds a predetermined threshold is set as the measurement candidate region. (Appendix 5) The calculation unit is Calculating a standard deviation of the deviations of the biological data for all of the plurality of light receiving elements; The measurement area setting unit is A region including the light receiving elements in which the deviation is equal to or greater than a predetermined multiple of the standard deviation is set as the measurement candidate region; 5. The measurement device according to claim 4, wherein the measurement area is set within a range of the measurement candidate area. (Appendix 6) The calculation unit is Calculating a difference between a representative value of the biological data for each of a plurality of calculation regions including a plurality of the light receiving elements and an average value of the representative values ​​of the biological data for all of the plurality of calculation regions as a regional deviation of the biological data for each of the calculation regions; The measurement area setting unit is 6. The measurement device according to claim 3, wherein the measurement candidate region is set in accordance with the region deviation of the biological data for each of the calculation regions. (Appendix 7) The measurement instruction output unit is 7. The measurement device according to claim 1, wherein the first measurement instruction is output to the optical sensor and the measurement area is updated at a timing when a predetermined period of time has elapsed since the start of the main measurement in response to the second measurement instruction. (Appendix 8) The measurement instruction output unit is 8. The measuring device according to claim 1, wherein, when the measurement value of the biological data falls below a reference value in the main measurement in response to the second measurement instruction, the measuring device outputs the first measurement instruction to the optical sensor and updates the measurement area. (Appendix 9) The measurement instruction output unit is 9. The measurement device according to claim 7 or 8, wherein when updating the measurement area, the first measurement instruction is output to the optical sensor, the first measurement instruction including an instruction to narrow down the preliminary measurement to a peripheral area of ​​the measurement area and the measurement area. (Appendix 10) The measurement area setting unit is When the measurement value of the biological data is interrupted in the main measurement in response to the second measurement instruction, a region having a high deviation rank is reset as the measurement region; The measurement instruction output unit is 10. The measurement device according to claim 1, further comprising: a second measurement instruction including an instruction to continue measurement in the reset measurement area, the ... (Appendix 11) 11. The measurement device according to any one of claims 1 to 10, further comprising a biological data output unit that outputs the biological data measured in the main measurement in response to the second measurement instruction. (Appendix 12) The biological data output unit includes: 12. The measurement device according to claim 11, wherein a heat map is output in which the measurement region is highlighted in correspondence with the light receiving surface of the light receiving element array. (Appendix 13) A measuring device according to any one of claims 1 to 12, a plurality of light emitters arranged on a measurement surface of a substrate that is attached to the skin of a subject whose biological data is to be measured, the light emitters emitting optical signals toward the skin of the subject; a light receiving element array disposed on the measurement surface of the substrate, the light receiving elements being two-dimensionally arranged to receive reflected light of the optical signals emitted from the light emitters; a control unit that causes a plurality of the light emitters to emit optical signals in response to a measurement instruction from the measuring device, receives a received signal for each of the light receiving elements in response to reflected light of the optical signal received by the plurality of the light receiving elements that constitute the light receiving element array, outputs the received signal for each of the light receiving elements to the measuring device, and outputs the received signal by the light receiving elements within a measurement area set by the measuring device to the measuring device during a period of main measurement in response to a second measurement instruction from the measuring device. (Appendix 14) A measuring device according to any one of claims 1 to 12, a control unit that causes the light emitters to emit the optical signals in response to a measurement instruction from the measurement device, receives a received signal for each of the light receiving elements corresponding to the reflected light of the optical signals received by the plurality of light receiving elements constituting the light receiving element array, outputs the received signal for each of the light receiving elements to the measurement device, and outputs the received signal by the light receiving elements within a measurement area set by the measurement device to the measurement device during a period of main measurement in response to a second measurement instruction from the measurement device. (Appendix 15) A measuring device according to any one of claims 1 to 12, an estimation device that acquires biometric data of the subject measured by the measurement device and estimates biometric information of the subject based on the acquired biometric data. (Appendix 16) The measuring device includes: measuring a pulse signal of the subject as the biological data; The estimation device includes: estimating a pulse rate of the subject using the pulse signal of the subject; 16. The biological information estimation system according to claim 15, which outputs information corresponding to the estimated pulse rate. (Appendix 17) The estimation device includes: estimating an emotional state of the subject using the pulse signal of the subject; 17. The biological information estimation system according to claim 16, which outputs information according to the estimated emotional state. (Appendix 18) The computer outputting measurement instructions including a first measurement instruction for instructing a first measurement corresponding to a preliminary measurement and a second measurement instruction for instructing a second measurement corresponding to a main measurement to an optical sensor including a light receiving element array in which a plurality of light receiving elements are arranged two-dimensionally; acquiring a reception signal from at least one of the plurality of light receiving elements in response to the measurement instruction; generating biological data for each of the light receiving elements using the acquired reception signals; calculating a deviation of the biological data for each of the light receiving elements using the reception signal acquired in response to the first measurement instruction; A measurement method for setting a measurement area including the light receiving element used for a second measurement in response to the second measurement instruction, according to the deviation of the biological data for each light receiving element. (Appendix 19) a process of outputting measurement instructions including a first measurement instruction for instructing a first measurement corresponding to a preliminary measurement and a second measurement instruction for instructing a second measurement corresponding to a main measurement to an optical sensor including a light receiving element array in which a plurality of light receiving elements are arranged two-dimensionally; A process of acquiring a reception signal from at least one of the plurality of light receiving elements in response to the measurement instruction; A process of generating biological data for each of the light receiving elements using the acquired reception signals; A process of calculating a deviation of the biological data for each of the light receiving elements by using the reception signal acquired in response to the first measurement instruction; and setting a measurement area including the light receiving elements to be used for a second measurement in response to the second measurement instruction, in accordance with the deviation of the biological data for each light receiving element. [Explanation of symbols]

[0176] 1. Biological data measurement system 3. Biometric information estimation system 10, 20, 30 Light Sensor 11, 21 Light emitter 12, 22 Photodetector array 13, 23 Control section 16, 36, 46 Measuring equipment 37 Estimation device 100, 300 terminal equipment 110 Substrate 111 Adhesive layer 131, 231 Measurement instruction acquisition unit 132, 232 Light emission control unit 133, 233 storage section 134, 234 Signal acquisition unit 135, 235 Signal output section 161, 461 Measurement instruction output unit 162, 462 Received signal acquisition unit 163, 463 Biometric Data Generation Department 164, 464 calculation section 165, 465 Measurement area setting section 166 Biometric data output unit 236 Measurement Department 340 Learning Device 370 Estimation Model

Claims

1. a measurement instruction output means for outputting measurement instructions to an optical sensor including a light receiving element array in which a plurality of light receiving elements are arranged two-dimensionally, the measurement instructions including a first measurement instruction for instructing all of the plurality of light receiving elements to perform a preliminary measurement prior to a continuous main measurement, and a second measurement instruction for instructing a selected light receiving element of the plurality of light receiving elements to perform the main measurement; a reception signal acquiring means for acquiring a reception signal from at least one of the plurality of light receiving elements in response to the measurement instruction; a biological data generating means for generating time series data of pulsation, which is biological data, for each of the light receiving elements, using the acquired time series data of the received signal; a calculation means for calculating a deviation of the biological data for each of the light receiving elements by using the biological data generated by using the reception signal acquired in response to the first measurement instruction; a measurement area setting means for setting an area including the light receiving element in which the deviation of the biological data exceeds a threshold value as a measurement area to be used for the main measurement in response to the second measurement instruction.

2. The measurement instruction output means 2. The measuring device according to claim 1, further comprising: a first measurement instruction that instructs measurement using all of the plurality of light receiving elements that constitute the light receiving element array; and a second measurement instruction that instructs measurement using the light receiving elements within the measurement area among the plurality of light receiving elements that constitute the light receiving element array, to the optical sensor.

3. The calculation means is Calculating a difference between the representative value of the biometric data for each of the light receiving elements and the representative value of all of the biometric data for the plurality of light receiving elements as the deviation of the biometric data for each of the light receiving elements; The measurement area setting means setting a measurement candidate region according to the deviation of the biological data for each of the light receiving elements; The measurement apparatus according to claim 1 or 2, wherein the measurement region is set within a range of the measurement candidate region.

4. The measurement device according to claim 1 , further comprising a biological data output unit that outputs the biological data measured in a second measurement in response to the second measurement instruction.

5. The measurement device according to any one of claims 1 to 4, a plurality of light emitters arranged on a measurement surface of a substrate that is attached to the skin of a subject whose biological data is to be measured, the light emitters emitting optical signals toward the skin of the subject; a light receiving element array disposed on the measurement surface of the substrate, the light receiving elements being two-dimensionally arranged to receive reflected light of the optical signals emitted from the light emitters; a control means for controlling the plurality of light emitters to emit optical signals in response to a measurement instruction from the measuring device, receiving a received signal for each of the optical receiving elements in response to reflected light of the optical signal received by the plurality of optical receiving elements constituting the optical receiving element array, outputting the received signal for each of the optical receiving elements to the measuring device, and outputting the received signal by the optical receiving elements within a measurement area set by the measuring device to the measuring device during a second measurement period in response to a second measurement instruction from the measuring device.

6. The measurement device according to any one of claims 1 to 4, a photodetector array arranged on the measurement surface of the substrate to be attached to the skin of a subject whose biometric data is to be measured, the photodetector array having a plurality of photoemitters arranged two-dimensionally and configured to receive reflected light of the optical signals emitted from the plurality of photoemitters; and a control means for causing the plurality of photoemitters to emit the optical signals in response to a measurement instruction from the measurement device, receiving a received signal for each of the photodetector elements in response to the reflected light of the optical signals received by the plurality of photodetector elements constituting the photodetector array, outputting the received signal for each of the photodetector elements to the measurement device, and outputting the received signal by the photodetector elements within a measurement area set by the measurement device to the measurement device during a second measurement period in response to a second measurement instruction from the measurement device.

7. The measurement device according to any one of claims 1 to 4, an estimation device that acquires biometric data of the subject measured by the measurement device and estimates biometric information of the subject based on the acquired biometric data.

8. The measuring device includes: measuring a pulse signal of the subject as the biological data; The estimation device includes: estimating a pulse rate of the subject using the pulse signal of the subject; The biological information estimation system according to claim 7 , wherein information corresponding to the estimated pulse rate is output.

9. The computer outputting measurement instructions to an optical sensor including a light receiving element array in which a plurality of light receiving elements are arranged two-dimensionally, the measurement instructions including a first measurement instruction for instructing all of the plurality of light receiving elements to perform a preliminary measurement prior to a continuous main measurement, and a second measurement instruction for instructing a selected light receiving element of the plurality of light receiving elements to perform the main measurement; acquiring a reception signal from at least one of the plurality of light receiving elements in response to the measurement instruction; generating time series data of pulsation, which is biological data, for each of the light receiving elements using the time series data of the acquired reception signal; calculating a deviation of the biological data for each of the light receiving elements using the biological data generated using the reception signal acquired in response to the first measurement instruction; A measurement method for setting an area including the light receiving element in which the deviation of the biological data exceeds a threshold as a measurement area to be used for the main measurement in response to the second measurement instruction.

10. a process of outputting measurement instructions to an optical sensor including a light receiving element array in which a plurality of light receiving elements are arranged two-dimensionally, the measurement instructions including a first measurement instruction for instructing all of the plurality of light receiving elements to perform a preliminary measurement prior to a continuous main measurement, and a second measurement instruction for instructing a light receiving element selected from the plurality of light receiving elements to perform the main measurement; A process of acquiring a reception signal from at least one of the plurality of light receiving elements in response to the measurement instruction; A process of generating time series data of pulsation, which is biological data, for each of the light receiving elements using the acquired time series data of the received signals; A process of calculating a deviation of the biological data for each of the light receiving elements using the biological data generated using the reception signal acquired in response to the first measurement instruction; and setting an area including the light receiving element in which the deviation of the biological data exceeds a threshold value as a measurement area to be used for the main measurement in response to the second measurement instruction.

Images