Information processing device, information processing method, and program

Abstract

The present technology pertains to an information processing device, an information processing method, and a program which make it possible to reduce power consumption while ensuring measurement accuracy of a sensor. An information processing device according to the present technology comprises a sensor control unit which controls on / off of operation of a second sensor that measures primary information which is used for calculating biological information of an object to be measured by a measurement method different from a first sensor that measures the primary information, on the basis of a measurement result of the primary information by the first sensor. The present technology can be applied, for example, to a smartwatch that measures biological information of a wearer.

Description

Information processing device, information processing method, and program

[0001] The present technology relates to an information processing device, an information processing method, and a program, and more particularly to an information processing device, an information processing method, and a program that are capable of reducing power consumption while ensuring the measurement accuracy of a sensor.

[0002] Non-invasive sensing modules that use infrared lasers, microwaves, millimeter waves, etc. to measure biological information such as blood sugar levels and blood pressure have been researched and commercialized.

[0003] As such a sensing module, a sensing module equipped with multiple types of sensors is known. For example, Patent Document 1 proposes a technology for suppressing noise generated in the signal of an electrode-based sensor and noise generated in the signal of a non-electrode-based sensor due to a current applied to a living body during a surgical operation.

[0004] JP 2024-16150 A

[0005] The contact state between the sensing module and the living body changes depending on the body movements of the living body being measured, and depending on the contact state, a difference may occur between the measurement result by the sensor and the true value, i.e., the measurement accuracy of the sensor may deteriorate.

[0006] One possible solution to the degradation of sensor measurement accuracy due to body movement is to increase the number of measurement attempts by the sensor, but this solution increases the power consumption of the sensing module.

[0007] The present technology has been made in view of such circumstances, and makes it possible to reduce power consumption while ensuring the measurement accuracy of the sensor.

[0008] An information processing device according to one aspect of the present technology includes a sensor control unit that controls the on / off operation of a second sensor that measures primary information using a measurement method different from that of a first sensor that measures primary information used to calculate biometric information of a subject to be measured, based on the measurement results of the primary information by the first sensor.

[0009] An information processing method according to one aspect of the present technology includes controlling the on / off operation of a second sensor that measures primary information using a measurement method different from that of a first sensor that measures primary information used to calculate biometric information of a subject to be measured, based on the measurement results of the primary information by the first sensor.

[0010] A program according to one aspect of the present technology causes a computer to perform processing that includes controlling the on / off operation of a second sensor that measures primary information using a measurement method different from that of a first sensor that measures primary information used to calculate the biological information of a subject to be measured, based on the measurement results of the primary information by the first sensor.

[0011] In one aspect of the present technology, the operation of a second sensor that measures primary information used to calculate the biological information of a measured subject using a measurement method different from that of a first sensor is controlled based on the measurement results of the primary information by the first sensor.

[0012] FIG. 1 is a diagram showing an example configuration of the exterior of an embodiment of a smart watch to which the present technology is applied. FIG. 2 is a diagram showing an example configuration of a sensing module. FIG. 3 is a diagram showing an example of wiring in the sensing module. FIG. 4 is a diagram showing an example layout of a sensor control unit. FIG. 5 is a flowchart illustrating processing performed by the sensing module. FIG. 6 is a flowchart illustrating processing performed by the sensing module when determining the contact state of each sensor set with respect to an object to be measured based on the measurement results of primary information by the optical sensor. FIG. 7 is a diagram showing an example configuration of a sensing module according to a second embodiment. FIG. 8 is a diagram illustrating processing performed by the sensing module according to the second embodiment. FIG. 9 is a top view showing an example layout of multiple types of sensors. FIG. 10 is a top view showing another example layout of multiple types of sensors. FIG. 11 is a diagram showing an example cross-sectional view of a sensor substrate. FIG. 12 is a diagram showing a modified example of the configuration of the sensing system of the present technology. FIG. 13 is a block diagram illustrating an example configuration of computer hardware.

[0013] Hereinafter, embodiments of the present technology will be described in the following order: 1. First embodiment 2. Second embodiment 3. Example of sensor arrangement

[0014] 1. First Embodiment - Example of a Smartwatch Configuration The present technology relates to a sensing module provided with multiple types of sensors and a sensing system equipped with a sensing module. In the following, as a specific embodiment, a case where the present technology is applied to a sensing system that measures biological information such as blood glucose level and blood pressure of a person to be measured will be described as an example.

[0015] FIG. 1 is a diagram showing an example of the external configuration of an embodiment of a smart watch to which the present technology is applied.

[0016] The smart watch 1 shown in FIG. 1 functions as a non-invasive device (information processing device) that measures the wearer's biological information.

[0017] The smart watch 1 can be worn on a person's wrist, and has a main body 11 and a band part 12. The main body 11 is fixed to the person's wrist by the band part 12, which is a wearing device.

[0018] The smartwatch 1 measures biometric information such as the wearer's blood glucose level and blood pressure. The main body 11 is provided with a small display 13, which can display the measurement results such as blood glucose level and blood pressure.

[0019] A sensing module having multiple types of sensors for measuring primary information used to calculate the wearer's biometric information is disposed inside the main body 11 or in a part of the band part 12. Hereinafter, different types of sensors refer to sensors that use different methods for measuring primary information.

[0020] Configuration Example of Sensing Module FIG. 2 is a diagram showing a configuration example of the sensing module 14. As shown in FIG.

[0021] As shown in FIG. 2, the sensing module 14 includes a sensor substrate 31 , an RF sensor control unit 32 , and an optical sensor control unit 33 .

[0022] 2, four optical sensors 41A to 41D and four RF (Radio Frequency) sensors 42A to 42D are provided on a sensor substrate 31 made of a semiconductor substrate or the like. Specifically, the optical sensors 41A to 41D and the RF sensors 42A to 42D are provided on the surface of the sensor substrate 31 that faces the wearer's arm, i.e., the surface that comes into contact with the wearer's arm when the smart watch 1 is worn.

[0023] Hereinafter, the surface of the sensor board 31 facing the wearer's arm, i.e., the surface on which the optical sensors 41 to 41D and the RF sensors 42A to 42D are mounted, will also be referred to as the back surface, and the surface opposite the back surface of the sensor board 31 will also be referred to as the front surface.

[0024] Each of the optical sensors 41A to 42D is connected to the optical sensor control unit 33 via a wire, and each of the RF sensors 42A to 42D is connected to the RF sensor control unit 32 via a wire.

[0025] The optical sensors 41A to 41D are sensors that measure primary information by irradiating the arm of the wearer, which is the measurement target, with light for measuring biological information and receiving the reflected light of the light. The optical sensors 41A to 41D are configured, for example, with a light-emitting unit and a light-receiving unit. The optical sensors 41A to 41D receive the reflected light and supply the light-receiving signal obtained as primary information to the optical sensor control unit 33.

[0026] An RF sensor 42A is arranged near the optical sensor 41A, an RF sensor 42B is arranged near the optical sensor 41B, an RF sensor 42C is arranged near the optical sensor 41C, and an RF sensor 42D is arranged near the optical sensor 41D.

[0027] In the sensing module 14, the optical sensor 41A and the RF sensor 42A arranged nearby are treated as one sensor set A, and the optical sensor 41B and the RF sensor 42B are treated as one sensor set B. Furthermore, the optical sensor 41C and the RF sensor 42C are treated as one sensor set C, and the optical sensor 41D and the RF sensor 42D are treated as one sensor set D. In other words, a plurality of sensor sets are arranged on the sensor substrate 31. A sensor set is a set of multiple types of sensors arranged nearby each other.

[0028] Hereinafter, when there is no need to particularly distinguish between the optical sensors 41A to 41D, they will be simply referred to as optical sensors 41, and when there is no need to particularly distinguish between the RF sensors 42A to 42D, they will be simply referred to as RF sensors 42. The distance between the sensor sets on the sensor substrate 31 is greater than the distance between the optical sensor 41 and the RF sensor 42 included in the same sensor set.

[0029] The number of optical sensors 41 provided on the sensor substrate 31 is not limited to four, and any number such as two, three, five or more may be used. The number of RF sensors 42 provided on the sensor substrate 31 is the same as the number of optical sensors 41.

[0030] The RF sensor 42 is a sensor that measures primary information by irradiating the arm of the wearer, which is the measurement target, with electromagnetic waves such as microwaves or millimeter waves as incident signals for measuring biological information. The RF sensor 42 is composed of, for example, a VNA (Vector Network Analyzer) or a probe or antenna that constitutes a port of the VNA.

[0031] The RF sensor 42 irradiates an incident signal from a predetermined port (hereinafter referred to as port 1) onto the arm portion of the wearer to be measured, and receives the incident signal that returns via port 1 as a reflected signal.

[0032] Furthermore, if the RF sensor 42 is provided with another port (hereinafter referred to as port 2) different from port 1, the RF sensor 42 receives an incident signal that has passed through the arm of the wearer, which is the object to be measured, as a transmitted signal. In this case, the incident signal is irradiated onto the object to be measured via port 1, and a transmitted signal corresponding to the incident signal is received via port 2.

[0033] The RF sensor 42 calculates the S parameters based on at least the incident signal and the reflected signal out of the incident signal, the reflected signal, and the transmitted signal.

[0034] S-parameters are parameters related to the magnitude (amplitude) and phase of reflected and transmitted signals, and are primary information used to calculate biological information. For example, when only port 1 is used for measurement, S11 is calculated as an S-parameter based on the incident and reflected signals. S11 is information that represents the change in magnitude and phase of the reflected signal relative to the incident signal.

[0035] For example, if port 1 and port 2 are used for measurement, S parameters S11 and S21 are calculated based on the incident signal, reflected signal, and transmitted signal. S21 is information that indicates the change in magnitude and phase of the transmitted signal relative to the incident signal.

[0036] The RF sensor 42 supplies the calculated S parameters to the RF sensor control unit 32 .

[0037] The RF sensor control unit 32 is composed of a CPU and other components, and controls the on / off operation of the RF sensors 42 and calculates biological information such as blood glucose levels based on the S parameters obtained by the RF sensors 42. The RF sensor control unit 32 also determines the contact state of each sensor set with the subject to be measured based on the primary information measurement results (e.g., S11) of each RF sensor 42. The contact state with the subject to be measured includes whether each sensor set is in appropriate contact with the subject to be measured, i.e., whether the measurement accuracy of the sensors included in each sensor set is sufficiently ensured.

[0038] The RF sensor control unit 32 notifies the optical sensor control unit 33 of the sensor set whose contact state with the object to be measured satisfies a predetermined condition, specifically, the sensor set whose sufficient measurement accuracy is ensured. The RF sensor control unit 32 may compare S11 between the sensor sets and notify the sensor set whose contact state with the object to be measured is the sensor set whose sufficient measurement accuracy is ensured.

[0039] The optical sensor control unit 33 is composed of a CPU or the like, and controls the on / off operation of the optical sensors 41 and calculates biological information such as blood pressure based on the light reception signals obtained by the optical sensors 41. Specifically, the optical sensor control unit 33 operates only the optical sensors 41 included in the sensor set determined by the RF sensor control unit 32 to have sufficient measurement accuracy, out of the multiple optical sensors 41 provided on the sensor substrate 31. The optical sensor control unit 33 calculates biological information based on the light reception signals obtained by the optical sensors 41 that have sufficient measurement accuracy.

[0040] Not all optical sensors 41 operate, but only optical sensors 41 that have sufficient measurement accuracy operate, making it possible to reduce the power consumption of the entire sensing module 14 while measuring biological information (primary information) with sufficient accuracy using optical sensors 41 that are in appropriate contact with the object being measured.

[0041] In addition, the contact state of each sensor set with the object to be measured may be determined based on the measurement results of primary information by the optical sensor 41, rather than based on the measurement results of primary information by the RF sensor 42.

[0042] In this case, the optical sensor control unit 33 determines the contact state of each sensor set with the object to be measured based on the measurement results of the primary information (e.g., the S / N ratio of the received light signal) of each optical sensor 41. The optical sensor control unit 33 notifies the RF sensor control unit 32 of the sensor set for which sufficient measurement accuracy has been ensured. The optical sensor control unit 33 may compare the S / N ratios between the sensor sets and notify the sensor set with the best contact state with the object to be measured as the sensor set for which sufficient measurement accuracy has been ensured.

[0043] The RF sensor control unit 32 operates only the RF sensors 42 included in the sensor set determined by the optical sensor control unit 33 to have sufficient measurement accuracy, among the multiple RF sensors 42 provided on the sensor substrate 31. The RF sensor control unit 32 calculates biological information based on the S parameters obtained by the RF sensors 42 for which sufficient measurement accuracy has been ensured.

[0044] Not all RF sensors 42 operate, but only RF sensors 42 that have sufficient measurement accuracy operate. This makes it possible to reduce the power consumption of the entire sensing module 14 while measuring biological information (primary information) with sufficient accuracy using RF sensors 42 that are in appropriate contact with the object being measured.

[0045] In addition to the sensing module 14, a communication unit and a battery (not shown) are also provided inside the main body 11. The communication unit is formed of a wireless module incorporating, for example, a Wi-Fi (registered trademark) function or a Bluetooth (registered trademark) function, and transmits and receives data to and from an external device.

[0046] The part of the wearer to be measured is not limited to the arm, but may be any part such as the earlobe, palm, foot, abdomen, etc. The object to be measured is not limited to a human being, but may also be an animal.

[0047] FIG. 3 is a diagram showing an example of wiring of the sensing module 14.

[0048] 2, each optical sensor 41 is connected to the optical sensor control unit 33 at the shortest distance, and each RF sensor 42 is connected to the RF sensor control unit 32 at the shortest distance. As shown in Fig. 3, wiring may be provided between each of the optical sensors 41A to 41D and the optical sensor control unit 33 so that the wiring lengths between the optical sensors 41 match. Also, wiring may be provided between each of the RF sensors 42A to 42D and the RF sensor control unit 32 so that the wiring lengths between the RF sensors 42 match.

[0049] 2 and 3 employs a so-called flat structure in which the RF sensor control unit 32 and the optical sensor control unit 33 are mounted on the same semiconductor substrate together with the optical sensor 41 and the RF sensor 42. Alternatively, as shown in Fig. 4, a so-called stacked structure may be employed in which the RF sensor control unit 32 (not shown) and the optical sensor control unit 33 are stacked on the front surface of the sensor substrate 31 on which the optical sensor 41 and the RF sensor 42 (not shown) are provided.

[0050] 4, the optical sensor control unit 33 is disposed at a position where the wiring lengths between the optical sensors 41A to 41D and the optical sensor control unit 33 are the same among the optical sensors 41. Similarly, the optical sensor control unit 33 is disposed at a position where the wiring lengths between the RF sensors 42A to 42D and the RF sensor control unit 32 are the same among the RF sensors 42.

[0051] Rather than physically matching the wiring length between each sensor and the sensor control unit, the RF sensor control unit 32 and the optical sensor control unit 33 can correct the measurement results of each sensor based on the wiring length between each sensor.

[0052] The RF sensor control unit 32 and the optical sensor control unit 33 may be integrated into one sensor control unit.

[0053] Operation of Sensing Module The processing performed by the sensing module 14 configured as described above will be described with reference to the flowchart in Fig. 5. Below, the flow of processing when the contact state of each sensor set with respect to the measured object is determined based on the measurement results of the primary information by the RF sensor 42 will be described.

[0054] In step S1, the plurality of RF sensors 42, under the control of the RF sensor control unit 32, irradiate an electromagnetic wave onto an object to be measured, thereby measuring S parameters (primary information).

[0055] In step S2, the RF sensor control unit 32 acquires the measurement results of the primary information from each RF sensor 42 (for example, S11).

[0056] In step S3, the RF sensor control unit 32 determines the contact state of each sensor set with the object to be measured based on the measurement results of the primary information by each RF sensor 42.

[0057] In step S4, the RF sensor control unit 32 notifies the optical sensor control unit 33 of the sensor set for which sufficient measurement accuracy is ensured.

[0058] In step S5, only the optical sensors 41 included in the sensor set determined by the RF sensor control unit 32 to have sufficient measurement accuracy irradiate the object to be measured with light in accordance with the control of the optical sensor control unit 33.

[0059] In step S6, the optical sensor control unit 33 acquires the measurement results of the primary information by the optical sensor 41 and calculates the biological information of the subject based on the measurement results. The calculated biological information is displayed on the display 13 of the smartwatch 1, for example.

[0060] Next, with reference to the flowchart of FIG. 6, a process performed by the sensing module 14 when determining the contact state of each sensor set with respect to the measurement target based on the measurement result of the primary information by the optical sensor 41 will be described.

[0061] In step S21, the optical sensors 41, under the control of the optical sensor control unit 33, irradiate the object to be measured with light, receive the reflected light, and acquire a light reception signal (primary information).

[0062] In step S22, the optical sensor control unit 33 acquires the measurement results of the primary information (for example, the SN ratio of the received light signal) from each optical sensor 41.

[0063] In step S23, the optical sensor control unit 33 determines the contact state of each sensor set with the object to be measured based on the measurement results of the primary information by each optical sensor 41.

[0064] In step S24, the optical sensor control unit 33 notifies the RF sensor control unit 32 of the sensor set for which sufficient measurement accuracy is ensured.

[0065] In step S25, only the RF sensors 42 included in the sensor set determined by the optical sensor control unit 33 to have sufficient measurement accuracy irradiate the object to be measured with electromagnetic waves in accordance with the control by the RF sensor control unit 32.

[0066] In step S26, the RF sensor control unit 32 acquires the measurement results of the primary information by the RF sensor 42 and calculates the biological information of the subject based on the measurement results. The calculated biological information is displayed on the display 13 of the smartwatch 1, for example.

[0067] Generally, the contact state between the sensing module and the living body changes depending on the body movement of the living body being measured. Therefore, in the past, depending on the contact state, a discrepancy occurred between the measurement result by the sensor installed in the sensing module and the true value, that is, the measurement accuracy of the sensor could be degraded.

[0068] One possible solution to the degradation of sensor measurement accuracy due to body movement is to increase the number of measurement attempts by the sensor, but this solution increases the power consumption of the sensing module.

[0069] As described above, in the sensing module 14 of the present technology, the on / off of the operation of the second sensor (the other of the optical sensor 41 and the RF sensor), which is a sensor that measures the primary information using a method different from that of the first sensor, is controlled based on the measurement result of the primary information by the first sensor (one of the optical sensor 41 and the RF sensor 42). Specifically, the contact state of the second sensor with the object to be measured (whether or not the state is such that measurement accuracy is sufficiently ensured) is determined based on the measurement result of the primary information by the first sensor, and the on / off of the operation of the second sensor is controlled based on the determination result of the contact state.

[0070] Even if the contact state between the sensing module 14 (sensor set) and the living body changes due to body movement, the contact state between the living body and each sensor set is appropriately determined based on the measurement results by the first sensor, and the second sensor, which does not have sufficient measurement accuracy, will not operate, thereby preventing deterioration of the measurement accuracy of the second sensor due to body movement of the living body.

[0071] Furthermore, since the number of measurement attempts by the second sensor does not increase, and only the second sensor among the multiple second sensors that has good contact with the object to be measured operates, the power consumption of the entire sensing module 14 can be significantly reduced.

[0072] 2. Second Embodiment In the first embodiment, an RF sensor 42 to be operated is selected from the plurality of RF sensors 42, for example, based on the measurement results of primary information by each of the plurality of optical sensors 41. In the second embodiment, the timing of operating the RF sensor is controlled based on the measurement results of primary information by a PPG sensor.

[0073] Configuration Example of Sensing Module FIG. 7 is a diagram showing a configuration example of the sensing module 14 according to the second embodiment.

[0074] As shown in FIG. 7, the sensing module 14 is composed of a sensor substrate 31 and a sensor control unit 102 .

[0075] 7, a PPG (Photoplethysmography) sensor 111 and an RF sensor 112 are provided on the back surface of the sensor substrate 31. The PPG sensor 111 and the RF sensor 112 are each connected to the sensor control unit 102 via wiring. In the sensing module 14, the PPG sensor 111 and the RF sensor 112 are treated as one sensor set.

[0076] The PPG sensor 111 is an optical sensor composed of a light-emitting element such as an LED (light-emitting diode) and a light-receiving element such as a PD (photodetector). The light-emitting element irradiates light onto the human body to be measured, and the light is absorbed, scattered, and reflected by the blood and tissue beneath the skin located several millimeters below the skin. The light-receiving element measures the amount of reflected light from the light irradiated by the light-emitting element, thereby measuring changes in blood flow in blood vessels beneath the skin due to heartbeat as a photoplethysmogram.

[0077] The PPG sensor 111 supplies the measurement result of the photoplethysmogram (primary information) to the sensor control unit 102 .

[0078] The RF sensor 112 is configured, for example, by a VNA or a probe or antenna that configures a port of the VNA. The RF sensor 112 measures S parameters by irradiating electromagnetic waves onto the human body being measured. The RF sensor 112 supplies the measured S parameters to the sensor control unit 102 as primary information.

[0079] The sensor control unit 102 is composed of a CPU and the like, and controls the on / off operation of the PPG sensor 111 and the RF sensor 112, and calculates biological information based on the primary information measured by the PPG sensor 111 and the RF sensor 112.

[0080] In addition, the sensor control unit 102 determines the contact state of the RF sensor 112 with the object to be measured based on the measurement results of the primary information by the PPG sensor 111, and controls the timing of operating the RF sensor 112 based on the contact state of the RF sensor 112 with the object to be measured.

[0081] For example, first, the sensor control unit 102 operates the RF sensor 112 at a predetermined timing, and determines the contact state of the RF sensor 112 with the object to be measured at that timing based on the primary information measured at that timing by the PPG sensor 111. Thereafter, the sensor control unit 102 determines the current contact state of the RF sensor 112 with the object to be measured based on the measurement results of the primary information by the PPG sensor 111, and operates the RF sensor 112 at a timing when the current contact state becomes the same as the contact state at a previous timing when the RF sensor 112 was operated (for example, the timing when the RF sensor 112 was first operated or the timing when it was last operated).

[0082] The contact state of the RF sensor 112 with the object to be measured changes depending on the heartbeat and changes in blood flow due to the heartbeat. Therefore, for example, if the sensor control unit 102 operates the RF sensor once at the timing of myocardial contraction acquired by the PPG sensor 111, the sensor control unit 102 thereafter operates the RF sensor 112 only at the timing of myocardial contraction. Also, for example, if the sensor control unit 102 operates the RF sensor 112 once at the timing of myocardial relaxation acquired by the PPG sensor 111, the sensor control unit 102 thereafter operates the RF sensor 112 only at the timing of myocardial relaxation.

[0083] It should be noted that the sensor control unit 102 may constantly determine the contact state and initially operate the RF sensor 112 at a timing when the contact state is in the desired state, rather than determining the contact state at the timing when the RF sensor 112 is first operated.

[0084] By aligning the contact state between the object to be measured and the RF sensor 112 when the RF sensor 112 is operating, the sensor control unit 102 can acquire stable S parameters from the RF sensor 112 regardless of the contact state with the object to be measured.

[0085] Since the RF sensor 112 does not operate constantly but operates only at predetermined times, it is possible to reduce the power consumption of the entire sensing module 14.

[0086] The sensor control unit 102 can estimate the body temperature of the subject based on the photoplethysmogram measured by the PPG sensor 111. The sensor control unit 102 may correct the measurement results of the S parameters by the RF sensor 112 based on the body temperature estimation results.

[0087] Operation of Sensing Module The processing performed by the sensing module 14 according to the second embodiment will be described with reference to the flowchart of FIG.

[0088] In step S41, the PPG sensor 111 measures the electrocardiogram pulse wave by irradiating light onto the object to be measured under the control of the sensor control unit 102.

[0089] In step S42, the sensor control unit 102 acquires the measurement result of the electrocardiogram pulse wave by the PPG sensor 111.

[0090] In step S43 , the sensor control unit 102 determines the current contact state of the RF sensor 112 with the object to be measured based on the measurement result of the electrocardiogram pulse wave by the PPG sensor 111 .

[0091] In step S44, the sensor control unit 102 determines whether the current contact state of the RF sensor 112 with the object to be measured satisfies a predetermined condition. For example, the sensor control unit 102 determines whether the current contact state of the RF sensor 112 with the object to be measured is the same as the contact state at a previous timing when the RF sensor was operated.

[0092] If it is determined in step S44 that the current contact state of the RF sensor 112 with the object to be measured does not satisfy the predetermined condition, the process returns to step S41, and the subsequent processes are performed.

[0093] On the other hand, if it is determined in step S44 that the current contact state of the RF sensor 112 with the object to be measured satisfies the predetermined condition, in step S45, the RF sensor 112 irradiates the object to be measured with electromagnetic waves in accordance with the control of the sensor control unit 102.

[0094] In step S46, the sensor control unit 102 acquires the measurement results of the S parameters by the RF sensor 112 and calculates the biological information of the subject based on the measurement results. The calculated biological information is displayed on the display 13 of the smartwatch 1, for example.

[0095] Through the above processing, the sensor control unit 102 can acquire stable biological information using the RF sensor 112 regardless of the state of contact with the object to be measured.

[0096] 3. Example of Sensor Arrangement As described above, in both the first and second embodiments of the present technology, a plurality of types of sensors that use different methods for measuring primary information are arranged on the sensor substrate 31 .

[0097] FIG. 9 is a top view showing an example of the arrangement of a plurality of types of sensors.

[0098] 9, the light-emitting unit 151 and the light-receiving unit 152 that constitute the optical sensor 41 and the PPG sensor 111 are arranged at a predetermined interval on the sensor substrate 31. As shown by the dashed line in FIG. 9, a light-shielding area A1, which is an area where a light-shielding member is provided, is formed between the light-emitting unit 151 and the light-receiving unit 152. The light-shielding member is a member that blocks light between the light-emitting unit 151 and the light-receiving unit 152.

[0099] The electrode 161, which functions as a probe or antenna of the RF sensor 42 or the RF sensor 112, is disposed within the light-shielding area A1 as, for example, a part of the light-shielding member. By disposing the electrode 161 between the light-emitting unit 151 and the light-receiving unit 152, the sensor set can be disposed compactly within the sensor substrate 31.

[0100] FIG. 10 is a top view showing another example of the arrangement of multiple types of sensors.

[0101] In the example of Figure 10, optical sensor 153A constituted by light-emitting unit 151A (not shown) and light-receiving unit 152A, optical sensor 153B constituted by light-emitting unit 151B and light-receiving unit 152B, optical sensor 153C constituted by light-emitting unit 151C and light-receiving unit 152C (not shown), optical sensor 153D constituted by light-emitting unit 151D (not shown) and light-receiving unit 152D, optical sensor 153E constituted by light-emitting unit 151E and light-receiving unit 152E, and optical sensor 153F constituted by light-emitting unit 151F and light-receiving unit 152F (not shown) are arranged on sensor substrate 31.

[0102] As shown by the dashed line in Fig. 10, for example, the electrode 161 of the RF sensor corresponding to the optical sensor 153B may be disposed in an area A2 between the optical sensor 153B and the adjacent optical sensors (optical sensors 153A, 153C, and 153E). In the example of Fig. 10, the area A2 is an arc-shaped region with a predetermined width.

[0103] FIG. 11 is a diagram showing an example of a cross-sectional view of the sensor substrate 31.

[0104] As shown in FIG. 11, the sensor substrate 31 is configured by laminating a substrate layer 201 and a protective layer 202 made of glass, resin, or the like.

[0105] The protective layer 202 is formed to cover the light emitting portion 151 and the light receiving portion 152 provided on the substrate layer 201. A through hole H1 for passing the electrode 161 therethrough is formed in the protective layer 202, and the tip surface of the electrode 161 is exposed from the protective layer 202 via the through hole H1.

[0106] That is, the light emitting section 151 and the light receiving section 152 are not in direct contact with the object to be measured, but the electrode 161 is in direct contact with the object to be measured.

[0107] In this way, protection of the optical sensor and ensuring contact with the RF sensor are both achieved.

[0108] Others FIG. 12 is a diagram showing a modified example of the configuration of the sensing system of the present technology.

[0109] Some of the functions of the sensing module 14 may be executed by an information processing device 301 connected to the smartwatch 1 .

[0110] For example, as shown in FIG. 12 , the smartwatch 1 transmits the measurement results of primary information from various sensors provided in the sensing module 14 to the information processing device 301 .

[0111] The information processing device 301 is configured by a PC, a smartphone, a tablet terminal, etc. The information processing device 301 calculates biometric information of the wearer of the smartwatch 1 based on, for example, primary information transmitted from the smartwatch 1, and presents the biometric information to the user of the information processing device 301. The information processing device 301 can also determine the contact state of the sensor with the object to be measured and control the on / off operation of the sensor.

[0112] The device in which the sensing module 14 is provided is not limited to the smart watch 1, but may be a wearable device without a display, an in-ear headphone, a medical device that measures a patient's biological information, etc. The device in which the sensing module 14 is provided may be a portable device or a stationary device.

[0113] Regarding the computer, the above-described series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed from a program recording medium into a computer incorporated in dedicated hardware or a general-purpose personal computer.

[0114] FIG. 13 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processes by a program.

[0115] A CPU (Central Processing Unit) 501 , a ROM (Read Only Memory) 502 , and a RAM (Random Access Memory) 503 are interconnected by a bus 504 .

[0116] An input / output interface 505 is also connected to the bus 504. An input unit 506 including a keyboard, a mouse, etc., and an output unit 507 including a display, a speaker, etc. are connected to the input / output interface 505. Also connected to the input / output interface 505 are a storage unit 508 including a hard disk, a nonvolatile memory, etc., a communication unit 509 including a network interface, etc., and a drive 510 that drives removable media 511.

[0117] In a computer configured as described above, the CPU 501 performs the above-described series of processes by, for example, loading a program stored in the storage unit 508 into the RAM 503 via the input / output interface 505 and the bus 504 and executing it.

[0118] The program executed by the CPU 501 is installed in the storage unit 508 by being recorded on, for example, a removable medium 511 or provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting.

[0119] The program executed by the computer may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.

[0120] In this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all of the components are housed in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.

[0121] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0122] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present technology.

[0123] Furthermore, each step described in the above flowchart can be executed by one device, or can be shared and executed by a plurality of devices.

[0124] Furthermore, when one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices.

[0125] Example of configuration combinations The present technology can also be configured as follows.

[0126] (1) An information processing device comprising: a sensor control unit that controls on / off of an operation of a second sensor that measures primary information used to calculate biological information of a measured subject, the second sensor measuring the primary information using a measurement method different from that of a first sensor that measures the primary information, based on a measurement result of the primary information by the first sensor. (2) The information processing device described in (1), wherein the sensor control unit determines a contact state of the second sensor with the measured subject based on a measurement result of the primary information by the first sensor, and controls on / off of the operation of the second sensor based on the determination result of the contact state. (3) The information processing device described in (2), further comprising a sensor substrate on which the first sensor and the second sensor are provided. (4) The information processing device described in (3), wherein one of the first sensor and the second sensor is an RF sensor that measures the primary information by irradiating the measured subject with electromagnetic waves, and the other of the second sensor and the second sensor is an optical sensor that measures the primary information by irradiating the measured subject with light. (5) The information processing device described in (4), wherein the RF sensor includes a VNA. (6) The information processing device according to any one of (4) to (5), wherein the sensor board is provided with a plurality of sensor sets, each set of the first sensor and the second sensor arranged near each other, and the sensor control unit selects the second sensor to be operated from the plurality of second sensors based on a measurement result of the primary information by each of the plurality of first sensors. (7) The information processing device according to (6), wherein, on the sensor board, a distance between the sensor sets is greater than a distance between the first sensor and the second sensor included in the sensor set. (8) The information processing device according to (6) or (7), wherein, on the sensor board, wiring connecting the sensor control unit and each of the plurality of first sensors is provided so that wiring lengths are consistent among the plurality of first sensors, and wiring connecting the sensor control unit and each of the plurality of second sensors is provided so that wiring lengths are consistent among the plurality of second sensors.(9) The information processing device according to (6) or (7), wherein the sensor control unit is arranged at a position where the wiring lengths of wiring connecting the sensor control unit and each of the plurality of first sensors are the same among the plurality of first sensors and the wiring lengths of wiring connecting the sensor control unit and each of the plurality of second sensors are the same among the plurality of second sensors. (10) The sensor control unit corrects the measurement results of the primary information by each of the plurality of first sensors based on the wiring lengths of wiring connecting the sensor control unit and each of the plurality of first sensors, and corrects the measurement results of the primary information by each of the plurality of second sensors based on the wiring lengths of wiring connecting the sensor control unit and each of the plurality of second sensors. (11) The information processing device according to (4) or (5), wherein the first sensor is the optical sensor, the second sensor is the RF sensor, and the sensor control unit operates the second sensor at a timing when the current contact state becomes the same as the contact state at a previous timing when the second sensor was operated. (12) The information processing device according to (11), wherein the optical sensor includes a PPG sensor. (13) The information processing device according to (12), wherein the sensor control unit estimates the body temperature of the subject based on the measurement result of the primary information by the PPG sensor and corrects the measurement result of the primary information by the RF sensor based on the body temperature estimation result. (14) The information processing device according to any of (4) to (13), wherein, on the sensor substrate, an electrode of the RF sensor is provided in a light-shielding area formed between a light-emitting unit and a light-receiving unit that constitute the optical sensor. (15) The information processing device according to (14), wherein, on the sensor substrate, the light-emitting unit and the light-receiving unit are covered by a protective layer, and the electrode is provided on the sensor substrate so that its tip surface is exposed from the protective layer. (16) The information processing device according to any of (1) to (15), wherein the sensor control unit calculates the biological information based on the measurement result of the primary information by the second sensor.(17) An information processing method including: controlling on / off of an operation of a second sensor that measures primary information used to calculate biological information of a subject based on a measurement result of the primary information by a first sensor that measures the primary information by a measurement method different from that of a first sensor that measures the primary information. (18) A program for causing a computer to execute processing including: controlling on / off of an operation of a second sensor that measures the primary information by a measurement method different from that of a first sensor that measures the primary information used to calculate biological information of a subject based on a measurement result of the primary information by the first sensor.

[0127] REFERENCE SIGNS LIST 1 Smart watch, 11 Main body, 12 Band part, 13 Display, 14 Sensing module, 31 Sensor substrate, 32 RF sensor control unit, 33 Optical sensor control unit, 41 Optical sensor, 42 RF sensor, 111 PPG sensor, 112 RF sensor, 151 Light emitting unit, 152 Light receiving unit, 161 Electrode, 201 Substrate layer, 202 Protective layer, 301 Information processing device

Claims

1. An information processing device having a sensor control unit that controls the on / off operation of a second sensor that measures primary information used to calculate the biological information of a subject based on the measurement results of the primary information by the first sensor.

2. The information processing device according to claim 1, wherein the sensor control unit determines the contact state of the second sensor with the object to be measured based on the measurement result of the primary information by the first sensor, and controls the on / off operation of the second sensor based on the determination result of the contact state.

3. The information processing device according to claim 2, further comprising a sensor substrate on which the first sensor and the second sensor are provided.

4. An information processing device as described in claim 3, wherein one of the first sensor and the second sensor is an RF sensor that measures the primary information by irradiating the object to be measured with electromagnetic waves, and the other of the second sensor and the second sensor is an optical sensor that measures the primary information by irradiating the object to be measured with light.

5. The information processing device according to claim 4, wherein the RF sensor includes a VNA.

6. The information processing device according to claim 4, wherein the sensor board is provided with a plurality of sensor sets, each set of the first sensor and the second sensor arranged in close proximity to each other, and the sensor control unit selects the second sensor to be operated from among the plurality of second sensors based on the measurement results of the primary information by each of the plurality of first sensors.

7. The information processing device according to claim 6, wherein on the sensor board, the distance between the sensor sets is greater than the distance between the first sensor and the second sensor included in the sensor set.

8. The information processing device according to claim 6, wherein the sensor substrate is provided with wiring connecting the sensor control unit and each of the plurality of first sensors so that the wiring lengths are the same among the plurality of first sensors, and wiring connecting the sensor control unit and each of the plurality of second sensors so that the wiring lengths are the same among the plurality of second sensors.

9. The information processing device according to claim 6, wherein the sensor control unit is positioned such that the wiring lengths of the wiring connecting the sensor control unit and each of the plurality of first sensors are the same among the plurality of first sensors, and the wiring lengths of the wiring connecting the sensor control unit and each of the plurality of second sensors are the same among the plurality of second sensors.

10. The information processing device described in claim 6, wherein the sensor control unit corrects the measurement results of the primary information by each of the multiple first sensors based on the wiring length of the wiring connecting the sensor control unit and each of the multiple first sensors, and corrects the measurement results of the primary information by each of the multiple second sensors based on the wiring length of the wiring connecting the sensor control unit and each of the multiple second sensors.

11. The information processing device according to claim 4, wherein the first sensor is the optical sensor, the second sensor is the RF sensor, and the sensor control unit activates the second sensor at a timing when the current contact state becomes the same as the contact state at a previous timing when the second sensor was activated.

12. The information processing device according to claim 11, wherein the optical sensor includes a PPG sensor.

13. The information processing device according to claim 12, wherein the sensor control unit estimates the body temperature of the subject based on the measurement results of the primary information by the PPG sensor, and corrects the measurement results of the primary information by the RF sensor based on the estimated body temperature.

14. The information processing device according to claim 4, wherein the electrode of the RF sensor is provided in a light-shielding area formed between a light-emitting section and a light-receiving section that constitute the optical sensor on the sensor substrate.

15. An information processing device according to claim 14, wherein the light emitting section and the light receiving section of the sensor substrate are covered with a protective layer, and the electrodes of the sensor substrate are provided so that their tip surfaces are exposed from the protective layer.

16. The information processing device according to claim 1, wherein the sensor control unit calculates the biological information based on the measurement result of the primary information by the second sensor.

17. An information processing method including controlling the on / off operation of a second sensor that measures primary information used to calculate biological information of a subject based on the measurement results of the primary information by a first sensor using a measurement method different from that of the first sensor.

18. A program for causing a computer to execute processing including controlling the on / off operation of a second sensor that measures primary information used to calculate the biological information of a subject using a measurement method different from that of a first sensor that measures the primary information based on the measurement results of the primary information by the first sensor.

Images