Method and device for detecting movement via optomechanical

By independently generating motion reference signals in the wearable device and sensing motion and physiological information using optical paths, the problem of PPG sensors being sensitive to motion noise is solved, and more accurate physiological signal extraction and monitoring is achieved.

CN119055191APending Publication Date: 2024-12-03YUKKA MAGIC LLC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410992030.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2016-06-03
Filing Date
2016-08-10
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In the existing wearable physiological information monitoring devices, photoplethysmography (PPG) sensors are particularly sensitive to motion-related noise, which makes it difficult to extract physiological signals. Commonly used accelerometers and gyroscope reference signals cannot effectively clear motion noise.

Method used

The optical path and physiological information path that independently generates motion reference signals are used to sense motion and physiological information separately through the optical emitter and detector, and the motion artifact is removed by using a signal processor to extract clear biometric signals.

Benefits of technology

Effectively removes movement artifacts, improves the clarity and accuracy of physiological signals, and enhances the monitoring accuracy of heart rate and other physiological parameters.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119055191A_ABST
    Figure CN119055191A_ABST
Patent Text Reader

Abstract

Methods and apparatus are described for facilitating extraction of a clearer biometric signal from a biometric monitor. A motion reference signal is generated independently of a biometric signal, and then the motion reference signal is used to remove motion artifacts from the biometric signal.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This divisional application is a divisional application of the Chinese invention patent application with application number 201680047372.7 and application date August 10, 2016.

[0002] Related Applications

[0003] This application claims the benefit of and priority to U.S. Provisional Patent Application No. 62 / 204,214 filed on August 12, 2015, U.S. Provisional Patent Application No. 62 / 257,502 filed on November 19, 2015, and U.S. Provisional Patent Application No. 62 / 345,579 filed on June 3, 2016, the disclosures of which are incorporated herein by reference as if set forth in their entirety. Technical Field

[0004] The present invention relates generally to monitoring devices and methods, and more particularly, to monitoring devices and methods for measuring physiological information. Background Art

[0005] Wearable devices capable of monitoring physiological information (such as heart rate) are increasingly being used. These devices appear in various form factors, including devices configured to be worn on the ear or other parts of the body, and include devices carried or worn by individuals, such as smartphones. U.S. Patents Nos. 8,652,040, 8,700,111, 8,647,270, 8,788,002, 8,886,269, and 8,929,965, which are all incorporated herein by reference, describe various wearable devices configured to monitor physiological information, including headsets, earbuds, and wristbands.

[0006] Physiological information obtained from a subject can be used to generate various types of health and fitness assessments of the subject. For example, using a photoplethysmography (PPG) sensor incorporated into a wearable monitoring device, blood flow information can be measured during the subject's daily activities, and this information can be used to generate assessments such as VOmax. 2 max, total energy expenditure (TEE), etc.

[0007] Unfortunately, biometric signals from physiological sensors of wearable devices often include noise related to the subject's motion, and PPG sensors are particularly sensitive to motion-related noise. Furthermore, efforts to use accelerometer- or gyroscope-based signals as a motion noise reference for cleaning PPG signals have achieved limited success, as these motion-related signals cannot fully represent the motion noise characteristics reflected in the PPG signal. Likewise, complex signal processing may be required to extract pure biometric information (i.e., heart rate, respiration rate) from the motion-related noise embedded in the sensor signal. Summary of the invention

[0008] It should be understood that the purpose of providing this summary is to introduce a selection of concepts in a simplified form, which are further described in the detailed description below. This summary is neither intended to identify the key features or essential features of the disclosure nor to limit the scope of the invention.

[0009] Embodiments of the present invention facilitate extracting clearer biometric signals from a biometric monitor (such as a PPG sensor, etc.) by generating a motion reference signal independently of the biometric signal and then using the motion reference signal to remove motion artifacts from the biometric signal.

[0010] According to some embodiments of the present invention, a device for sensing physiological information and body motion information includes at least one optical emitter and at least one optical detector, and at least two optical paths. One optical path is configured to sense body motion information by sensing light from at least one emitter scattered by body motion. Another optical path is configured to sense physiological information by sensing light from at least one emitter scattered from the body by blood flow.

[0011] According to some embodiments of the present invention, a biometric sensor module includes: a housing; a stabilizer member, the stabilizer member is supported by the housing; at least one optical emitter, the at least one optical emitter is supported by the housing; and at least one optical detector, the at least one optical detector is supported by the housing. The at least one optical emitter is configured to guide light into the body of a subject via a first optical path and to guide light to the stabilizer member along a second optical path. The first and second optical paths may be optically isolated from each other. The at least one optical detector is configured to detect light from the body of the subject and generate a first signal including physiological information of the subject, and is also configured to detect light reflected by the stabilizer member and generate a second signal including motion information of the subject. The sensor module may include at least one signal processor, the at least one signal processor being configured to process the first and second signals so that motion artifacts are removed from the first signal.

[0012] In some embodiments, the stabilizer member may include an optical filter configured to pass, block, or scatter multiple different wavelengths of light representing the subject's motion. In other embodiments, at least one optical emitter may be configured to direct light into the subject's body and / or to the stabilizer member at multiple different wavelengths.

[0013] In some embodiments, at least one optical emitter includes a first optical emitter configured to direct light into a subject's body via a first optical path, and a second optical emitter configured to direct light to a stabilizer member along a second optical path. The second optical emitter may include at least one optical element configured to direct light to a stabilizer member, such as a lens, a filter, and / or a reflective element.

[0014] In some embodiments, the at least one optical detector includes a first optical detector configured to detect light from the subject's body and generate a first signal including subject physiological information; and a second optical detector configured to detect physically modulated light reflected by the stabilizer member and generate a second signal including subject motion information. The light reflected by the stabilizer member is physically modulated due to subject motion.

[0015] In some embodiments, the stabilizer member is movably supported by the housing and includes a portion that extends from the housing and engages the body of the subject.

[0016] In some embodiments, the first optical pathway and / or the second optical pathway comprises a light guiding material.

[0017] In some embodiments, the housing comprises a substantially opaque material.

[0018] In some embodiments, the sensor module is configured to be positioned at or within the ear of the subject. In other embodiments, the sensor module is configured to be fixed to an appendage or other body part of the subject, or even integrated into clothing worn by the subject.

[0019] In some embodiments, the sensor module includes a blood flow stimulator configured to increase blood perfusion at a site of the subject's body that receives light via a first optical path at or before the time at which at least one optical detector detects light from the body and generates a physiological information signal.

[0020] According to other embodiments of the present invention, a sensor module configured to be worn by a subject includes: a housing; at least one optical emitter, the at least one optical emitter is supported by the housing; and at least one optical detector, the at least one optical detector is supported by the housing. The at least one optical emitter is configured to guide light into the subject's body via a first optical path and to guide light to the body along a second optical path. The first and second optical paths may be optically isolated from each other. The at least one optical detector is configured to detect light from the subject's body and generate a first signal including physiological information of the subject, and wherein the at least one optical detector is configured to detect light reflected by the body and generate a second signal including motion information of the subject. The reflected light may be physically modulated due to the subject's motion. The sensor module may include at least one signal processor, the at least one signal processor being configured to process the first and second signals to remove motion artifacts from the first signal.

[0021] In some embodiments, the at least one optical emitter includes a first optical emitter configured to direct light into a body of a subject via a first optical pathway and a second optical emitter configured to direct light into the body along a second optical pathway.

[0022] In some embodiments, at least one optical detector includes a first optical detector configured to detect light from a subject's body and generate a first signal including physiological information of the subject, and a second optical detector configured to detect light reflected by the body and generate a second signal including motion information of the subject.

[0023] In some embodiments, the first optical pathway and / or the second optical pathway comprises a light guiding material.

[0024] In some embodiments, the housing comprises a substantially opaque material.

[0025] In some embodiments, at least one optical emitter is configured to direct light into and / or at the body of a subject at a plurality of different wavelengths.

[0026] In some embodiments, the sensor module is configured to be positioned at or within the ear of the subject. In other embodiments, the sensor module is configured to be fixed to an appendage or other body part of the subject, or even integrated into clothing worn by the subject.

[0027] In some embodiments, the sensor module includes a blood flow stimulator configured to increase blood perfusion at a site of the subject's body that receives light via a first optical path at or before the time at which at least one optical detector detects light from the body and generates a physiological information signal.

[0028] According to other embodiments of the present invention, a sensor module configured to be worn by a subject includes: a housing; at least one optical emitter and at least one optical detector, the at least one optical emitter and the at least one optical detector being supported by the housing; and a stabilizer member, the stabilizer member being movably supported by the housing. The stabilizer member includes a portion extending through a first hole in the housing and configured to engage with the subject's body. At least one optical emitter is configured to guide light through a second hole in the housing and guide light into the subject's body via a first optical path and guide light to a portion of the stabilizer member within the housing along a second optical path. The first and second optical paths may be optically isolated from each other. At least one optical detector is configured to detect light from the subject's body via a third hole in the housing and generate a first signal including physiological information of the subject, and wherein at least one optical detector is configured to detect light reflected by the stabilizer member and generate a second signal including motion information of the subject. The sensor module may include at least one signal processor, the at least one signal processor being configured to process the first and second signals so as to remove motion artifacts from the first signal.

[0029] In some embodiments, at least one optical emitter includes at least one first optical emitter configured to direct light into a subject's body via a first optical path and at least one second optical emitter configured to direct light to a stabilizer member along a second optical path.

[0030] In some embodiments, the light guide is supported by the housing and the at least one optical emitter is configured to direct light into the subject's body via the light guide. The light guide may include multiple portions extending through corresponding holes in the housing and configured to engage portions of the subject's body.

[0031] In some embodiments, the housing is formed from a substantially opaque material.

[0032] In some embodiments, the sensor module is configured to be positioned at or within the ear of the subject. In other embodiments, the sensor module is configured to be fixed to an appendage or other body part of the subject, or even integrated into clothing worn by the subject.

[0033] In some embodiments, the sensor module includes a blood flow stimulator configured to increase blood perfusion at a site of the subject's body that receives light via a first optical path at or before the time at which at least one optical detector detects light from the body and generates a physiological information signal.

[0034] According to other embodiments of the present invention, a sensor module configured to be worn by a subject includes: a housing; first and second optical emitters, the first and second optical emitters are supported by the housing; an optical detector, the optical detector is supported by the housing; and first and second light guides, the first and second light guides are supported by the housing. The first light guide is optically connected to the first optical emitter and defines a first optical path, and the second light guide is optically connected to the second optical emitter and defines a second optical path. The first and second optical paths can be optically isolated from each other. The first optical emitter is configured to guide light into the subject's body via the first optical path, and the second optical emitter is configured to guide light to the subject's body via the second optical path. The optical detector is configured to detect light from the subject's body and generate a first signal including physiological information of the subject. The optical detector is also configured to detect light reflected by the subject's body and generate a second signal including subject motion information. The light reflected by the body can be physically modulated due to subject motion. The sensor module may include at least one signal processor, the at least one signal processor configured to process the first and second signals so that motion artifacts are removed from the first signal.

[0035] In some embodiments, the first light guide includes a portion that extends through the aperture in the housing and is configured to engage the body of the subject.

[0036] In some embodiments, the housing is formed from a substantially opaque material.

[0037] In some embodiments, the sensor module is configured to be positioned at or within the ear of the subject. In other embodiments, the sensor module is configured to be fixed to an appendage or other body part of the subject, or even integrated into clothing worn by the subject.

[0038] In some embodiments, the sensor module includes a blood flow stimulator configured to increase blood perfusion at a site of the subject's body that receives light via the first optical path at or before the time the optical detector detects light from the body and generates a physiological information signal.

[0039] According to other embodiments of the present invention, a sensor module configured to be worn by a subject includes: a housing; at least one optical detector, the at least one optical detector is supported by the housing; at least one optical emitter, the at least one optical emitter is supported by the housing; and a stabilizer member, the stabilizer member is movably supported by the housing. The stabilizer member includes a portion extending from the housing and engaging with the subject's body. The at least one optical emitter is configured to guide light into the subject's body via a first optical path and guide light to the at least one optical detector along a second optical path. The first and second optical paths are generally optically isolated from each other. The stabilizer member is configured to modulate the amount of light in the second optical path by modulating the volume of the second optical path.

[0040] The at least one optical detector is configured to detect light from the subject's body and generate a first signal containing physiological information of the subject. The at least one optical detector is configured to detect light in a second optical path and generate a second signal containing motion information of the subject. The sensor module may include at least one signal processor configured to process the first and second signals so that motion artifacts are removed from the first signal.

[0041] In some embodiments, the first optical pathway and / or the second optical pathway comprises a light guiding material.

[0042] In some embodiments, the second optical pathway includes a plurality of optical channels, and the stabilizer member is configured to modulate an amount of light in the second optical pathway in response to subject movement by modulating volumes of the plurality of optical channels.

[0043] In some embodiments, the housing comprises a substantially opaque material.

[0044] In some embodiments, the sensor module is configured to be positioned at or within the ear of the subject. In other embodiments, the sensor module is configured to be fixed to an appendage or other body part of the subject, or even integrated into clothing worn by the subject.

[0045] In some embodiments, the sensor module includes a blood flow stimulator configured to increase blood perfusion at a site of the subject's body that receives light via a first optical path at or before the time at which at least one optical detector detects light from the body and generates a physiological information signal.

[0046] According to other embodiments of the present invention, a sensor module configured to be worn by a subject includes: a housing; a pressure transducer, the pressure transducer is supported by the housing; at least one optical emitter, the at least one optical emitter is supported by the housing; at least one optical detector, the at least one optical detector is supported by the housing; and a stabilizer member, the stabilizer member is movably supported by the housing. The stabilizer member is configured to modulate the pressure transducer in response to the subject's movement, and includes a portion extending from the housing and engaging with the subject's body. At least one optical emitter is configured to direct light into the subject's body. At least one optical detector is configured to detect light from the subject's body and generate a first signal containing the subject's physiological information. The pressure transducer is configured to generate a second signal containing the subject's motion information. The sensor module may include at least one signal processor, the at least one signal processor being configured to process the first and second signals so that motion artifacts are removed from the first signal.

[0047] In some embodiments, the sensor module is configured to be positioned at or within the ear of the subject. In other embodiments, the sensor module is configured to be secured to an appendage of the subject, or even integrated within clothing worn by the subject.

[0048] In some embodiments, the sensor module includes a blood flow stimulator configured to increase blood perfusion at a site of the subject's body that receives light via a first optical path at or before the time at which at least one optical detector detects light from the body and generates a physiological information signal.

[0049] According to other embodiments of the present invention, a method for removing motion artifacts from a biometric signal generated by a sensor module worn by a subject is provided. The sensor module includes a stabilizer member, at least one optical emitter, and at least one optical detector. The method includes: directing light from at least one optical emitter into the subject's body via a first optical path; directing light from at least one optical emitter to the stabilizer member along a second optical path; detecting light from the subject's body and generating a first signal including physiological information of the subject; detecting light reflected by the stabilizer member and generating a second signal including motion information of the subject; and processing the first and second signals so that motion artifacts are removed from the first signal.

[0050] In some embodiments, the at least one optical emitter includes first and second optical emitters, and the method includes directing light from the first optical emitter into the subject's body via a first optical path; and directing light from the second optical emitter along a second optical path to the stabilizer member.

[0051] In some embodiments, at least one optical detector includes first and second optical detectors, and the method includes: detecting light from the subject's body via the first optical detector and generating a first signal including physiological information of the subject; and detecting physically modulated light reflected by the stabilizer member via the second optical detector and generating a second signal including motion information of the subject.

[0052] In some embodiments, the first and second optical paths are optically isolated from each other.

[0053] According to other embodiments of the present invention, a method for removing motion artifacts from a biometric signal generated by a sensor module worn by a subject is provided. The sensor module includes at least one optical emitter and at least one optical detector, and the method includes: directing light from at least one optical emitter into the subject's body via a first optical path and directing light to the subject's body along a second optical path; detecting light from the subject's body and generating a first signal containing the subject's physiological information; detecting light reflected by the subject's body and generating a second signal containing the subject's motion information; and processing the first and second signals so that motion artifacts are removed from the first signal.

[0054] In some embodiments, the at least one optical emitter includes first and second optical emitters, and the method includes directing light from the first optical emitter into the subject's body via a first optical path; and directing light from the second optical emitter to the body along a second optical path.

[0055] In some embodiments, at least one optical detector includes first and second optical detectors, and the method includes: detecting light from the subject's body via the first optical detector and generating a first signal containing physiological information of the subject; and detecting light reflected by the body via the second optical detector and generating a second signal containing movement information of the subject.

[0056] In some embodiments, the first and second optical paths are optically isolated from each other.

[0057] According to other embodiments of the present invention, a device (such as a smartphone or other portable electronic device) includes: a sensor module, the sensor module is configured to obtain physiological information from a body part of a subject; and a blood flow stimulator, the blood flow stimulator is configured to increase blood perfusion at the body part at or before the moment when the sensor module obtains the physiological information. The blood flow stimulator may include a heater configured to increase blood perfusion, such as an infrared (IR) heater. In some embodiments, the blood flow stimulator includes a mechanical actuator configured to apply physical stimulation to the body part. For example, in some embodiments, the device is a smartphone, and the blood flow stimulator is a vibration actuator within the smartphone configured to provide tactile feedback to the user.

[0058] In some embodiments, the sensor module includes a stabilizer member, at least one optical emitter, and at least one optical detector. The at least one optical emitter is configured to direct light into the subject's body via a first optical path and to direct light to the stabilizer member along a second optical path. The at least one optical detector is configured to detect light from the subject's body and generate a first signal including physiological information of the subject, and to detect light reflected by the stabilizer member and generate a second signal including motion information of the subject.

[0059] In some embodiments, the sensor module includes at least one optical emitter and at least one optical detector. The at least one optical emitter is configured to direct light into the subject's body via a first optical path and to direct light to the body along a second optical path. The at least one optical detector is configured to detect light from the subject's body and generate a first signal including the subject's physiological information, and to detect light reflected by the body and generate a second signal including the subject's motion information.

[0060] According to other embodiments of the present invention, a wearable device includes an optical sensor configured to detect physiological information optically obtained from a site on a subject's body and includes at least one optical emitter and at least one optical detector. The wearable device also includes a thermal energy generator configured to increase the temperature of the body at the site; a temperature sensor configured to sense body temperature information at the site; and at least one circuit configured to control the electrical bias of at least one optical emitter, thermal energy generator, and temperature sensor. In addition, the wearable device includes a data storage configured to receive and store data from the optical sensor and the temperature sensor; and a processor configured to process the data from the optical sensor in the data storage according to the data from the temperature sensor in the data storage to generate a physiological assessment of the subject.

[0061] In some embodiments, at least one circuit is configured to electrically bias the at least one optical emitter for a set period of time associated with electrical biasing of the thermal energy generator.

[0062] In some embodiments, the at least one optical emitter includes a plurality of optical emitters, and the at least one circuit is configured to temporally alternately bias the plurality of optical emitters to generate a data matrix including wavelength information and temperature information of the optical emitters.

[0063] In some embodiments, the optical sensor is configured to sense scattered light and luminescent light from the site, and wherein at least one circuit is configured to temporally alternately bias a plurality of optical emitters to generate a data matrix comprising optical emitter wavelength information, temperature information, and time information.

[0064] In some embodiments, the at least one optical detector includes a plurality of optical detectors, and at least one of the plurality of optical detectors is configured to detect at least one wavelength of light that at least one other of the plurality of optical detectors is configured not to detect. Data from the plurality of optical detectors is used to generate a data matrix that includes a data matrix of optical emitter wavelength information and temperature information.

[0065] According to other embodiments of the present invention, a wearable device includes a sensor module (such as a PPG sensor module), which is configured to obtain physiological information from a body part of a subject wearing the device. The wearable device also includes a pouch of flexible material, which contains a fluid, such as a liquid, a gas, or a gel. The pouch is configured to contact the subject's skin at or near the body part. The pouch may have various shapes and configurations. In some embodiments, the pouch has an annular shape that surrounds the sensor module at the periphery.

[0066] A pressure sensor is provided that generates a signal proportional to a change in fluid pressure within a bladder. The pressure change is responsive to the motion of the subject. As such, the pressure sensor generates a motion noise reference signal that can be used to remove motion artifacts from physiological information obtained by a sensor module.

[0067] In some embodiments, the bladder is configured to at least partially wrap around a limb of a subject.

[0068] In some embodiments, the pouch includes at least one fluid reservoir containing fluid and a plurality of artificial blood vessels in fluid communication with the at least one fluid reservoir. The pouch is pressed due to the movement of the subject causing the fluid to be forced from the at least one fluid reservoir into the artificial blood vessel, thereby generating a pressure in the pouch that can be detected by a pressure sensor. This construction can be useful to more closely resemble the construction of venous blood in the body, so that the artificial structure can generate a motion noise waveform, and during movement, the motion noise waveform is more closely similar to the motion noise waveform of the subject's venous blood when it moves, thereby facilitating use as a noise reference as described above. It should be noted that the blood vessel and the reservoir may also include at least one bubble portion (cavitation) to facilitate fluid flow during movement. In some embodiments, the density of the bubble portion and the viscosity of the blood may be designed to be very similar to the density and viscosity of the subject's blood. In another embodiment, the fluid may include a plurality of fluids, each having a different density and / or polarity. Having such a fluid distribution may more closely resemble the properties of the subject's venous blood.

[0069] In some embodiments, the pressure sensor is a MEMS (micro-electromechanical system) device, a diaphragm, and / or an actuator. In other embodiments, the pressure sensor is an optomechanical pressure sensor.

[0070] It should be noted that aspects of the invention described for one embodiment may be incorporated into different embodiments, even though no specific description has been given thereto. That is, all embodiments and / or features of any embodiment may be combined in any manner and / or combination. Applicants reserve the right to modify any initially filed claims or to submit any new claims accordingly, including the right to amend any initially filed claims to be dependent upon and / or include any features of any other claims, even though not originally claimed in this manner. These and other objects and / or aspects of the invention are explained in detail below. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] The accompanying drawings, which form a part of this specification, illustrate various embodiments of the present invention. The drawings and the description together serve to fully explain the embodiments of the present invention.

[0072] Figure 1 to Figure 2 An "internal" optomechanical biometric sensor module and the motion information and biometric information paths generated thereby are illustrated in accordance with some embodiments of the present invention.

[0073] Figures 3 to 5 An "external" optomechanical biometric sensor module and the motion information and biometric information paths generated thereby are illustrated according to some embodiments of the present invention.

[0074] Figure 6An "internal" optomechanical biometric sensor module and the motion information and biometric information paths generated thereby are illustrated in accordance with some embodiments of the present invention.

[0075] Fig. 7A An "external" optomechanical biometric sensor module is illustrated according to some embodiments of the present invention.

[0076] Figure 7B yes Fig. 7A A top plan view of the sensor module.

[0077] Figure 7C It is along Figure 7B The line 7C-7C in Figure 7B A cross-sectional view of a sensor module.

[0078] Fig.7D It is along Figure 7B The line 7D-7D in Figure 7B A cross-sectional view of a sensor module.

[0079] FIG. 8A to FIG. 8B is an exploded view of an internal optomechanical biometric sensor module according to some embodiments of the present invention.

[0080] Fig. 9A It is in assembly construction FIG. 8A to FIG. 8B A front perspective view of a sensor module.

[0081] Fig. 9B is a diagram illustrating the biometric information path Fig. 9A A cross-sectional view of a sensor module.

[0082] Fig. 9C is a diagram showing the path of motion information Fig. 9A A cross-sectional view of a sensor module.

[0083] Fig.9D is a diagram showing the path of motion information Fig. 9A An enlarged cross-sectional view of the sensor module.

[0084] Fig. 10A An "internal" optomechanical biometric sensor module is illustrated according to some embodiments of the present invention.

[0085] Fig. 10B is taken along line 10B-10B and illustrates the biometric information path Fig. 10A A cross-sectional view of a sensor module.

[0086] Fig. 10C is taken along line 10C-10C and illustrates the path of motion information Fig. 10A A cross-sectional view of a sensor module.

[0087] Fig.11A An "internal" optomechanical biometric sensor module is illustrated according to some embodiments of the present invention.

[0088] Fig. 11B is taken along line 11B-11B and illustrates the biometric information path Fig.11A A cross-sectional view of a sensor module.

[0089] FIG. 11C to FIG. 11D is taken along line 11C-11C and illustrates the motion information path in the unpressed configuration and the pressed configuration, respectively. Fig.11A A cross-sectional view of a sensor module.

[0090] Fig. 12A An "internal" mechanical biometric sensor module is illustrated according to some embodiments of the present invention.

[0091] Fig. 12B It is along Fig. 12A The line 12B-12B is intercepted Fig. 12A A cross-sectional view of a sensor module.

[0092] Fig. 12C It is along Fig. 12A The line 12C-12C in Fig. 12A A cross-sectional view of a sensor module.

[0093] Fig.13A A band of a wearable monitoring device with an integrated pressure sensing bladder is illustrated according to some embodiments of the present invention.

[0094] Fig. 13B is a top perspective view of a pressure sensing pouch of a wearable device according to some embodiments of the present invention.

[0095] Fig. 13C yes Fig. 13B A top plan view of a pressure sensing bladder.

[0096] Fig.13D yes Fig. 13B A cross-sectional view of a pressure sensing pouch of FIG. 1 and illustrates the pouch attached to a wristband of a wearable device.

[0097] Fig.13E yes Fig. 13B A bottom plan view of a pressure sensing bladder.

[0098] Fig.13F A pressure sensing balloon comprising a fluid reservoir and a vascular prosthesis in fluid communication with the fluid reservoir is illustrated according to some embodiments of the present invention.

[0099] FIG. 14A to FIG. 14B An array of optomechanical sensors secured to a subject's arm and configured to track gestural motions is illustrated in accordance with some embodiments of the present invention.

[0100] FIG. 15A to FIG. 15E is the spectrum of the noise reference signal and the associated photovascular volume map.

[0101] FIG. 16A to FIG. 16C is a spectrogram illustrating the removal of real-time noise from a PPG signal.

[0102] Fig.17 An optomechanical sensor module with a subtractive filter and a noise reference for removing noise from a noisy physiological signal is illustrated according to some embodiments of the present invention.

[0103] Fig.18 is to use Fig.17 Flowchart of the operation of the optomechanical sensor.

[0104] Figure 19 to Figure 20 An "internal" optomechanical biometric sensor module and the motion information and biometric information paths generated thereby for "single-touch" or short-time sensing applications according to some embodiments of the present invention are illustrated.

[0105] Fig.21 An electronic device including a "one-touch" or short-time sensing optomechanical sensor module according to some embodiments of the present invention is illustrated.

[0106] Fig. 22 It is taken along line 22-22 Fig.21 A cross-sectional view of an electronic device.

[0107] Fig.23 is a flow chart of operations for implementing blood flow stimulation to improve PPG measurements according to some embodiments of the present invention.

[0108] Fig.24 is a top plan view of a device having an optomechanical sensor module and a blood flow stimulator according to some embodiments of the present invention.

[0109] Fig.25 It is taken along line 25-25 Fig.24 A cross-sectional view of an embodiment of a device.

[0110] FIG. 26A to FIG. 26D An integrated microfabricated optomechanical sensor module and process steps for fabricating the optomechanical sensor module according to some embodiments of the present invention are illustrated.

[0111] Fig. 27A system for generating high quality PPG data and transmitting the data to a secondary device or system according to some embodiments of the present invention is illustrated.

[0112] Fig.28 is a cross-sectional view of an earpiece having a plurality of optomechanical sensor modules integrated therein according to some embodiments of the present invention.

[0113] Fig.29 is a top plan view of a device having an optomechanical sensor module and a blood flow stimulator according to some embodiments of the present invention.

[0114] Figure 30 to Figure 32 is a flow diagram of operations for generating a physiological assessment of a subject according to some embodiments of the present invention.

[0115] Fig.33 is a graph of the relationship between optical scattering (PPG) signal intensity and bioluminescence signal intensity and measured skin temperature for multiple optical excitation wavelengths according to some embodiments of the present invention.

[0116] Fig.34 is a flow diagram of operations for generating a physiological assessment of a subject according to some embodiments of the present invention. DETAILED DESCRIPTION

[0117] The present invention will now be described more fully below with reference to the accompanying drawings in which embodiments of the present invention are shown. However, the present invention may be embodied in different forms and should not be construed as being limited to the embodiments described herein. Similar symbols refer to similar elements throughout. In the accompanying drawings, for clarity, certain layers, components or features may be enlarged, and dashed lines illustrate optional features or operations, unless otherwise specified. In addition, the order of operations (or steps) is not limited to the order presented in the drawings and / or claims, unless otherwise specifically noted. Features described for a drawing or an embodiment may be associated with another embodiment or drawing, although not specifically described or shown in the same manner.

[0118] It will be understood that when a feature or element is referred to as "on another feature or element", it can be directly on another feature or element, or there may be intervening features and / or elements. On the contrary, when a feature or element is referred to as "directly on another feature or element", there is no intervening feature or element. It will also be understood that when a feature or element is referred to as "fixed to", "connected to", "attached to" or "coupled to" another feature or element, it can be directly fixed to, directly connected to, attached to or coupled to another feature or element, or there may be intervening features or elements. On the contrary, when a feature or element is referred to as "directly fixed to", "directly connected to", "directly attached to" or "directly coupled to" another feature or element, there is no intervening feature or element. Although features and elements are described or shown for one embodiment, the features and elements described or shown in this way can be applied to other embodiments.

[0119] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present invention.As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

[0120] As used herein, the terms "comprise," "comprising," "comprises," "include," "including," "includes," "have," "has," "having," or variations thereof are open ended and include one or more stated features, integers, elements, steps, parts, or functions, but do not preclude the presence or addition of one or more other features, integers, elements, steps, parts, functions, or combinations thereof. In addition, as used herein, the general abbreviation "eg," derived from the Latin phrase "exempli gratia," may be used to introduce or specify one or more general examples of previously mentioned items, and is intended to limit such items. The general abbreviation "ie," derived from the Latin phrase "id est," may be used to specify a specific item from a more general recitation.

[0121] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items and may be abbreviated as " / ".

[0122] As used herein, phrases such as "between X and Y" and "between approximately X and Y" should be interpreted to include X and Y. As used herein, phrases such as "between approximately X and Y" mean "between approximately X and approximately Y. As used herein, phrases such as "from approximately X to Y" mean "from approximately X to approximately Y."

[0123] For ease of description, spatially relative terms such as "under...", "below...", "below...", "above...", "on...", etc. may be used herein to describe the relationship of one element or feature as illustrated in the accompanying drawings with respect to (one or more) another element or (one or more) features. It will be understood that spatially relative terms are intended to include different orientations of the device in use or operation other than the orientation depicted in the accompanying drawings. For example, if the device in the accompanying drawings is inverted, the element described as being "under" or "below" other elements or features will be oriented as being "above" other elements or features. Therefore, the exemplary term "under..." may include both the orientations above and below. The device may be oriented in other ways (rotated 90 degrees or in other orientations), and the spatially relative descriptors used herein are interpreted accordingly. Similarly, the terms "upward", "downward", "vertical", "horizontal", etc. are used herein for explanation purposes only, unless otherwise specifically noted.

[0124] It will be understood that, although the term first and second are used herein to describe various features or elements, these features or elements should not be limited by these terms. These terms are only used to distinguish a feature or element from another feature or element. Therefore, the first feature or element discussed below can be referred to as the second feature or element, and similarly, without departing from the teaching of the present invention, the second feature or element discussed below can be referred to as the first feature or element.

[0125] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as that commonly understood by one of ordinary skill in the art to which the present invention belongs. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of this specification and the relevant field, and should not be interpreted in an idealized sense or an overly formal sense unless clearly defined herein. For the sake of brevity and / or clarity, well-known functions or structures may not be described in detail.

[0126] The term "about" as used herein with respect to a value or amount means that the value or amount may vary more or less, for example, by + / -20%, + / -10%, + / -5%, + / -1%, + / -0.5%, + / -0.1%, etc.

[0127] The term "circuit" as used herein refers to an embodiment that is entirely software or an embodiment that combines software and hardware aspects, features and / or components (including, for example, a processor and software embedded within, associated with, and / or executable by the processor to programmatically direct and / or perform certain described actions, operations, or method steps).

[0128] The term "photoplethysmography" (PPG) as used herein refers to a method of generating optical plethysmographic information from at least one region of the body and processing the information to generate biometric information derived from the optical plethysmographic information. A PPG sensor module refers to a small module that includes at least one optical emitter, at least one optical detector, and at least some signal processing electronics (analog and / or digital) to process the electrical signals from the optical detector. The PPG sensor module may additionally include optomechanical (optics and mechanical support) and a noise reference sensor, such as a motion sensor, for detecting motion noise information that can be processed with the optical detector information to reduce motion artifacts from the desired PPG signal. Other types of noise references, such as ambient light (background light) noise references, may also be integrated into the PPG sensor module to help reduce background light noise from the desired PPG signal. When multiple optical emitters and / or detectors are integrated into a PPG sensor module, additional biometric information may be extracted, such as determination of blood analyte (blood constituent) levels such as oxyhemoglobin, deoxyhemoglobin, carboxyhemoglobin, methemoglobin, bilirubin, etc. A PPG sensor module may be placed or worn on nearly any part or area of ​​the body having blood flow, but such a module may more typically be close to the skin of a living being, such as the skin of the ears, forehead, nose, neck, chest, limbs (arms & legs), wrists, feet, hands and toes (fingers & toes), etc.

[0129] As used herein, the term "metric" generally refers to a measurement or measurement system of a property, and a "sensor metric" refers to a measurement or measurement system associated with a sensor. A metric may include an identifier of the type of measurement, the value of the measurement, and / or a diagnosis based on the measurement. For example, a metric may include "blood pressure", a value of "120 / 80", and / or a diagnosis of "normal".

[0130] As used herein, the term "biometric" refers to a metric associated with physiological (biological) information. Thus, the terms "biometric sensor" and "physiological sensor" are synonymous. For example, a "biometric optical sensor" may refer to an optical sensor configured for physiological monitoring. An "optical sensor" may refer to an optical detector itself or a complete PPG sensor including an optical emitter, detector, noise reference, etc.

[0131] As used herein, the terms "sensor," "sensing element," "sensor module," and "biometric sensor module" are interchangeable and refer to a sensor element or group of sensor elements that can be utilized to sense information, such as information from the body of a subject (e.g., physiological information, body movement, etc.) and / or environmental information in the vicinity of the subject. A sensor / sensing element / sensor module may include one or more of the following: a detector element, an emitter element, a processing element, an optical device, a mechanical support, a supporting circuit system, etc. Both a single sensor element and a collection of sensor elements may be considered a sensor, a sensing element, or a sensor module. In this specification, references to a "sensor element" from time to time refer to a substantial component of a sensor module or discrete sensor, wherein the sensor module or discrete sensor includes a plurality of sensor elements.

[0132] The term "optical emitter" as used herein may include a single optical emitter and / or a plurality of separate optical emitters associated with each other.

[0133] The term "optical detector" as used herein may include a single optical detector and / or a plurality of separate optical detectors associated with each other.

[0134] As used herein, the term "wearable sensor module" refers to a sensor module configured to be worn on or near the body of a subject.

[0135] As used herein, the terms "monitoring device" and "biometric monitoring device" are interchangeable and include any type of device, article, or garment that can be worn by and / or attached to a subject and includes at least one sensor / sensing element / sensor module. Exemplary monitoring devices may be specifically embodied as ear-wearings, head-wearings, finger clips, hand- and toe (finger or toe) products, limb bands (such as arm bands or leg bands), ankle bands, wristbands, nosepieces, sensor patches, eyewear (such as glasses or sunglasses), clothing (such as shirts, hats, underwear, etc.), oral products or dental products, contact lenses, etc.

[0136] The term "monitoring" refers to the action of measuring, quantifying, granting, estimating, sensing, calculating, interpolating, extrapolating, inferring, deriving, or any combination of these actions. More generally, "monitoring" refers to the manner of obtaining information via one or more sensing elements. For example, "blood health monitoring" includes monitoring blood gas levels, blood hydration, and metabolite / electrolyte levels.

[0137] The term "head-mounted device" as used herein is intended to include any type of device or ear-wearing that can be attached to or near the ear (or ears) of a user and can have various configurations without limitation. Head-mounted devices including sensor modules as described herein may include mono head-mounted devices (devices with only one earbud, one ear-wearing, etc.) and stereo head-mounted devices (devices with two earbuds, two ear-wearings, etc.), true wireless head-mounted devices (with two wireless ear-wearings), earbuds, hearing aids, ear ornaments, masks, headbands, glasses or goggles, etc. In some embodiments, the term "head-mounted device" may broadly include head-mounted device elements that are not located on the head but are associated with the head-mounted device. For example, in a "medallion" style wireless head-mounted device, where the medallion-shaped portion includes wireless electronics and the headset is inserted or hardwired into the medallion-shaped portion, the wearable medallion-shaped portion will be considered as a part of the head-mounted device as a whole. Similarly, in some cases, if a mobile phone or other mobile device is closely associated with an insertable headset, the term "headset" may refer to the headset-mobile device combination. The terms "headset" and "earpohne" as used herein are interchangeable.

[0138] As used herein, the term "optomechanical" refers in a general sense to optical modulation with respect to mechanical energy. The motion may be due to relative motion, absolute motion, vibration, pressure, force, etc. For example, generally in these inventions, an optomechanical sensor may be used to sense motion artifacts caused by any form of mechanical energy.

[0139] The term "physiological" refers to the condition or energy of the body of a living being (e.g., a human, an animal, etc.) or the condition or energy from the body of a living being (e.g., a human, an animal, etc.). In embodiments of the present invention, the term "physiological" is intended to be used broadly, covering both the physical and psychological conditions and energy of the body of a living being or both the physical and psychological conditions and energy from the body of a living being.

[0140] According to an embodiment of the present invention, the term "body" refers to the body of a subject (human or animal) that can wear a monitoring device.

[0141] The term "processor" is widely used to refer to a signal processor or computing system or a processing or computing method that can be local or distributed. For example, a local signal processor may include one or more signal processors or a processing method localized to a general location (such as, to a wearable device). Examples of such wearable devices may include ear wear, headwear, finger clips, hand and toe (finger or toe) supplies, limb bands (such as, arm bands or leg bands), ankle bands, wristbands, nose pads, sensor patches, eye wear (such as, glasses or sunglasses), clothing (such as, shirts, hats, underwear, etc.), oral supplies or dental supplies, contact lenses, etc., as well as smartphones and other devices carried or worn by individuals. Examples of distributed processors include "clouds", the Internet, remote databases, remote processor computers, multiple remote processors or computers that communicate with each other, etc., or processing methods distributed in one or more of these elements. The key difference is that distributed processors may include non-localized elements, while local processors may work independently of distributed processing systems. As specific examples, a microprocessor, a microcontroller, an ASIC (application specific integrated circuit), analog processing circuitry, or a digital signal processor are some non-limiting examples of physical signal processors that may be found in a wearable device.

[0142] The term "remote" does not necessarily mean that the remote device is a wireless device or is at a long distance from the device with which it communicates. Instead, the term "remote" is intended to reference a device or system that is different from another device or system or that is not substantially dependent on another device or system for core functionality. For example, a computer connected to a wearable device may be considered a remote device because the two devices are different and / or are not substantially dependent on each other for core functionality. Nevertheless, any wireless device (such as, for example, a portable device) or system (such as, for example, a remote database) is considered to be remote relative to any other wireless device or system.

[0143] As used herein, the terms "respiration rate" and "breathing rate" are interchangeable.

[0144] As used herein, the terms "heart rate" and "pulse rate" are interchangeable.

[0145] The term "RRi" refers to the "RR interval (R-Rinterval)" in a human heart waveform (i.e., electrocardiogram, photoplethysmogram, etc.). Generally, in the case where heart rate is used in embodiments of the present invention, RRi can also be applied in a similar manner. However, RRi and heart rate are usually related in an inverse manner, such that 1 / RRi = instantaneous heart rate.

[0146] As used herein, the term "thermal communication" includes one or more of conductive transfer of thermal energy, convective transfer of thermal energy, and radiative transfer of thermal energy.

[0147] This article can be explained by using the name of the parameter (such as "heart rate", VO 2 max, etc.) to describe various biometric and activity parameters. In general, these names may refer to the instantaneous value of the associated parameter(s), an average, or some other manipulation of the parameter. For example, a respiratory rate of 14 BPM (breaths per minute) may refer to an instantaneous measurement or an average measurement (e.g., an average respiratory rate of 14 BPM averaged over 5 minutes). Unless "instantaneous," "average," or some other adjective is used to describe a parameter, no limitation on the manipulation of the parameter should be assumed.

[0148] In the following figures, various monitoring devices attached to the ear or appendage of a human body, or even integrated into clothing, will be illustrated and described. However, it will be understood that embodiments of the present invention are not limited to those worn by a person. In addition, monitoring devices according to embodiments of the present invention can be worn at other parts of the body.

[0149] The ear is an ideal location for wearable health and environmental monitors. The ear is a relatively stable platform that does not obstruct a person's movement or field of vision. Monitoring devices located at the ear can access, for example, the internal auditory canal and tympanic membrane (for measuring core body temperature), muscle tissue (for monitoring muscle tone), the auricle, earlobes, and other places (for monitoring blood gas levels), the area behind the ear (for measuring skin temperature and galvanic skin response), and the internal carotid artery (for measuring cardiopulmonary function). The ear is also in or near a location exposed to the following: environmental inhalable toxic substances (volatile organic compounds, pollutants, etc.); noise pollution to the ear; and lighting conditions for the eye. In addition, because the ear canal is naturally designed to transmit acoustic energy, the ear provides a good location for monitoring internal sounds (such as heartbeat, breathing rate, and mouth movement). Accurate sensing of photoplethysmograms and heart rate through the ear has been demonstrated in the area between the concha and tragus locations of the outer ear and at other locations at the ear.

[0150] The optical coupling of blood vessels entering the ear may vary between individuals. As used herein, the term "coupling" refers to the interaction or communication between excitation energy (such as light) entering or leaving a region and the region itself. For example, one form of optical coupling may be the interaction between excitation light generated from an optical sensor of an earplug (or other device positioned at or in the ear) and the blood vessels of the ear. In one embodiment, such interaction may involve the excitation light entering the ear region and scattering from the blood vessels in the ear, so that the temporary change in the intensity of the scattered light is proportional to the temporary change in the blood flow in the blood vessels. Another form of optical coupling may be the interaction between the excitation light generated by the optical emitter in the earplug and the light-conducting region of the earplug. Therefore, an earplug with integrated light-conducting capability can ensure that each individual wearing the earplug will generate an optical signal related to blood flow through the blood vessels, wherein the light can be directed to multiple regions and / or selected regions along the earplug. The optical coupling of light to a specific ear region of a person may not produce a photoplethysmographic signal for each person. Therefore, coupling light to multiple regions can ensure that at least one blood vessel-rich region will be found for each person wearing the earplug. Coupling multiple areas of the ear with light can also be accomplished by diffusing light from a light source within the earplug.

[0151] Another example of an optical coupling is coupling scattered light from the subject's body to a light-guide optical device that directs the light toward the photodetector. However, the term "coupling" can also refer to mechanical coupling, electrical coupling, optomechanical coupling, etc., not just optical coupling. As an example of an optomechanical coupling, an optical coupling of a light guide from an optical emitter to the subject's body can also be associated with a mechanical coupling of a light guide (or another optical path) to the subject's body.

[0152] Reference Figures 1 to 6 , illustrates a biometric sensor module 10 that can be incorporated into various wearable devices. The illustrated sensor module 10 can be integrated into various wearable devices / apparel, including but not limited to: earplugs, wristbands, armbands, smartphones, clothing and clothing accessories, or any other wearable form factor for hands, toes, limbs, torso, head, ears, face, etc. Each sensor module 10 is constructed to capture motion information from the subject's body via an optomechanical coupling between the body and the sensor module 10. The captured motion information is used as a noise reference for filtering motion noise (motion artifacts) from the biometric sensor signal. In Figure 1In the embodiment illustrated in FIG, a sensor module (e.g., a PPG sensor module, etc.) 10 includes a base 12 (such as a printed circuit board (PCB)) supporting first and second optical emitters 14, 16 and an optical detector 18. An optical barrier 20 is provided to prevent light emitted by the emitter 16 from directly entering the optical detector 18 or saturating the optical detector 18. The illustrated sensor module 10 also includes a stabilizer member 22, which is configured to transmit motion information from the body of a subject wearing the sensor module 10 to the optical detector 18. The stabilizer member 22 may also be referred to as an optical modulation (or light adjustment) mechanism. In addition to helping to transmit subject motion information caused by mechanical energy (i.e., the force of the subject's body against the stabilizer member 22 due to the subject's motion), the stabilizer member 22 may also be configured to help stabilize the sensor module 10 against the skin.

[0153] Figures 1 to 6 The physical dimensions of the biometric sensor modules are such that they are small enough to be wearable but large enough to support optics, electronics, and power components. Considering a top view, typical dimensions for the modules may be approximately 1 mm to 20 mm in length / diameter, and the associated optics may be approximately 100 microns to 3 mm in length / diameter. However, smaller and larger sizes may be utilized, and embodiments of the invention are not limited to any particular size or dimensions.

[0154] The illustrated sensor module 10 generates two optical paths 30, 40. The first optical path 30 (also referred to as the "motion information path") is created by light emitted by the first optical emitter 12 and reflected off the stabilizer member 22. The second path 40 (also referred to as the "biometric information path") is created by light emitted by the second optical emitter 16 and absorbed, scattered, and / or reflected by tissue, blood vessels, etc. within the body of the subject. The biometric information path 40 includes a higher level of subject physiological information than the motion information path 30, which includes a higher level of subject motion information.

[0155] In addition to utilizing a single optical transmitter to create both the motion information optical path 30 and the biometric information optical path 40, Figure 2 The embodiment shown in the figure is Figure 1The illustrated sensor module (e.g., a PPG sensor module, etc.) 10 includes a base 12 (such as a PCB), an optical emitter 14, first and second optical detectors 18, 24, and an optical barrier 20. As discussed above, the optical barrier 20 is configured to prevent light emitted by the emitter 14 from directly entering / saturating the optical detector 18. The illustrated sensor module 10 also includes a stabilizer member 22 configured to transmit motion information from the body of a subject wearing the biometric sensor module 10, and to stabilize the biometric monitor 10 relative to the subject's skin. Figure 1 As with the embodiment of the present invention, the illustrated sensor module 10 generates a motion information path 30 and a biometric information path 40. The emitter 14 is configured to direct light toward the stabilizer member 22 to create the motion information path 30, and is also configured to direct light toward the subject's skin so that the light can be absorbed, scattered and / or reflected by tissue, blood vessels, etc. within the subject's body.

[0156] In addition to not utilizing stabilizer members, Figure 3 The embodiment shown in the figure is Figure 1 The illustrated sensor module (e.g., a PPG sensor module, etc.) 10 includes a base 12 (such as a PCB) supporting first and second optical emitters 14, 16 and an optical detector 18, and an optical barrier 20. As discussed above, the optical barrier 20 is configured to prevent light emitted by the emitters 16 from directly entering / saturating the optical detector 18. Figure 1 As with the embodiment of the present invention, the illustrated sensor module 10 generates a motion information optical path 30 and a biometric information optical path 40. However, the motion information path 30 is created by the first emitter 14 directing light toward the subject so that the light is directly reflected off the skin without substantial interaction with tissue rich in blood flow, and the motion information path 30 is detected by the optical detector 18.

[0157] In addition to not utilizing stabilizer members, Figure 4 The embodiment shown in the figure is Figure 2 The illustrated sensor module (e.g., a PPG sensor module, etc.) 10 includes a base 12 (such as a PCB) supporting an optical emitter 14, first and second optical detectors 18, 24, and an optical barrier 20. As discussed above, the optical barrier 20 is configured to prevent light emitted by the emitter 16 from directly entering / saturating the optical detector 18. Figure 2As with the embodiment of the present invention, the illustrated sensor module 10 generates a motion information optical path 30 and a biometric information optical path 40. However, the motion information path 30 is created by the emitter 14 directing light toward the subject so that the light is directly reflected off the skin without substantial interaction with tissue rich in blood flow, and the motion information path 30 is detected by the optical detector 18. The single emitter 14 is also configured to direct light toward the subject's skin so that the light can be absorbed, scattered and / or reflected by tissue, blood vessels, etc. within the subject's skin.

[0158] Will be in Figure 1 and Figure 2 The sensor module illustrated in FIG. 1 is referred to as an “internal” optomechanical sensor module (because the motion path modulation occurs via the internal motion (ie, the stabilizer member motion)), and Figure 3 and Figure 4 The sensor module of is called an “external” optomechanical sensor module (because the motion path modulation occurs via external motion (i.e., motion between the skin and the body)). Figures 1 to 4 Each of the embodiments illustrated in FIG. 1 works by physically modulating light in response to movement between the body of a subject wearing the sensor module 10 and the sensor module 10. Figure 1 and Figure 2 In FIG. 1 , stabilizer member 22 is used to transmit motion information from the subject's body via motion information path 30. In contrast, for Figure 3 and 4 In an "external" embodiment, physical modulation is achieved through relative movement between the subject's body and the biometric sensor module 10 itself.

[0159] exist Figures 1 to 4 In each of the embodiments of the present invention, the motion information path 30 includes little or no physiological information. Likewise, by processing the two separate signals created by the two optical paths (i.e., the motion information path 30 and the biometric information path 40) via a circuit or processor, motion noise information can be attenuated and biometric signal information can be preserved or amplified. In some embodiments, the attenuation of motion artifacts by processing the two separate signals can be performed in the analog space (via analog comparator methods, differential amplification, analog adaptive filtering, etc.) or in the digital space (via spectral subtraction, digital adaptive filtering, variable filtering, etc.).

[0160] For Figures 1 to 4, it should be noted that since the signal paths for biometric 40 and motion 30 are different, modulation of the electrical power fed to the optical emitter(s) is not critical to the operation of embodiments of the present invention. Thus, embodiments of the present invention may operate during steady state (DC) power conditions without modulating the power to the optical emitters or detectors. However, modulation of the optical emitters is in fact permitted in these configurations and may be useful for digital signal processing (generally) and for removing background light noise. As a specific example, background light may be attenuated from the PPG signal output by subtracting the optical detector signals collected when the optical emitters are turned off from the optical detector signals collected when the optical emitters are turned on. As another example, for a PPG signal having at least two optical emitters (such as Figure 1 and Figure 3 In an embodiment (illustrated in FIG. 1 ), the emitters can be modulated in an alternating manner, wherein only one emitter generates light at a given time. This can help prevent optical crosstalk from contaminating the optical detector reading when evaluating the relationship between the biometric signal path 40 and the motion signal path 30.

[0161] Reference Figure 5 , an external optomechanical sensor module (e.g., a PPG sensor module, etc.) 10 according to other embodiments of the present invention is illustrated. The illustrated sensor module 10 can be integrated into various wearable devices, including but not limited to: earplugs, wristbands, armbands, smartphones, or any wearable form factor for hands, toes, limbs, torsos, heads, ears, faces, etc. In addition to utilizing various optical elements (e.g., optical filters, optical lenses, etc.) with optical emitters 14, 16 and with detectors 18, Figure 5 The embodiment shown in the figure is Figure 3 . For example, one or more optical elements 15 are associated with the emitter 14 to help redirect light so that it is reflected from the user's skin to generate a motion information optical path 30. One or more optical elements 17 are associated with the emitter 17 to help redirect light so that it enters the subject's skin and generates a biometric information optical path 40. One or more optical elements 19 are associated with the optical detector and help detect light from each of the motion information path 30 and the biometric information path 40. Examples of suitable optical elements include light guides, light reflectors, light claddings, etc. In the illustrated embodiment, the barrier 20 is positioned between the detector 18 and each of the emitters 14, 16, and each barrier 20 is constructed to prevent light emitted by the emitters 14, 16 from directly entering / saturating the optical detector 18.

[0162] It should be noted that a combined external and internal optomechanical sensor module can also be produced by combining external path components and internal path components on the same module. In this case, it would be preferred to have at least one optical detector associated with each path, such that at least one detector is associated with the external path and at least one detector is associated with the internal path. Alternatively, one detector can be used by alternating power to the emitters associated with each path, such that a single emitter (or multiple emitters) from only one path is powered at any given time.

[0163] In other embodiments of the present invention, Figure 6 As shown in FIG, the internal optomechanical sensor module 10 can generate both a motion sensing path 30 and a biometric signal path 40 via a single optical emitter 14 and a single optical detector 18. The illustrated sensor module 10 can be integrated into a variety of wearable devices, including but not limited to: earplugs, wristbands, armbands, smartphones, or any wearable form factor for hands, toes, limbs, torsos, heads, ears, faces, etc. The stabilizer member 26 includes one or more optical filters to pass, block, or scatter distinguishable wavelengths or wavelength bands. For example, some wavelengths of light from the optical emitter 14 can pass through the stabilizer member 26 and pass through the biometric signal path 40, while other wavelengths of light can be scattered by the stabilizer member 26 and pass through the motion sensing path.

[0164] In the illustrated embodiment, the optical emitter 14 is configured to generate electromagnetic energy of at least two distinguishable wavelengths in distinguishable, separate time periods, and / or the optical detector 18 is configured to discriminate between the at least two distinguishable wavelengths. For example, the optical emitter 14 may include at least two separate emitters (such as having an LED array or a mesa array, etc.) whose emission intensities alternate in time, and the detector 18 may be configured to sense each wavelength separately in time. As another example, the optical emitter 14 may be configured to generate multiple wavelengths simultaneously (i.e., not alternating in time), and the detector 18 may include at least two different detection regions (such as a photodiode or a mesa array, etc.), each detection region being associated with a different optical filter, so that the detector 18 can sense each wavelength simultaneously via a separate detection region or "channel". Figure 6 The important benefit of the internal optomechanical sensor structure is that Figure 1 and Figure 2 Unlike the embodiments presented in , a single optical emitter and a single optical detector may be used.

[0165] Now refer to FIG. 7A to FIG. 7D, illustrates an "external" optomechanical sensor module (e.g., a PPG sensor module, etc.) 100 that can generate both a motion information optical path 30 and a biometric information optical path 40 according to some embodiments of the present invention. The illustrated biometric sensor module 100 can be integrated into a variety of wearable devices, including but not limited to: earbuds, wristbands, armbands, smartphones, or any wearable form factor for a hand, toe, limb, torso, head, ear, face, etc. The illustrated sensor module 100 includes a housing 102 having a generally rectangular configuration. However, embodiments of the present invention are not limited to the configuration of the illustrated biometric sensor module 100. The sensor module 100 may have any shape, such as a triangle, a polygon, a circle, etc. The housing 102 may be formed of a substantially opaque material.

[0166] The size of the sensor module 100 may be determined in part by the part of the body where the sensor module 100 is positioned. For example, a smaller sensor module 100 may be more suitable for the ear or along a muscle group, while a larger sensor module 100 may be more suitable for a flat surface, such as a wrist or forearm, etc. Ideally, however, the sensor module 100 should be constructed to be small enough not to "rock" on multiple muscle groups as they contract independently.

[0167] Within the sensor module housing 102 is a base 110, such as a PCB, that supports a first pair of optical emitters 112, a second pair of optical emitters 114, and an optical detector 116. Exemplary optical emitters 112, 114 include, but are not limited to, light emitting diodes (LEDs), laser diodes (LDs), compact incandescent bulbs, organic LEDs (OLEDs), micro plasma emitters, IR black body sources, etc. A light guide 120 is in optical communication with each optical emitter 112 and is shaped and constructed to guide light emitted from each emitter 112 into the skin of a subject wearing the sensor module 100 so that a biometric information path 40 ( Fig.7D ). The light guide 130 is in optical communication with each optical emitter 114 and is shaped and configured to guide light so as to reflect off the subject's skin and create a motion information path 30 ( Fig.7D ).

[0168] Light guide 140 is in optical communication with detector 114 and is configured to collect light from both motion information path 30 and biometric information path 40 and deliver the collected light to optical detector 114. In some embodiments, light guide 140 may include reflective material along its sidewalls to help guide light to the optical detector. Additionally, light guide 140 may have a variety of shapes and configurations that may be used to collect light for detection.

[0169] The illustrated sensor module 100 also includes a plurality of stabilizer members 150 configured to stabilize the sensor module 100 when in contact with the subject's skin. As illustrated, the light guides 120, 130, the detector light guide 140, and the plurality of stabilizer members 150 extend outwardly from the housing 102 through corresponding holes formed in the outer surface 104 of the housing 102. It should be noted that in this particular embodiment, the stabilizer members 150 are not configured to modulate the motion path. That is, these stabilizers 150 are only used to stabilize the sensor module 100 against the subject's body.

[0170] In use, the sensor module 100 is positioned against the subject's skin, for example via a strip or band, and the optical emitter 112 emits light through the light guide 120 and into the body. The light propagates through the body and then enters the light guide 140, which guides the light to the light detector 116. The optical emitter 114 emits light through the light guide 130, which guides the light to reflect off the subject's body and into the light guide 140 so as to be detected by the detector 116 and not substantially enter the body. The light from the optical emitter 112 is turned on (modulated) at a different time than the light from the optical emitter 114, and the detector 116 is able to distinguish between light containing biometric information (i.e., light in the biometric information path 40) and light containing motion information (i.e., light in the motion information path 30). The signals generated by the light detector 116 for the detected light containing motion information and the detected light containing biometric information are sent to the processor and, along with any other reference signals, are used to extract pure biometric information.

[0171] In one mode of operation, the emitters 112, 114 may be temporally alternatingly modulated, such as with pulses or biases, so that signal processing may be used to identify motion information in the motion information path 30 and biometric information in the biometric information path 40. Analog or digital filters may then be implemented to process both the motion information and the biometric information to selectively attenuate motion artifact information from the biometric information.

[0172] As sensor module housing 102 moves up and down and side to side against the skin of a subject wearing sensor module 100, light in motion information path 30 is modulated primarily by motion artifacts, such as optical scattering from the skin interface. Conversely, light in the biometric information path may be physically modulated by subject motion or physiologically modulated by absorption, scattering, and / or reflection by tissues, blood vessels, etc. within the subject's body.

[0173] In some embodiments, the optical emitter 114 may emit light at a shorter wavelength than the light emitted by the optical emitter 112. Light of a shorter wavelength may not penetrate as deeply into the skin as light of a longer wavelength, thereby reducing the strength of the biometric information in the motion information path 30. In some embodiments, the optical emitter 114 emits light at a wavelength of light shorter than 470 nanometers. In other embodiments, the optical emitter 114 emits light at a wavelength of light shorter than 420 nanometers. However, the emitter 114 may use an optical emitter that can emit light at any wavelength of light, including wavelengths longer than the wavelength generated by the optical emitter 112 in the biometric signal path. However, wavelengths shorter than 280 nanometers and longer than 5 microns are more challenging to implement effectively, in part due to high absorption of shorter wavelengths and waveguide effects at larger wavelengths. In addition, solid-state optical detectors exhibit extremely low sensitivity for wavelengths shorter than 280 nanometers and are extremely noisy (especially at room temperature and higher) for wavelengths greater than 2 microns.

[0174] As discussed above, some biometric information (e.g., PPG information) may be included in the motion information path 30 because at least some of the light may interact with blood flow at the skin surface. Thus, the scattered light received by the detector 116 may at least partially include the biometric information, which is undesirable because in this case it may be difficult to use the motion path signal as a noise reference for cleaning the photoplethysmogram. Therefore, in some embodiments of the present invention, the light guide 130 is configured such that the light emitted by the optical emitter 114 is diverted to be scattered from the skin at a large angle, which may hinder absorption at the skin. As in Fig.7D As illustrated in FIG. 1 , the sensor module 100 is configured such that light is scattered from the light guide 130 to propagate toward the skin at a large angle and is scattered off the skin surface toward the detector light guide 140 and / or is directed along the skin surface toward the detector light guide 140 .

[0175] Now refer to FIG. 8A to FIG. 8B as well as 9A to 9D, illustrates an "internal" optomechanical sensor module (e.g., PPG sensor module, etc.) 200 that can generate both a motion information optical path 30 and a biometric information optical path 40 according to some embodiments of the present invention. The illustrated biometric sensor module 200 can be integrated into a variety of wearable devices, including but not limited to: earbuds, wristbands, armbands, smartphones, or any wearable form factor for hands, toes, limbs, torsos, heads, ears, faces, etc. The illustrated sensor module 200 includes a housing 202 having first and second portions 204, 206, which are secured together via fasteners F. In the illustrated embodiment, each fastener F is a screw or other threaded member inserted through the second housing portion 206 and threadedly engaged to a threaded insert 207 secured to the first housing portion 204. However, embodiments of the present invention are not limited to the use of threaded fasteners. As will be appreciated by those skilled in the art, various means may be utilized to secure the first and second housing portions 204, 206 together. In some embodiments, one or both of the housing first and second portions 204, 206 are formed from a substantially opaque material to help prevent the intrusion of background light and, thus, prevent contamination of the optical signal.

[0176] The illustrated sensor module 200 has a generally circular configuration. However, embodiments of the present invention are not limited to the illustrated configuration of the sensor module 200. The sensor module 200 may have any shape, such as a triangle, a polygon, a rectangle, etc. In addition, the size of the sensor module 200 may be determined in part by the body part where the sensor module 200 is positioned. For example, a smaller sensor module 200 may be more suitable for an ear or along a muscle group, while a larger sensor module 100 may be more suitable for a flat surface, such as a wrist or a forearm. However, the sensor module 200 should ideally be small enough not to "rock" on multiple muscle groups when the multiple muscle groups are contracted independently.

[0177] Positioned within the housing 202 of the sensor module 200 is a base 210, such as a PCB, that supports optical emitters 212, 214 and an optical detector 216. Also positioned within the housing 202 is a light guide 220 configured to be in optical communication with the optical emitter 212, a stabilizer pad 230, and a light guide 240 configured to be in optical communication with the optical detector 216.

[0178] The illustrated light guide 220 includes a plurality of elements 222 extending outwardly from one side thereof, the plurality of elements 222 being configured to extend through corresponding holes 203 in the first housing portion 204. Unlike stabilizing elements 232 and 234, these elements 222 are not intended to convey motion information, but rather to stabilize (support) the sensor at the body.

[0179] The light guide 220 also includes an element 224 extending through the hole 205 in the first housing portion 204, the element 224 being configured to direct light from the emitter 212 into the body of a subject wearing the sensor module 200. The light guide 220 is also configured to internally direct light from the emitter 214 toward the stabilizer members 232, 234 of the stabilizer pad 230.

[0180] The illustrated stabilizer pad 230 includes a first pair of stabilizer members 232 extending outwardly therefrom, the first pair of stabilizer members 232 being configured to extend through corresponding holes 207 in the first housing portion 204. The illustrated stabilizer pad 230 also includes two pairs of stabilizer members 234 extending outwardly therefrom, the two pairs of stabilizer members 234 being configured to extend through corresponding holes 209 in the first housing portion 204. The stabilizer members 232, 234 are configured to contact the subject's skin and move in response to the subject's movement. As will be described below, light from the optical emitter 214 is directed toward the stabilizer members 232, 234 via either the light guide 220 or via the empty pocket space in the pad 230 to create a corresponding motion information path 30.

[0181] In the illustrated embodiment, the light guide 220 and the stabilizer pad 230 are integrated into one unit and are referred to as a "multi-shot" lens. The illustrated multi-shot lens can be manufactured by guiding two types of plastics into a mold (transparent + opaque) so that there is no seam between the two areas. As a result, the multi-shot lens can prevent moisture (such as sweat from a subject wearing the sensor module 200) from leaking into the electronics. The transparent portion of the lens is configured for light guiding. The opaque area is configured for optomechanical sensing (i.e., motion sensing) as described above. However, in other embodiments, the light guide 220 and the stabilizer pad 230 can be separate elements.

[0182] Now refer to Fig. 9A , FIG. 8A to FIG. 8B The sensor module 200 is shown in an assembled configuration. As shown, stabilizer members 232, 234 extend through the first portion of the housing. Stabilizer members 232, 234 interact with the skin of a subject wearing the sensor module 200 and are configured to press downward against the light guide 220 due to subject movement and modulate light emitted by the optical emitter 214 to produce motion information detected by the optical detector 216. Figure 1 to Figure 2, 30). The stabilizer members 232, 234 are configured to change shape (i.e., collapse) in proportion to the relative motion between the skin and the sensor module 200. For example, the relative motion may be caused by forces exerted on the stabilizer members 232, 234 by the user's body. When the stabilizer members 232, 234 collapse, they may modulate the light between the optomechanical emitter 214 and the detector 216 in proportion to the relative motion. Thus, given FIG. 7A to FIG. 7D The external optomechanical sensor light guides 120, 130 of the sensor module may be made of a rigid optically transparent material so that bending of the optics will not distort the desired reflection profile of the scattered light, and instead the internal optomechanical sensor module 200 utilizes stabilizer members 232, 234 made of a material that is at least partially flexible (soft) under pressure between the sensor module 200 and the skin / body.

[0183] Fig. 9B yes Fig. 9A 2 is a cross-sectional view of a sensor module 200 and illustrates the construction of a light guide 220 that creates a biometric information optical path that allows light emitted from an optical emitter 212 to enter the subject's body and then be collected and detected by a detector 216. Fig. 9C yes Fig. 9A 2 is a cross-sectional view of a sensor module 200 and illustrates the construction of a light guide 220 that creates a motion information optical path that allows light emitted from an optical emitter 214 to be modulated by stabilizer members 232, 234 and then detected by a detector 216. Fig.9D The motion information path 30 generated by the sensor module 200 is illustrated in FIG.

[0184] During relative motion between the sensor module 200 and the body of a subject wearing the sensor module, both light scattered via the motion information path and light scattered by the biometric information path may include motion artifact information. The linearity of the motion artifact information from these optical paths may be at least partially determined by the flexibility of the stabilizer members 232, 234 used. In general, higher linearity between these paths may be achieved when the flexibility of the stabilizer members 232, 234 is close to the flexibility of the subject's skin. This is because light scattered from the biometric information path may be scattered primarily by the skin and / or other tissue near the user's skin, and thus the stabilizer members 232, 234, which have a mechanical flexibility similar to that of the skin, may also scatter light in a similar manner during motion. It should be noted that although Fig.9DThe moving information path 30 in the embodiment does not contain any light-conducting material (e.g., the moving information path 30 is filled with air or vacuum), but the moving information path can be filled with light-conducting material instead. Moreover, such light-conducting material can also be rigid (e.g., glass) or flexible (e.g., silicone).

[0185] For Figures 1 to 6 , FIG. 7A to FIG. 7D , FIG. 8A to FIG. 8B as well as 9A to 9D , the physical dimensions of the housing of these embodiments may be approximately 5-20 mm, and the physical dimensions of the optical emitter and detector components may be 0.5-3 mm. However, embodiments of the present invention are not limited to any particular housing size / configuration or optical emitter / detector size / configuration. Many size configurations are suitable for embodiments of the present invention. Some size limitations worth noting are that the ideal spacing between the emitter and the detector in the biometric signal path may be between 2 mm and 7 mm. In general, the farther the emitter to detector spacing, the higher the signal-to-noise (AC / DC) ratio. However, if the spacing is too far, the biometric signal will be too weak to exceed the background noise of the photodetector. And, ideally, Figures 1 to 6 , FIG. 7A to FIG. 7D , FIG. 8A to FIG. 8B as well as 9A to 9D The size of the optical device in the embodiments may be larger than tens of microns so that the optical device can capture enough light without excessively attenuating the signal.

[0186] Now refer to FIG. 10A to FIG. 10C , illustrates an internal optomechanical sensor module (eg, PPG sensor module, etc.) 300 according to other embodiments of the present invention. The illustrated sensor module 300 includes a light guide 320 having three separate portions 320a, 320b, 320c separated by an optical barrier 330. Fig. 10B It is taken along line 10B-10B Fig. 10A A cross-sectional view of the sensor module 300, and Fig. 10B Illustrated is a biometric information path 40. Light guide 320 is configured to allow light emitted from optical emitter 312 to enter the body of the subject and then be collected and detected by detector 316 to create a biometric information path.

[0187] Fig. 10C It is taken along line 10C-10C Fig. 10A300, and illustrates the motion information path 30. The stabilizer member 332 is configured to modulate according to the motion at the sensor module / skin interface. As the interface force increases on the stabilizer member 332, the gap decreases, thereby reducing the amount of light reaching the optical detector 316. The modulation of the amount of light reaching the optical detector 316 can be related to the subject's motion, and a motion reference signal can be generated via a processor.

[0188] Now refer to FIG. 11A to FIG. 11D , illustrates an internal optomechanical sensor module (e.g., a PPG sensor module, etc.) 400 according to other embodiments of the present invention. The illustrated sensor module 400 includes a base 410, such as a printed circuit board (PCB), supporting a pair of optical emitters 412 and an optical detector 416. The sensor module 400 also includes a pressable / deformable member 420 that includes a plurality of internal light shielding channels or paths 422. In Fig. 11C In the embodiment, there is only slight external pressure on the depressible / deformable member 420 of the sensor module 400. Therefore, the light shielding path 422 remains expanded, thereby allowing a maximum amount of light to pass therethrough to reach the optical detector 416. Fig.11D , the force on the depressible / deformable member 420 has increased due to the subject's motion. As a result, the light shielding path 422 is compressed, thereby reducing the amount of light that can pass therethrough to reach the optical detector. The modulation of the amount of light reaching the optical detector 416 can be related to the subject's motion, and a motion reference signal can be generated via a processor.

[0189] Now refer to FIG. 12A to FIG. 12C , illustrates a biometric sensor module 500 including an internal mechanical device (e.g., a pressure transducer) 520 configured to capture motion information from the body of a subject wearing the sensor module 500. The illustrated sensor module 500 includes a base 510, such as a printed circuit board (PCB), supporting a plurality of optical emitters 512 and a light detector 516. The sensor module 500 also includes a plurality of members 530 extending therefrom and configured to engage the skin of a subject wearing the sensor module 500. The force exerted on the members 530 due to the subject's motion is transmitted to the pressure transducer 520 and measured. The modulation of the pressure in the pressure sensor can be related to the subject's motion, and a motion reference signal can be generated via a processor.

[0190] Now refer to Fig.13AAccording to other embodiments of the present invention, pressure change information can be obtained by wrapping a subject's limb 600 with a fluid-filled inflatable bladder 610, and then constraining the bladder 600 to prevent expansion away from the limb 600 using a band 620 with low flexibility or no flexibility (i.e., low stretchability or no stretchability). The illustrated band 620 supports a biometric sensor module 630, such as a PPG sensor module. The non-stretch (i.e., inelastic) band 620 can be included as part of the inflatable bladder 610 itself by constructing the bladder 610 from a semi-flexible material. An example of the semi-flexible material can be a polyurethane-coated nylon material that is RF welded together to form a bag. This type of structure will allow some stretching, but will maintain a defined shape within the functional pressure range and effectively serve as a semi-constraint system. Through this construction, pressure changes within the limb of the subject wearing the bladder 610 can be directly transferred to the fluid-filled bag.

[0191] The fluid within the pouch 610 may be any suitably stable liquid, gas, or gel (water, aqueous solution, air, silica gel, colloid(s), etc.), and a pressure transducer (not shown) may be employed within the pouch volume to transmit a signal proportional to the internal pressure change. Exemplary pressure transducers include MEMS (micro-electromechanical systems) devices, diaphragms, actuators, etc. Additionally, where the movement of the pouch 610 is proportional to the pressure change, an optical scatter sensor (such as an optomechanical pressure sensor) may be used to sense the optical scatter.

[0192] In order for the bladder 610 to interact with the subject's limb 600 to obtain a pressure reading, it may be necessary to allow the bladder 610 to interact with the limb 600 by maintaining a good surface interaction with the limb 600. Tensioning the band 620 surrounding the fixed volume bladder 610 may force the bladder 610 to interact with the limb 600 and experience deformation and pressure changes caused by pressure changes within the limb 600. Without this constraint, the bladder 610 may break away from the outside of the band 620 and then some portions of the bladder 610 may not be well coupled to the limb 600. However, if the rigid or semi-rigid band does not completely surround the bladder 610, a semi-constrained bladder system may also provide a good coupling between the limb 600 and the pressure sensitive bladder 610. In this case, it may be necessary to pump or fill gas (manually or automatically) into the bladder 610 to prevent the bladder 610 from breaking away from the outside of the band 620.

[0193] Use a flexible bladder (such as in Fig.13A A pouch 610 as shown in FIG. 6A and FIG. 6B may be advantageous because the large surface area may interact with the limb 600 over a large portion of the surface area of ​​the limb 600. Fig.13AIn the illustrated embodiment of , the capsular bag surrounds the limb 600 and the pressure changes involve compression of the entire cross-sectional area of ​​the limb 600. In this way, the processor associated with the PPG sensor 630 receives information about the pressure changes throughout the entire cross-sectional area of ​​the limb because the limb 600 can be completely contained within the pressure interrogation region. However, a partial capsular bag (non-circumferential) can also be used so that only a portion of the limb 600 can interact with the capsular bag 610. In this case, the capsular bag 610 can preferably be located near the location of the biometric sensor site so that the motion noise reference site (pressure sensing site) and the biometric sensing site are close. In addition, although the motion noise reference site (pressure sensing site) is drawn for a limb (such as an arm, wrist, leg, etc.), the pressure sensing site is close to the motion noise reference site. Fig.13A , however, embodiments of the invention may be applied to the limbs (fingers and toes) and other parts of the body that can support a wraparound device or a partial wraparound device.

[0194] Now refer to FIG. 13B to FIG. 13D , illustrates a modular pouch 640 according to an embodiment of the present invention. The PPG sensor module 630 is positioned on top of a substrate 650 (such as a circuit board or other support structure having electrical connections for powering the sensor module 630), and the substrate 650 can be placed on top of the pouch 640. Thus, when the pouch 640 is integrated into a wearable device (i.e., such as a wearable band 620, Fig.13D ), the pouch 640 experiences a pressing force (ie, pressure) when the PPG sensor module 630 is in contact with the skin, thereby pushing the base 650, and thereby the pouch 640 is in contact with the base 650. Fig.17 As depicted, a pressure sensor 660 in the bladder 640 detects this pressure so that the pressure can be used as a noise reference.

[0195] As described below, pressure sensor 660 may be any of a variety of different types of pressure sensors that may be embedded in a wearable sensor module. Additionally, although one pressure sensor 660 is shown, multiple pressure sensors may be utilized.

[0196] FIG. 13A to FIG. 13ESeveral concepts are illustrated: 1) reducing pressure and pressure variations on the sensor module, and 2) using pressure measurements of the bladder fluid as a noise reference for blood occlusion. Pressure variations of a wearable device's sensor head, device housing, strap, etc. on the subject's skin tend to modulate the blood's proximity to the skin's surface through occlusion. Greater pressure tends to occlude blood from the surface, while lesser pressure allows blood to return to the surface. It would be advantageous to reduce and redistribute the total pressure on the face of the sensor head against the subject's skin. The sensor head can be mounted with a fluid-filled bladder to act as a pressure absorber to reduce pressure between the sensor head and the skin. The fluid can be air (or other suitable inert gas), silicone, gel, liquid water (or other suitable inert liquid), etc. By using FIG. 13B to FIG. 13E With the bladder 640 shaped as a ring around the sensor head / module 630 , pressure can be redistributed equally across the sensor head / skin interface so that blood occlusion points are reduced, particularly at or near corners of the sensor head's optical path.

[0197] The bladder 640 also serves to reduce the rate of change of pressure of the sensor head / module 630 against the skin, such as occurs during intense activity or during muscle movement in the area of ​​the sensor head / module 630. The bladder 640 acts to reduce sudden changes in system pressure. This is beneficial to sensor signal quality to avoid sudden changes in measurement. The bladder fluid may be selected to most effectively balance the overall decompression effect, to most effectively redistribute pressure, or to most effectively reduce pressure changes.

[0198] Because PPG sensors are sensitive to changes in blood flow, during motion or muscle contraction during a user's activity, the pressure-related blood flow can be a source of noise on the measured optical signal of the sensor head / module 630. For example, contracting muscles can push blood away so that the resulting PPG signal during muscle contraction displays characteristics of a heartbeat pulse wave, thereby interfering with algorithms designed to extract heart rate from the PPG signal.

[0199] To allow the algorithm to take this noise into account, it would be advantageous to know the pressure of the sensor head / module 630 against the skin so that this pressure can be used as a noise reference. FIG. 13B to FIG. 13EThe amount of pressure inside the bladder 640 can be directly related to the amount of pressure between the sensor head / module 630 and the skin. By coupling the pressure sensor 660 to the fluid within the bladder, the measurement can be estimated as a measurement of the pressure of the blood occlusion force. The bladder fluid can be selected to closely represent the fluid dynamics of the skin / blood system so that it most closely correlates with the contributed noise so that subtracting the noise results in a clearer PPG signal that more closely correlates with the blood flow caused by the heartbeat. For example, in a pressure sensor with an optomechanical construction in which an optical emitter shines light into the fluid and an optical detector detects light scattered from the fluid (where the scattered light intensity is proportional to the fluid motion), the desired optical detector signal will closely correlate with the unwanted venous blood motion component (non-pulsatile component) of the blood flow signal captured by the associated PPG sensor.

[0200] exist Fig.13F An exemplary construction of such a representation is presented in Fig.13F A pouch 670 is illustrated wherein the fluid-filled region includes an artificial blood vessel 680 that is at least partially filled with a fluid 682. In this configuration, the pouch may be comprised of a flexible (compressible) material (such as, for example, a plastic, a polymer material, silicone, rubber, latex, etc.) such that compression of the material will cause skin-like (i.e., human skin-like) compression to push the fluid 682 from the artificial fluid reservoir 690 through the artificial blood vessel 680. Although the artificial blood vessels 680 are illustrated as being primarily lateral in configuration, they may be oriented as primarily vertical configurations or in other dominant directions as would be the case with real human blood vessels. Fig.13F In one non-limiting embodiment, the pouch 670 can be constructed by molding silicone (or other suitable material) around the artificial blood vessel mold. In another non-limiting embodiment, the artificial blood vessel 680 can be manufactured by molding silicone (or other suitable material) without the artificial blood vessel mold in place. Conversely, the vascular structure can be manufactured by creating intentional bubbles in the silicone. The fluid can be filled into the container 680 by soaking the pouch 670 in the fluid or exposing the pouch 670 to the fluid and sealing the structure (such as by overmolding, etc.) to create a non-leaking unit.

[0201] exist Fig.13F In another embodiment, the artificial structure (i.e., the pouch 670) may also include microfluidic or nanofluidic circuits and structures to control the flow of fluid within the artificial structure. Various microfluidic and nanofluidic circuits and structures are well known in the art. It should be noted that Fig.13F The specific embodiment of the invention may be particularly useful as a noise reference for heart rate monitoring and blood pressure monitoring, because the pressure signal generated is comparable to FIG. 13A to FIG. 13EOther embodiments of the invention are more indicative of venous blood flow. Fig.13F An additional benefit of the construction as a noise reference is that there may be no need for the artificial structure 670 to be in physical contact with the skin, as fluid will flow during movement and be sensed by the pressure (or optical) sensor, even in the absence of a pressure differential between the wearable device utilizing the artificial structure 670 and the subject's body.

[0202] Now refer to FIG. 14A to FIG. 14B , illustrates a sensor module 700 having an array of optomechanical motion noise reference sensors 710 (having, for example, one or more of the optomechanical configurations described in various embodiments of the present invention) for tracking gesture motion. The sensor module 700 is attached to a subject's limb via a band 720. The optomechanical motion sensors 710 are applied in an array along the body (in this case, the limb) to sense pressure or sense changes in motion between the array elements and the subject's body. Thus, when the subject makes gestures, the array elements 710 can sense the pressure generated by these gestures, and these signals can be processed to recognize the gestures. Because the positions of the optomechanical sensors relative to each other are known in advance by their layout in the wearable device, the processor can analyze the sensor readings to map out pressure readings caused by muscle movement across the body, thereby converting the sensor information into gesture information.

[0203] The wearable array may also communicate with local accelerometers, and the combined accelerometer data plus the array data may be processed to determine overall body part motion as well as gesture motion. This functionality may be achieved because the accelerometers may be configured to evaluate overall acceleration, angular momentum, magnetic position, etc., while the array may be configured to sense pressure signals from gestures. It should be noted that in a strict gesture monitoring system, biometric sensors are not necessarily required, but integrated biometric sensors may also be added to embodiments to provide biometric sensing in addition to gesture sensing.

[0204] The movement or posture of the head or ears can also be evaluated via embodiments of the present invention. One or more optomechanical sensors or sensor arrays 710 can be integrated into the audio ear wear and configured to measure light signals scattered by body movements caused by footsteps, talking, yawning, chewing, etc. The output of the optomechanical sensor can then be processed to extract footsteps and mouth movements. Signals associated with mouth movements can be processed to determine what words the subject is saying or what words someone is "lip-syncing" (not strictly speaking, but producing mouth movements for the words). These signals can then be used to control a user interface or to convert these signals into real sounds. For example, by lip-syncing the word "open", the optomechanical sensor output can be processed (locally or remotely) into a command to turn on a smartphone, the ear wear itself, or other device.

[0205] Now refer to FIG. 15A to FIG. 15E . Fig.15E is a spectrum of a raw PPG signal collected from a person wearing a PPG sensor close to the person's skin. FIG. 15A to FIG. 15B A normalized spectrogram of a heart rate signal derived from a PPG after active motion noise cancellation employing embodiments of the present invention and embodiments of commonly owned U.S. Patent Application Publication Nos. 2014 / 0114147, 2015 / 0018636, and 2015 / 0011898, which are incorporated herein by reference in their entirety, is shown.

[0206] According to an embodiment of the present invention, a person wearing an armband with a PPG sensor module exercises via strength training techniques involving the following exercises: rowing, inchworm, and thrust. The PPG armband includes an inertial sensor (3-axis accelerometer) and an optomechanical sensor (internal optomechanical sensor). During PPG signal acquisition, frequencies associated with motion noise and its harmonics are actively removed in real time via spectral subtraction and redaction as described in U.S. Patent Application Publication Nos. 2014 / 0114147, 2015 / 0018636, and 2015 / 0011898.

[0207] FIG. 15A to FIG. 15B shows the PPG spectrogram for this exercise phase after active noise removal. Fig.15A shows a spectrum plot for the case of a PPG signal using only the accelerometer as a noise reference, and Fig. 15B2 shows a spectrum diagram of a PPG signal using both an optomechanical sensor and an accelerometer according to an embodiment of the present invention as noise references. Note that for Fig. 15B , the heart rate information is clearly visible in the spectrogram for all exercises. However, Fig.15A The heart rate information for the first part of the exercise (in this case, the rowing exercise) is not fully extracted. Fig. 15C and Fig.15D The standardized spectrum diagram is shown in Fig.15A and Fig. 15B The cause of the noteworthy differences between Fig. 15C The z-axis of the accelerometer is shown. Fig.15D shows the output of the optomechanical sensor. That is, Fig.15D The spectrum of the optomechanical sensor output more closely reflects Fig.15E The noise in the original PPG spectrogram (as shown by Fig.15E The low frequency noise in the

[0208] In contrast, the spectrogram output by the accelerometer does not reflect the noise characteristics of the original PPG spectrogram as closely as possible. Fig.15D When the optomechanical information is obtained, it is more efficient to subtract the unwanted frequencies, thus producing a more accurate representation of the user's heart rate (compared to Fig.15A In contrast Fig. 15B ). For noise removal, it is important to note that one can choose to use either the accelerometer signal or the optomechanical signal to determine the user's cadence, and then use that cadence information to determine the harmonics for editing (i.e., edit the harmonics of the running cadence from the PPG signal). However, each noise reference can be used for spectral subtraction, either individually or in combination.

[0209] It should be noted that a number of noise removal techniques can be applied with the optomechanical pressure signal as a noise reference. For example, the optomechanical signal can be used as an input to an adaptive filter so that the noise reference is actively removed from the raw PPG signal in real time. FIG. 16A to FIG. 16C are spectrograms illustrating real-time noise removal from a PPG signal. These spectrograms are intensity normalized in each time segment and are from a 600 second run. The same subject was tested with a PPG sensor with an internal optomechanical sensor as in 9A to 9D As shown in . Fig.16A The spectrogram of the PPG signal (biometric information) after DC removal filtering is presented. In this spectrogram, the heart rate signal is almost invisible, while motion noise is obvious. Fig. 16BThe spectrogram of the associated optomechanical signal (motion noise reference) after DC removal filtering is presented. Motion noise is clearly present in the spectrogram. Fig. 16C spectral plots of the output of an adaptive filter (i.e., an LMS or “least mean square” adaptive filter) used to subtract optomechanical information (from PPG signal information) from PPG signal information in accordance with an embodiment of the present invention are presented. Fig.16A Feature removal Fig. 16B ). It is noted that once the motion noise is removed, the heart rate signal “jumps out” from the spectrogram. Specifically, Fig. 16C The common noise between the optical signal and the optomechanical signal (noise less than 50 BPM) is removed. Fig. 16C In the example above, most of the motion noise between 50 BPM and 80 BPM was removed between 230 and 350 seconds.

[0210] Exemplary adaptive filters are described in commonly owned U.S. Patent Nos. 8,700,111 and 8,647,270, which are incorporated herein by reference in their entirety. Fig.17 As illustrated in FIG, an optomechanical sensor according to an embodiment of the present invention may first be used as a noise reference to subtract a temporal adaptive filter, thereby effectively removing or subtracting motion noise from the PPG signal to generate a clearer PPG signal, and then, as described in the aforementioned U.S. patent, this cleaned PPG output may be an input to a parameter extractor that uses an accelerometer as a noise reference and / or uses an accelerometer to determine the user's rhythm and implement heuristics for estimating heart rate. Optionally, the accelerometer may also be used as a second noise reference in the adaptive filter to further clean the PPG signal before the output reaches the parameter extraction stage.

[0211] exist Fig.17 In the illustrated embodiment of FIG. 1 , signals 900 and 902 from a sensor module according to an embodiment of the present invention are input to a subtraction filter 904. Signal 900 is a signal that primarily contains physiological information from a subject (i.e., physiological information obtained via biometric information optical path 40), and signal 902 primarily contains subject motion information (i.e., motion information obtained via biometric information optical path 30). Subtraction filter 904 removes motion noise from the biometric signal using the motion information path signal as a noise reference, and the cleaned biometric signal is input to a parameter extractor 906 that is configured to generate a digital data string including various physiological data.

[0212] In combination with the motion path information signal 902, the accelerometer 908 associated with the sensor module can be used as an additional noise reference and / or for determining the user's cadence and implementing heuristics for estimating heart rate. Fig.17 , motion information from both the accelerometer 908 and the motion information path signal 902 can be subtracted from the biometric information path signal 900. Similarly, both the accelerometer 908 and the motion information path signal 902 can provide motion information to the processor as a basis for editing harmonics associated with body motion from the biometric path signal.

[0213] Additionally, the accelerometer 908 signal and the motion information path signal 902 may be processed by the processor such that one of these signals filters or modifies the other. This may be useful in situations where the two signals may have similar characteristics in the time or frequency domain (i.e., similar amplitude, pulse width, phase, peak frequency, harmonics, etc.) prior to the active cleaning of the biometric path signal 900 noise removal step (904, 1002). In this case, Fig.18 The steps between 1000 and 1002 in may be configured to “normalize” the strength of the other of accelerometer 908 or motion path signal 902 based on the output of the other of accelerometer 908 or motion path signal 902 .

[0214] It should be noted that Fig.17 This should not be considered as a limiting method of signal extraction for the cleaned PPG signal using the motion information path signal 902 as a noise reference, but rather as an exemplary method. As described earlier, various filtering methods may be applied to clean the biometric information path signal 900 using the motion information path signal 902 as a noise reference. Fig.17 In the embodiment shown in , the subtractive filter 904 may include a simple subtractive filter, an adaptive filter, a heuristic filter, etc. As described earlier, the filter may also include an editing method to selectively remove signals (such as unwanted frequencies) from the biometric information path signal 900 using the motion information path signal 902 and / or the accelerometer 908 signal as a noise reference. The editing method may be particularly useful for removing spectral harmonics of unwanted motion noise from the biometric information path signal 900.

[0215] As described earlier, in Fig.17In some embodiments, the subtractive filter 904 may also include a spectral transform generator so that the subtractive method is performed in the frequency domain. It should be noted that, in general, the filter used to remove motion noise as described herein can be analog and / or digital in nature, and the subtractive filter 904 may include at least one digital algorithm and / or may include an analog filter. Static or active analog filters can be used, but active analog filters may be more beneficial because they can help actively remove time-dependent motion noise characteristics.

[0216] It should also be noted that although heart rate extraction is discussed in detail with respect to embodiments of the present invention, the present invention is not limited to heart rate monitoring. The cleaned PPG sensor output may also be processed to extract other parameters such as RRi, respiration rate, blood pressure, SpO 2 , blood hydration level, vascular compliance, heart rate variability (HRV), blood analyte levels, mathematical operations on waveforms (such as integration, derivatives, transformations, etc.), and various other blood flow-related properties (such as blood flow, volume, density, etc.), and these parameters can be processed together (i.e., by a processor in the wearable device) and organized in the form of data output, such as a serial or parallel data stream.

[0217] Reference Fig.18 , illustrating various embodiments of the optomechanical sensors described herein (possibly using Fig.17 An exemplary method of a system (system) is provided. Optical scatter data is alternately collected from biometric information path signal 900 and motion information path signal 902 by alternately pulsing optical emitters associated with the respective paths (block 1000). For example, emitter(s) associated with one path may be in a powered state while emitter(s) from another path are in a powered-off state.

[0218] A subtractive filter (such as subtractive filter 904) is applied to the collected data using the motion information path signal 902 as a motion noise reference to generate a clearer biometric signal (block 1002). Biometric parameter information is then extracted from the biometric signal (block 1004) and transmitted to another device or system (block 1006). It may be beneficial to transmit the extracted biometric parameter information as a serial string of consecutive values ​​representing the biometric value of each extracted biometric parameter. In addition, it may be beneficial for the serial string to include information about the type of biometric parameter and the confidence in the value of the biometric parameter (see U.S. Patent Application No. 8,923,941, which is incorporated herein by reference in its entirety).

[0219] Embodiments of the present invention are not limited to "wearable" embodiments (i.e., embodiments in which the sensor module or monitoring device is worn by the subject). Embodiments of the present invention may also be applied to "single-touch" or short-time sensing applications. For example, Fig.19 A biometric sensor module 2000 for a finger or other digit F is illustrated. As described above, the illustrated sensor module 2000 is an internal optomechanical sensing module having first and second optical emitters 14, 16 and an optical detector 18. The illustrated sensor module 10 also includes a stabilizer member 22 configured to transmit motion information from the subject's digit F to the optical detector 18, so that when the digit F is pressed against the biometric sensor module, the motion information (such as motion information caused by skin displacement, pressure changes, blood displacement, etc.) is transmitted to the stabilizer member 22, thereby modulating the light scattered in the motion noise path. The illustrated sensor module 2000 generates two optical paths 30, 40. The first optical path 30 ("motion information path") is created by light emitted by the first optical emitter 14 and reflected off the stabilizer member 22. The second path 40 ("biometric information path") is created by light emitted by the second optical emitter 16 that is absorbed, scattered, and / or reflected by tissue, blood vessels, etc. within the subject's finger F. Biometric information path 40 contains a higher level of subject physiological information than motion information path 30, which may contain a higher level of subject motion information than physiological information.

[0220] In addition to providing optical barrier 20 to prevent light emitted by emitter 14 from being exposed to the user's skin, Fig. 20 The sensor module 2000 and Fig.19 is similar to the sensor module 2000. (Note that Fig.19 In the embodiment of the present invention, there may be small gaps through which light from the emitter 14 can reach the user's skin. Fig. 20 The barrier 20 in FIG. 2 can prevent this. The barrier 20 can be critical when using the motion noise path signal as a noise reference during biometric parameter extraction ( Fig.17 and 18 ), because it is important that the motion noise signal has little or no physiological information that may be inadvertently removed from the biometric path signal during the biometric parameter extraction process.

[0221] As with other embodiments described herein, the optical detector 18 may be shared, or each path (i.e., the biometric information path and the motion information path) may have its own detector. Sharing the same detector has the benefit of potentially improving the linearity between unwanted motion noise in the biometric information path signal 40 and the motion noise detected by the motion information path signal 30 (e.g., linearity in signal amplitude and phase).

[0222] The light guide region 52 of the biometric information path and the light modulation region 50 of the motion information path may each include a soft material, such as optically transparent silicone. The light modulation region 50 is covered by an optically opaque or light scattering stabilizer 22 (such as a light scattering layer, opaque silicone, or other opaque and soft material). In this way, both biometric (PPG) information and motion information can be captured by the optical detector 18. However, it should be noted that the function of the motion information path is to capture motion information, and this can be achieved using rigid materials, as well as, for example, via vibrations in a rigid solid. For example, the light guide / modulation region can utilize polycarbonate, glass, or other rigid, optically transparent materials. Alternatively, the light guide region 52 of the biometric information path can be composed of a rigid material, and the light modulation region 50 of the motion information path can be composed of a soft material.

[0223] The stabilizer(s) may preferably be composed of a soft material, but a sufficiently opaque rigid material or another material that can scatter light with body movement may be used. Important aspects of the stabilizer are that a) it cannot be optically transparent, as the light from the emitter 14 should not reach the user's skin, and b) it must be able to scatter light in a manner proportional to body movement, so that moving the digit F against the stabilizer should modulate the light scattered in the path of the motion noise.

[0224] Although Fig.19 and Fig. 20 An internal optomechanical sensor configuration is shown, but it should be noted that external optomechanical embodiments may also be used (such as in Figures 3 to 5 , those embodiments illustrated in FIG. 7 ) as well as other internal optomechanical embodiments described herein to achieve short time sensing embodiments.

[0225] Fig.21 and Fig. 22 The optomechanical sensor configuration is illustrated when the optomechanical sensor may be applied to an electronic device 2100, such as a smartphone or other electronic device. The illustrated device 2100 includes a finger-shaped recess 2102 configured to receive a portion of a subject's finger therein. The optomechanical sensor module 2120 (such as, for example, Fig.19 and Fig. 20) is located within the finger-shaped recess 2102. The optomechanical sensor module 2120 can be any internal or external optomechanical sensor module described herein.

[0226] A plurality of stabilizing elements 2104 are positioned within the finger-shaped recess 2102 and are configured to support and stabilize the subject's finger F at the site of the optomechanical sensor 2120. These stabilizing elements may be similar elements 222 in Fig. 9. That is, they are not intended to transmit motion information (unlike stabilizing members 232 and 234 in Fig. 9), but are used to stabilize (support) the sensor at the body.

[0227] This illustrated configuration may be particularly useful for one-touch, short-duration sensing of PPG-related biometrics such as heart rate, respiration rate, blood pressure, hydration level, metabolic rate, cardiac output, blood analyte levels, blood oxygen levels, hemodynamics, etc. In some embodiments, to enhance blood perfusion during PPG measurements, thereby increasing the signal-to-noise ratio of the PPG waveform information, a vibration motor within the smartphone 2100 may be engaged to facilitate blood flow to the outer layer of the skin of the finger F, which may be accomplished via a method such as the following for Fig.23 Described algorithm to control.

[0228] The various optomechanical sensor modules described herein may be combined with a blood flow stimulator to help increase blood perfusion in a body region interrogated by optical radiation. The blood flow stimulator may be integrated into the sensor module or an electronic device including the sensor module (e.g., in a Fig.21 and Fig. 22 2100). Various blood flow stimulation methods may be implemented, including but not limited to thermal, electrical, mechanical, acoustic, and electromagnetic blood flow stimulation methods. For example, a heating element for blood flow stimulation may include a resistive heating filament, an infrared (IR) heater (also electromagnetic), etc. that may be integrated into a sensor module or an electronic device including a sensor module. An electrical element for blood flow stimulation may include one or more electrode pairs. A mechanical blood flow stimulator may include a motor or other mechanical actuator, such as a piezoelectric actuator, an acoustic mechanical actuator, a thermomechanical actuator, an electroactive actuator, etc.

[0229] Additionally, actuators within the smartphone for generating tactile feedback may be used to stimulate blood flow, for example, by initiating a vibration sequence during the PPG measurement process. The acoustic element may include a sound generator for generating sound waves (or ultrasound waves) that facilitate blood flow beneath the optical interrogation zone of the optomechanical sensor module.

[0230] Because many smartphones and other electronic devices include vibration actuators, no new mechanical hardware is required for blood flow stimulation. Algorithms (such as Fig.23 ) to stimulate blood flow, interrogate the skin with light, remove motion noise, and generate biometrics derived from the PPG.

[0231] In contrast, integrating other types of blood flow stimulators into smartphones and other electronic devices may require additional considerations. For example, it may be important for the resistive heating element to be in thermal communication with the skin interface thermal conductor to couple the thermal energy between the resistive heater and the subject's skin. Similarly, the skin interface electrical conductor may be important for coupling the electrical energy between the embedded electrodes and the skin. In addition, a thin layer of gold or conductive polymer may be important for preventing corrosion or degradation of such skin interface conductors. In the case of a radiant IR heater, an IR transparent optical window (such as sapphire, IR-transparent ceramics, metal fluorides, metal selenides, silicon, germanium, etc.) may be important for coupling the thermal energy between the IR heater and the subject's skin.

[0232] Now refer to Fig.23 , illustrates a method that may be implemented in conjunction with an optomechanical sensor module and a blood flow stimulator to improve PPG measurements according to some embodiments of the present invention. The method may be performed by one or more processors in communication with a sensor output from the optomechanical sensor module. For example, in some embodiments, Fig.23 The method can be controlled by a processor running a smartphone application.

[0233] The illustrated method may begin by first determining whether the subject's skin is sufficiently close to the optomechanical sensor using a proximity detection routine (such as via an optical threshold detection method, sensor fusion, or similar proximity detection method) (block 1100). If the skin is deemed sufficiently close to the sensor, the processor(s) may determine whether blood flow (perfusion) beneath the user's skin is sufficient, for example using a signal quality detection method (block 1104). Because the optomechanical sensor is a PPG sensor, this may be accomplished by analyzing the quality of the PPG waveform, the signal-to-noise ratio of the PPG signal, blood oxygen levels sensed using SpO2, and the like. An example of such a PPG signal quality method is described in U.S. Provisional Patent Application Serial No. 62 / 056,510, the contents of which are incorporated herein by reference in their entirety. Once proximity is confirmed and the algorithm determines that perfusion is sufficient, then biometric calculations may be performed to generate at least one PPG-based biometric (block 1108). If perfusion is deemed insufficient (block 1104), a blood flow stimulator may be engaged to stimulate blood flow and continue to operate until perfusion is deemed sufficient for at least one biometric measurement (block 1106). Fig.23This is not an example of a method, but in fact the method may be performed via any sufficiently powerful processor and associated circuitry of other electronic devices.

[0234] Fig.24 and Fig.25 The configuration of the optomechanical sensor module and the blood flow stimulator according to some embodiments of the present invention are illustrated. Fig.24 22 is a top view of a device 2200 (such as a smartphone or other electronic device) in which an optomechanical sensor module 2202 is integrated. The device includes skin interface elements 2204, 2206, which can be electrodes, thermal conductors, sound generators, electromagnetic (i.e., IR) radiators, mechanical actuators, etc., depending on the method used to stimulate perfusion (blood flow).

[0235] Fig.25 yes Fig.24 2200 and illustrates a thermally conductive blood flow stimulator (BFS) 2204 and an IR (radiation) BFS 2206. For the thermally conductive BFS, an air-filled void or other heat-conducting medium may be used to conduct heat from the resistive heater to the skin interface thermal conductor. For the IR BFS, a vacuum, air-filled void, or other IR-transparent medium may be used because the stimulation energy is radiative and non-conductive.

[0236] It should be noted that although Fig.25 Two blood flow stimulators (2204, 2206) are shown, but it may not be necessary to have both in the device. Instead, the two stimulators are shown to represent the way in which each stimulator can be integrated into the device. In some cases, the optomechanical sensor module 2200 can be surrounded by an array of blood flow stimulators of the same type (i.e., all thermal blood flow stimulators, all infrared blood flow stimulators, all acoustic blood flow stimulators, all electrical blood flow stimulators, etc.) or multiple types.

[0237] Fig.29 2 is a top view of a device 2200 (such as a smartphone or other electronic device) in which an optomechanical sensor module 2202 is integrated. The illustrated device 2200 includes a BFS 2204 in the form of a resistive heater having a heating element 2205 located at the surface of the skin interface. Various resistive heaters suitable for heating human skin are well known in the art. Fig.29 Shown in FIG. 2 is a piezoelectric actuator membrane 2210 , which, alternatively or additionally, may be used to stimulate blood flow at a body region illuminated by the optomechanical sensor module 2202 .

[0238] Embodiments of the present invention may include microfabricated devices or nanofabricated devices. For example, FIG. 26A to FIG. 26D Illustrated is an integrated microfabricated optomechanical sensor module 3000 fabricated using standard microfabrication processes commonly used to fabricate MEMS devices. Fig.26A is a side view of the optomechanical sensor module 3000, and Fig.26D is a top plan view of the optomechanical sensor module 3000 . FIG. 26A to FIG. 26C The diagram shows the generation FIG. 26C to FIG. 26D A possible manufacturing sequence for module 3000.

[0239] The illustrated optomechanical sensor module 3000 includes four tabletop LEDs 3002, two of which are used for the biometric signal path and two for the motion (noise) path. In the illustrated embodiment, the LEDs 3002 may be composed of AlxInyGa1-x-yN, AlxInyGa1-x-yAs, or other optoelectronic materials, and the substrate 3004 may be sapphire, SiC, AlxInyGa1-x-yN, AlxInyGa1-x-yAs, silicon, or other suitable materials. In the illustrated embodiment, for simplicity, the LED electrodes are not shown, but in principle, a suitable layout would be for the electrodes to extend to the periphery of the substrate surface, protected by oxide, and exposed for wire bonding at the periphery. Similarly, for simplicity, opaque barrier regions between the LEDs 3002, which would be useful for preventing direct light contamination from adjacent LEDs 3002, are not shown.

[0240] The LEDs 3002 can be forward biased to emit light and reverse biased to detect light. Thus, if at least one LED 3002 in each path is forward biased and at least one other LED 3002 is reverse biased, a suitable optical emitter-detector combination can be achieved. Thus, the reverse biased LEDs can function as optical detectors as described herein.

[0241] Many methods of creating micro-fabricated optomechanical modules 3000 according to embodiments of the present invention may be utilized. For example, once LED 3002 is fabricated, one method is to selectively deposit sacrificial layer 3006 and support layer 3008 on the motion path LED 3002. Then, as in Fig.26B As shown in FIG. 3 , the support layer 3008 may be etched down a few microns, and then the membrane layer 3010 may be selectively deposited. The membrane layer 3010 (with Figure 19 to Figure 20 The important function of the stabilizer 22 described in FIG. 300 is to move with the motion and scatter the light generated by the forward biased LED 3002 so that the reverse biased LED 3002 can collect motion noise information. Fig.26C, the sacrificial layer 3006 may then be removed to provide a membrane 3010 supported by an etched-back support layer 3008 on the motion path LED 3002. Various sacrificial layers, support layers, and membrane layers are well known to those skilled in the art and are from a non-limiting list of oxides, nitrides, metals, polymers, and semi-metals.

[0242] Fig. 27 A system 4000 for generating high-quality PPG data and transmitting the data to an auxiliary device or system according to some embodiments of the present invention is illustrated. The illustrated system 4000 may be integrated within a single discrete electronic module, or may be distributed across another electronic device (e.g., in a Fig.21 and Fig. 22 The smart phone 2100 shown in FIG. 2 is integrally formed in or embedded in another electronic device (such as a Fig.21 and Fig. 22 The dashed lines around biometric path 4006 and motion noise path 4008 are intended to emphasize that these paths are most likely integrated into a discrete module 4004 (e.g., Figure 19 to Figure 20 In the sensor module 2000, etc. Figure 21 to Figure 22 For example, the power supply circuit system 4002, the A / D circuit system 4010, the blood flow stimulator and associated circuit system 4014, and the communication circuit system 4012 can all be a smart phone (such as, Figure 21 to Figure 22 The optomechanical sensor module 4004 is powered by the smartphone circuit system and transmits information to the smartphone circuit system.

[0243] However, in another specific embodiment, Fig. 27 All of the functional blocks of the system may be integrated together in a discrete module, such as a printed circuit board (PCB) with a supporting housing, optomechanical electronics, etc. In some embodiments, the auxiliary device or system may include a remote system or device, and communication between the two systems may occur via standard electrical or wireless protocols.

[0244] Fig.28Depicted are ways in which embodiments of the present invention may be integrated into an earwear 5000. Although only one optomechanical sensor module may be needed to generate clear PPG information, multiple optomechanical sensor modules 5002 are shown at various locations on the earwear 5000, representing potentially good locations for coupling both physiological and motion information between the ear and the module. As described earlier, the optomechanical sensor modules may be internal optomechanical embodiments or external optomechanical embodiments, or a combination of both. The illustrated earwear 5000 includes a housing 5004 at least partially surrounded by a cover 5006 and a speaker driver 5008 within the housing 5004.

[0245] Fig.24 , Fig.25 ,and Fig.29 The combined stimulation-sensor system (including sensor module 2202 and (one or more) blood flow stimulators 2204, 2206, 2208) may also include at least one biometric temperature sensor 2220 exposed to the skin to collect thermal data from the irradiated area of ​​the body for estimating the temperature of the skin, blood, or other tissue in proximity to the blood flow stimulator. The biometric temperature sensor 2220 is configured to be in proximity to the blood flow stimulator (e.g., 2204, 2206, 2208) and in thermal communication with the user's skin. Such a sensor 2220 may include a biometric temperature sensing element coupled to a skin interface thermal conductor. As a specific example, such a sensor may include a temperature sensing IC (integrated circuit) coupled to an exposed metal contact (skin interface thermal conductor) such that the exposed metal contact transfers thermal energy to the sensing element when in contact with the user's skin for generating an electrical signal including skin temperature information. Many wearable skin temperature sensing configurations are well known to those skilled in the art and may employ various types of thermal sensing elements—ICs, thermistors, thermocouples, IR sensors, RTDs (resistance temperature detectors), etc.—along with various thermal conductors.

[0246] exist Fig. 27 In the illustrated system 4000, as described above, the blood flow stimulator 4014 includes a biometric temperature sensor 4016 and a heat generator worn close to the skin. The system 4000 can be used for the following: Fig.24 , Fig.25 , Fig.29The system 4000 can be used to interrogate temperature-related sensing of blood and tissue (i.e., skin, muscle, etc.) using both light from the optical emitter(s) of the sensor module 2202 and thermal energy from the skin interface element(s) of the blood flow stimulator 4014. In conjunction with the processor, the system 4000 can be used to actively control stimulation as well as actively characterize biometric information from the blood or tissue.

[0247] Thermal information collected by the biometric temperature sensor 4016 can be processed by the processor to: 1) estimate the temperature of the skin, blood, or tissue irradiated by the optical emitter of the PPG sensor module, and 2) determine the thermal dose applied to the skin by the blood flow stimulator 4014, thereby providing feedback for actively controlling the thermal energy dose. For example, an algorithm executed by the processor can process the thermal energy information to determine whether the dose is above or below a determined threshold. In this case, the processor can then transmit information to the control electronics that will reduce or increase the intensity of the blood flow stimulation accordingly. This configuration can help prevent skin burns while ensuring that sufficient thermal energy is supplied to produce adequate blood perfusion in the irradiated body area.

[0248] In addition, according to embodiments of the present invention, the stimulus-sensor system + biometric temperature sensor can also be applied to temperature-related biometric characterization. For example, in the case of supporting analog and / or digital control electronic devices / circuitry systems, the optomechanical sensor module (e.g., Fig.24 , Fig.25 , Fig.29 The light generated by the sensor module 2202) is synchronized in time with the thermal blood flow stimulator to perform temperature-dependent biometric analysis of blood, skin, or tissue via temperature-dependent light absorption, optical scattering, light polarization, and / or luminescence. That is, because the interaction between light and biological materials changes with temperature, analyzing the PPG signal from the system 4000 during multiple skin temperatures, blood temperatures, or tissue temperatures can be used to identify the presence and concentration of skin, blood, and tissue components.

[0249] As a specific example, it is known that the intensity of bioluminescence of a body region, typically caused by irradiating the body region with light wavelengths between 200 nanometers and 490 nanometers, depends on the temperature of the body region, and that this temperature dependence may be different for different luminescent species. Thus, by controlling the local body temperature within a set range and recording the luminescence intensity within these set temperature ranges, or even more so by recording the luminescence intensity associated with the optical excitation wavelength within these temperature ranges, and then analyzing these wavelength-dependent luminescence intensities based on a bioluminescence model, the composition of the local excitation region may be characterized.

[0250] Reference Fig.30 , in one embodiment, Fig. 27 The system 4000 of FIG. 4000 may be used, for example, to generate a physiological assessment by: 1) first determining whether the blood perfusion level is acceptable for measurement (block 6000), such as by performing the above Fig.23 The method described herein comprises: 1) measuring both biometric optical sensor data and biometric temperature sensor data (block 6002), 2) analyzing the optical sensor data based on the temperature sensor information (block 6004), and 4) generating a physiological assessment based on the analysis of the data (block 6006). The method is particularly suitable for collecting PPG optical scatter data that varies with the temperature of the illuminated area. Key functional benefits of the method include: 1) power savings can be achieved by performing PPG analysis only when the perfusion state of the subject is acceptable, and 2) reducing PPG analysis errors (such as, for example, PPG-based blood pressure measurement errors) by only collecting PPG data when the perfusion state of the subject is acceptable.

[0251] In another embodiment, as in Fig.31 As shown in , once a feasible perfusion state is determined, temperature control of the body region of interest (skin and associated blood vessels, blood, etc.) can be more relaxed. Fig.31 In the method illustrated in , a blood flow stimulator (in this case, a thermal energy generator) is turned on and off during certain time periods; during these time periods, sensor readings are collected from the biometric optical sensor and the temperature sensor and stored (in memory) (boxes 6010, 6012). If the PPG sensor module (including (one or more) optical emitters and (one or more) detectors) is configured to generate light at multiple wavelengths, the optical sensor data at each wavelength can be stored for each on / off cycle of thermal energy generation. This can be achieved by cycling through each individual wavelength in time at a set duty cycle or by utilizing an optical detector configured to selectively detect light within multiple individual wavelength ranges, as described in U.S. Patents Nos. 8,251,903 and 8,700,111, the contents of which are incorporated herein by reference in their entirety. The PPG and temperature sensor data are analyzed for the "on" time period and the "off" time period of the blood flow stimulator (e.g., thermal energy generator) to generate a physiological assessment (box 6014).

[0252] As an example of one type of physiological assessment, a hemodynamic assessment may be generated by processing PPG data from both the "on" and "off" cycles of a blood flow stimulator (thermal energy generator). As a specific example, the intensity of the PPG peaks (i.e., the amplitude of the PPG waveform of one or more blood flow pulses) may be compared for both the "on" and "off" cycles, and the relationship of the amplitude ratio of the PPG intensity during the "on" cycle to the amplitude ratio of the PPG intensity during the "off" cycle may be used to assess how sensitive the subject's blood flow dynamics may be to background temperature or various forms of body temperature.

[0253] According to Fig.32 In another embodiment of the invention illustrated in FIG, the intensity of the thermal generator of the blood flow stimulator can be adjusted to various settings so that a matrix of optical sensor signal intensities over a range of temperatures (and a range of optical wavelengths if a multi-wavelength emitter is employed) can be generated. This matrix can then be used to generate a physiological assessment based on a biological model.

[0254] For example, according to Fig.32 In the method illustrated in FIG. 6 , a blood flow stimulator (e.g., a thermal energy generator) is turned on and the heat intensity is adjusted to a controlled setting (block 6020). By using a temperature sensor to sense thermal information from the skin and focusing the peak optical emission intensity at λ 1 The PPG data is collected from the skin to determine the skin temperature (block 6022). The steps of blocks 6020 and 6022 are repeated within a controlled range of heat intensity settings to create a data set containing information related to the PPG as a function of temperature (block 6024). Then, for each desired wavelength (λ n )(λ n The steps of blocks 6020, 6022 and 6024 are repeated (block 6026) in the range from n=1 to n=k. The relationship between temperature, PPG amplitude, and the lambda matrix is ​​then analyzed to generate a physiological assessment of the subject (block 6028).

[0255] exist Fig.33 Applicable Fig.32 An example of the method of the present invention is shown for multiple light excitation wavelengths (λ 1 , 2 , 3 , n ) is a plot of the relationship between the optical scattering (PPG) signal intensity & bioluminescence (bioluminescence) signal intensity and the measured skin temperature. Two exemplary temperatures Temp are presented on the plot 1 and Temp n , showing that the optical intensity matrix can be generated - optical(Tempn λ n ) in such a way that the matrix can be applied to generate physiological assessments based on biological models. Although the collected light energy detected by the optical sensor may include optical scattering information or optical luminescence information from multiple blood, skin, or tissue components, as with a multi-wavelength pulse oximeter, having optical sensor data from multiple wavelengths of light at multiple temperatures helps provide sufficient data to characterize "n" components, where "n" is unknown.

[0256] For situations where luminescent blood, skin, or tissue components are of interest, the Fig.34 The method shown in the figure is to scatt and optical luminous segment t lum Generates a matrix of temperature-dependent light intensity over time - optical(Temp n λ n t n ). For example, in Fig.34 As shown in FIG. 6 , the blood flow stimulator (e.g., thermal energy generator) is turned on and the optical emitter of the PPG sensor module is turned on (block 6030). It is determined whether the skin temperature has reached a first threshold and remains stable at that value, and if so, for a period of time t on PPG data is collected from the skin at the first threshold starting at t=0 in (block 6032). This measurement may be repeated for multiple excitation wavelengths. s When the blood flow stimulator (eg, thermal energy generator) is turned off and during the time period t off The skin temperature data and PPG data related to time are collected within a period of t (block 6034). This measurement can be repeated for multiple excitation wavelengths. on and t off The PPG data and temperature sensor data are analyzed to generate at least one physiological assessment of the subject (box 6036).

[0257] It should be noted that although Fig.34 The λ value in represents the peak light excitation wavelength λ excit , but as described above, if a multi-wavelength optical detector is used in the PPG sensor module, then for a given λ excit , optical luminescence can be collected at multiple luminescence wavelengths. Fig.34 An advantage of the method is that data can be collected for both PPG optical scatter and bioluminescence, and the characteristic temperature dependencies of both optical properties can be collected and analyzed to generate a physiological assessment.

[0258] The foregoing is an explanation of the present invention and is not to be construed as limiting the present invention. Although some exemplary embodiments of the present invention have been described, it will be readily appreciated by those skilled in the art that many modifications may be made to the exemplary embodiments with substantial deviations from the teachings and advantages of the present invention. Accordingly, all such modifications are intended to be included within the scope of the present invention as defined in the claims. The present invention is defined by the appended claims, and the equivalents of the claims are included therein.

Claims

1. A method of removing motion artifacts from a biometric signal generated by a sensor module worn by a subject, wherein the sensor module comprises at least one optical emitter and at least one optical detector, the method comprising: directing light from the at least one optical emitter: at a first light guide along a first optical pathway, the first light guide being configured to cause light guided along the first optical pathway to enter a body of a subject; as well as at a second light guide along a second optical path, the second light guide being configured to cause light guided along the second optical path to be reflected from a skin surface of the subject; detecting, via the at least one optical detector, light that has entered the body of the subject along the first optical path and generating a first signal including physiological information of the subject; detecting, via the at least one optical detector, light reflected by the skin surface of the subject along the second optical path and generating a second signal including subject motion information; as well as The first signal and the second signal are processed to remove motion artifacts from the first signal.

2. The method of claim 1 , wherein the at least one optical emitter comprises a first optical emitter and a second optical emitter, and wherein the method comprises: directing light from the first optical emitter into the body of the subject via a first optical pathway, and Light from the second optical emitter is directed toward the body along the second optical path.

3. The method of claim 1, wherein the at least one optical detector comprises a first optical detector and a second optical detector, and wherein the method comprises: detecting, via the first optical detector, light from the body of the subject and generating a first signal including physiological information of the subject, and Via the second optical detector, light reflected by the skin surface is detected and a second signal comprising subject motion information is generated. The method of claim 1 , wherein the first optical path and the second optical path are optically isolated from each other.

5. The method of claim 1 , wherein the first optical pathway is configured such that light from the first optical pathway is directed toward the subject at a first angle, wherein the second optical pathway is configured such that light from the second optical pathway is directed toward the subject at a second angle different from the first angle, wherein the first angle facilitates light from the first optical pathway to be absorbed by the body, and wherein the second angle hinders light from the second optical pathway from being absorbed by the body.

6. A device for sensing physiological and body movement information, the device comprising: at least one optical emitter configured to emit light along at least two optical paths; a first light guide configured to guide light along a first path configured to sense body motion information by sensing light scattered from a body skin surface; as well as a second light guide configured to guide light along a second path configured to sense physiological information by sensing light that has entered the body and scattered from the body by blood flow; The detector is constructed as follows: detecting light reflected by the skin surface of the subject along the first path and generating a first signal including subject motion information; as well as detecting light from the body of the subject along the second path and generating a second signal including physiological information of the subject; as well as A processor is configured to process the first signal and the second signal to determine a physiological parameter of the user.

7. The device of claim 6, wherein the device is a wearable device.

8. The device of claim 6, wherein the device is configured to be located at or within the ear of the subject.

9. The device of claim 6, wherein the device is configured to be secured to an appendage of the subject, integrated into a wearable device, and / or integrated into a garment worn by the subject.

10. An apparatus comprising: a sensor module configured to acquire physiological information from a body part of a subject; as well as A blood flow stimulator is configured to increase blood perfusion at the body part at or before the time when the sensor module acquires the physiological information.

11. A wearable device comprising: an optical sensor configured to detect optically acquired physiological information from a site on a body of a subject, wherein the optical sensor comprises at least one optical emitter and at least one optical detector; a thermal energy generator configured to increase the temperature of the body at the site; a temperature sensor configured to sense body temperature information at the site; at least one circuit configured to control electrical biasing of the at least one optical emitter, the thermal generator, and the temperature sensor; a data storage device configured to receive and store data from the optical sensor and the temperature sensor; and A processor is configured to process the data from the optical sensor in the data store based on the data from the temperature sensor in the data store to generate a physiological assessment of the subject.