Touch sensing system and method using physiological or biochemical sensors

Abstract

Disclosed herein are systems, components, and methods of a sensor system that applies a correction factor to spectral information based on a force associated with a touch from a person applying the touch to the sensor system.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority and benefit to U.S. Provisional Patent Application No. 63 / 036,682, filed June 9, 2020, which is incorporated herein by reference in its entirety and is a part of this document. Background Technology

[0003] Touch-based non-invasive physiological and biochemical sensor technologies are rapidly evolving, encompassing smaller size, improved human-machine interface (HMI) interaction, higher signal-to-noise ratio (SNR), reduced measurement time, and novel information extraction techniques. This includes incorporating such sensors into mobile phones and / or watches, reusable medical devices such as pulse oximeters, and more. As an example, various methods have been disclosed to optimize the measurement quality of non-invasive finger touch sensors, including capacitive sensors for positioning the finger in an appropriate configuration and providing tactile and auditory feedback. As a second example, pulse oximeter systems attempt to normalize the force exerted by a finger on a sensor probe by using a spring-loaded finger probe clip. Once placed on the finger, the finger probe clip applies nominal and uniform pressure at the finger / probe interface.

[0004] However, the ability, accuracy, and precision to extract useful information from such sensors (e.g., detecting one or more specific biochemical analytes and / or the concentration of these analytes) are a function of numerous variables related to the subject, the subject's testing location (e.g., the palmar side of the finger), and the HMI of the test (sensor probe size, applied force, sensor feedback during measurement, etc.). For conventional systems, such as the examples above, the applied force can vary based on size and application location on the finger, spring mechanical properties, and the age and loading history of the spring. This variation can significantly reduce the ability to detect one or more physiological properties or one or more biochemical analytes and / or reduce the accuracy and precision of measuring physiological properties and / or (one or more) analytes. For example, contact pressure can cause the absolute error of blood oxygenation (SpO2) to vary by as much as 10% or more. This is significant, especially when the metric is derived from the ratio of multiple different wavelength reflectance measures over time.

[0005] Therefore, systems and methods are needed to overcome the challenges of conventional technologies, and some of these systems and methods are described herein. For example, there is a need for touch sensing systems and methods that can be used in switches. More specifically, there is a need for physiological and / or biochemical non-invasive touch sensing systems and methods that can be incorporated into switches. It may also be necessary for switches to include active tactile feedback systems (e.g., noise / vibration) that can be activated to notify a change in the state of a person pressing the button. Summary of the Invention

[0006] This paper discloses a system, components, and methods for a sensor assembly that determines the force level and spectral information of a touch, and applies a spectral correction factor to the spectral information based on the force level.

[0007] Other advantages will be set forth in part in the following description, or may be learned by practice. These advantages will be realized and obtained by means of the elements and combinations particularly pointed out in the appended claims. It should be understood that, as stated above, the general description above and the detailed description below are exemplary and illustrative only, and not restrictive. Attached Figure Description

[0008] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments and, together with the description, serve to explain the principles of the methods and systems:

[0009] Figure 1A This is a block diagram illustration of an exemplary spectrum sensor system;

[0010] Figure 1B This is a diagram of exemplary chemical bonds associated with the absorption spectrum in a portion of the infrared electromagnetic region;

[0011] Figure 1C This is an illustration of a block diagram of an exemplary spectrum sensor system that further includes one or more tactile exciters;

[0012] Figure 1D This is an illustration of a block diagram of an exemplary spectrum sensor system that further includes one or more haptic actuators, one or more force sensors, and a touchpad;

[0013] Figure 2A An exemplary switch assembly is shown;

[0014] Figure 2B An exemplary switch assembly further including a touchpad and a haptic actuator is shown;

[0015] Figure 3 This is a flowchart of a method for applying a correction factor to spectral information based on the level of force applied to a spectral sensor by touch;

[0016] Figure 4 An exemplary computer is shown that can be used to run software for determining the touch force applied to a spectrum sensor and spectral information from the spectrum sensor about the person applying the touch;

[0017] Figure 5A This is an image of an exemplary sensor spectrum measurement system, which includes a spectrometer located at a microscale for measuring force in grams in sync with the spectrum measurement;

[0018] Figure 5B It is shown by Figure 5A The absorption spectrum produced by the spectrometer was plotted. The spectrometer was placed at the center of this microscale and zeroed out (e.g., a baseline spectrum established without the application of force by a finger). Then, a finger was placed on the device and force was applied to obtain values ​​of 50g, 100g, 120g, 150g, 200g, 250g, 300g, 350g, 400g, 450g, and 500g. These values ​​and spectra were then fed into chemometric modeling software to find the correlation between changes in the finger surface spectrum and changes in the applied force.

[0019] Figure 6 This is a graph showing the correlation between the predicted (force, in grams, y-axis) and the measured (force, in grams, x-axis) using only the second latent variable from principal component analysis, which uses... Figure 5B Three latent variables in the spectrum;

[0020] Figure 7 This is a plot showing the RMSEC (Residual Mean Square Error of Calibration Error) and RMSECV (Residual Mean Square Error of Calibration Error Variance) of a predictive model that uses force and spectral correlation as a function of the latent variables used to derive the predictive model. The plot shows that these errors are close to zero. This verifies that the relationship between the applied force and the finger spectrum can be correlated, and that a predictive model can be created for the force applied to a subject's index finger.

[0021] Figure 8 This is a graph showing spectrometer data (X = wavelength (in nm), Y = reflectance). The graph shows 100 spectra from four different individuals at 10 different force levels according to Table 1. The dataset contains a total of 400 spectra.

[0022] Figure 9 The resulting PLS model predictions are shown, where the x-axis represents the applied force and the y-axis represents the resulting model (shape corresponds to the applied force, with a circle being the lowest and a star the highest). To estimate the model's effectiveness, an alternative method called Partial Least Squares Discriminant Analysis (PLSDA) is used.

[0023] Figure 10 The Receiver Operating Characteristic (ROC) plot is shown, illustrating the correlation between force and spectrum based on the three different categories grouped in Table 1; and

[0024] Figure 11The classification results using a truth table-based predictive model are shown. It demonstrates the ability to "predict" forces based on a previously defined chemometric model. Results using cross-validation are also shown. The vast majority of spectra are selected based on their spectra falling within the correct force range. Detailed Implementation

[0025] Before disclosing and describing the methods and systems of this application, it should be understood that these methods and systems are not limited to specific synthesis methods, specific components, or specific compositions. It should also be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting.

[0026] As used in the specification and appended claims, the singular forms “a” and “the” include plural indicators unless the context clearly specifies otherwise. Hereinafter, a range may be expressed as from “about” a particular value, and / or to “about” another particular value. When such a range is expressed, another embodiment includes all values ​​from said one particular value and / or to said other particular value. Similarly, when a value is expressed as an approximation using the antecedent “about,” it will be understood that the particular value forms another embodiment. It will be further understood that the endpoints of each range are important both in relation to and independently of another endpoint.

[0027] "Optional" or "optionally" means that the event or situation described below may or may not occur, and the description includes both the possibility that the event or situation will occur and the possibility that it will not occur.

[0028] Throughout the specification and claims of this application, the word "comprise" and its variations (e.g., "comprising" and "comprises") means "including but not limited to" and is not intended to exclude, for example, other additions, components, integers, or steps. "Exemplary" means "an example of..." and is not intended to convey indications of preferred or ideal embodiments. "For example" is not used in a limiting sense but is for interpretive purposes.

[0029] Components that can be used to perform the disclosed methods and systems are disclosed herein. These and other components are disclosed herein, and it should be understood that while specific references to individual and collective combinations and arrangements of these components may not be explicitly disclosed when disclosing combinations, subsets, interactions, groups, etc., of these components, each reference is specifically contemplated and described herein for all methods and systems. This applies to all aspects of this application, including but not limited to the steps in the disclosed methods. Therefore, if various additional steps are available, it can be understood that each of these additional steps can be performed using any particular implementation or combination of implementations of the disclosed methods.

[0030] The methods and systems of this application can be more readily understood by referring to the following detailed description of preferred embodiments and examples included therein, as well as the accompanying drawings and descriptions preceding and following them.

[0031] It is well known that pressure on living tissue causes changes in the spectral information of the living tissue. Such spectral information can include, for example, physiological and / or biochemical spectral information, including but not limited to blood chemistry (e.g., glucose levels, blood ethanol, hydration levels, etc.), physiological measurements (e.g., blood pressure, blood oxygen levels and patterns, etc.), skin thickness, compressed capillaries, and reduced blood flow to the sensor contact area. Considering this concept, spectral changes can be modeled using a sensor system capable of capturing physiological and / or biochemical spectral information about the touch applied to the spectral sensor and capable of capturing the force level of the touch applied to the spectral sensor. For example, using mathematical chemometric models, such as partial least squares (PLS), the correlation between force and the spectrum acquired by the spectral sensor can be obtained. If changes in force lead to measurement errors in physiological or biochemical measurements, this allows for the efficient elimination of force variables used in testing by using compensation methods. Alternatively, this can be used to indicate the force applied to the spectral sensor such that the living tissue subject can reach and / or maintain the nominal force required for accurate physiological or biochemical measurements. Measurements can be omitted when the force does not meet defined high and / or low thresholds or does not fall within a specified range.

[0032] By measuring force data from all touch-based measurements and deriving a detection or measurement model, correction factors can be derived and applied during real-time measurements. A switch can be provided that allows for force measurement without movement of the touch interface. For example, such a switch can be used in the optical measurement path of any near-infrared spectrometer. This avoids optical path errors caused by movement.

[0033] Furthermore, such a switch may also include tactile stimulation at the sensor system interface. Applying vibrations (randomly or otherwise) with a defined average amplitude and frequency can be used to alert the person applying the touch that the desired force level has been reached or has not yet been reached, or to indicate whether the touch is within or outside the desired force range measured in an effective frequency spectrum.

[0034] Figure 1A This is an illustration of a block diagram of an exemplary spectrum sensor system 100. Such a system 100 may include a switch. In some cases, such a switch may be used in a vehicle to control vehicle systems (e.g., turning entertainment systems on / off or adjusting environmental controls, windshield wipers, lights, seat adjustments, engine on / off, etc.). In some cases, such a switch may be embedded in the vehicle's drive system (e.g., steering wheel).

[0035] like Figure 1AAs shown, one embodiment of the spectrum sensor system 100 includes a spectrum sensor 102. The spectrum sensor 102 captures physiological and / or biochemical spectral information about a touch applied to it. In some cases, the sensor uses spectroscopy to capture physiological and / or biochemical spectral information about a touch applied to it. For example, the spectrum sensor 102 may use one or more of visible light spectroscopy, infrared spectroscopy, near-infrared spectroscopy, mid-infrared spectroscopy, fluorescence spectroscopy, nuclear magnetic resonance spectroscopy, etc., to capture physiological and / or biochemical spectral information about a touch applied to it. In some cases, the spectrum sensor 102 includes a visible and near-infrared spectrometer with a range of 300 nm to 2600 nm or greater. For example, the near-infrared spectrometer may include a Michelson, a grating filter, a diode array, silicone, or a Fabry-Perot near-infrared spectrometer.

[0036] Figure 1A The spectrum sensor system 100 also includes a memory 106 in communication with a processor 104. The processor 104 is communicatively coupled to the memory 106, one or more force sensors 112, and the spectrum sensor 102. The processor 104 executes computer-readable instructions stored in the memory 106. In one embodiment, the computer-readable instructions cause the processor to receive spectrum information from the spectrum sensor 102 and to cause action based on the spectrum information by sending control signals from the processor 104 to the controlled system 108. The one or more force sensors 112 measure the force (i.e., touch force) applied to the spectrum sensor 102 or the touchpad (described herein). In some implementations, the one or more force sensors 112 may include a microelectromechanical system (MEMS) that provides an output signal corresponding to the magnitude of the force received by the sensor. For example, a MEMS force sensor is capable of detecting forces with displacements as small as 2 micrometers. In other embodiments, the one or more force sensors 112 may include a capacitive sensor, a piezoresistive sensor, a mechanical sensor, or other suitable sensors for recognizing touch events and measuring the associated force.

[0037] One or more force sensors 112 can be used to develop a calibration model. A correction factor is derived from the calibration model and applied to physiological and / or biochemical spectral information about a touch applied to sensor 102, captured by the spectral sensor 102, as a function of the time based on the varying force. In some cases, the calibration model can be derived for individual subjects and / or for statistical cross-samples of a large number of subjects.

[0038] In some cases, processor 104 uses chemometric analysis to process the spectral information received from spectrum sensor 102. In some cases, this may include using a trained predictive model to correlate spectral features with force values ​​from a touch force dataset. In various cases, chemometric analysis may include one or more of partial least squares, principal component analysis, principal component regression, and multiple linear regression.

[0039] In some cases, the spectrum sensor system 100 uses chemometric analysis to analyze components / abnormalities / changes in the bloodstream of a subject (the subject being a person who applies tactile force to the spectrum sensor 102 or the optional touchpad 114 described below). Specifically, the spectrum sensor system 100 can measure different bonds in molecules. For example, the spectrum sensor system 100 can measure organic chemical bonds, such as, but not limited to, CH, NH, and OH bonds. Changes in the number of bonds in the subject's blood result in changes in spectral absorbance, which can be measured using chemometric analysis. This change can be used to determine whether unwanted components are present in the subject's physiological functions. Figure 1B This is a graph of the bonds associated with the absorption spectrum. If the number of these bonds changes, it can be detected in the spectral measurements using chemometric analysis (e.g., when a person has high blood sugar). 12 At 06, compared to people without high blood sugar, they will have different, predictable measurement results. Another example is alcohol concentration (C2H5OH). For example, if the spectrum sensor 102 determines that a person's blood alcohol content is too high using spectrum information from a person touching or pushing the spectrum sensor 102, the system can cause the controlled system 108 to take or not take action. For example, if it is determined that the blood alcohol content exceeds a certain threshold, the spectrum sensor system 100 will not allow the car's ignition system (e.g., controlled system 108) to start.

[0040] Now for reference Figure 1C In some cases, the spectrum sensor system 100 may also include a haptic actuator or haptic exciter 110 communicating with the processor 104. The processor 104 causes the haptic exciter 110 to generate haptic feedback in response to a determined touch force, which can be felt at a touch point on the spectrum sensor 102 or the touchpad. In some cases, the processor 104 generates haptic feedback in response to a determined touch force exceeding, meeting, or not meeting a defined threshold or range. In some cases, haptic feedback is generated only after the determined touch force has exceeded the threshold for a predetermined period of time. In some cases, haptic feedback is continuously generated when the force exceeds or meets the defined threshold or range to indicate to the user that the spectrum sensor 102 is continuously reading spectrum information, and therefore the user should continue to apply force.

[0041] Now for reference Figure 1DIn some cases, as described herein, the spectrum sensor system 100 may optionally include a touchpad 114 in communication with the spectrum sensor 102. When the touchpad 114 is provided, a touch is applied to it. In some cases, neither the touchpad 114 nor the spectrum sensor 102 moves when a touch force is applied, while in other cases, the touchpad 114 and the spectrum sensor 102 displace only a few micrometers, for example, less than 10 micrometers, when a touch force is applied. In some cases, the touchpad is configured with and / or constructed of suitable materials to allow the spectrum sensor 102 to monitor changes in the analyte of a person applying a touch to the touchpad 114. Such materials include, but are not limited to, polycarbonate, which is transparent in the spectral region of interest, such as infrared.

[0042] Figure 2A An exemplary switching assembly 200 is illustrated. One embodiment of the switching assembly 200 may include a spectrum sensor 102 having a first side 202 and a second side 204. As described herein, sensor 102 captures physiological and / or biochemical spectrum information about a touch applied to sensor 102 by monitoring changes in an analyte of the person applying the touch. The switching assembly also includes one or more force sensors 112. The one or more force sensors 112 are used to determine the force level of the touch, and the spectrum sensor 102 obtains spectrum information about the touch. In general, the force level and spectrum information are used to apply a spectrum correction factor to the spectrum information based on the force level. The correction factor is applied to the physiological and / or biochemical spectrum information about the touch applied to the sensor captured by sensor 102 as a function of time based on the changing force.

[0043] exist Figure 2B In the embodiment of the switch assembly 200 shown, the switch assembly 200 further includes an optional haptic actuator 110 that communicates with at least a portion of the spectrum sensor 102. After a touch is applied to a first side 202 of the spectrum sensor 102, the haptic actuator 110 causes haptic feedback that reaches at least the first side 202. Figure 2B The implementation also includes a touchpad 114. As described herein, the touchpad 114 is made of a suitable material to allow the spectrum sensor 102 to monitor changes in the analytes of a person applying a touch to the touchpad 114. As a non-limiting example, the touchpad may include all or part of a car start / stop button that appears identical to a conventional start / stop button to the user but allows the system to correctly analyze the spectrum information from the user. For example, if the alcohol content is too high, the system will not allow the car to start.

[0044] Typically, the switching assembly 200 communicates with a processor 104 having a memory 106. The processor 104 and / or memory 106 may be part of the switching assembly 200 or may be separate from it. The processor 104 executes computer-readable instructions stored on the memory 106, which cause the processor 104 to receive spectral information from the spectrum sensor 102, wherein the spectral information is correlated with changes in the analytes of the person applying the touch. Determining changes in the analytes of the person applying the touch includes determining components / abnormalities / changes in the subject's bloodstream. Determining components / abnormalities / changes in the subject's bloodstream includes measuring different bonds in molecules. For example, organic chemical bonds, including CH, NH, and OH bonds, may be measured. Changes in the number of bonds in the blood will produce changes in the spectral information. In some cases, changes in the spectral information indicate components that are not desired in the subject's physiological functions (e.g., alcohol, drugs, etc.).

[0045] The disclosed system and components implement a method for determining spectral information from a person applying a touch using chemometric analysis and applying a correction factor to the spectral information based on the force level of the touch. In one aspect, this is as follows: Figure 3 The process is completed as shown in the flowchart. In step 302, a touch is received. As described herein, this touch can be applied to a spectrum sensor or a touchpad. In step 304, spectral information from the touch is obtained by the spectrum sensor. In step 306, the spectral information is provided to a processor, which analyzes the spectral information using chemometric analysis. In step 308, force level information about the touch is obtained using one or more force sensors. In step 310, a correction factor is determined based on the force level and applied to the spectral information.

[0046] The systems and components described herein have been described above as being composed of units. Those skilled in the art will understand that this is a functional description and that the various functions can be performed by software, hardware, or a combination of software and hardware. Units can be software, hardware, or a combination of software and hardware. These units may include software for analyzing spectral information received from a spectrum sensor. In one exemplary aspect, these units may include an analyzer and / or a data analysis computer, the data analysis computer including one or more computing devices, each computing device including, for example... Figure 4 The processor 421 shown and described below. As used herein, a processor refers to a physical hardware device that runs coded instructions to perform functions based on input and create output.

[0047] Figure 4An exemplary computer is shown that can run software for applying correction factors to spectral information based on the detected level of force of a user's touch applied to a spectral sensor. As used herein, "computer" can include multiple computers. A computer may include one or more hardware components, such as a processor 421, a random access memory (RAM) module 422, a read-only memory (ROM) module 423, a memory 424, a database 425, one or more input / output (I / O) devices 426, and an interface 427. Alternatively and / or additionally, a computer may include one or more software components, such as a computer-readable medium including computer-executable instructions for performing methods associated with the exemplary embodiments. It is contemplated that one or more of the hardware components listed above may be implemented using software. For example, memory 424 may include a software partition associated with one or more other hardware components. It should be understood that the components listed above are exemplary only and are not intended to be limiting.

[0048] Processor 421 may include one or more processors, each configured to execute instructions and process data to perform one or more functions associated with a computer that runs software to perform a method for determining a correction factor based on a determined touch force applied by a user to a spectrum sensor and applying it to spectrum information. Processor 421 may be communicatively coupled to RAM 422, ROM 423, memory 424, database 425, I / O device 426, and interface 427. Processor 421 may be configured to execute sequences of computer program instructions to perform various processes. The computer program instructions may be loaded into RAM 422 for execution by processor 421.

[0049] RAM 422 and ROM 423 may each include one or more devices for storing information associated with the operation of processor 421. For example, ROM 423 may include a memory device configured to access and store information associated with the computer, including information for identifying, initializing, and monitoring the operation of one or more components and subsystems. RAM 422 may include a memory device for storing data associated with one or more operations of processor 421. For example, ROM 423 may load instructions into RAM 422 for execution by processor 421.

[0050] The memory 424 may include any type of mass storage device configured to store information that the processor 421 may need to perform processes consistent with the disclosed embodiments. For example, the memory 424 may include one or more disk and / or optical disk devices, such as hard disk drives, CD-ROMs, DVD-ROMs, or any other type of mass media device.

[0051] Database 425 may include one or more software and / or hardware components that cooperate to store, organize, classify, filter, and / or arrange data used by computer and / or processor 421. For example, database 425 may store data related to analysis software. The database may also contain data and instructions associated with computer-executable instructions for performing a method of determining a correction factor based on a determined touch force applied by a user to a spectrum sensor and applying the correction factor to the spectrum information. It is conceivable that database 425 may store additional information beyond what is listed above and / or information different from what is listed above.

[0052] I / O device 426 may include one or more components configured to transmit information to a user associated with a computer. For example, the I / O device may include a console with an integrated keyboard and mouse to allow a user to maintain a database of analyte variation / force correlations specific to a subject or a group of subjects. I / O device 426 may also include a display including a graphical user interface (GUI) for outputting information on a monitor. I / O device 426 may also include peripheral devices such as a printer, a user-accessible disk drive (e.g., a USB port, floppy disk, CD-ROM, or DVD-ROM drive, etc.) allowing the user to input data stored on a portable media device, a microphone, a speaker system, or any other suitable type of interface device.

[0053] Interface 427 may include one or more components configured to send and receive data via a communication network, such as the Internet, a local area network, a workstation peer-to-peer network, a direct-link network, a wireless network, or any other suitable communication platform. For example, interface 427 may include one or more modulators, demodulators, multiplexers, demultiplexers, network communication devices, wireless devices, antennas, modems, and any other type of device configured to perform data communication via a communication network.

[0054] These accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code, which includes one or more executable instructions for implementing one or more specified logical functions. It should also be noted that in some alternative implementations, the functions indicated in the blocks may appear outside the order indicated in the figures. For example, in fact, two blocks shown consecutively may operate substantially simultaneously, or these blocks may sometimes operate in reverse order, depending on the functions involved. It will also be noted that each block in the block diagram and / or flowchart illustrations, and combinations of blocks in the block diagram and / or flowchart illustrations, may be implemented by a system based on dedicated hardware or a combination of dedicated hardware and computer instructions that performs the specified functions or actions.

[0055] All means or steps plus functional elements in the appended claims are intended to include any structure, material, action, and equivalent for use in combination with other claimed elements to perform a function. This specification is presented for illustrative and descriptive purposes and is not intended to be exhaustive or to limit the invention to the forms disclosed. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the invention. This implementation was chosen and described in order to best explain the principles and practical application of the invention and to enable others skilled in the art to understand the various implementations of the invention with various modifications suitable for the intended particular use.

[0056] Any combination of one or more computer-readable media can be used to implement the systems and methods described herein. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any suitable combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) may include: electrical connections having one or more wires, portable computer floppy disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable optical disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In the context of this document, a computer-readable storage medium can be any tangible medium that can contain or store programs used by or associated with an instruction execution system, apparatus, or device.

[0057] Computer-readable signal media may include propagated data signals in which computer-readable program code is embedded, for example, the data signal being in baseband or as part of a carrier wave. Such propagated signals may take any of a variety of forms, including but not limited to electromagnetic, optical, or any suitable combination thereof. Computer-readable signal media may be any computer-readable medium that is not a computer-readable storage medium and can transmit, propagate, or transfer programs used by or associated with an instruction execution system, apparatus, or device.

[0058] Program code stored on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, fiber optic, RF, or any suitable combination thereof.

[0059] Computer program code used to perform operations of various aspects of this invention can be written in any combination of one or more programming languages, including object-oriented programming languages ​​(such as Java, Smalltalk, C++, etc.) and traditional procedural programming languages ​​(such as the "C" programming language or similar programming languages). The program code can run entirely on the system computer's computing device as a standalone software package, partially on the system computer, partially on the system computer and partially on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer can be connected to the system computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., via the Internet provided by an Internet service provider). Non-limiting examples of a system computer include a computer or computing device in a vehicle. In this case, the system computer can be a computer dedicated to the embodiments described herein, or it can be a computer or processing device used to communicate with, monitor, and / or control various vehicle systems.

[0060] This document describes various aspects of the invention with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to generate a machine, thereby creating means for implementing the functions / actions specified in one or more blocks of the flowchart illustrations and / or block diagrams, as executed by the processor of the computer or other programmable data processing apparatus.

[0061] These computer program instructions may also be stored in a computer-readable medium that can instruct a computer, other programmable data processing apparatus, or other device to operate in a particular manner, such that the instructions stored in the computer-readable medium produce an article of writing comprising instructions that implement the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0062] Computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus, or other device to produce a computer-implemented process, such that the instructions running on the computer or other programmable apparatus provide a process for implementing the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0063] Example

[0064] Figure 5A The image shows an exemplary sensor system that includes a spectrometer (i.e., a spectrum sensor) located on a microscale (i.e., a force sensor) for measuring forces in grams.

[0065] Figure 5B It is shown by Figure 5A The absorption spectrum produced by the spectrometer was plotted. The spectrometer was placed at the center of this microscale and zeroed. Then, a finger was placed on the device and pressure was applied to obtain values ​​of 50g, 100g, 120g, 150g, 200g, 250g, 300g, 350g, 400g, 450g, and 500g. These values ​​and spectra were then input into PLS modeling software to find correlations.

[0066] Figure 6 This is a graph showing the predictive and measurement correlations for a subject with three latent variables. Figure 7 The graph shows that the force and spectrum of RMSEC and RMSECV can be correlated and a predictive model can be created for a subject.

[0067] Figure 5A This is an image of an exemplary sensor spectrum measurement system, which includes a spectrometer located at a microscale for measuring force in grams in time with the spectrum measurement.

[0068] Figure 5B It is shown by Figure 5AThe absorption spectrum produced by the spectrometer was plotted. The spectrometer was placed at the center of this microscale and zeroed (e.g., a baseline spectrum established without the application of force by a finger). A finger was then placed on the device and force was applied to obtain values ​​of 50g, 100g, 120g, 150g, 200g, 250g, 300g, 350g, 400g, 450g, and 500g. These values ​​and spectra were then input into chemometric modeling software to find the correlation between changes in the finger surface spectrum and changes in applied force.

[0069] Figure 6 This is a graph showing the correlation between the predicted (force, in grams, y-axis) and the measured (force, in grams, x-axis) using only the second latent variable from principal component analysis, which uses... Figure 5B The three latent variables of the spectrum.

[0070] Figure 7 This is a plot showing the RMSEC (Residual Mean Square Error of Calibration Error) and RMSECV (Residual Mean Square Error of Calibration Error Variance) of a predictive model that uses force and spectral correlation as a function of the latent variables used to derive the predictive model. The plot shows that these errors are close to zero. This verifies that the relationship between the applied force and the finger spectrum can be correlated, and that a predictive model can be created for the force applied to a subject's index finger.

[0071] A second experiment was conducted using four people instead of one to verify that the calibration model could be derived from the changes in subjects by applying a measuring force on a spectrometer and collecting a spectral sample set of the applied fixed force.

[0072] Table 1: Force sensor output (units: Newtons and grams)

[0073]

[0074] Figure 8 This is a graph showing spectrometer data (X = wavelength (in nm), Y = reflectance). The graph shows 100 spectra from four different individuals at 10 different force levels according to Table 1. The dataset contains a total of 400 spectra.

[0075] Figure 9 The resulting PLS model predictions are shown, where the x-axis represents the applied force and the y-axis represents the resulting model (the shape corresponds to the applied force, with a circle being the lowest and a star the highest). To estimate the model's effectiveness, an alternative method called Partial Least Squares Discriminant Analysis (PLSDA) is used.

[0076] Figure 10 The receiver operating characteristic (ROC) plot is shown, which illustrates the correlation between force and spectrum based on the three different categories grouped in Table 1.

[0077] Figure 11 The classification results using the truth table-style predictive model are shown. The figure demonstrates the ability to “predict” forces based on the previously defined chemometric model. The figure also shows the results using cross-validation. The vast majority of spectra were selected based on their spectra falling within the correct force range. A confusion matrix was used to create a results table representing the true positive rate (TPR), false positive rate (FPR), true negative rate (TNR), and false negative rate (FNR) as matrices for each class modeled in the input model, where:

[0078] TPR: The proportion of correctly identified positive cases (sensitivity), = P / (TP+FN)

[0079] FPR: The proportion of negative cases misclassified as positive, = P / (FP+TN)

[0080] TNR: The proportion of correctly classified negative cases (specificity), = TN / (TN+FP)

[0081] FNR: The proportion of positive cases misclassified as negative, = N / (FN+TP)

[0082] Although the subject matter has been described in language specific to structural features and / or methodological actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are disclosed as examples of implementing the claims.

[0083] Various changes and modifications to the disclosed embodiments will be apparent to those skilled in the art. These changes and modifications can be made without departing from the spirit and scope of the invention, including but not limited to changes and modifications relating to the chemical structure, substituents, derivatives, intermediates, compounds, compositions, formulations, or methods of use of the invention.

[0084] While the methods and systems have been described in conjunction with preferred embodiments and specific examples, they are not intended to limit their scope to the specific embodiments described, as the embodiments herein are illustrative rather than restrictive in all respects.

[0085] Unless otherwise expressly stated, no method described herein shall be construed as requiring its steps to be performed in a particular order. Therefore, if a method claim does not actually describe the order in which its steps are to be followed, or if the claims or specification do not expressly state that these steps are limited to a particular order, then no order is intended to be deduced in any way. This applies to any possible non-express basis of interpretation, including: logical problems of the arrangement of steps or operational flow; naive meanings derived from grammatical organization or punctuation; and the number or type of embodiments described in the specification.

[0086] Throughout this application, references may be made to various disclosures. To provide a more comprehensive description of the prior art involved in the methods and systems, the entire disclosures of these disclosures are incorporated herein by reference. For example, the embodiments disclosed herein can be used with switching components, such as those described in U.S. Patent Publication 2018 / 0188876, published July 5, 2018; and those described in U.S. Patent Publication 2018 / 0190449, published July 5, 2018; each of which is fully incorporated by reference and is appended to this document as part of this application.

[0087] Various modifications and variations will be apparent to those skilled in the art without departing from the scope or spirit of the appended claims. Other embodiments will be apparent to those skilled in the art upon consideration of the specification and practice disclosed herein. This specification and examples are intended to be considered exemplary only, and their true scope and spirit are indicated by the appended claims.

Claims

1. An analyte detection system, comprising: A spectrum sensor, wherein the spectrum sensor captures physiological and / or biochemical spectrum information about a touch applied to the spectrum sensor; A force sensor, wherein the force sensor determines the force level of the touch applied to the spectrum sensor; A memory, wherein the memory stores computer-readable instructions; A processor, communicatively connected to the memory, the spectrum sensor, and the force sensor, wherein the processor executes computer-readable instructions stored in the memory, the computer-readable instructions causing the processor to: Receive the spectrum information from the spectrum sensor; Receive the force level from the force sensor; Determine whether the force level is within a threshold force range, and if the force level is within the threshold force range, then: One or more spectral correction factors are applied to the spectral information based on the force level, wherein the one or more spectral correction factors are determined using chemometric analysis of the spectral information, the chemometric analysis including: applying a trained chemometric model to the spectral information to correlate spectral feature variations with force values ​​in a touch force dataset, wherein the chemometric model predicts the applied force based on the spectral information to eliminate measurement errors of the force level from the force sensor, and wherein the one or more spectral correction factors vary based on changes in the force level; and A haptic actuator communicating with the processor, wherein the haptic actuator generates haptic feedback in response to a determined force level of the touch, and wherein the haptic feedback is continuously generated when the determined force level of the touch exceeds or meets the threshold force range to indicate that the spectrum sensor is continuously reading the spectrum information and therefore the determined force level of the touch should be continuously applied to the spectrum sensor.

2. The analyte detection system according to claim 1, wherein, The computer-readable instructions also cause the processor to take action based on corrected spectral information.

3. The analyte detection system according to claim 1 or 2, wherein, If the force level is not within the threshold force range, the processor ignores the spectral information and takes no action.

4. The analyte detection system according to claim 1, wherein, The chemometric analysis includes partial least squares, principal component analysis, and multiple linear regression.

5. The analyte detection system according to claim 1, wherein, The chemometric analysis also detected changes in the analytes of the person who applied the touch.

6. The analyte detection system according to claim 5, wherein, Detecting changes in the analyte includes determining the components in the person's bloodstream.

7. The analyte detection system according to claim 6, wherein, Determining the components in the bloodstream of the person in question includes measuring the different bonds in the molecules.

8. The analyte detection system according to claim 7, wherein, The CH, NH, and OH bonds are the different bonds in the molecule being measured.

9. The analyte detection system according to claim 8, wherein, The change in the number of different bonds in the molecules within the bloodstream produces the change in the spectral information.

10. The analyte detection system according to claim 9, wherein, The changes in the spectral information indicate unwanted components in the subject's physiological functions.

11. The analyte detection system according to claim 1, wherein, The spectrum sensor uses spectral data to capture physiological and / or biochemical spectral information about the touch applied to the spectrum sensor.

12. The analyte detection system according to claim 11, wherein, The spectrum includes one or more of infrared spectroscopy and nuclear magnetic resonance spectroscopy.

13. The analyte detection system according to claim 1, wherein, The spectrum sensor includes a visible and near-infrared spectrometer with a range of 300 nm to 2600 nm.

14. The analyte detection system according to claim 13, wherein, The near-infrared spectrometer includes a Michelson near-infrared spectrometer, a grating filter, a diode array, an organosilicon, or a Fabry-Perot near-infrared spectrometer.

15. The analyte detection system according to claim 1, further comprising a touchpad communicating with the spectrum sensor, wherein, The touch is applied to the touchpad, and the force sensor determines the force level of the touch on the touchpad.

16. The analyte detection system according to claim 15, wherein, When the touch is applied, the touchpad and the spectrum sensor move less than 10 micrometers.

17. The analyte detection system according to claim 1, wherein, The tactile feedback is generated only after the determined force level of the touch meets or exceeds the threshold force range for a predetermined time period.

18. The analyte detection system according to claim 1, further comprising a calibration model, wherein, The one or more spectral correction factors are derived from the calibration model and applied to the physiological and / or biochemical spectral information as a function of time based on the changing force.

19. The analyte detection system according to claim 18, wherein, The calibration model is derived from statistical cross-samples of individual subjects and / or large groups of subjects.

20. A method for determining a force applied to a sensor using the system according to any one of claims 1-19, the method comprising: Receives touch applied to the sensor; Receive spectral information from the received touch, the spectral information being associated with the person who applied the touch; One or more force sensors are used to obtain force level information based on the touch; Determine whether the force level from the force level information is within a threshold force range, and if the force level is within the threshold force range, then: One or more spectral correction factors are applied to the spectral information, wherein the one or more spectral correction factors are determined using chemometric analysis of the spectral information, the chemometric analysis comprising: applying a trained chemometric model to the spectral information to correlate spectral feature variations with force values ​​in a touch force dataset, wherein the chemometric model predicts applied force based on the spectral information to eliminate measurement errors of the force level from the force sensor, wherein the one or more spectral correction factors vary based on changes in the force level.

Images